Skip to main content

You can help teach NASA rovers to explore Mars with the AI4Mars project

Artificial intelligence could be a huge help to Mars rovers like NASA’s Curiosity or Perseverance, but first these A.I. systems need to be trained on what to look for. A NASA project invites members of the public to help identify features of the Martian landscape, in order to train an algorithm that future rovers could use to navigate around the red planet.

The robotic arm of NASA’s Perseverance rover is visible in this image used by the AI4Mars project.
The robotic arm of NASA’s Perseverance rover is visible in this image used by the AI4Mars project. Users outline and identify different rock and landscape features to help train an artificial intelligence algorithm that will help improve the capabilities of Mars rovers. NASA/JPL-Caltech

The AI4Mars project was launched last year, and users have already labeled nearly half a million images to help develop the Soil Property and Object Classification (SPOC) algorithm. This algorithm identifies features of the landscape like sand and rock, and does so correctly nearly 98% of the time. In the future, this algorithm could be incorporated into Mars rovers’ autonomous driving capabilities like the AutoNav technology used by Perseverance.

Now, the researchers want to expand SPOC to get more detailed information about rock formations such as the presence of float rocks or nodules. By automatically classifying the types of rock imaged by rovers, the researchers can send driving instructions back to the rovers more quickly.

“It’s not possible for any one scientist to look at all the downlinked images with scrutiny in such a short amount of time, every single day,” explained Vivian Sun, a JPL scientist who helps coordinate Perseverance’s daily operations and consulted on the AI4Mars project. “It would save us time if there was an algorithm that could say, ‘I think I saw rock veins or nodules over here,’ and then the science team can look at those areas with more detail.”

To help develop this algorithm, NASA is inviting members of the public to go to the AI4Mars page on Zooniverse and look at images of the Martian surface captured by the Curiosity rover. They are asked to draw polygons around particular features like sand, soil, bedrock, and large rocks. The results of thousands of classifications made by the public are then collated and checked by scientists to make sure that the labeling is accurate.

Over time, as more individual pieces of data are labeled, the algorithm can learn to distinguish features for itself.

“Machine learning is very different from normal software,” said lead researcher for the AI4Mars project, Hiro Ono. “This isn’t like making something from scratch. Think of it as starting with a new brain. More of the effort here is getting a good dataset to teach that brain and massaging the data so it will be better learned.”

Georgina Torbet
Georgina is the Digital Trends space writer, covering human space exploration, planetary science, and cosmology. She…
NASA’s Mars rover marvels at ‘big chunky weirdo’
The Perseverance Mars rover took this selfie on Sept. 10, 2021 — sol 198 of the mission – in Jezero Crater after coring into a rock called ‘Rochette.’ Rock core samples from the floor of the crater will be brought back to Earth and analyzed to characterize the planet’s geology and past climate.

NASA’s Perseverance rover has been busy exploring Mars since landing there in spectacular fashion in February 2021.

The car-sized vehicle is equipped with a bunch of science tools and cameras to help it in its quest to find evidence of ancient microbial life on the distant planet. It’s also gathering together samples of Martian rock and soil for return to Earth in the ambitious Mars Sample Return mission. Additionally, the current mission offers an opportunity to test robotic technology that could be further developed for the first crewed mission to Mars.

Read more
NASA’s June skywatching tips include Mars in the Beehive
how to photograph perseid meteor shower night sky with

What's Up: June 2023 Skywatching Tips from NASA

NASA is back again with its monthly roundup of what to look out for in the sky over the coming weeks.

Read more
NASA’s Curiosity Mars rover gets a speed boost
curiosity clay samples water

While NASA’s newer Perseverance rover tends to get all the headlines these days, the Curiosity rover also continues to explore the surface of Mars more than a decade after it reached the red planet.

The team at NASA’s Jet Propulsion Laboratory (JPL), which oversees the Mars rover missions, has just given Curiosity a new lease of life after installing its first major software update in seven years.

Read more