This article aims to explain how artificial intelligence systems assisted the Perseverance rover during its descent to Mars. We discuss the importance of robustness in hostile environments and Terrain Related Navigation (TRN) technologies.


The use of AI in landing space systems

Seven minutes. Seven minutes is the time Nasa teams let the automated landing systems of the Perseverance vehicle guide its descent to the red planet. But this February 18, 2021, the landing systems were a little different than usual because they were assisted by an artificial intelligence. After nearly seven months of travel to Mars and more than a decade of development, comes the most risky phase of the landing. Taking place more than 250 million kilometers from Earth, the action had to be carried out in real time without any human intervention. 

1 – The challenge of communication and the use of TRN technology

The large distance between the Earth and Mars makes direct and instantaneous communication with the rover impossible. It takes between 3 and 22 minutes to transmit a signal to the rover, depending on the position of Mars in relation to the Earth. The success of this mission was made possible in part by the use of an artificial intelligence system called “Terrain Related Navigation (TRN)“. Its role is to assist the rover throughout the descent to land accurately and avoid dangerous terrain (3). 

During the previous Apollo lunar landings, the astronauts would set a landmark for the landing. Then during the final descent, the crew would adjust the trajectory of the module by eye, through the window, in order to avoid craters and rocky fields and land safely. It is in particular in this way that on July 20, 1969 Neil Armstrong manually landed Eagle, the first lunar lander with crew. He landed it on the lunar surface after the automated systems had directed the spacecraft to a landing site that was too dangerous in the “Sea of Tranquility”(6). The difference between the terms “automatic” and “autonomous” is fundamental, as we discussed in our article “Autonomy of AI: Can we really talk about it?“.

Nowadays, on-board computers, sensors, and powerful AI systems can reinforce human capabilities. They allow to navigate and to make landings like the successful one of Perseverance. The question remains to verify that these systems are safe enough.

The TRN artificial intelligence systems, also called Landing Vision System (LVS), provide position measurements relative to known landmarks on the surface to augment inertial navigation (4). During its descent to the landing site, the Perseverance rover was equipped with a camera, allowing it to take images and analyze them in real time. These images were then correlated, thanks to LIDAR (Light Detection and Ranging) technology, to the map of the landing site that the rover had on board. This was done in order to recognize the location of the rover during its descent thanks to computer vision algorithms. 

By comparing the images taken by the camera with those of the on-board map, the Terrain Related Navigation (TRN) automatically corrected the landing trajectory in order to complete the mission.  The goal was to prevent the rover from heading towards a dangerous obstacle, as there are many on the Jezero crater (landing site): steep cliffs, sand dunes, rocky fields. In case of danger, the system was able to trigger retro-rockets to move and avoid it. Thanks to TRN, the rover was able to estimate its location and correct its position relative to the ground with an accuracy of 40 meters (5). 

2 – The importance of the robustness of AI systems in a hostile environment

The robustness of the AI system aboard Perseverance certainly played a big role in its landing. ISO defines robustness as the ability of an AI system to maintain its level of performance under all circumstances (7). “Under all circumstances” assumes that NASA was fully aware of all conditions (geographical, physical, meteorological etc) during the descent of the Perseverance rover. However, our knowledge of the Red Planet is still limited. Nothing assured them that the training base of the TRN AI system used to validate it was sufficiently representative of the real conditions of its use. 

To overcome this, engineers rely on the ability to generalize that AI systems allow. This allows them to remain efficient even when the real conditions do not correspond exactly to those defined during the validation of the system. It is this capacity that the robustness property must allow to measure in order to ensure the success of a system.  An artificial intelligence system that generalizes sufficiently well provides a valuable capacity to maintain its performance. This is especially true when no one has control over the system in real time and when it is confronted with changing conditions.

3- Artificial intelligence at the heart of space missions

In future space missions, the use of artificial intelligence systems will become increasingly important. Indeed, it offers the necessary flexibility to adapt to unforeseen or changing conditions. The analysis of a large amount of data and the realization of tasks technically unfeasible for humans (as it was the case for the landing of Perseverance) testify of its importance.

Nevertheless, the material constraints due to the conditions imposed by the space domain represent a technical obstacle to the further integration of AI systems in this domain. This is now an important research topic that is progressing, as demonstrated by this landing.

Find all our articles by clicking here!

Sources: 

[1] – “Conquête spatiale : le robot Perseverance arrive sur Mars”, https://www.francetvinfo.fr/sciences/mars-curiosity/conquete-spatiale-le-robot-perseverance-arrive-sur-mars_4301679.html

[2] – The NASA Perseverance Mars Landing – a Victory for Artificial Intelligence and Machine Learning

[3] –  NASA’s Perseverance Rover Lands on Mars: Here’s How It Is Using AI

[4] –  Overview of Terrain Relative Navigation Approaches for Precise Lunar Landing https://ieeexplore.ieee.org/document/4526302

[5] – Digging The Tech Behind NASA’s Perseverance Rover https://analyticsindiamag.com/digging-the-tech-behind-nasas-perseverance-rover/

[6] –   Terrain Relative Navigation: Landing Between the Hazards https://science.nasa.gov/technology/technology-highlights/terrain-relative-navigation-landing-between-the-hazards

[7] –  Définition : robustesse de la norme ISO/IEC 24029-1

Arnault Ioualalen

CEO of Numalis

communication@numalis.com

Born August 13, 1983 in Avignon.
Arnault invented the technology base industrialised by Numalis. He has carried the project and instilled his vision for Numalis since its inception. He has brought together associates, partners and clients to bring Numalis to its current level of development. His main motivation is to bring his academic work to industry and create synergy between research and industry.

Arnault IouAlalen

Leave a Reply

Your email address will not be published. Required fields are marked *