The software called OnSight, developed by Nasa’s Jet Propulsion Laboratory (JPL) in Pasadena, will give researchers a means to plan and, along with the Mars Curiosity rover, conduct science operations on the Red Planet.
OnSight will give rover scientists the ability to walk around and explore Mars right from their offices.
OnSight will use real rover data and extend the Curiosity mission’s existing planning tools by creating a 3D simulation of the Martian environment where scientists around the world can meet. Program scientists will be able to examine the rover’s worksite from a first-person perspective, plan new activities and preview the results of their work firsthand.
Until now, rover operations required scientists to examine Mars imagery on a computer screen and make inferences about what they are seeing. But images, even 3D stereo views, lack a natural sense of depth that human vision employs to understand spatial relationships.
The OnSight system uses holographic computing to overlay visual information and rover data into the user’s field of view.
Holographic computing blends a view of the physical world with computer-generated imagery to create a hybrid of real and virtual. To view this holographic realm, members of the Curiosity mission team don a Microsoft HoloLens device, which surrounds them with images from the rover’s Martian field site.
The OnSight tool also will be useful for planning rover operations.
For example, scientists can program activities for many of the rover’s science instruments by looking at a target and using gestures to select menu command.
Comments