Skip to main content

NASA enters virtual and augmented realities with new pilot projects

nasa
NASA/James Blair
Believer it or not, NASA astronauts have already visited Mars — in virtual reality. And they have been training in VR for years. Now the agency is exploring new ways to apply virtual and augmented realities (VR and AR) for scientists and engineers, from designing next-gen spacecraft to interpreting cosmic data.

“Anyone who followed the popularity of Pokémon Go has seen how the public has embraced this technology,” Thomas Grubb, a NASA engineer, said in a statement. “Just as it’s changing the gaming industry, it will change the way we do our jobs. Five years from now, it’s going to be amazing.”

Grubb and his team are developing six pilot projects to study the potential of these technologies for near- and long-term applications for scientists, technicians, and engineers.

Last year was called the year VR goes from virtual to reality. The thing is, VR has been around for years. And although it became more prominent in 2016, VR seemed overshadowed by news about other emerging tech, like hobby drones, artificial intelligence, and 3D printing.

In this virtual “cleanroom” users can assemble spacecraft. NASA
NASA

“For several years, commercial VR and AR technology has been showing promise, but without real tangible results,” said Ted Swanson, a senior technologist at NASA. “However, recently there have been substantial developments in VR/AR hardware and software that may allow us to use this technology for scientific and engineering applications.”

Among the AR pilot projects, the team will test an app designed for technicians controlling robotic arms, like the one found on the International Space Station. The augmented app provides users with a camera view and telemetry data in a single interface. In another app, users get a 3D simulation of Goddard Space Flight Center’s thermal-vacuum chamber, so engineers can review whether spacecraft parts fit in the facility before undergoing testing.

On the VR side, Grubb and his team are creating an app that allows users to design and construct spacecraft using off-the-shelf components and virtual tools. With these systems, workers from various locations can work together on a single project.

“The collaborative capability is a major feature in VR,” Grubb said. “Even though they may work at locations hundreds of miles apart, engineers could work together to build and evaluate designs in real-time due to the shared virtual environment. Problems could be found earlier, which would save NASA time and money.”

The teams will also be experimenting with VR and AR for interpreting scientific data. These will include a 3D simulation of terrestrial lava flows, a visualization of CubeSats orbiting and studying the Sun, and a simulation of Earth’s magnetosphere.

Dyllan Furness
Dyllan Furness is a freelance writer from Florida. He covers strange science and emerging tech for Digital Trends, focusing…
Apple may have just leaked its VR headset’s operating system
A man using a virtual reality headset with controllers.

If the rumors are correct, Apple’s upcoming mixed-reality headset is going to be packed with advanced features, from detailed eye tracking to a blend of augmented and virtual reality. The device is going to need a powerful operating system -- and it looks like Apple might have accidentally just leaked its name.

As spotted by iOS developer Matthew Davis, an official-looking Apple GitHub repository makes reference to the name “realityOS,” and we don’t expect this was intended for public consumption given Apple’s extreme secrecy. In fact, the code refers to realityOS nine times, with hints as to its purpose and capabilities sprinkled throughout.

Read more
Turns out Microsoft’s HoloLens 3 might not be dead after all
microsoft hololens 2

Recent rumors indicated that Microsoft's next-generation Hololens 3 mixed reality headset could be dead, but now there's a chance that might not be true at all. In a tweet, Alex Kipman, who invented HoloLens and is currently a technical fellow at Microsoft, seemed to indicate that the product could still be alive.

As a recap, the whole saga started after a Business Insider report revealed the state of internal disarray and uncertainty within the HoloLens Team. The report also indicated that Microsoft could be working with Samsung on a next-generation headset, and HoloLens 3 was canceled in the middle of last year when that project began. Kipman, though, says not to "believe what you read on the internet," and that "HoloLens is doing great."

Read more
You won’t be taking Microsoft’s HoloLens 3 into the metaverse
Microsoft HoloLens 2

As rival Apple is rumored to be eyeing an entrance into the metaverse, Microsoft, an early proponent of mixed and augmented reality applications, is criticized for its blurry vision behind the company's own HoloLens strategy. While HoloLens notched big early wins, including scoring a U.S. Department of Defense contract, subsequent delays, project cancellations, and high-profile executive departures may have resulted in the death of the HoloLens 3. Still, despite a scathing profile by Business Insider, it appears that Microsoft remains, at least publicly, committed to its HoloLens endeavors for now. The company has gone on record to refute the publication's reporting that HoloLens 3 has been killed.

There are a number of factors that may be causing Microsoft to pivot from its early bet on HoloLens, but the Microsoft profile cited internal divisions and the lack of a unified strategy among the top reasons for concern. As a result of the chaos, it appears that the largest collateral damage to Microsoft's infighting is the cancellation of its next-generation HoloLens 3 hardware.

Read more