Skip to main content
  1. Home
  2. Computing
  3. News

Nvidia and Apple are collaborating on the Vision Pro in the most unlikely way

By
Nvidia revealing support for the Apple Vision Pro.
Nvidia

You don’t normally see tech titans like Nvidia and Apple pair up, but the two companies announced at this week’s Nvidia GTC 2024 that they are coming together around the Vision Pro. Nvidia is bringing its Omniverse Cloud platform to Apple’s headset, allowing users to interact with objects and design directly through the Vision Pro.

The basis of support is a set of Omniverse Cloud APIs that can stream Omniverse assets to Apple’s headset. Omniverse isn’t running on the Vision Pro itself. Instead, designers can stream scenes made with the Universal Scene Description (OpenUSD) in Omniverse to the Vision Pro, and interact with the 3D objects natively.

Recommended Videos

Nissian demoed this capability in a demo video. Through the Vision Pro, the user is able to swap out paint colors, adjust the trim, and even go inside the car using spatial awareness thanks to the Vision Pro.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!
Privacy Policy

It’s sure to make a splash in the enterprise sector, but there are some consumer implications here. Nvidia is essentially showing that it can stream interactable 3D applications to the Vision Pro. This is enabled by Nvidia’s Graphics Delivery Network (GDN), which is already being used to stream 3D applications from the cloud. The fact that it can work on the Vision Pro is a big deal.

The linchpin for this are the Omniverse Cloud APIs. Also at GTC, Nvidia revealed five new APIs centered around Omniverse Universal Scene Description (OpenUSD) loud that can be used individually or collectively:

  • USD Render: support for ray-traced renders of OpenUSD data
  • USD Write: support for modifying OpenUSD data
  • USD Query: support for interactive scenes
  • USD Notify: support for tracking USD changes
  • Omniverse Channel: allows users to connect tools and projects across scenes

Right now, Omniverse Cloud on the Vision Pro is focused around enterprise applications, just as Apple’s headset itself is. This is still a critical foundation for streaming interactable 3D applications to Apple’s headset in the future. Even with how powerful the Vision Pro is, it’s not enough to handle aspects like ray tracing in highly detailed 3D scenes. Being able to stream these scenes at the same quality could line up some exciting apps in the future.

Editors' Recommendations

Topics
Jacob Roach
Jacob Roach
Lead Reporter, PC Hardware
Jacob Roach is the lead reporter for PC hardware at Digital Trends. In addition to covering the latest PC components, from…
Does the Vision Pro work with glasses and contacts?
An Apple employee shows a person how to use a Vision Pro headset at an Apple Store.

Apple gave the Vision Pro headset incredible clarity. We know this because one of our writers praised its clarity after his own hands-on experience with the headset.

But that praise-worthy clarity doesn't matter, though, if people who wear glasses can't use prescription lenses to enjoy the Vision Pro's large, sharp screens. That might be one of the most important questions to answer for more than half of the U.S. population that wear glasses or contact lenses -- and the answer isn't great.
Apple Vision Pro with glasses
The Apple Vision Pro works with Zeiss optical inserts for vision correction. Apple

Read more
Apple’s next Pencil may work with the Vision Pro headset
All three versions of the Apple Pencil lined up next to each other.

A couple of news reports posted on Monday suggest that Apple has been testing a new Apple Pencil that can be used with the company's recently released Vision Pro headset. One of them even suggests that the new Vision Pro-compatible Apple Pencil could launch alongside new iPads in the next few weeks, but this is by no means confirmed.

Both MacRumors and GSM Arena cited people with knowledge of the matter, with the former saying that support for the Apple Pencil would “essentially turn your surroundings into the Pencil's canvas.”

Read more
Does the Apple Vision Pro come with a battery?
Apple Vision Pro as seen from behind, with the battery pack superimposed.

Apple's Vision Pro is now available for purchase, but you might be wondering what's included at the starting price of $3,500 and if its battery is sold separately. Given that there's not a battery inside the headset itself, that's a good question.

Along with the actual headset, the base model of Vision Pro does include a battery, plus: a charger, 5-foot charging cable, front cover, top strap, light seal cushion, and polishing cloth. That means you get everything you need to start using Apple's exciting new spatial computer as soon as it arrives in the package.

Read more