NVIDIA’s Omniverse Leverages Apple Vision Pro to Push Boundaries of Virtual Worlds

nVidia GTC

nVidia has announced that it will be bringing OpenUSD-based Omniverse enterprise digital twins to the Apple Vision Pro. This new software framework, built on Omniverse Cloud APIs, allows developers to easily send their Universal Scene Description (OpenUSD) industrial scenes from content creation applications to the NVIDIA Graphics Delivery Network (GDN). The GDN is a global network of graphics-ready data centers that can stream advanced 3D experiences to the Apple Vision Pro.

At the recent nVidia GTC conference, a demo was showcased featuring an interactive digital twin of a car streamed in full fidelity to the high-resolution displays of the Apple Vision Pro. The demo demonstrated a car configurator application developed by CGI studio Katana on the Omniverse platform. The designer wearing the Vision Pro was able to toggle through paint and trim options and even enter the vehicle, blending 3D photorealistic environments with the physical world.

Spatial computing has become a powerful technology for delivering immersive experiences and seamless interactions between people, products, processes, and physical spaces. To make manufacturing experiences true to reality, industrial enterprise use cases require high-resolution displays and powerful sensors operating at high frame rates. The new Omniverse-based workflow combines Apple Vision Pro’s high-resolution displays with NVIDIA’s RTX cloud rendering, allowing spatial computing experiences with just the device and an internet connection.

This cloud-based approach enables real-time physically based renderings to be seamlessly streamed to the Apple Vision Pro, delivering high-fidelity visuals without compromising the details of large engineering fidelity datasets. Apple’s Vice President of the Vision Products Group, Mike Rockwell, expressed excitement about the possibilities of this technology, stating that it will redefine how designers and developers build captivating digital content.

Rev Lebaredian, Vice President of Simulation at NVIDIA, also highlighted the benefits of the Apple Vision Pro, calling it the first untethered device that allows enterprise customers to realize their work without compromise. The workflow also introduces hybrid rendering, a technique that combines local and remote rendering on the device. Users can render fully interactive experiences in a single application from Apple’s native SwiftUI and Reality Kit with the Omniverse RTX Renderer streaming from GDN.

NVIDIA’s GDN, available in over 130 countries, utilizes the company’s global cloud-to-edge streaming infrastructure to deliver smooth, high-fidelity, interactive experiences. By offloading heavy compute tasks to GDN, users can tackle even the most demanding rendering use cases, regardless of the size or complexity of the dataset.

The Omniverse-based workflow showcased its potential for various use cases. Designers can now see their 3D data in full fidelity, without any loss in quality or model decimation. This allows them to interact with trustworthy simulations that closely resemble the real physical product, opening up new opportunities for e-commerce experiences. In industrial settings, factory planners can view and interact with their full engineering factory datasets, optimizing workflows and identifying potential bottlenecks.

NVIDIA is also working on building capabilities that would allow developers and independent software vendors to seamlessly interact with existing data in their applications using the native tools on the Apple Vision Pro. This further enhances the spatial computing workloads across different use cases, promising a new era of creativity and engagement.

Background Information

---

About Apple: Apple Inc., known for its iconic products, was founded by Steve Jobs, Steve Wozniak, and Ronald Wayne in 1976. The company has since revolutionized the technology landscape with innovations like the Macintosh computer, iPod, iPhone, iPad, and more. for its emphasis on design, user experience, and ecosystem integration, Apple's devices and software have made a profound impact on various industries. With a commitment to quality and innovation, Apple remains a global technology leader.

  

---

About nVidia: NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

Event Info

---

About nVidia GTC: The NVIDIA GTC event is a premier gathering for innovators, researchers, and industry leaders to explore the latest advancements in GPU computing and artificial intelligence. Through presentations, workshops, and demonstrations, GTC showcases breakthroughs in deep learning, autonomous vehicles, healthcare, and scientific research, driving forward the evolution of technology and its impact on society.