NVIDIA introduces Generative AI Models and NIM Microservices for OpenUSD

nVidia has just made some major advancements to Universal Scene Description (USD), also known as OpenUSD, that will have a significant impact on various industries. This universal 3D data interchange framework is now expanding its reach to robotics, industrial design and engineering, and it’s set to revolutionize the development of virtual worlds for the next generation of AI.

Through the integration of OpenUSD with NVIDIA’s Omniverse platform, developers in different sectors can now create applications for visualizing industrial design and engineering projects, as well as simulating environments for the development of physical AI and robots. This opens up a whole new world of possibilities for industries that have traditionally been left out of the digital world revolution.

NVIDIA is introducing NIM microservices for AI models that can generate OpenUSD language to answer user queries, generate OpenUSD Python code, apply materials to 3D objects, and understand 3D space and physics. These microservices will help accelerate the development of digital twins, which are virtual replicas of physical objects or systems.

But what exactly does this mean for heavy industries? Well, according to Rev Lebaredian, vice president of Omniverse and simulation technology at NVIDIA, “The generative AI boom for heavy industries is here.” Until now, digital worlds have mostly been used by creative industries, but with the enhancements and accessibility that NVIDIA NIM microservices bring to OpenUSD, industries of all kinds can now build physically based virtual worlds and digital twins to drive innovation and prepare for the next wave of AI.

One of the most exciting aspects of this announcement is the introduction of generative AI models for OpenUSD development. These models, developed by NVIDIA, will be available as NIM microservices. This means that developers can now incorporate generative AI copilots and agents into their USD workflows, expanding the possibilities in 3D worlds and speeding up the adoption of USD in industries like manufacturing, automotive, and robotics.

Some of the microservices that will be available include USD Code, USD Search, and USD Validate. The USD Code microservice can answer general knowledge OpenUSD questions and automatically generate OpenUSD-Python code based on text prompts. The USD Search microservice allows developers to search through massive libraries of OpenUSD, 3D, and image data using natural language or image inputs. And the USD Validate microservice checks the compatibility of uploaded files against OpenUSD release versions and generates fully RTX-rendered, path-traced images.

But NVIDIA isn’t stopping there. They have also announced other upcoming microservices like USD Layout, USD SmartMaterial, fVDB Mesh Generation, fVDB Physics Super-Res, and fVDB NeRF-XL. These microservices will further enhance the capabilities of OpenUSD and provide even more tools for developers to create realistic and immersive virtual worlds.

Already, companies like Foxconn, a global manufacturing leader, and WPP, a world leader in marketing and communications services, are benefiting from NVIDIA’s computing platform and utilizing the NIM microservices and Omniverse to create digital twins and innovative production tools.

The introduction of USD connectors for robotics data formats and streaming to Apple Vision Pro is another exciting development. This opens up new possibilities for roboticists to seamlessly bring their robot data across applications, including design, simulation, and reinforcement learning.

NVIDIA is also collaborating with Siemens, a global leader in industrial automation and software, to facilitate more industrial workloads using OpenUSD. This collaboration will enable high-fidelity, real-time, photorealistic visualization of complex simulation data, providing deeper insights into a product’s performance within its real-world operating environment.

To further expand the OpenUSD ecosystem, NVIDIA has announced the OpenUSD Exchange software development kit, which allows developers to build their own robust OpenUSD data connectors. This will encourage more developers to get involved and contribute to the growth of the OpenUSD community.

Overall, these advancements to OpenUSD are set to revolutionize the way we create and interact with 3D content. With NVIDIA’s new services and APIs, we can expect to see accelerated growth and adoption of USD, paving the way for new users and industries to engage with this exciting ecosystem.

If you’re a developer interested in getting started with OpenUSD and generative AI, NVIDIA has made the USD Search, USD Code, and USD Validate NIM microservices available in preview on their API catalog. The OpenUSD to URDF connector is also now available with NVIDIA Isaac Sim. So, now is the perfect time to dive into the world of OpenUSD and start building the next generation of virtual worlds and digital twins.

Background Information

---

About Apple:

Apple Inc., known for its iconic products, was founded by Steve Jobs, Steve Wozniak, and Ronald Wayne in 1976. The company has since revolutionized the technology landscape with innovations like the Macintosh computer, iPod, iPhone, iPad, and more. for its emphasis on design, user experience, and ecosystem integration, Apple's devices and software have made a profound impact on various industries. With a commitment to quality and innovation, Apple remains a global technology leader.

  

Latest Articles about Apple

---

About Foxconn:

Foxconn, officially known as Hon Hai Precision Industry Co., Ltd., is a global technology manufacturing company. With a rich history dating back to 1974, Foxconn has played a pivotal role in revolutionizing the electronics industry. Foxconn is mainly known for its role as a important contract electronics manufacturer. The company specializes in assembling a wide variety of electronic products, including smartphones, tablets, computers, televisions, gaming consoles, and other consumer electronics on behalf of some of the world's leading technology brands

  

Latest Articles about Foxconn

---

About nVidia:

NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

Latest Articles about nVidia