NVIDIA’s Tech Breathes Life into AI Characters, Blurring Reality

nVidia, the technology company, has made an exciting announcement regarding its digital human technologies. These advanced technologies are being utilized by leading AI application developers in various industries to create incredibly realistic avatars for commercial applications and dynamic game characters. The impressive results of these efforts are being showcased at the Global AI Conference (GTC) in SAN Jose, California.

NVIDIA’s Avatar Cloud Engine (ACE) for speech and animation, NVIDIA NeMo for language, and NVIDIA RTX for ray-traced rendering are the key components that empower developers to bring digital humans to life. These technologies enable AI-powered natural language interactions, making conversations with these avatars more realistic and engaging.

John Spitzer, the Vice President of Developer and Performance Technologies at NVIDIA, expressed his excitement about the company’s products, stating, “NVIDIA offers developers a world-class set of AI-powered technologies for digital human creation. These technologies may power the complex animations and conversational speech required to make digital interactions feel real.”

The suite of digital human technologies includes language, speech, animation, and graphics powered by AI. NVIDIA ACE utilizes facial animation powered by NVIDIA Audio2Face and speech powered by NVIDIA Riva automatic speech recognition (ASR) and text-to-speech (TTS). ACE microservices are flexible, allowing models to run on the cloud or PC depending on the local GPU capabilities, ensuring users receive the best experience. NVIDIA NeMo is an end-to-end platform that enables developers to deliver enterprise-ready generative AI models with precise data curation, customization, retrieval-augmented generation, and accelerated performance. Finally, NVIDIA RTX offers a collection of rendering technologies that enable real-time path tracing in games and applications.

To demonstrate the capabilities of these digital human technologies, NVIDIA collaborated with industry leaders such as Hippocratic AI, Inworld AI, and UneeQ. Hippocratic AI has developed a safety-focused Healthcare Agent powered by LLM. This agent performs various tasks such as calling patients, following up on care coordination, delivering instructions, and managing post-discharge care. With the integration of NVIDIA ACE microservices and other technologies, Hippocratic AI showcased the potential of a generative AI healthcare agent avatar.

UneeQ, an autonomous digital human platform specializing in creating AI-powered avatars for customer service and interactive applications, integrated NVIDIA Audio2Face microservice into its platform to create highly realistic avatars. These avatars enhance the customer experience and engagement by providing real-time interactions that are emotionally responsive.

In the gaming industry, NVIDIA ACE is revolutionizing the way game characters are brought to life. In partnership with Inworld AI, NVIDIA introduced Covert Protocol, a technology demonstration that pushes the boundaries of character interactions in games. Inworld’s AI engine utilizes NVIDIA Riva for accurate speech-to-text and NVIDIA Audio2Face for lifelike facial performances. This multimodal approach creates immersive narratives with stunning RTX-rendered characters set in beautifully crafted environments.

The gaming industry is not the only one benefiting from NVIDIA’s digital human technologies. Developers across healthcare, financial services, media & entertainment, and retail sectors are embracing ACE and generative AI technologies. Companies such as Deloitte, Ubisoft, Tencent, and many more are exploring how these technologies can enhance their products and services.

NVIDIA ACE is available for developers to incorporate into their own platforms. The company offers a full suite of digital human technologies or individual microservices to cater to specific needs. Developers can apply for the early access program to access in-development AI models and explore available models on NVIDIA NIM, a set of user-friendly microservices designed to accelerate the deployment of generative AI.

With NVIDIA’s digital human technologies, we can expect to see more lifelike avatars and dynamic game characters that revolutionize the way we interact with AI-powered entities. The possibilities for realistic and engaging conversations are endless, opening up new doors for various industries.

Background Information

---

About nVidia: NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

---

About Ubisoft: Ubisoft is a important video game company that was founded in 1986 in France by the Guillemot brothers: Christian, Claude, Gérard, Michel, and Yves. The company is known for developing and publishing a wide range of popular video game franchises, including Assassin's Creed, Far Cry, Rainbow Six, and Watch Dogs. Ubisoft is recognized for its commitment to delivering immersive and engaging gaming experiences across multiple platforms, from consoles and PCs to mobile devices.

  

Technology Explained

---

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

---

LLM: A Large Language Model (LLM) is a highly advanced artificial intelligence system, often based on complex architectures like GPT-3.5, designed to comprehend and produce human-like text on a massive scale. LLMs possess exceptional capabilities in various natural language understanding and generation tasks, including answering questions, generating creative content, and delivering context-aware responses to textual inputs. These models undergo extensive training on vast datasets to grasp the nuances of language, making them invaluable tools for applications like chatbots, content generation, and language translation.

---

SAN: A Storage Area Network (SAN) is a high-speed and specialized network architecture designed to facilitate the connection of storage devices, such as disk arrays and tape libraries, to servers. Unlike traditional network-attached storage (NAS), which is file-based, SAN operates at the block level, enabling direct access to storage resources. SANs are known for their performance, scalability, and flexibility, making them ideal for data-intensive applications, large enterprises, and environments requiring high availability. SANs typically employ Fibre Channel or iSCSI protocols to establish dedicated and fast communication paths between servers and storage devices. With features like centralized management, efficient data replication, and snapshot capabilities, SANs offer advanced data storage, protection, and management options. Overall, SAN technology has revolutionized data storage and management, enabling organizations to efficiently handle complex storage requirements and ensure reliable data access.