NVIDIA introduces AI Foundation Models for Next-Gen RTX PCs

CES Las Vegas

NVIDIA releases AI Power on Your Desktop

Today, nVidia is making waves with an exciting announcement: the launch of foundation models that can run locally on NVIDIA RTX AI PCs. This leap forward is set to supercharge everything from digital humans to content creation, productivity, and development. At the heart of this innovation are the new Geforce RTX 50 Series GPUs, boasting a jaw-dropping capability of up to 3,352 trillion operations per second in AI performance, paired with a hefty 32 GB of VRAM.

Built on the NVIDIA Blackwell architecture, these GPUs are not just powerful; they’re also the first consumer-grade cards to support FP4 compute. What does that mean for you? Well, it essentially doubles the AI inference performance while allowing generative AI models to run locally without hogging all your system’s memory. Imagine being able to harness the power of AI right from your PC without needing a massive data center!

Streamlined Access with NIM Microservices

NVIDIA is rolling out NIM microservices that will make accessing and deploying the latest generative AI models as easy as pie. With NVIDIA AI Blueprints—essentially your cheat sheet for AI workflows—you’ll have preconfigured setups for everything from digital humans to content creation. It’s like having a personal assistant that knows exactly what you need to kickstart your projects.

As Jensen Huang, NVIDIA’s founder and CEO, aptly put it, “AI is advancing at light speed.” With NIM microservices and AI Blueprints, both developers and enthusiasts have the building blocks to dive headfirst into the world of AI. But what does that really mean for you? It means that whether you’re a seasoned developer or a curious newbie, the tools you need to explore AI are more accessible than ever.

The Building Blocks of Generative AI

So, what exactly are these foundation models? Think of them as neural networks that have been trained on massive datasets. They form the backbone of generative AI, enabling everything from large language models (LLMs) to image generation and speech recognition. NVIDIA has partnered with top model developers like Black Forest Labs, Meta, Mistral, and Stability AI to offer a pipeline of NIM microservices tailored for RTX AI PCs.

Robin Rombach, CEO of Black Forest Labs, emphasized the significance of these advancements: “Making FLUX an NVIDIA NIM microservice increases the rate at which AI can be deployed and experienced by more users.” Essentially, the GeForce RTX 50 Series GPUs will open the floodgates for a plethora of models that were once confined to large data centers.

Meet the Llama Nemotron Family

NVIDIA is also introducing the Llama Nemotron family of open models, designed for a range of agentic tasks. The Llama Nemotron Nano model, available as a NIM microservice, is particularly adept at tasks like instruction following, coding, and even math. It’s a game-changer for anyone looking to leverage AI for practical applications.

But what if you’re not a developer? No worries! The NIM microservices are optimized for deployment across NVIDIA GPUs, whether you’re using a workstation or the cloud. The beauty of this setup is that anyone can quickly download, set up, and run these microservices on Windows 11 PCs with Windows Subsystem for Linux (WSL).

AI Innovation on Windows 11

Pavan Davuluri, corporate vice president of Windows at Microsoft, highlighted the synergy between NVIDIA’s NIM microservices and Windows 11, stating, “AI is driving Windows 11 PC innovation at a rapid rate.” With these optimized microservices, developers can easily integrate AI capabilities into their Windows applications, making it a breeze to enhance user experiences.

The NIM microservices will also play nicely with popular AI development frameworks like AI Toolkit for VSCode, LangChain, and more. This means you can connect your applications to the latest AI models using industry-standard endpoints, simplifying the integration process and making technology accessible to everyone.

Project R2X: Bringing AI to Life

To showcase the potential of NIM, NVIDIA previewed Project R2X—a vision-enabled PC avatar that can assist users with tasks like reading documents, summarizing information, and even enhancing video calls. This avatar is powered by NVIDIA RTX Neural Faces, a new generative AI algorithm that creates lifelike facial animations. Imagine having a virtual assistant that not only understands you but can also communicate with you in a natural, engaging way!

Project R2X can connect to various cloud AI services, including OpenAI’s GPT-4 and others, making it a versatile tool for both developers and everyday users. Want to stay updated on this project? You can sign up for updates and be among the first to experience this innovative technology.

AI Blueprints: Your Creative Companion

For those eager to dive into AI, NVIDIA’s AI Blueprints offer a treasure trove of reference workflows that run locally on RTX PCs. One exciting blueprint allows users to transform PDF documents into engaging podcasts, complete with audio recordings that can be customized. You can even chat with the AI podcast host in real time!

Another blueprint empowers artists by giving them finer control over image generation. By using 3D objects in a renderer like Blender, creators can guide AI to produce stunning images that match their vision. It’s like having a creative partner that understands your artistic style!

Availability and Future Prospects

NVIDIA’s NIM microservices and AI Blueprints will be available starting in February, compatible with a range of powerful GPUs, including the GeForce RTX 50 Series and NVIDIA RTX 6000 and 5000 professional GPUs. Major PC manufacturers like Acer, ASUS, Dell, and HP are gearing up to offer NIM-ready RTX AI PCs, so you’ll have plenty of options to choose from.

As we gear up for CES, NVIDIA is poised to showcase how NIM microservices and AI Blueprints are accelerating the future of generative AI. Are you ready to explore the magic of AI right from your desktop? The future is looking bright!

Background Information

---

About Acer:

Acer is a globally recognized technology brand known for its extensive range of products, including laptops, desktops, monitors, and electronic devices. With a focus on innovation and affordability, Acer caters to diverse consumer needs, providing reliable and high-performance solutions. From gaming enthusiasts to professionals, Acer's products span various segments, making it a significant player in the technology industry.

  

Latest Articles about Acer

---

About ASUS:

ASUS, founded in 1989 by Ted Hsu, M.T. Liao, Wayne Hsieh, and T.H. Tung, has become a multinational tech giant known for its diverse hardware products. Spanning laptops, motherboards, graphics cards, and more, ASUS has gained recognition for its innovation and commitment to high-performance computing solutions. The company has a significant presence in gaming technology, producing popular products that cater to enthusiasts and professionals alike. With a focus on delivering and reliable technology, ASUS maintains its position as a important player in the industry.

  

Latest Articles about ASUS

---

About Dell:

Dell is a globally technology leader providing comprehensive solutions in the field of hardware, software, and services. for its customizable computers and enterprise solutions, Dell offers a diverse range of laptops, desktops, servers, and networking equipment. With a commitment to innovation and customer satisfaction, Dell caters to a wide range of consumer and business needs, making it a important player in the tech industry.

  

Latest Articles about Dell

---

About HP:

Founded by Bill Hewlett and Dave Packard in a garage in 1939, HP (Hewlett-Packard) is a global technology giant known for its pioneering innovations in computing and printing technology. With a legacy of over eight decades, HP has consistently delivered a wide range of high-quality products and services, including personal computers, printers, servers, and software solutions.

Latest Articles about HP

---

About Microsoft:

Microsoft, founded by Bill Gates and Paul Allen in 1975 in Redmond, Washington, USA, is a technology giant known for its wide range of software products, including the Windows operating system, Office productivity suite, and cloud services like Azure. Microsoft also manufactures hardware, such as the Surface line of laptops and tablets, Xbox gaming consoles, and accessories.

  

Latest Articles about Microsoft

---

About nVidia:

NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

Latest Articles about nVidia

Event Info

---

About CES:

CES, the Consumer Electronics Show, is an annual event held in Las Vegas, Nevada, organized by the Consumer Technology Association (CTA). With a history dating back to 1967, it has become the world's premier platform for unveiling and exploring the latest innovations in consumer electronics and technology. Drawing exhibitors ranging from industry titans to startups across diverse sectors, including automotive, health and wellness, robotics, gaming, and artificial intelligence, CES transforms Las Vegas into a global tech hub, offering a glimpse into the future of technology through a wide array of showcases, from startup-focused Eureka Park to cutting-edge automotive and health tech exhibitions.

  

Latest Articles about CES

Technology Explained

---

Blackwell: Blackwell is an AI computing architecture designed to supercharge tasks like training large language models. These powerful GPUs boast features like a next-gen Transformer Engine and support for lower-precision calculations, enabling them to handle complex AI workloads significantly faster and more efficiently than before. While aimed at data centers, the innovations within Blackwell are expected to influence consumer graphics cards as well

Latest Articles about Blackwell

---

Geforce: Geforce is a line of graphics processing units (GPUs) developed by Nvidia. It is the most popular GPU used in the computer industry today. Geforce GPUs are used in gaming PCs, workstations, and high-end laptops. They are also used in virtual reality systems, artificial intelligence, and deep learning applications. Geforce GPUs are designed to deliver high performance and power efficiency, making them ideal for gaming and other demanding applications. They are also capable of rendering high-resolution graphics and providing smooth, realistic visuals. Geforce GPUs are used in a variety of applications, from gaming to professional workstations, and are the preferred choice for many computer users.

Latest Articles about Geforce

---

VRAM: VRAM (Video Random Access Memory) is a type of computer memory used in graphics cards to store image data. It is a high-speed memory that is used to store the image data that is sent to the monitor. It is used in the computer industry to improve the performance of graphics cards and to provide faster access to the image data. VRAM is also used in gaming consoles to provide a more immersive gaming experience. It is also used in virtual reality applications to provide a more realistic experience. VRAM is an important component of the computer industry and is used in many applications.

Latest Articles about VRAM