NVIDIA’s GPU IP Powers MediaTek’s Dimension Auto SoCs

MediaTek has launched its latest lineup of Dimensity Auto Cockpit system-on-chips, covering a wide range of the automotive market. While automotive chip announcements may not always be the most exciting news, this one stands out because of the graphics IP that MediaTek is utilizing: nVidia’s. This partnership marks the first time a third-party vendor will release chips based on NVIDIA’s Geforce graphics technology.

NVIDIA’s initial attempt to license its GPU IP to third parties dates back to 2013, when the company sought to rival ARM and Imagination Technologies by licensing its Kepler GPU IP. However, that effort fell flat. Fast forward to today, and NVIDIA has finally succeeded in licensing its IP. MediaTek’s new Dimensity Auto Cockpit system-on-chips will rely on NVIDIA’s GPU IP, Drive OS, and CUDA, marking a significant milestone for both companies.

The family of next-generation Dimensity Auto Cockpit processors from MediaTek consists of four separate system-on-chip models: CX-1 for high-end vehicles, CY-1, CM-1, and CV-1 for entry-level cars. These highly-integrated SoCs feature Armv9-A-based general-purpose CPU cores along with NVIDIA’s next-generation graphics processing unit IP. NVIDIA’s GPU IP enables AI workloads for driver assistance and powers infotainment systems, supporting advanced graphics technologies like real-time ray-tracing and DLSS 3 image upscaling.

According to HardwareLuxx, the Dimensity Auto Cockpit processors are monolithic SoCs with a built-in multi-camera HDR ISP. This ISP supports various safety applications with front-facing, in-cabin, and bird’s-eye-view cameras. Additionally, these processors include an audio DSP that supports different voice assistants.

While the announcement from MediaTek does not specify the exact generation of NVIDIA’s graphics IP being used, it is described as a “next-gen” design. Automotive SoC announcements tend to be conservative due to certification requirements, so it remains to be seen how much of an improvement this graphics IP will offer compared to the current Ada Lovelace architecture.

The new MediaTek SoCs will be fully compatible with NVIDIA’s Drive OS, which is already widely used by automakers. This compatibility allows automakers to streamline their software stack and utilize the same set of software for all vehicles powered by MediaTek’s Dimensity chips. Furthermore, with full support for CUDA, TensorRT, and Nsight, MediaTek’s Dimensity SoCs can leverage AI applications developed for NVIDIA’s platform.

Jerry Yu, Corporate Senior Vice President and General Manager of MediaTek’s CCM Business Group, stated that “Generative AI is transforming the automotive industry in the same way it revolutionized the mobile market with more personalized and intuitive computing experiences.” He believes that the Dimensity Auto Cockpit portfolio will bring AI-powered entertainment to vehicles, and the unified hardware and software platform will make it easy for automakers to scale AI capabilities across their entire lineup.

Licensing graphics IP and platform IP to a third party is a significant milestone for NVIDIA, particularly in its automotive endeavors. Expanding the use of DriveOS and CUDA beyond NVIDIA’s own hardware platform is a major development for a business unit that has faced tough competition and slow adoption rates from conservative automakers. It remains to be seen how MediaTek’s new Dimensity Auto Cockpit processors will compare to NVIDIA’s own previously announced Thor SoC and associated DRIVE Thor platform, which boasts a Blackwell-based GPU delivering 800 TFLOPS of 8-bit floating-point AI performance.

Background Information

---

About ARM: ARM, originally known as Acorn RISC Machine, is a British semiconductor and software design company that specializes in creating energy-efficient microprocessors, system-on-chip (SoC) designs, and related technologies. Founded in 1990, ARM has become a important player in the global semiconductor industry and is widely recognized for its contributions to mobile computing, embedded systems, and Internet of Things (IoT) devices. ARM's microprocessor designs are based on the Reduced Instruction Set Computing (RISC) architecture, which prioritizes simplicity and efficiency in instruction execution. This approach has enabled ARM to produce highly efficient and power-saving processors that are used in a vast array of devices, ranging from smartphones and tablets to IoT devices, smart TVs, and more. The company does not manufacture its own chips but licenses its processor designs and intellectual property to a wide range of manufacturers, including Qualcomm, Apple, Samsung, and NVIDIA, who then integrate ARM's technology into their own SoCs. This licensing model has contributed to ARM's widespread adoption and influence across various industries.

  

---

About MediaTek: MediaTek Inc. is a Taiwanese semiconductor company that designs and manufactures a wide range of system-on-chip (SoC) solutions for various consumer electronics, including smartphones, tablets, smart TVs, wearables, and IoT (Internet of Things) devices. Founded in 1997, MediaTek has become a important player in the semiconductor industry, known for its innovative chipsets that offer a balance of performance, power efficiency, and affordability.

  

---

About nVidia: NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

Technology Explained

---

Ada Lovelace: NVIDIA Ada Lovelace architecture is a new GPU architecture that delivers incredible performance for gaming, creating, professional graphics, AI, and compute. It features third-generation RT Cores, fourth-generation Tensor cores, and next-generation CUDA cores that enable revolutionary performance for ray tracing and AI-based neural graphics. It also supports new rendering features such as DLSS 3.0, RTX Remix, shader execution reordering, displaced micro-meshes, opacity micromaps, and Nvidia Reflex43.

---

Blackwell: Blackwell is an AI computing architecture designed to supercharge tasks like training large language models. These powerful GPUs boast features like a next-gen Transformer Engine and support for lower-precision calculations, enabling them to handle complex AI workloads significantly faster and more efficiently than before. While aimed at data centers, the innovations within Blackwell are expected to influence consumer graphics cards as well

---

CPU: The Central Processing Unit (CPU) is the brain of a computer, responsible for executing instructions and performing calculations. It is the most important component of a computer system, as it is responsible for controlling all other components. CPUs are used in a wide range of applications, from desktop computers to mobile devices, gaming consoles, and even supercomputers. CPUs are used to process data, execute instructions, and control the flow of information within a computer system. They are also used to control the input and output of data, as well as to store and retrieve data from memory. CPUs are essential for the functioning of any computer system, and their applications in the computer industry are vast.

---

DLSS: DLSS (Deep Learning Super Sampling) is an advanced AI-powered technology developed by NVIDIA that enhances real-time graphics rendering in video games and applications. DLSS utilizes deep learning algorithms to upscale lower-resolution images in real-time, resulting in higher-quality visuals while maintaining optimal performance. By harnessing the power of AI and deep neural networks, DLSS effectively boosts frame rates and image quality, enabling gamers to experience smoother gameplay and more immersive graphics without sacrificing computational efficiency. This technology has gained widespread recognition for its ability to deliver impressive visual fidelity and improved performance simultaneously, revolutionizing the way modern computer graphics are processed and displayed.

DLSS Website: https://www.nvidia.com/en-gb/geforce/technologies/dlss

---

Geforce: Geforce is a line of graphics processing units (GPUs) developed by Nvidia. It is the most popular GPU used in the computer industry today. Geforce GPUs are used in gaming PCs, workstations, and high-end laptops. They are also used in virtual reality systems, artificial intelligence, and deep learning applications. Geforce GPUs are designed to deliver high performance and power efficiency, making them ideal for gaming and other demanding applications. They are also capable of rendering high-resolution graphics and providing smooth, realistic visuals. Geforce GPUs are used in a variety of applications, from gaming to professional workstations, and are the preferred choice for many computer users.

---

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

---

HDR: High Dynamic Range (HDR) is a technology used to create images and videos with a greater range of luminance levels than what is possible with standard digital imaging. It allows for a greater range of colors and details to be captured in an image, resulting in a more realistic and vibrant look.

---

SoC: A System-on-Chip (SoC) is a highly integrated semiconductor device that encapsulates various electronic components, including processors, memory, input/output interfaces, and often specialized hardware components, all on a single chip. SoCs are designed to provide a complete computing system or subsystem within a single chip package, offering enhanced performance, power efficiency, and compactness. They are commonly used in a wide range of devices, from smartphones and tablets to embedded systems and IoT devices, streamlining hardware complexity and facilitating efficient integration of multiple functions onto a single chip.