ASUS introduces “AI Cache Boost” BIOS Feature, Promising Enhanced Performance Benefits

Why Memory Matters for Large Language Models

If you’ve been keeping an eye on the world of large language models (LLMs), you know that they thrive on memory—lots of it. In fact, AI enthusiasts are now diving into multi-GPU setups just to squeeze out more VRAM for their favorite AI applications. But here’s the kicker: even with all that GPU power, today’s LLMs are so massive that sometimes the GPU has to lean on the CPU for extra processing. This is where the performance of your CPU cache and DRAM comes into play. It’s not just about having a beefy GPU; it’s all about the entire data pipeline connecting your GPU, CPU, I/O die, and DRAM modules. So, how do we optimize this setup for better AI performance?

Enter the AMD Ryzen CPUs with 3D V-Cache Technology

After some serious tinkering in our R&D labs, we’ve stumbled upon something exciting: the new AMD Ryzen CPUs featuring AMD 3D V-Cache Technology. Say hello to the AMD Ryzen 9 9950X3D and Ryzen 9 9900X3D—these chips are set to redefine performance benchmarks. We’ve tested a variety of optimizations across different workloads and discovered some settings that could really make a difference for AI fans. The best part? We’re rolling out these optimizations through a shiny new BIOS feature called AI Cache Boost. If you’ve got an ASUS AMD 800 Series motherboard, you can unlock performance gains of up to 12.75% when working with those colossal LLMs. Ready to dive in?

How to Activate AI Cache Boost

To get started with AI Cache Boost, you’ll need an ASUS AMD 800 Series motherboard paired with an Ryzen 9000">AMD Ryzen 9000 Series Granite Ridge CPU. Simply fire up the UEFI BIOS utility and head over to the Extreme Tweaker tab. From there, toggle AI Cache Boost to “Enabled,” and you’re good to go! What happens next? A series of optimizations kick in, including overclocking the Infinity Fabric clock (FCLK) to 2100 MHz. This is crucial because boosting FCLK enhances the bandwidth of data transfers between CPU cores, cache, and memory—key factors when you’re dealing with those hefty LLMs.

Now, for anyone who juggles both AI applications and gaming on the same rig, here’s a fun fact: enabling AI Cache Boost doesn’t significantly impact gaming performance. So, feel free to keep that setting on when you switch gears. If you want to play it safe for gaming, you can always dial back the FCLK to a lower setting after enabling AI Cache Boost.

The Performance Uplift You Can Expect

For our testing setup, we went with the ROG Crosshair X870E Hero motherboard, an nVidia Geforce RTX 5090 graphics card, and 32 GB of DDR5 RAM. We ran various AMD Ryzen CPUs equipped with 3D V-Cache Technology, including the Ryzen 9 9950X3D, 9900X3D, and 9800X3D. Our first test? Geekbench AI using the ONNX DirectML framework, focusing on GPU performance. The results? A performance uplift ranging from about 4% to 8%. That’s pretty significant for anyone who spends a good chunk of their day running AI workflows, especially considering how straightforward it is to enable AI Cache Boost.

Curious about older hardware? We swapped in an NVIDIA RTX 4090 and found that AI Cache Boost still delivered a noticeable performance bump, with improvements peaking at 7.57% using the AMD Ryzen 7 9800X3D. Interestingly, this particular chip performed the best with AI Cache Boost enabled. We saw similar results with the UL Procyon AI Computer Vision Benchmark, where the Ryzen 7 9800X3D achieved an impressive 12.75% score increase with AI Cache Boost.

Turbo Game Mode: A New Dimension of Performance

The stellar performance of the AMD Ryzen 7 9800X3D in both benchmarks hints that the 3D V-Cache technology might be playing a more significant role than the increased core counts of the Ryzen 9 9950X3D and 9900X3D. To dig deeper, we decided to run some extra tests, activating both AI Cache Boost and Turbo Game Mode. This BIOS feature, available on ASUS AM5 motherboards, optimizes performance in two key ways.

First, if you’re equipped with a high-end AMD Ryzen CPU featuring two Core Complex Dies (CCD), Turbo Game Mode disables the second CCD, allowing for a more efficient CPU operation in specific scenarios. Second, it turns off simultaneous multithreading (SMT). While SMT can supercharge multithreaded performance, disabling it can yield higher performance for workflows that don’t need all those threads.

When we enabled both AI Cache Boost and Turbo Game Mode, the AMD Ryzen 9 9950X3D took the lead, showcasing a whopping 19.85% increase over default settings. This suggests that AI enthusiasts could benefit significantly from turning on both features when their workflow doesn’t fully utilize their CPU’s extensive thread count. And the best part? Both options are readily accessible in the Extreme Tweaker BIOS tab, making it easy for users to explore the advantages of toggling them on together.

Elevate Your AI Game with ASUS and AMD

The new AMD Ryzen 9 9950X3D and Ryzen 9 9900X3D are stirring up the PC enthusiast community. With 32 and 24 threads, respectively, they’re built for outstanding multithreaded performance right out of the box, all while leveraging the benefits of AMD 3D V-Cache Technology. Pairing these CPUs with ASUS AMD 800 Series motherboards ensures you get the most out of your setup, thanks to optional BIOS settings designed to optimize your experience.

For those diving into AI workflows, especially those involving LLMs, AI Cache Boost is a game-changer—and it couldn’t be easier to activate. To maximize your new AMD CPU’s potential, check out our full lineup of AM5 motherboards, ranging from high-end X870E and X870 models to more budget-friendly B850 and B840 options. Ready to kick your AI ambitions up a notch? The future looks bright!

Background Information

---

About AMD:

AMD, a large player in the semiconductor industry is known for its powerful processors and graphic solutions, AMD has consistently pushed the boundaries of performance, efficiency, and user experience. With a customer-centric approach, the company has cultivated a reputation for delivering high-performance solutions that cater to the needs of gamers, professionals, and general users. AMD's Ryzen series of processors have redefined the landscape of desktop and laptop computing, offering impressive multi-core performance and competitive pricing that has challenged the dominance of its competitors. Complementing its processor expertise, AMD's Radeon graphics cards have also earned accolades for their efficiency and exceptional graphical capabilities, making them a favored choice among gamers and content creators. The company's commitment to innovation and technology continues to shape the client computing landscape, providing users with powerful tools to fuel their digital endeavors.

  

Latest Articles about AMD

---

About ASUS:

ASUS, founded in 1989 by Ted Hsu, M.T. Liao, Wayne Hsieh, and T.H. Tung, has become a multinational tech giant known for its diverse hardware products. Spanning laptops, motherboards, graphics cards, and more, ASUS has gained recognition for its innovation and commitment to high-performance computing solutions. The company has a significant presence in gaming technology, producing popular products that cater to enthusiasts and professionals alike. With a focus on delivering and reliable technology, ASUS maintains its position as a important player in the industry.

  

Latest Articles about ASUS

---

About nVidia:

NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

Latest Articles about nVidia

Technology Explained

---

AM5: Socket AM5 (LGA 1718) is a zero insertion force flip-chip land grid array (LGA) CPU socket designed by Advanced Micro Devices, that is used for AMD Ryzen microprocessors starting with the Zen 4 microarchitecture. AM5 replaces the Socket AM4 and is AMD's first LGA socket designed for mainstream, non-enthusiast CPUs.

Latest Articles about AM5

---

CPU: The Central Processing Unit (CPU) is the brain of a computer, responsible for executing instructions and performing calculations. It is the most important component of a computer system, as it is responsible for controlling all other components. CPUs are used in a wide range of applications, from desktop computers to mobile devices, gaming consoles, and even supercomputers. CPUs are used to process data, execute instructions, and control the flow of information within a computer system. They are also used to control the input and output of data, as well as to store and retrieve data from memory. CPUs are essential for the functioning of any computer system, and their applications in the computer industry are vast.

Latest Articles about CPU

---

DDR5: DDR5 (Double Data Rate 5) is the next generation of memory technology for the computer industry. It is a modern day improvement on earlier DDR technologies, with faster speeds, greater bandwidth and higher capacities. DDR5 enables higher resolution, seamless gaming experiences and faster data transfer rates, making it an ideal choice for high-performance computing and 4K gaming. With its greater RAM compatibility, DDR5 provides faster buffering times and raised clock speeds, giving users an improved overall work system. DDR5 is also optimized for multi-tasking, allowing users to multitask without experiencing a significant drop in performance, increasing the productivity of digital tasks. As an ever-evolving technology, DDR5 is paving the way for the computer industry into a new and powerful era.

Latest Articles about DDR5

---

Geforce: Geforce is a line of graphics processing units (GPUs) developed by Nvidia. It is the most popular GPU used in the computer industry today. Geforce GPUs are used in gaming PCs, workstations, and high-end laptops. They are also used in virtual reality systems, artificial intelligence, and deep learning applications. Geforce GPUs are designed to deliver high performance and power efficiency, making them ideal for gaming and other demanding applications. They are also capable of rendering high-resolution graphics and providing smooth, realistic visuals. Geforce GPUs are used in a variety of applications, from gaming to professional workstations, and are the preferred choice for many computer users.

Latest Articles about Geforce

---

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

Latest Articles about GPU

---

SMT: Simultaneous multithreading (SMT) is a technology that allows a CPU core to process two tasks (threads) simultaneously. It is crucial to the swift operation of modern-day CPUs. SMT is AMD’s brand of multithreading, while Hyperthreading is Intel’s

Latest Articles about SMT

---

VRAM: VRAM (Video Random Access Memory) is a type of computer memory used in graphics cards to store image data. It is a high-speed memory that is used to store the image data that is sent to the monitor. It is used in the computer industry to improve the performance of graphics cards and to provide faster access to the image data. VRAM is also used in gaming consoles to provide a more immersive gaming experience. It is also used in virtual reality applications to provide a more realistic experience. VRAM is an important component of the computer industry and is used in many applications.

Latest Articles about VRAM