Supermicro Expands Products with NVIDIA Blackwell Ultra for AI Advancements

Supermicro introduces AI Solutions

Hey there, tech enthusiasts! If you’ve been keeping an eye on the latest in AI and data center tech, you’ll want to hear about the latest from Supermicro, Inc. This company, known for being a total IT solution powerhouse, has just rolled out some exciting new systems and rack solutions that are powered by nVidia’s Blackwell Ultra platform. This includes the impressive NVIDIA HGX B300 NVL16 and NVIDIA GB300 NVL72 platforms, both designed to handle the most demanding AI workloads out there.

Charles Liang, the president and CEO of Supermicro, couldn’t hide his enthusiasm: “We are excited to continue our long-standing partnership with NVIDIA to bring the latest AI technology to market with the NVIDIA Blackwell Ultra Platforms.” And he has every reason to be excited! These new AI solutions are set to deliver some serious performance boosts for tasks like AI reasoning, agentic AI, and video inference applications.

Revolutionizing Cooling Solutions

One of the standout features of Supermicro’s new products is their innovative cooling solutions. They’ve developed advanced liquid-cooling systems that promise exceptional thermal efficiency. Imagine running your data center with 40℃ warm water in an 8-node rack configuration or 35℃ warm water in a double-density 16-node setup. This not only enhances performance but also reduces power consumption by up to 40%. Talk about a win-win for the environment and your operational costs!

But how does this all tie back to the Blackwell Ultra platform? Well, it’s designed to tackle the most demanding AI applications, effectively eliminating bottlenecks that arise from limited GPU memory and network bandwidth. With an astounding 288 GB HBM3E of memory per GPU, the performance improvements for AI training and inference are nothing short of revolutionary.

The Supermicro NVIDIA HGX B300 NVL16 System

Let’s dive a little deeper into the specifics. The Supermicro NVIDIA HGX B300 NVL16 system is a game-changer for AI training clusters. It features an 8-GPU NVIDIA NVLink domain and a 1:1 GPU-to-NIC ratio, ensuring high-performance clusters are within reach. The new 8U platform maximizes the output of the NVIDIA HGX B300 NVL16 board, boasting a staggering 2.3 TB of HBM3e memory per system.

What’s more, Supermicro has integrated eight NVIDIA ConnectX -8 NICs directly into the baseboard, enabling node-to-node speeds of up to 800 Gb/s. This is a significant upgrade that promises to enhance network performance dramatically.

Meet the NVIDIA GB300 NVL72

Now, let’s talk about the NVIDIA GB300 NVL72. This powerhouse integrates 72 NVIDIA Blackwell Ultra GPUs and 36 NVIDIA Grace CPUs into a single rack, pushing the boundaries of exascale computing. With over 20 TB of HBM3e memory and a 1.8 TB/s 72-GPU NVLink domain, this system is designed for serious AI workloads. The NVIDIA ConnectX -8 SuperNIC also supports 800 Gb/s speeds for both GPU-to-NIC and NIC-to-network communication, which is a game-changer for cluster-level performance.

Supermicro’s Expertise in Liquid Cooling

Supermicro’s expertise doesn’t stop at just hardware; their approach to liquid cooling and data center deployment is top-notch. They’re ready to help enterprises build their data centers from the ground up. This includes everything from planning and design to testing and installation of racks, servers, switches, and other networking equipment tailored to fit specific organizational needs.

If you’re curious about the specifics, the 8U Supermicro NVIDIA HGX B300 NVL16 system is designed for every data center with a thermally-optimized chassis and an impressive 2.3 TB of HBM3e memory per system. Meanwhile, the NVIDIA GB300 NVL72 offers essentially double the memory capacity and networking speeds compared to its predecessor.

Catch Supermicro at GTC 2025

Mark your calendars, tech lovers! Supermicro will be showcasing these innovations at GTC 2025, happening in SAN Jose, CA, from March 17-21, 2025. Swing by booth #1115 to check out the X14/H14 B200, B300, and GB300 systems, along with their rack-scaled liquid-cooled solutions. You won’t want to miss this opportunity to see the future of AI infrastructure up close!

So, what do you think? Are these advancements in AI and cooling technology what you’ve been waiting for? Let us know your thoughts!

Background Information

---

About nVidia:

NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

Latest Articles about nVidia

---

About Supermicro:

Supermicro is a reputable American technology company founded in 1993 and headquartered in San Jose, California. Specializing in high-performance server and storage solutions, Supermicro has become a trusted name in the data center industry. The company offers a wide range of innovative and customizable server hardware, including motherboards, servers, storage systems, and networking equipment, catering to the needs of enterprise clients, cloud service providers, and businesses seeking reliable infrastructure solutions.

  

Latest Articles about Supermicro

Technology Explained

---

Blackwell: Blackwell is an AI computing architecture designed to supercharge tasks like training large language models. These powerful GPUs boast features like a next-gen Transformer Engine and support for lower-precision calculations, enabling them to handle complex AI workloads significantly faster and more efficiently than before. While aimed at data centers, the innovations within Blackwell are expected to influence consumer graphics cards as well

Latest Articles about Blackwell

---

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

Latest Articles about GPU

---

HBM3E: HBM3E is the latest generation of high-bandwidth memory (HBM), a type of DRAM that is designed for artificial intelligence (AI) applications. HBM3E offers faster data transfer rates, higher density, and lower power consumption than previous HBM versions. HBM3E is developed by SK Hynix, a South Korean chipmaker, and is expected to enter mass production in 2024. HBM3E can achieve a speed of 1.15 TB/s and a capacity of 64 GB per stack. HBM3E is suitable for AI systems that require large amounts of data processing, such as deep learning, machine learning, and computer vision.

Latest Articles about HBM3E

---

Liquid Cooling: Liquid cooling is a technology used to cool down computer components, such as processors, graphics cards, and other components that generate a lot of heat. It works by circulating a liquid coolant, such as water or a special coolant, through a series of pipes and radiators. The liquid absorbs the heat from the components and then dissipates it into the air. This technology is becoming increasingly popular in the computer industry due to its ability to provide more efficient cooling than traditional air cooling methods. Liquid cooling can also be used to overclock components, allowing them to run at higher speeds than their rated speeds. This technology is becoming increasingly popular in the gaming industry, as it allows gamers to get the most out of their hardware.

Latest Articles about Liquid Cooling

---

SAN: A Storage Area Network (SAN) is a high-speed and specialized network architecture designed to facilitate the connection of storage devices, such as disk arrays and tape libraries, to servers. Unlike traditional network-attached storage (NAS), which is file-based, SAN operates at the block level, enabling direct access to storage resources. SANs are known for their performance, scalability, and flexibility, making them ideal for data-intensive applications, large enterprises, and environments requiring high availability. SANs typically employ Fibre Channel or iSCSI protocols to establish dedicated and fast communication paths between servers and storage devices. With features like centralized management, efficient data replication, and snapshot capabilities, SANs offer advanced data storage, protection, and management options. Overall, SAN technology has revolutionized data storage and management, enabling organizations to efficiently handle complex storage requirements and ensure reliable data access.

Latest Articles about SAN