Supermicro introduces NVIDIA Blackwell Solutions with Direct-Liquid Cooling Innovations

Supermicro introduces Its Most Powerful SuperCluster Yet

Supermicro, Inc. is stirring up the tech world with the announcement of its latest innovation: the SuperCluster. This isn’t just any data center solution; it’s an end-to-end powerhouse designed specifically for the age of trillion-parameter-scale generative AI. Built on the nVidia Blackwell platform, this new SuperCluster promises to take AI computing to dizzying new heights.

Imagine a data center packed with NVIDIA HGX B200 8-GPU systems, all nestled within a liquid-cooled rack. This setup dramatically boosts GPU compute density, far surpassing Supermicro’s already impressive liquid-cooled NVIDIA HGX H100 and H200-based SuperClusters. But what does this mean for businesses? Simply put, it means more power and efficiency, enabling organizations to tackle complex AI tasks with ease.

Efficiency Meets Performance

Charles Liang, the president and CEO of Supermicro, is enthusiastic about these advancements. He points out that Supermicro has the ability to deploy massive liquid-cooled AI data centers, some housing up to 100,000 GPUs. That’s no small feat! The latest SuperClusters not only reduce power consumption thanks to their direct Liquid Cooling (DLC) efficiencies but also pave the way for future AI computing solutions that are even denser and more powerful.

But what’s the real magic behind these SuperClusters? The innovative rack-scale design features vertical coolant distribution manifolds (CDMs), which allow for more compute nodes in a single rack. Add to that the newly developed cold plates and advanced hose designs, and you have a cooling system that’s not just efficient but also smartly engineered. And for those who still rely on traditional setups, there’s good news: the new NVIDIA HGX B200 8-GPU systems can be integrated into air-cooled data centers too.

The Upgraded NVIDIA HGX B200 Systems

So, what’s new with the NVIDIA HGX B200 8-GPU systems? For starters, they come packed with enhancements that make them a significant upgrade over their predecessors. We’re talking about improved thermal performance and power delivery, plus support for some serious processing power with dual 500 W Intel Xeon 6 or AMD EPYC 9005 Series processors.

But that’s not all. The new air-cooled 10U form-factor system features a redesigned chassis that accommodates eight 1000 W TDP Blackwell GPUs. And with a 1:1 GPU-to-NIC ratio, you can scale across a high-performance compute fabric like a pro. Plus, two NVIDIA BlueField-3 data processing units (DPUs) help streamline data handling efficiently, ensuring that your AI workloads run as smoothly as possible.

Unlocking New Possibilities with NVIDIA Superchips

Supermicro isn’t stopping there. They’re also rolling out solutions for NVIDIA’s GB200 Grace Blackwell Superchips, including the newly announced GB200 NVL4 Superchip and the GB200 NVL72 single-rack exascale computer. These superchips are game-changers, offering revolutionary performance by uniting four NVIDIA NVLink-connected Blackwell GPUs with two NVIDIA Grace CPUs.

Imagine the possibilities! This setup is compatible with Supermicro’s liquid-cooled NVIDIA MGX modular systems and can deliver up to 2x the performance for tasks like scientific computing and graph neural network training. The GB200 NVL72 SuperCluster, with its comprehensive liquid-cooling solution, can deliver an exascale supercomputer all in a single rack. Talk about efficiency!

Accelerated Computing with NVIDIA H200 NVL

For those looking for flexibility, Supermicro’s new 5U PCIe accelerated computing systems come equipped with NVIDIA H200 NVL. These systems are perfect for lower-power, air-cooled enterprise rack designs, enabling a range of AI and HPC workloads. With a 1.5x increase in memory capacity and 1.2x bandwidth boost thanks to HBM3E, the H200 NVL can fine-tune large language models in mere hours, delivering up to 1.7x faster inference performance compared to previous generations.

And let’s not forget about the versatility of Supermicro’s X14 and H14 systems, which can support multiple GPU configurations, ensuring that businesses have the power they need, when they need it.

Catch Supermicro at Supercomputing Conference 2024

If you’re eager to see these innovations in action, mark your calendars for the Supercomputing Conference 2024! Supermicro will showcase its complete portfolio of AI and HPC infrastructure solutions, including those impressive liquid-cooled GPU servers.

Don’t miss out on the in-booth theater sessions where experts from Supermicro and their technology partners will dive deep into the latest breakthroughs in computing technology. Swing by booth #2531 in Hall B at SC24 and get ready to be inspired by the future of AI and HPC.

In a world where data is king, Supermicro is clearly positioning itself as a leader in the race for AI supremacy. Are you ready to join the revolution?

Background Information

---

About AMD:

AMD, a large player in the semiconductor industry is known for its powerful processors and graphic solutions, AMD has consistently pushed the boundaries of performance, efficiency, and user experience. With a customer-centric approach, the company has cultivated a reputation for delivering high-performance solutions that cater to the needs of gamers, professionals, and general users. AMD's Ryzen series of processors have redefined the landscape of desktop and laptop computing, offering impressive multi-core performance and competitive pricing that has challenged the dominance of its competitors. Complementing its processor expertise, AMD's Radeon graphics cards have also earned accolades for their efficiency and exceptional graphical capabilities, making them a favored choice among gamers and content creators. The company's commitment to innovation and technology continues to shape the client computing landscape, providing users with powerful tools to fuel their digital endeavors.

  

Latest Articles about AMD

---

About Intel:

Intel Corporation, a global technology leader, is for its semiconductor innovations that power computing and communication devices worldwide. As a pioneer in microprocessor technology, Intel has left an indelible mark on the evolution of computing with its processors that drive everything from PCs to data centers and beyond. With a history of advancements, Intel's relentless pursuit of innovation continues to shape the digital landscape, offering solutions that empower businesses and individuals to achieve new levels of productivity and connectivity.

  

Latest Articles about Intel

---

About nVidia:

NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

Latest Articles about nVidia

---

About Supermicro:

Supermicro is a reputable American technology company founded in 1993 and headquartered in San Jose, California. Specializing in high-performance server and storage solutions, Supermicro has become a trusted name in the data center industry. The company offers a wide range of innovative and customizable server hardware, including motherboards, servers, storage systems, and networking equipment, catering to the needs of enterprise clients, cloud service providers, and businesses seeking reliable infrastructure solutions.

  

Latest Articles about Supermicro

Technology Explained

---

Blackwell: Blackwell is an AI computing architecture designed to supercharge tasks like training large language models. These powerful GPUs boast features like a next-gen Transformer Engine and support for lower-precision calculations, enabling them to handle complex AI workloads significantly faster and more efficiently than before. While aimed at data centers, the innovations within Blackwell are expected to influence consumer graphics cards as well

Latest Articles about Blackwell

---

EPYC: EPYC is a technology designed by computer chip manufacturer AMD for use in the server and data center industry. It was introduced in June 2017 and features an innovative design to improve performance and power efficiency. EPYC processor technology is based on an innovative 14nm processor architecture, allowing up to 32 high-performance cores in a single socket. This allows for more efficient processing power, increased memory bandwidth, and greater compute density. EPYC is now widely used in the data center and cloud computing industry and provides benefits such as greater scalability, increased resource efficiency, and advanced virtualization capabilities. Additionally, EPYC technology is used in data intensive servers like server farms, gaming, and virtualization platforms. EPYC ensures that even with large deployments in multi-processor environments, power consumption and performance levels are optimized to ensure maximum efficiency.

Latest Articles about EPYC

---

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

Latest Articles about GPU

---

Grace Blackwell: Grace Blackwell is a cutting-edge technology that has revolutionized the computer industry. It is a type of artificial intelligence that is designed to mimic human cognitive abilities, such as learning, problem-solving, and decision-making. This technology has been applied in various areas of the computer industry, including data analysis, natural language processing, and machine learning. For example, Grace Blackwell can analyze large amounts of data and identify patterns and trends, making it a valuable tool for businesses to make informed decisions. It can also understand and respond to human language, making it useful for virtual assistants and chatbots. Additionally, Grace Blackwell can continuously learn and improve its performance, making it an invaluable asset in the development of new technologies. Overall, Grace Blackwell has greatly enhanced the capabilities of computers and has opened up new possibilities for the future of technology.

Latest Articles about Grace Blackwell

---

HBM3E: HBM3E is the latest generation of high-bandwidth memory (HBM), a type of DRAM that is designed for artificial intelligence (AI) applications. HBM3E offers faster data transfer rates, higher density, and lower power consumption than previous HBM versions. HBM3E is developed by SK Hynix, a South Korean chipmaker, and is expected to enter mass production in 2024. HBM3E can achieve a speed of 1.15 TB/s and a capacity of 64 GB per stack. HBM3E is suitable for AI systems that require large amounts of data processing, such as deep learning, machine learning, and computer vision.

Latest Articles about HBM3E

---

HPC: HPC, or High Performance Computing, is a type of technology that allows computers to perform complex calculations and process large amounts of data at incredibly high speeds. This is achieved through the use of specialized hardware and software, such as supercomputers and parallel processing techniques. In the computer industry, HPC has a wide range of applications, from weather forecasting and scientific research to financial modeling and artificial intelligence. It enables researchers and businesses to tackle complex problems and analyze vast amounts of data in a fraction of the time it would take with traditional computing methods. HPC has revolutionized the way we approach data analysis and has opened up new possibilities for innovation and discovery in various fields.

Latest Articles about HPC

---

Liquid Cooling: Liquid cooling is a technology used to cool down computer components, such as processors, graphics cards, and other components that generate a lot of heat. It works by circulating a liquid coolant, such as water or a special coolant, through a series of pipes and radiators. The liquid absorbs the heat from the components and then dissipates it into the air. This technology is becoming increasingly popular in the computer industry due to its ability to provide more efficient cooling than traditional air cooling methods. Liquid cooling can also be used to overclock components, allowing them to run at higher speeds than their rated speeds. This technology is becoming increasingly popular in the gaming industry, as it allows gamers to get the most out of their hardware.

Latest Articles about Liquid Cooling

---

PCIe: PCIe (Peripheral Component Interconnect Express) is a high-speed serial computer expansion bus standard for connecting components such as graphics cards, sound cards, and network cards to a motherboard. It is the most widely used interface in the computer industry today, and is used in both desktop and laptop computers. PCIe is capable of providing up to 16 times the bandwidth of the older PCI standard, allowing for faster data transfer speeds and improved performance. It is also used in a variety of other applications, such as storage, networking, and communications. PCIe is an essential component of modern computing, and its applications are only expected to grow in the future.

Latest Articles about PCIe

---

Xeon: The Intel Xeon processor is a powerful and reliable processor used in many computer systems. It is a multi-core processor that is designed to handle multiple tasks simultaneously. It is used in servers, workstations, and high-end desktop computers. It is also used in many embedded systems, such as routers and switches. The Xeon processor is known for its high performance and scalability, making it a popular choice for many computer applications. It is also used in many cloud computing applications, as it is capable of handling large amounts of data and providing high levels of performance. The Xeon processor is also used in many scientific and engineering applications, as it is capable of handling complex calculations and simulations.

Latest Articles about Xeon