Supermicro introduces NVIDIA HGX H200 and MGX Grace Hopper Platforms for AI Advancements

Supermicro, a leading IT solution provider, is expanding its AI capabilities with support for the new nVidia HGX H200, equipped with H200 Tensor Core GPUs. Supermicro’s AI platforms, including 8U and 4U Universal GPU Systems, are compatible with the HGX H200, offering increased capacity and higher bandwidth compared to the previous H100 model. Additionally, Supermicro’s portfolio of NVIDIA MGX systems will support the upcoming NVIDIA Grace Hopper Superchip. These rack-scale AI solutions provide exceptional performance, scalability, and reliability for computationally intensive AI tasks, language model training, and HPC applications.

Supermicro is also introducing the industry’s highest density server with the NVIDIA HGX H100 in a liquid-cooled 4U system. This compact GPU server allows data center operators to reduce footprints and energy costs while delivering unmatched AI training capacity. By leveraging Liquid Cooling solutions, organizations can achieve higher performance and lower total cost of ownership.

Charles Liang, President and CEO of Supermicro, highlighted their partnership with NVIDIA in designing advanced systems for AI training and HPC applications. Supermicro’s building block architecture enables them to quickly adopt new technology and deliver it to customers faster. The new systems, powered by the NVIDIA H200 GPU with high-speed interconnects, offer up to 1.1 TB of high-bandwidth memory per node, delivering exceptional performance for language models and generative AI.

Supermicro offers a wide range of AI servers with different form factors. Their popular 8U and 4U Universal GPU systems are now compatible with the new H200 GPUs, enabling faster training of larger language models. Each NVIDIA H200 GPU provides 141 GB of memory with a bandwidth of 4.8 TB/s.

Dion Harris, Director of Data Center Product Solutions for HPC, AI, and Quantum Computing at NVIDIA, expressed excitement about Supermicro’s upcoming server designs using the NVIDIA HGX H200. These servers will accelerate generative AI and HPC workloads, allowing enterprises to maximize their AI infrastructure’s potential.

The new NVIDIA GPUs also enable the acceleration of large language models, fitting hundreds of billions of parameters into more compact clusters for efficient training and real-time inference. Supermicro is showcasing its latest offering, a liquid-cooled 4U Universal GPU System featuring the eight-way NVIDIA HGX H100, at SC23. This system, equipped with Supermicro’s innovative liquid-cooling technology, improves density and efficiency, reducing data center footprints and power costs.

For more information, visit Supermicro’s booth at SC23.

Background Information

---

About nVidia:

NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

Latest Articles about nVidia

---

About Supermicro:

Supermicro is a reputable American technology company founded in 1993 and headquartered in San Jose, California. Specializing in high-performance server and storage solutions, Supermicro has become a trusted name in the data center industry. The company offers a wide range of innovative and customizable server hardware, including motherboards, servers, storage systems, and networking equipment, catering to the needs of enterprise clients, cloud service providers, and businesses seeking reliable infrastructure solutions.

  

Latest Articles about Supermicro

Technology Explained

---

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

Latest Articles about GPU

---

Liquid Cooling: Liquid cooling is a technology used to cool down computer components, such as processors, graphics cards, and other components that generate a lot of heat. It works by circulating a liquid coolant, such as water or a special coolant, through a series of pipes and radiators. The liquid absorbs the heat from the components and then dissipates it into the air. This technology is becoming increasingly popular in the computer industry due to its ability to provide more efficient cooling than traditional air cooling methods. Liquid cooling can also be used to overclock components, allowing them to run at higher speeds than their rated speeds. This technology is becoming increasingly popular in the gaming industry, as it allows gamers to get the most out of their hardware.

Latest Articles about Liquid Cooling

---

Quantum Computing: Quantum computing is a type of advanced computing that takes advantage of the strange behaviors of very small particles. It's like having a supercharged computer that can solve incredibly complex problems much faster than regular computers. It does this by using special "bits" that can be both 0 and 1 at the same time, which allows it to process information in a very unique way. This technology has the potential to make a big impact in areas like data security and solving really tough scientific challenges, but there are still some technical hurdles to overcome before it becomes widely useful.

Latest Articles about Quantum Computing