HPE Begins Shipping NVIDIA’s New “Grace Blackwell” Computing System

HPE Launches nVidia’s Blackwell-Based Solution

Exciting news in the tech world! Today, Hewlett Packard Enterprise (HPE) has officially shipped its first NVIDIA Blackwell family-based solution—the NVIDIA GB200 NVL72. This isn’t just another piece of hardware; it’s a game-changer for service providers and large enterprises that are racing to deploy massive, complex AI clusters. With advanced direct Liquid Cooling solutions, this system aims to enhance both efficiency and performance.

Meeting the Demands of AI

As the pressure mounts for AI service providers and large enterprises, the need for scalability and rapid deployment has never been more critical. Trish Damkroger, HPE’s senior vice president and general manager of HPC & AI Infrastructure Solutions, puts it bluntly: “AI service providers and large enterprise model builders are under tremendous pressure to offer scalability, extreme performance, and fast time-to-deployment.” And HPE is stepping up to the plate. With a track record of building three of the world’s fastest systems that utilize direct liquid cooling, HPE is focused on delivering lower costs per token training along with top-notch performance and service.

What’s Inside the GB200 NVL72?

So, what makes the NVIDIA GB200 NVL72 tick? This powerhouse features a shared-memory, low-Latency architecture that’s tailor-made for handling extremely large AI models—think over a trillion parameters—all in one memory space. It’s not just about raw power; the GB200 NVL72 seamlessly integrates NVIDIA CPUs, GPUs, compute and switch trays, networking, and software, making it a robust solution for heavily parallelizable workloads like generative AI (GenAI) model training and inferencing.

Bob Pette, vice president of enterprise platforms at NVIDIA, emphasizes the importance of liquid cooling technology, especially as power and compute requirements continue to escalate. He notes, “Engineers, scientists, and researchers need liquid cooling technology to keep up with increasing power and compute requirements.” This collaboration between HPE and NVIDIA is set to empower service providers and enterprises to efficiently build, deploy, and scale their AI clusters.

The Power of Experience

HPE’s extensive experience in liquid cooling—spanning five decades—positions them uniquely in the market. They’ve successfully delivered eight of the top 15 supercomputers on the Green500 list, which ranks the world’s most energy-efficient supercomputers. Talk about credibility! HPE is recognized as a leader in direct liquid cooling technology, having built seven of the top 10 fastest supercomputers globally.

Key Features of the NVIDIA GB200 NVL72

Let’s break down some of the standout features of this system:

–

72 NVIDIA Blackwell GPUs

and

36 NVIDIA Grace CPUs

, interconnected via high-speed NVIDIA NVLink.
– Up to

13.5 TB total HBM3E memory

with an impressive

576 TB/sec bandwidth

.
– HPE’s innovative

direct liquid cooling technology

.

Unmatched Support and Services

What’s more, HPE doesn’t just stop at delivering hardware. They provide a suite of services designed to support AI solutions on a global scale. Their HPC & AI Custom Support Services are tailored to meet the unique needs of each customer, ensuring they get the most out of their investment.

Some of the available services include:

–

Onsite engineering resources

: Highly trained resident engineers who collaborate closely with your IT teams to optimize system performance.
–

Performance and benchmarking engagements

: A top-tier team of experts dedicated to fine-tuning solutions throughout the system’s lifecycle.
–

Sustainability services

: Offering energy and emissions reporting, sustainability workshops, and resource monitoring to help reduce environmental impact.

A New Era of Computing

The newly shipped NVIDIA GB200 NVL72 by HPE is just one of many high-performance computing and supercomputing systems designed to tackle a variety of use cases, from GenAI to scientific discovery and beyond. Want to dive deeper into what HPE has to offer? Explore their impressive portfolio of compute and supercomputing systems in the NVIDIA AI Computing by HPE lineup.

In a world where speed and efficiency are paramount, HPE is making sure that enterprises have the tools they need to stay ahead of the curve. Are you ready to embrace the future of AI?

Background Information

---

About nVidia:

NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

Latest Articles about nVidia

Technology Explained

---

Blackwell: Blackwell is an AI computing architecture designed to supercharge tasks like training large language models. These powerful GPUs boast features like a next-gen Transformer Engine and support for lower-precision calculations, enabling them to handle complex AI workloads significantly faster and more efficiently than before. While aimed at data centers, the innovations within Blackwell are expected to influence consumer graphics cards as well

Latest Articles about Blackwell

---

HBM3E: HBM3E is the latest generation of high-bandwidth memory (HBM), a type of DRAM that is designed for artificial intelligence (AI) applications. HBM3E offers faster data transfer rates, higher density, and lower power consumption than previous HBM versions. HBM3E is developed by SK Hynix, a South Korean chipmaker, and is expected to enter mass production in 2024. HBM3E can achieve a speed of 1.15 TB/s and a capacity of 64 GB per stack. HBM3E is suitable for AI systems that require large amounts of data processing, such as deep learning, machine learning, and computer vision.

Latest Articles about HBM3E

---

HPC: HPC, or High Performance Computing, is a type of technology that allows computers to perform complex calculations and process large amounts of data at incredibly high speeds. This is achieved through the use of specialized hardware and software, such as supercomputers and parallel processing techniques. In the computer industry, HPC has a wide range of applications, from weather forecasting and scientific research to financial modeling and artificial intelligence. It enables researchers and businesses to tackle complex problems and analyze vast amounts of data in a fraction of the time it would take with traditional computing methods. HPC has revolutionized the way we approach data analysis and has opened up new possibilities for innovation and discovery in various fields.

Latest Articles about HPC

---

Latency: Technology latency is the time it takes for a computer system to respond to a request. It is an important factor in the performance of computer systems, as it affects the speed and efficiency of data processing. In the computer industry, latency is a major factor in the performance of computer networks, storage systems, and other computer systems. Low latency is essential for applications that require fast response times, such as online gaming, streaming media, and real-time data processing. High latency can cause delays in data processing, resulting in slow response times and poor performance. To reduce latency, computer systems use various techniques such as caching, load balancing, and parallel processing. By reducing latency, computer systems can provide faster response times and improved performance.

Latest Articles about Latency

---

Liquid Cooling: Liquid cooling is a technology used to cool down computer components, such as processors, graphics cards, and other components that generate a lot of heat. It works by circulating a liquid coolant, such as water or a special coolant, through a series of pipes and radiators. The liquid absorbs the heat from the components and then dissipates it into the air. This technology is becoming increasingly popular in the computer industry due to its ability to provide more efficient cooling than traditional air cooling methods. Liquid cooling can also be used to overclock components, allowing them to run at higher speeds than their rated speeds. This technology is becoming increasingly popular in the gaming industry, as it allows gamers to get the most out of their hardware.

Latest Articles about Liquid Cooling