Dell and Imbue Collaborate on AI Compute Cluster with 10K NVIDIA H100 GPUs


November 30, 2023

Dell and Imbue Collaborate on AI Compute Cluster with 10K NVIDIA H100 GPUs

Summary: Dell Technologies and Imbue have partnered to develop a high-performance computing cluster for training advanced reasoning models, with the aim of creating more capable and trustworthy AI agents that can operate autonomously.

Voltage Park's platform provides Imbue with a secure, reliable, and cost-effective environment for training AI models.

  • Dell Technologies and Imbue have joined forces in a $150 million partnership to develop a high-performance computing cluster for training advanced reasoning models.
  • The Dell systems are specifically optimized for AI, machine learning, and deep learning training, boasting high GPU memory, bandwidth, and security features.
  • The management of Imbue's system falls under Voltage Park, a cloud compute provider specializing in machine learning solutions.


Dell Technologies and Imbue, an independent AI research company, have joined forces in a $150 million partnership to develop a high-performance computing cluster for training advanced reasoning models. Imbue stands out among AI labs as it creates its own foundation models and trains them to possess enhanced reasoning capabilities, such as analyzing their own outputs and formulating plans to achieve complex goals. The aim is to build practical tools that can assist workers across various domains, from engineers writing code to analysts drafting policy proposals.

Jeff Boudreau, Chief AI Officer at Dell Technologies, emphasized the importance of research-level technology in driving human progress. Dell’s technology will provide Imbue with a robust engine to uncover the next wave of impactful AI innovations. Imbue is already utilizing the cluster, powered by Dell PowerEdge XE9680 servers with nVidia H100 Tensor Core GPUs, to train AI models and develop prototype agents capable of bug correction and document analysis. The long-term goal is to create more capable and trustworthy AI agents that can operate autonomously, freeing up users’ time for other activities.

Imbue and Dell collaborated on designing a system that includes smaller clusters for rapid experimentation on novel model architectures, as well as efficient networking into a larger cluster for training large-scale foundation models. Imbue’s Chief Technology Officer, Josh Albrecht, praised Dell for their swift deployment of a custom cluster, highlighting the need for top-notch IT infrastructure in building the next generation of foundation models. The Dell systems are specifically optimized for AI, machine learning, and deep learning training, boasting high GPU memory, bandwidth, and security features. Additionally, the PowerEdge servers’ Smart Cooling capabilities contribute to better performance efficiency and reduced carbon footprint in data centers.

The management of Imbue’s system falls under Voltage Park, a cloud compute provider specializing in machine learning solutions.

Dell and Imbue Collaborate on AI Compute Cluster with 10K NVIDIA H100 GPUs

(Source)

Background Information


About Dell: Dell is a globally technology leader providing comprehensive solutions in the field of hardware, software, and services. for its customizable computers and enterprise solutions, Dell offers a diverse range of laptops, desktops, servers, and networking equipment. With a commitment to innovation and customer satisfaction, Dell caters to a wide range of consumer and business needs, making it a important player in the tech industry.

Dell Website: https://www.dell.com/
Dell LinkedIn: https://www.linkedin.com/company/dell/

About nVidia: NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

nVidia Website: https://www.nvidia.com
nVidia LinkedIn: https://www.linkedin.com/company/nvidia/

Technology Explained


GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.



Leave a Reply