Dell introduces AMD Instinct Accelerators, Creating Open Ecosystem for Generative AI

In the realm of technological advancements, Generative AI (GenAI) stands out as a game-changer, with IT decision makers expressing immense excitement over its potential impact on organizations. According to a recent survey, 78% of these decision makers are eagerly looking forward to leveraging GenAI for productivity gains, process optimization, and cost savings. It’s clear that embracing this technology is crucial for businesses to remain competitive in the digital era.

Recognizing the significance of GenAI, Dell Technologies and AMD have joined forces to expand the Dell Generative AI Solutions portfolio. This collaboration aims to accelerate advanced workloads and provide businesses with a wider range of options to embark on their unique GenAI journeys. The partnership emphasizes the importance of open ecosystems and silicon diversity in empowering customers with tailored and trustworthy AI solutions that seamlessly integrate with their data infrastructure.

The exponential growth of data and the challenges it presents are at the heart of the AI landscape today. As the latest wave of innovation, AI requires robust computing power to fuel its potential. By teaming up with AMD, Dell can offer customers a greater selection of solutions to power their AI and GenAI workloads.

One notable addition to Dell’s lineup is the Dell PowerEdge XE9680, which boasts the separateion of being the fastest ramping solution in Dell’s history. This powerful server will support the upcoming AMD Instinct MI300X accelerator, providing customers with enhanced AI performance options. The PowerEdge XE9680, coupled with the MI300X accelerator, delivers impressive capabilities for enterprises seeking to unlock the value of their data and gain a competitive edge through customized large language models (LLMs). With eight MI300X GPUs, 192 GB of 5.3 TB/s High Bandwidth Memory (HBM3) per GPU, and over 21 Petaflops of FP16 performance, the PowerEdge XE9680 with MI300X democratizes access to GenAI, enabling enterprises to train larger models, optimize data center footprints, reduce total cost of ownership (TCO), and achieve superior performance.

In addition to the AMD MI300X Instinct Accelerator support, Dell is also introducing the next phase of Dell Generative AI Solutions. This development aims to simplify the deployment of trustworthy GenAI with the introduction of the Dell Validated Design for Generative AI with AMD. Scheduled for release next year, this design will incorporate AMD ROCm-powered AI frameworks and open-source large language models. AMD ROCm is an open-source stack that encompasses drivers, dev toolkits, and APIs for AMD Instinct accelerators. The Dell Validated Design for Generative AI with AMD expands the Dell Generative AI Solutions ecosystem and eliminates the complexities associated with integration, performance optimization, and sizing considerations, enabling Dell customers to effortlessly build reliable GenAI platforms tailored to their specific requirements.

The PowerEdge XE9680 not only delivers exceptional performance but also prioritizes security and simplicity. Dell’s Open Manage Enterprise software streamlines and expedites GenAI infrastructure deployment, while CloudIQ software provides intelligent automation from anywhere. With integrated cyber recovery and a comprehensive Zero Trust approach, the PowerEdge XE9680 offers robust security measures.

Leveraging the power of the AMD Instinct Platform, the PowerEdge XE9680 harnesses eight AMD Instinct MI300X accelerators, enabling near-linear scaling and low-Latency distributed GenAI training and inferencing. This is made possible through Global Memory Interconnect (xGMI), which spans a cluster of PowerEdge servers interconnected by MI300X GPUs over an Ethernet-based AI fabric, utilizing a Dell validated GPU fabric with Dell PowerSwitch Z9664F-ON.

As a member of the Ultra Ethernet Consortium (UEC), Dell remains committed to advocating for standards-based networking. By implementing an open approach across the entire GenAI solution, encompassing compute, fabric, and storage, Dell Technologies is uniquely positioned to unlock the full potential of this technology. The Dell PowerEdge XE9680 with AMD Instinct MI300X accelerators and Dell Validated Design for Generative AI with AMD will be available in the first half of 2024, further solidifying Dell’s commitment to empowering organizations in their GenAI endeavors.

Background Information

---

About AMD:

AMD, a large player in the semiconductor industry is known for its powerful processors and graphic solutions, AMD has consistently pushed the boundaries of performance, efficiency, and user experience. With a customer-centric approach, the company has cultivated a reputation for delivering high-performance solutions that cater to the needs of gamers, professionals, and general users. AMD's Ryzen series of processors have redefined the landscape of desktop and laptop computing, offering impressive multi-core performance and competitive pricing that has challenged the dominance of its competitors. Complementing its processor expertise, AMD's Radeon graphics cards have also earned accolades for their efficiency and exceptional graphical capabilities, making them a favored choice among gamers and content creators. The company's commitment to innovation and technology continues to shape the client computing landscape, providing users with powerful tools to fuel their digital endeavors.

  

Latest Articles about AMD

---

About Dell:

Dell is a globally technology leader providing comprehensive solutions in the field of hardware, software, and services. for its customizable computers and enterprise solutions, Dell offers a diverse range of laptops, desktops, servers, and networking equipment. With a commitment to innovation and customer satisfaction, Dell caters to a wide range of consumer and business needs, making it a important player in the tech industry.

  

Latest Articles about Dell

Technology Explained

---

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

Latest Articles about GPU

---

Latency: Technology latency is the time it takes for a computer system to respond to a request. It is an important factor in the performance of computer systems, as it affects the speed and efficiency of data processing. In the computer industry, latency is a major factor in the performance of computer networks, storage systems, and other computer systems. Low latency is essential for applications that require fast response times, such as online gaming, streaming media, and real-time data processing. High latency can cause delays in data processing, resulting in slow response times and poor performance. To reduce latency, computer systems use various techniques such as caching, load balancing, and parallel processing. By reducing latency, computer systems can provide faster response times and improved performance.

Latest Articles about Latency