Intel introduces 5th Gen “Emerald Rapids” Xeon Processors, embedding AI acceleration in every core.

Intel has made a significant announcement at its “AI Everywhere” event with the launch of its 5th Gen Intel Xeon processors, codenamed Emerald Rapids. These processors are designed to offer increased performance per watt and lower total cost of ownership (TCO) across a range of critical workloads, including artificial intelligence, high-performance computing, networking, storage, database, and security.

This latest release marks the second upgrade to the Xeon family in less than a year, providing customers with enhanced compute power and faster memory within the same power envelope as the previous generation. What sets these processors apart is their compatibility with 4th Gen Intel Xeon processors, allowing customers to upgrade their infrastructure while minimizing costs and reducing carbon emissions.

Sandra Rivera, Intel’s executive vice president and general manager of Data Center and AI Group, highlighted the focus on AI capabilities across cloud, network, and edge use cases. She emphasized that the 5th Gen Intel Xeon processors were developed based on extensive collaboration with customers, partners, and the developer ecosystem. This collaboration has resulted in a proven foundation that enables rapid adoption and scalability at a lower TCO.

One of the key features of these processors is their AI acceleration in every core, enabling them to handle demanding end-to-end AI workloads without the need for additional accelerators. In fact, they offer up to 42% higher inference performance and less than 100 millisecond Latency on large language models with up to 20 billion parameters. Compared to the previous generation, these processors deliver an average performance gain of 21% for general compute tasks and a 36% increase in performance per watt across various customer workloads. This translates to significant cost savings for customers following a typical five-year refresh cycle, with potential TCO reductions of up to 77%.

Building on the success of previous generations, the 5th Gen Xeon processors bring new innovations to the table. They support up to 64 cores per CPU and offer nearly three times the maximum last-level cache compared to the previous generation. Additionally, they provide eight channels of DDR5 per CPU, supporting DDR5 at speeds of up to 5,600 megatransfers per second (MT/s). The inter-socket bandwidth is also improved with Intel UPI 2.0, offering up to 20 gigatransfers per second (GT/s). Select instances based on these processors will also support CXL Type 3 workflows through leading cloud service providers.

Customers can expect a seamless upgrade experience as the 5th Gen Xeon processors are pin-compatible with the previous generation. Top OEMs such as Cisco, Dell, HPE, IEIT Systems, Lenovo, and Super Micro Computer will offer a wide range of single- and dual-socket systems starting in the first quarter of 2024. Furthermore, major CSPs will announce the availability of instances based on these processors throughout the year.

In terms of security, Intel Trust Domain Extensions (Intel TDX) provides increased confidentiality and security at the virtual machine level. This feature enhances privacy and control over data by isolating guest operating systems and VM applications from access by the cloud host, hypervisor, and other VMs on the platform. Initially introduced with the 4th Gen Xeon processors, Intel TDX will now be generally available to all OEM and CSP solution providers with the launch of the 5th Gen Xeon processors.

Overall, Intel’s latest processors offer impressive performance improvements and numerous benefits for its customers and partners. With a commitment to executing its roadmap, Intel has already launched the 4th Gen Xeon processors earlier this year and is now introducing the 5th Gen Xeon processors. Looking ahead, Intel plans to deliver even more significant advancements in power efficiency and performance with future Xeon processors, including Sierra Forest in the first half of 2024 and Granite Rapids shortly after, promising E-core efficiency and P-core performance, respectively.

Background Information

---

About Dell: Dell is a globally technology leader providing comprehensive solutions in the field of hardware, software, and services. for its customizable computers and enterprise solutions, Dell offers a diverse range of laptops, desktops, servers, and networking equipment. With a commitment to innovation and customer satisfaction, Dell caters to a wide range of consumer and business needs, making it a important player in the tech industry.

  

---

About Intel: Intel Corporation, a global technology leader, is for its semiconductor innovations that power computing and communication devices worldwide. As a pioneer in microprocessor technology, Intel has left an indelible mark on the evolution of computing with its processors that drive everything from PCs to data centers and beyond. With a history of advancements, Intel's relentless pursuit of innovation continues to shape the digital landscape, offering solutions that empower businesses and individuals to achieve new levels of productivity and connectivity.

  

---

About Lenovo: Lenovo, formerly known as "Legend Holdings," is a important global technology company that offers an extensive portfolio of computers, smartphones, servers, and electronic devices. Notably, Lenovo acquired IBM's personal computer division, including the ThinkPad line of laptops, in 2005. With a strong presence in laptops and PCs, Lenovo's products cater to a wide range of consumer and business needs. Committed to innovation and quality, Lenovo delivers reliable and high-performance solutions, making it a significant player in the tech industry.

  

Technology Explained

---

CPU: The Central Processing Unit (CPU) is the brain of a computer, responsible for executing instructions and performing calculations. It is the most important component of a computer system, as it is responsible for controlling all other components. CPUs are used in a wide range of applications, from desktop computers to mobile devices, gaming consoles, and even supercomputers. CPUs are used to process data, execute instructions, and control the flow of information within a computer system. They are also used to control the input and output of data, as well as to store and retrieve data from memory. CPUs are essential for the functioning of any computer system, and their applications in the computer industry are vast.

---

DDR5: DDR5 (Double Data Rate 5) is the next generation of memory technology for the computer industry. It is a modern day improvement on earlier DDR technologies, with faster speeds, greater bandwidth and higher capacities. DDR5 enables higher resolution, seamless gaming experiences and faster data transfer rates, making it an ideal choice for high-performance computing and 4K gaming. With its greater RAM compatibility, DDR5 provides faster buffering times and raised clock speeds, giving users an improved overall work system. DDR5 is also optimized for multi-tasking, allowing users to multitask without experiencing a significant drop in performance, increasing the productivity of digital tasks. As an ever-evolving technology, DDR5 is paving the way for the computer industry into a new and powerful era.

---

Latency: Technology latency is the time it takes for a computer system to respond to a request. It is an important factor in the performance of computer systems, as it affects the speed and efficiency of data processing. In the computer industry, latency is a major factor in the performance of computer networks, storage systems, and other computer systems. Low latency is essential for applications that require fast response times, such as online gaming, streaming media, and real-time data processing. High latency can cause delays in data processing, resulting in slow response times and poor performance. To reduce latency, computer systems use various techniques such as caching, load balancing, and parallel processing. By reducing latency, computer systems can provide faster response times and improved performance.

---

Xeon: The Intel Xeon processor is a powerful and reliable processor used in many computer systems. It is a multi-core processor that is designed to handle multiple tasks simultaneously. It is used in servers, workstations, and high-end desktop computers. It is also used in many embedded systems, such as routers and switches. The Xeon processor is known for its high performance and scalability, making it a popular choice for many computer applications. It is also used in many cloud computing applications, as it is capable of handling large amounts of data and providing high levels of performance. The Xeon processor is also used in many scientific and engineering applications, as it is capable of handling complex calculations and simulations.