AMD’s Ryzen 7 7840U Outperforms Intel’s Core Ultra 7 in AI Workloads, Consumes Less Power

AMD’s Ryzen 7 7840U has emerged as the clear winner in AI workloads when compared to Intel’s Core Ultra 7 processors. Not only does it outperform its rival, but it also consumes less power, making it a compelling choice for those seeking top-notch AI performance without compromising on energy efficiency.

Intel’s Core Ultra CPUs, marketed as the first AI processors with dedicated NPUs, have failed to deliver substantial gains in performance or efficiency. In contrast, AMD’s Ryzen 7040 lineup has been offering the same features for a much longer time. In a recent campaign, Team Red, as AMD is often referred to, highlights why their Ryzen AI Laptops are superior to their Core Ultra counterparts in every aspect, including AI performance, pricing, and power efficiency.

The comparison between the two processors includes the Core Ultra 7 155H (28W) and the Ryzen 7 7840U (15W), which were put to the test in LM Studio using LLAMA 2 and Mistral. The results speak for themselves. The Ryzen processor outperforms its Core Ultra rival by an impressive 79% in LLAMA v2 Chat and offers 41% higher performance in Mistral Instruct 7B (time to first token).

Furthermore, the Ryzen 7 7840U showcases a throughput advantage of up to 17% and 14% over the Core Ultra 7 in Mistral and LLAMA v2, respectively. What’s remarkable is that this lead is achieved with nearly half the TDP (thermal design power) of the Meteor Lake SKU.

When it comes to TTFT (time to first token) performance with different quantization methods, the Ryzen CPU shines once again. It surpasses the Core Ultra 7 155H by 30-50%, showcasing its superior capabilities.

In terms of effective performance (tokens per second), the Ryzen 7 7840U remains ahead, being up to 19% faster than the Core Ultra 7 155H. Even at higher quantization models, such as Q8, the performance remains similar between the two processors.

The Mistral 7B benchmark further solidifies the Ryzen 7040 processor’s superiority. It achieves TTFT speeds that are 16-30% faster than its Core Ultra counterpart, with smaller deficits in quantization performance.

Both LLAMA v2 and Mistral 7B demonstrate that the Ryzen 7 7840U excels at lower quantization models, offering notably faster performance compared to the Core Ultra 7. At Q8, the performance levels out, showcasing similar capabilities between the two processors.

The key takeaway from these benchmarks is that AMD has been at the forefront of NPU-accelerated AI performance, far ahead of Intel. Not only does AMD offer superior AI capabilities, but it does so with significantly higher power efficiency. The Ryzen 8040 lineup, despite being a refresh, is expected to further extend AMD’s lead over Intel’s Core Ultra offering in the AI space.

In conclusion, AMD’s Ryzen 7 7840U has proven its mettle in AI workloads, outperforming Intel’s Core Ultra 7 while consuming less power. With its impressive performance and energy efficiency, the Ryzen CPU lineup is undoubtedly a force to be reckoned with in the world of AI processing.

Background Information

---

About AMD:

AMD, a large player in the semiconductor industry is known for its powerful processors and graphic solutions, AMD has consistently pushed the boundaries of performance, efficiency, and user experience. With a customer-centric approach, the company has cultivated a reputation for delivering high-performance solutions that cater to the needs of gamers, professionals, and general users. AMD's Ryzen series of processors have redefined the landscape of desktop and laptop computing, offering impressive multi-core performance and competitive pricing that has challenged the dominance of its competitors. Complementing its processor expertise, AMD's Radeon graphics cards have also earned accolades for their efficiency and exceptional graphical capabilities, making them a favored choice among gamers and content creators. The company's commitment to innovation and technology continues to shape the client computing landscape, providing users with powerful tools to fuel their digital endeavors.

  

Latest Articles about AMD

---

About Intel:

Intel Corporation, a global technology leader, is for its semiconductor innovations that power computing and communication devices worldwide. As a pioneer in microprocessor technology, Intel has left an indelible mark on the evolution of computing with its processors that drive everything from PCs to data centers and beyond. With a history of advancements, Intel's relentless pursuit of innovation continues to shape the digital landscape, offering solutions that empower businesses and individuals to achieve new levels of productivity and connectivity.

  

Latest Articles about Intel

Technology Explained

---

CPU: The Central Processing Unit (CPU) is the brain of a computer, responsible for executing instructions and performing calculations. It is the most important component of a computer system, as it is responsible for controlling all other components. CPUs are used in a wide range of applications, from desktop computers to mobile devices, gaming consoles, and even supercomputers. CPUs are used to process data, execute instructions, and control the flow of information within a computer system. They are also used to control the input and output of data, as well as to store and retrieve data from memory. CPUs are essential for the functioning of any computer system, and their applications in the computer industry are vast.

Latest Articles about CPU

---

NPU: NPU, or Neural Processing Unit, is a type of specialized processor that is designed to handle complex artificial intelligence tasks. It is inspired by the structure and function of the human brain, with the ability to process and analyze large amounts of data simultaneously. In the computer industry, NPU technology is being used in various applications such as speech recognition, image and video processing, and natural language processing. This allows computers to perform tasks that were previously only possible for humans, making them more efficient and intelligent. NPU technology is also being integrated into smartphones, self-driving cars, and other devices, making them smarter and more responsive to user needs. With the increasing demand for AI-driven technology, the use of NPU is expected to grow and revolutionize the way we interact with computers in the future.

Latest Articles about NPU