SK hynix Unveils Cutting-Edge AI Memory Solutions at NVIDIA GTC 2024

SK hynix showcases AI memory technologies, including HBM3E and CXL1, at NVIDIA's GTC 2024, highlighting memory solutions crucial for handling large data and processing power in the AI era.

SK hynix is a leading semiconductor company with a strong presence in the AI memory sector.
The company is showcasing products, including the impressive 12-layer HBM3E and Compute Express Link (CXL)1, at GTC 2024.
SK hynix is the first company to mass-produce HBM3E, solidifying its position as a leader in the industry.

SK hynix, a leading semiconductor company, is making waves at nVidia’s GPU Technology Conference (GTC) 2024 in SAN Jose. This year’s conference marks a significant milestone as it is the first in-person event since the start of the pandemic. Industry officials, tech decision makers, and business leaders have gathered to witness SK hynix’s latest AI memory technologies and solutions for data centers.

As the AI revolution continues to gain momentum across various industries, SK hynix recognizes the need for advanced memory solutions capable of handling massive amounts of data and processing power. At GTC 2024, the company is showcasing its products, including the impressive 12-layer HBM3E and Compute Express Link (CXL)1, with the theme “Memory, The Power of AI”.

HBM3E, the fifth generation of HBM2, stands out as the highest-specification DRAM available for AI applications. With a remarkable capacity of 36 gigabytes (GB) and a processing speed of 1.18 terabytes (TB) per second, HBM3E sets a new standard in the industry. Its exceptional heat dissipation capabilities make it especially suitable for AI systems. SK hynix proudly announced on March 19 that it has become the first company to mass-produce HBM3E, solidifying its position as a leader in this field.

Displayed alongside HBM3E is CXL, a standardized interface that significantly enhances the efficiency of utilizing CPUs, GPUs, accelerators, and memory. CXL’s ability to expand memory and improve AI application performance positions it as a crucial component in the AI era. Visitors to SK hynix’s booth can also catch a glimpse of some never-before-seen products, such as the next-generation GDDR7 DRAM designed specifically for video and graphics processing. Boasting double the maximum bandwidth compared to its predecessor, GDDR7 offers a 40% improvement in power efficiency and expanded memory density, resulting in enhanced visuals. This technology will play a vital role in AI and other advanced applications that require rapid and large-capacity data processing.

In addition to its impressive display of AI memory solutions, SK hynix revealed a new consumer product based on its industry-leading Gen 5 solid-state drive (SSD), PCB01. The company plans to complete the development of PCB01 in the first half of 2024 and launch two versions targeting both large technology companies and general consumers by the end of the year.

SK hynix’s presence at GTC 2024 goes beyond showcasing its technological advancements. The company also hosted sessions on key AI memory technologies, providing valuable insights into the market outlook for HBM and emphasizing the importance of memory solutions in the AI era. Through its participation in the conference, SK hynix reaffirms its leadership in the AI memory sector and commits to further technological breakthroughs and advancements in AI technology.

About Our Team

Our team comprises industry insiders with extensive experience in computers, semiconductors, games, and consumer electronics. With decades of collective experience, we’re committed to delivering timely, accurate, and engaging news content to our readers.

Background Information

About nVidia: NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

About SK hynix: SK Hynix is a important South Korean semiconductor company known for its innovative contributions to the global technology landscape. Specializing in the production of memory solutions, SK Hynix has played a vital role in shaping the semiconductor industry. With a commitment to research and development, they have continuously pushed the boundaries of memory technology, resulting in products that power various devices and applications.

Technology Explained

GDDR7: GDDR7 (Graphics Double Data Rate 7) is the seventh generation of graphics double data rate (GDDR) memory. It is a type of dynamic random-access memory (DRAM) that is specifically designed for use in graphics cards. GDDR7 memory offers a number of advantages over previous generations of GDDR memory. GDDR7 is a significant improvement over previous generations of GDDR memory. It offers faster speeds up to 32 gigabits per second (Gbps) per pin, lower power consumption, and improved error correction. This makes it ideal for use in high-performance graphics cards and other applications that require high bandwidth and low latency.

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

HBM3E: HBM3E is the latest generation of high-bandwidth memory (HBM), a type of DRAM that is designed for artificial intelligence (AI) applications. HBM3E offers faster data transfer rates, higher density, and lower power consumption than previous HBM versions. HBM3E is developed by SK Hynix, a South Korean chipmaker, and is expected to enter mass production in 2024. HBM3E can achieve a speed of 1.15 TB/s and a capacity of 64 GB per stack. HBM3E is suitable for AI systems that require large amounts of data processing, such as deep learning, machine learning, and computer vision.

SAN: A Storage Area Network (SAN) is a high-speed and specialized network architecture designed to facilitate the connection of storage devices, such as disk arrays and tape libraries, to servers. Unlike traditional network-attached storage (NAS), which is file-based, SAN operates at the block level, enabling direct access to storage resources. SANs are known for their performance, scalability, and flexibility, making them ideal for data-intensive applications, large enterprises, and environments requiring high availability. SANs typically employ Fibre Channel or iSCSI protocols to establish dedicated and fast communication paths between servers and storage devices. With features like centralized management, efficient data replication, and snapshot capabilities, SANs offer advanced data storage, protection, and management options. Overall, SAN technology has revolutionized data storage and management, enabling organizations to efficiently handle complex storage requirements and ensure reliable data access.

SSD: A Solid State Drive (SSD) is a modern data storage device that employs flash memory technology to store data electronically. Unlike traditional hard disk drives (HDDs), SSDs have no moving parts, resulting in significantly faster read and write speeds. This leads to quicker boot times, faster application loading, and smoother overall system performance. SSDs are known for their durability, shock resistance, and energy efficiency, making them ideal for laptops, ultrabooks, and other portable devices. They come in various form factors, including 2.5-inch, M.2, and PCIe cards, and are favored for their reliability, quiet operation, and reduced heat generation