SK hynix introduces SSD for AI PCs at NVIDIA GTC 2024

nVidia GTC

SK hynix, a leading memory chip manufacturer, has recently launched its latest solid-state drive (SSD) called PCB01 at the GPU Technology Conference (GTC) 2024 in SAN Jose, California. GTC is a conference for AI developers, hosted by nVidia. The PCB01 is a PCIe fifth-generation SSD, designed specifically for on-device AI PCs. It has already undergone performance and reliability verification by a major global customer and is set to be launched in two versions by the end of this year.

One of the key highlights of PCB01 is its exceptional performance levels. It offers an industry-leading sequential read speed of 14 gigabytes per second (GB/s) and a sequential write speed of 12 GB/s, which is double the speed of its previous generation. This enables the loading of Large Language Models (LLMs) required for AI learning and inference in less than one second. This impressive speed and efficiency are expected to significantly enhance the performance of on-device AIs.

Moreover, PCB01 also boasts a 30% improvement in power efficiency compared to its predecessor, making it highly capable of managing power during large-scale AI computations. SK hynix has incorporated single-level cell (SLC) caching technology into the product, allowing selected data to be quickly read and written. This feature accelerates the operation of AI services and general PC tasks.

Jae-yeun Yun, head of NAND Product Planning and Enablement at SK hynix, expressed his excitement about the potential of PCB01. He stated that the product will not only make waves in the AI PC market but will also gain attention from gaming and high-end PC users. SK hynix aims to solidify its position as the global leader in AI memory provision, not only in the HBM field but also in the on-device AI domain.

In addition to PCB01, SK hynix showcased its next-generation flagship technologies and solutions at GTC 2024. This included the introduction of its 36 GB 12-layer HBM3E, CXL, and GDDR7. The company has already begun volume production of HBM3E, which is the industry’s first fifth-generation HBM solution. Furthermore, GDDR7 garnered significant interest for its doubled bandwidth and 40% improvement in power efficiency compared to its predecessor, GDDR6.

SK hynix also took the opportunity to hold presentation sessions at GTC 2024. Seoyeong Jeong, Technical Leader of HBM Marketing, delivered a talk titled “The Outlook of the HBM Market,” where she shared valuable insights on the significance of AI memory and its core technologies.

Background Information

---

About nVidia: NVIDIA has firmly established itself as a leader in the realm of client computing, continuously pushing the boundaries of innovation in graphics and AI technologies. With a deep commitment to enhancing user experiences, NVIDIA's client computing business focuses on delivering solutions that power everything from gaming and creative workloads to enterprise applications. for its GeForce graphics cards, the company has redefined high-performance gaming, setting industry standards for realistic visuals, fluid frame rates, and immersive experiences. Complementing its gaming expertise, NVIDIA's Quadro and NVIDIA RTX graphics cards cater to professionals in design, content creation, and scientific fields, enabling real-time ray tracing and AI-driven workflows that elevate productivity and creativity to unprecedented heights. By seamlessly integrating graphics, AI, and software, NVIDIA continues to shape the landscape of client computing, fostering innovation and immersive interactions in a rapidly evolving digital world.

  

---

About SK hynix: SK Hynix is a important South Korean semiconductor company known for its innovative contributions to the global technology landscape. Specializing in the production of memory solutions, SK Hynix has played a vital role in shaping the semiconductor industry. With a commitment to research and development, they have continuously pushed the boundaries of memory technology, resulting in products that power various devices and applications.

  

Event Info

---

About nVidia GTC: The NVIDIA GTC event is a premier gathering for innovators, researchers, and industry leaders to explore the latest advancements in GPU computing and artificial intelligence. Through presentations, workshops, and demonstrations, GTC showcases breakthroughs in deep learning, autonomous vehicles, healthcare, and scientific research, driving forward the evolution of technology and its impact on society.

Technology Explained

---

GDDR6: GDDR6 stands for Graphics Double Data Rate 6th generation memory. It is a high performance memory used in graphics cards and graphics processing units (GPUs), specifically targeting gaming, AI and deep learning-related applications. GDDR6 achieves higher bandwidth than previous generations, allowing faster and smoother gaming experience for users. It is also more power efficient, resulting in lower energy consumption overall. The improved power efficiency makes it adaptable to today's needs of thinner laptops and ultra-high definition gaming laptops. Additionally, GDDR6 is used in storage solutions and advanced data center applications to help streamline large amounts of data at lightning-fast speeds.

---

GDDR7: GDDR7 (Graphics Double Data Rate 7) is the seventh generation of graphics double data rate (GDDR) memory. It is a type of dynamic random-access memory (DRAM) that is specifically designed for use in graphics cards. GDDR7 memory offers a number of advantages over previous generations of GDDR memory. GDDR7 is a significant improvement over previous generations of GDDR memory. It offers faster speeds up to 32 gigabits per second (Gbps) per pin, lower power consumption, and improved error correction. This makes it ideal for use in high-performance graphics cards and other applications that require high bandwidth and low latency.

---

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

---

HBM3E: HBM3E is the latest generation of high-bandwidth memory (HBM), a type of DRAM that is designed for artificial intelligence (AI) applications. HBM3E offers faster data transfer rates, higher density, and lower power consumption than previous HBM versions. HBM3E is developed by SK Hynix, a South Korean chipmaker, and is expected to enter mass production in 2024. HBM3E can achieve a speed of 1.15 TB/s and a capacity of 64 GB per stack. HBM3E is suitable for AI systems that require large amounts of data processing, such as deep learning, machine learning, and computer vision.

---

NAND: NAND technology is a type of non-volatile memory that is used in many computer applications. It is a type of flash memory that is used to store data in a non-volatile manner, meaning that the data is not lost when the power is turned off. NAND technology is used in many computer applications, such as solid-state drives, USB flash drives, digital cameras, and memory cards. It is also used in many embedded systems, such as cell phones, tablets, and other consumer electronics. NAND technology is a reliable and cost-effective way to store data, making it a popular choice for many computer applications.

---

PCIe: PCIe (Peripheral Component Interconnect Express) is a high-speed serial computer expansion bus standard for connecting components such as graphics cards, sound cards, and network cards to a motherboard. It is the most widely used interface in the computer industry today, and is used in both desktop and laptop computers. PCIe is capable of providing up to 16 times the bandwidth of the older PCI standard, allowing for faster data transfer speeds and improved performance. It is also used in a variety of other applications, such as storage, networking, and communications. PCIe is an essential component of modern computing, and its applications are only expected to grow in the future.

---

SAN: A Storage Area Network (SAN) is a high-speed and specialized network architecture designed to facilitate the connection of storage devices, such as disk arrays and tape libraries, to servers. Unlike traditional network-attached storage (NAS), which is file-based, SAN operates at the block level, enabling direct access to storage resources. SANs are known for their performance, scalability, and flexibility, making them ideal for data-intensive applications, large enterprises, and environments requiring high availability. SANs typically employ Fibre Channel or iSCSI protocols to establish dedicated and fast communication paths between servers and storage devices. With features like centralized management, efficient data replication, and snapshot capabilities, SANs offer advanced data storage, protection, and management options. Overall, SAN technology has revolutionized data storage and management, enabling organizations to efficiently handle complex storage requirements and ensure reliable data access.

---

SSD: A Solid State Drive (SSD) is a modern data storage device that employs flash memory technology to store data electronically. Unlike traditional hard disk drives (HDDs), SSDs have no moving parts, resulting in significantly faster read and write speeds. This leads to quicker boot times, faster application loading, and smoother overall system performance. SSDs are known for their durability, shock resistance, and energy efficiency, making them ideal for laptops, ultrabooks, and other portable devices. They come in various form factors, including 2.5-inch, M.2, and PCIe cards, and are favored for their reliability, quiet operation, and reduced heat generation