SK hynix introduces AiMX: The First GDDR6-AiM Accelerator Card for Generative AI

SK hynix, a leading semiconductor manufacturer, recently launched its latest innovation at the AI Hardware & Edge AI Summit 2023 in Santa Clara, California. The company showcased a prototype of AiMX (Accelerator-in-Memory based Accelerator), a generative AI accelerator card that is based on GDDR6-AiM.

The AI Hardware & Edge AI Summit, organized by Kisaco Research, brings together global IT companies and startups to share advancements in artificial intelligence and machine learning. This is SK hynix’s third time participating in the summit, highlighting its commitment to pushing the boundaries of AI technology.

AiMX is a powerful accelerator card that combines multiple GDDR6-AiMs to enhance performance. It is designed to handle large amounts of data and offers a low-power, high-speed memory solution. This makes it an ideal choice for data-intensive generative AI systems, where the performance of AI models improves as they are trained on more data.

During the event, SK hynix also demonstrated Meta’s generative AI Open Pretrained Transformer (OPT) 13B model on a server system equipped with the AiMX prototype. The results were impressive, with the AiMX system reducing data processing time by over 10 times compared to GPU-based systems, while consuming only one-fifth of the power. This demonstration caught the attention of global companies providing AI services, as it showcased AiMX’s superior performance compared to other accelerators currently available.

To further highlight the benefits of AiMX, SK hynix held a session titled “Cost-Effective Generative AI Inference Acceleration using AiM.” Eui-cheol Lim, vice president of the Solution Development division, compared the performance of GPUs and AiMX and discussed the future of next-generation intelligent semiconductor memories. Lim emphasized that AiMX delivers higher performance, consumes less power, and costs less than conventional GPUs. He also expressed SK hynix’s commitment to developing memory technologies that will lead the way in the era of artificial intelligence.

SK hynix’s AiMX is a promising solution that addresses the growing demand for high-performance and energy-efficient AI accelerators. With its advanced memory technology, SK hynix aims to play a significant role in advancing the field of generative AI and empowering AI-driven applications across various industries.

Background Information

---

About SK hynix:

SK Hynix is a important South Korean semiconductor company known for its innovative contributions to the global technology landscape. Specializing in the production of memory solutions, SK Hynix has played a vital role in shaping the semiconductor industry. With a commitment to research and development, they have continuously pushed the boundaries of memory technology, resulting in products that power various devices and applications.

  

Latest Articles about SK hynix

Technology Explained

---

GDDR6: GDDR6 stands for Graphics Double Data Rate 6th generation memory. It is a high performance memory used in graphics cards and graphics processing units (GPUs), specifically targeting gaming, AI and deep learning-related applications. GDDR6 achieves higher bandwidth than previous generations, allowing faster and smoother gaming experience for users. It is also more power efficient, resulting in lower energy consumption overall. The improved power efficiency makes it adaptable to today's needs of thinner laptops and ultra-high definition gaming laptops. Additionally, GDDR6 is used in storage solutions and advanced data center applications to help streamline large amounts of data at lightning-fast speeds.

Latest Articles about GDDR6

---

GPU: GPU stands for Graphics Processing Unit and is a specialized type of processor designed to handle graphics-intensive tasks. It is used in the computer industry to render images, videos, and 3D graphics. GPUs are used in gaming consoles, PCs, and mobile devices to provide a smooth and immersive gaming experience. They are also used in the medical field to create 3D models of organs and tissues, and in the automotive industry to create virtual prototypes of cars. GPUs are also used in the field of artificial intelligence to process large amounts of data and create complex models. GPUs are becoming increasingly important in the computer industry as they are able to process large amounts of data quickly and efficiently.

Latest Articles about GPU