Corsair and d-Matrix Pioneer AI Inference Without GPUs


November 21, 2024 by our News Team


Introducing Corsair: A Game Changer for AI Inference

Today, d-Matrix has rolled out something truly : Corsair, a fresh approach to computing that’s tailor-made for the next generation of AI inference in modern data centers. Imagine a system built from the ground up, specifically designed to turbocharge AI workloads while keeping performance, energy efficiency, and costs in check. That’s Corsair for you! With its innovative Digital In-Memory Compute architecture (DIMC), it’s setting a new standard that leaves traditional GPUs and other alternatives in the dust.

As we dive deeper into AI, the emergence of reasoning agents and the ability to generate interactive videos highlight just how much we need more robust inference computing power. Think about it: these advancements require models that can “think” and produce top-notch outputs. Corsair is poised to be the go-to solution for enterprises eager to unlock advanced automation and intelligence without sacrificing performance or breaking the bank.

A Vision for the Future of AI

Sid Sheth, co-founder and CEO of d-Matrix, shared his excitement about this launch: “We saw transformers and generative AI coming, and founded d-Matrix to tackle the inference challenges around the largest computing opportunity of our time.” He emphasizes that Corsair is not just fast; it’s designed for high interactivity applications that can handle multiple users seamlessly, making generative AI commercially viable.

But here’s the kicker: Gartner predicts a staggering 160% increase in data center energy consumption over the next two years, primarily due to the rise of AI and GenAI. This surge means that by 2027, about 40% of existing AI data centers could face operational hurdles due to power availability. In simpler terms, scaling AI models could quickly become a costly endeavor if we don’t adapt.

Breaking Barriers with d-Matrix Innovations

What sets d-Matrix apart? They’re not just throwing around buzzwords; they’re making real strides with several industry-first innovations in silicon, software, and chiplet packaging. Generative inference is often memory-bound, but d-Matrix has cracked that code with its DIMC architecture, which seamlessly integrates memory and compute.

Scaling is a breeze thanks to DMX Link, which ensures high-speed, energy-efficient connectivity across chiplets, and DMX Bridge for connecting packages across two cards. Plus, they’re among the first to support block floating-point numerical formats, now an OCP standard known as Micro-scaling (MX), enhancing inference efficiency even further.

And for AI developers, the d-Matrix Aviator software stack provides a familiar user experience, making it easier to dive into this new tech. Corsair comes in a standard PCIe Gen 5 full-height, full-length card form factor, with pairs of cards linked via DMX Bridge cards. Each Corsair card boasts DIMC compute cores delivering a jaw-dropping 2400 TFLOPs of 8-bit peak compute, along with 2 GB of integrated Performance Memory and up to 256 GB of off-chip Capacity Memory.

With an ultra-high memory bandwidth of 150 TB/s—significantly surpassing HBM—Corsair promises up to 10x faster interactive speeds, 3x better performance per total cost of ownership (TCO), and 3x greater energy efficiency. That’s not just impressive; it’s a game changer.

Transforming the AI Landscape

Michael Stewart, managing partner of M12, Microsoft’s Venture Fund, sees d-Matrix as a leader in this monumental shift in GenAI. “They’re the first to tackle the pain points of AI in the enterprise,” he says. With a world-class team and innovations, d-Matrix is making AI infrastructure more accessible, allowing businesses to scale operations without the energy constraints and Latency issues that have historically held back enterprise adoption.

In a nutshell, d-Matrix is democratizing access to the hardware necessary for AI, making GenAI attainable for everyone.

When Can You Get Your Hands on Corsair?

If you’re eager to experience the power of Corsair, you’ll be happy to know that it’s currently sampling to early-access customers and will be widely available in Q2 2025. d-Matrix is partnering with OEMs and System Integrators to bring Corsair-based solutions to market.

Vik Malyala, Senior Vice President for Technology and AI at Supermicro, expressed enthusiasm about collaborating with d-Matrix: “We’re excited to work on Corsair’s ultra-high bandwidth in-memory compute solution, which is purpose-built for generative AI and will accelerate the adoption of sustainable AI computing.”

Alan Benjamin, CEO at GigaIO, adds, “Combining d-Matrix’s Corsair PCIe card with our industry-leading scale-up architecture creates a transformative solution for enterprises deploying next-generation AI inference at scale.”

And let’s not forget Liqid, whose Co-Founder, Sumit Puri, highlights how integrating Corsair enables unmatched capability and efficiency in the rapidly evolving AI landscape.

With Corsair, d-Matrix isn’t just changing the game; they’re redefining what’s possible in AI inference. Are you ready to embrace the future?

Corsair and d-Matrix Pioneer AI Inference Without GPUs

Corsair and d-Matrix Pioneer AI Inference Without GPUs

Corsair and d-Matrix Pioneer AI Inference Without GPUs

About Our Team

Our team comprises industry insiders with extensive experience in computers, semiconductors, games, and consumer electronics. With decades of collective experience, we’re committed to delivering timely, accurate, and engaging news content to our readers.

Background Information


About Corsair:

Corsair, founded in 1994, is a manufacturer of high-performance gaming and enthusiast PC components and peripherals. The company specializes in producing top-tier gaming keyboards, mice, headsets, as well as computer cases, power supplies, and memory modules. Corsair has earned a strong reputation in the industry for its commitment to quality and innovation, catering to gamers and PC enthusiasts worldwide.

Corsair website  Corsair LinkedIn
Latest Articles about Corsair

About Microsoft:

Microsoft, founded by Bill Gates and Paul Allen in 1975 in Redmond, Washington, USA, is a technology giant known for its wide range of software products, including the Windows operating system, Office productivity suite, and cloud services like Azure. Microsoft also manufactures hardware, such as the Surface line of laptops and tablets, Xbox gaming consoles, and accessories.

Microsoft website  Microsoft LinkedIn
Latest Articles about Microsoft

About Supermicro:

Supermicro is a reputable American technology company founded in 1993 and headquartered in San Jose, California. Specializing in high-performance server and storage solutions, Supermicro has become a trusted name in the data center industry. The company offers a wide range of innovative and customizable server hardware, including motherboards, servers, storage systems, and networking equipment, catering to the needs of enterprise clients, cloud service providers, and businesses seeking reliable infrastructure solutions.

Supermicro website  Supermicro LinkedIn
Latest Articles about Supermicro

Technology Explained


chiplet: Chiplets are a new type of technology that is revolutionizing the computer industry. They are small, modular components that can be used to build powerful computing systems. Chiplets are designed to be used in combination with other components, such as processors, memory, and storage, to create a complete system. This allows for more efficient and cost-effective production of computers, as well as more powerful and versatile systems. Chiplets can be used to create powerful gaming PCs, high-end workstations, and even supercomputers. They are also being used in the development of artificial intelligence and machine learning applications. Chiplets are an exciting new technology that is changing the way we build and use computers.

Latest Articles about chiplet

chiplets: Chiplets are a new type of technology that is revolutionizing the computer industry. They are small, modular components that can be used to build a variety of computer systems. Chiplets are designed to be highly efficient and cost-effective, allowing for the creation of powerful and complex systems without the need for large, expensive components. They are also highly customizable, allowing for the creation of systems tailored to specific needs. Chiplets are being used in a variety of applications, from high-end gaming PCs to embedded systems and even supercomputers. They are also being used to create powerful AI systems, allowing for the development of more advanced and intelligent machines. Chiplets are revolutionizing the computer industry, allowing for the creation of powerful and efficient systems at a fraction of the cost.

Latest Articles about chiplets

Latency: Technology latency is the time it takes for a computer system to respond to a request. It is an important factor in the performance of computer systems, as it affects the speed and efficiency of data processing. In the computer industry, latency is a major factor in the performance of computer networks, storage systems, and other computer systems. Low latency is essential for applications that require fast response times, such as online gaming, streaming media, and real-time data processing. High latency can cause delays in data processing, resulting in slow response times and poor performance. To reduce latency, computer systems use various techniques such as caching, load balancing, and parallel processing. By reducing latency, computer systems can provide faster response times and improved performance.

Latest Articles about Latency

PCIe: PCIe (Peripheral Component Interconnect Express) is a high-speed serial computer expansion bus standard for connecting components such as graphics cards, sound cards, and network cards to a motherboard. It is the most widely used interface in the computer industry today, and is used in both desktop and laptop computers. PCIe is capable of providing up to 16 times the bandwidth of the older PCI standard, allowing for faster data transfer speeds and improved performance. It is also used in a variety of other applications, such as storage, networking, and communications. PCIe is an essential component of modern computing, and its applications are only expected to grow in the future.

Latest Articles about PCIe




Leave a Reply