This Nvidia Challenger Says Its AI Chip Is 10x Faster Than A GPU
d-Matrix, a California-based chip startup, has announced its Corsair AI inference chip is now in full production, claiming it is 10x faster at token generation and 3x cheaper than standalone GPUs. The chip uses on-chip SRAM instead of high-bandwidth memory to bypass the memory bottleneck limiting GPU performance. The company has secured $275 million in funding and partnerships with major players including Microsoft, Arista, Broadcom, and Supermicro.
Summary
d-Matrix, founded in 2019 by Sid Sheth, has entered full production with its Corsair AI inference chip, manufactured at TSMC in Taiwan on a six-nanometer node. The chip is designed specifically for AI inference workloads and is being positioned as a direct challenger to Nvidia's GPU dominance in that segment. Corsair is a card-based product housing four chips that can be plugged into a standard server, making it relatively easy to integrate into existing data center infrastructure.
The core technical differentiation of the Corsair chip lies in its memory architecture. Rather than relying on external high-bandwidth DRAM — which is in short supply from manufacturers like SK Hynix, Samsung, and Micron — d-Matrix integrates SRAM directly onto the chip. This eliminates the memory bottleneck that the company argues plagues GPUs and other accelerators, enabling faster and more energy-efficient data access. d-Matrix claims its solution produces tokens ten times faster than GPUs alone, costs three times less, and is up to five times more energy efficient, making it particularly well-suited for inference tasks like chatbots, video generation, and agentic AI.
d-Matrix's approach mirrors that of two other memory-first chip companies that have seen significant success: Cerebras, which achieved a near-$100 billion market cap IPO in May, and Groq, whose assets were acquired by Nvidia for $20 billion. Nvidia subsequently unveiled a new line of chips based on Groq's technology, called Language Processing Units (LPUs), at its GTC conference in March. This validates the SRAM-on-chip approach that d-Matrix is also pursuing.
On the business side, d-Matrix has not yet disclosed specific customers but says it has commitments from hyperscalers, neoclouds, and leading AI labs. The company raised $275 million in November at a $2 billion valuation, with Microsoft investing through its M12 venture arm. d-Matrix has also formed a partnership with Arista, Broadcom, and Supermicro to deliver a full rack-scale deployment system for AI data centers. The company is also exploring the possibility of selling chips into China, noting that its inference-only design does not enable model training, which could help it navigate U.S. export control restrictions.
Key Insights
- d-Matrix's CEO Sid Sheth claims Corsair solves a memory bottleneck that GPUs and Amazon's Trainium chips cannot, because it does not rely on DRAM and instead uses SRAM integrated directly onto the chip to accelerate memory access.
- d-Matrix claims its Corsair chip, when paired with GPUs in a server rack, produces tokens ten times faster than GPUs alone, while also being three times cheaper and up to five times more energy efficient for inference workloads.
- Nvidia acquired Groq's assets for $20 billion — its largest acquisition to date — and then unveiled a new line of Language Processing Units (LPUs) based on Groq's SRAM-on-chip technology at GTC in March, validating the memory-first inference chip approach.
- d-Matrix's CEO suggests the company could eventually ship chips to China, arguing that because Corsair is inference-only and cannot be used to train AI models, it may be positioned to navigate U.S. export control restrictions.
- Microsoft invested in d-Matrix through its M12 venture arm as part of a $275 million funding round that valued the company at $2 billion, which is notable given Microsoft's parallel development of its own Maya inference chips and other in-house silicon.
Topics
Transcript
[0:00] There's a new Nvidia Challenger, d-Matrix, making a very different kind of chip it says is far faster at AI inference than Nvidia's standalone GPUs. And we are reporting here first that it's now in full production. Our solution solves the problem that GPUs cannot. GPUs cannot, Trainium chips cannot. So they are in high demand. The new chip, called Corsair, is made at TSMC in Taiwan on six nanometer node and will begin shipping later this month. If you take out the sheet metal on this product, you'll see, you know, collection of four chips [0:31] inside. This is something you can plug into a server. d-Matrix won't disclose specific customers yet, but says it already has commitments…
Full transcript available for MurmurCast members
Sign Up to AccessMore from CNBC
GTA 6's Billion-Dollar Hype Machine
GTA VI is projected to be the most anticipated game launch in history, with an estimated $1 billion+ development budget expected to be recouped on day one through 25 million pre-sales at $100 each. The game's release is anticipated to have massive economic ripple effects across entertainment, streaming, and traditional business sectors, with nearly 1 in 3 gamers planning to purchase it.
The rise, reinvention and uncertain future of Nvidia without Jensen Huang
Nvidia founder Jensen Huang has been removed as CEO amid allegations of multiple affairs, including with direct reports, and connections to Alice Wong, who may be a Chinese spy involved in distributing AI chips across Southeast Asia. The scandal represents the company's biggest crisis in its 33-year history, occurring during a period of strict U.S. export controls on advanced chips to China.
Could Democratic Gains Bring Tariff Relief For Canada?
Following Democrats' 2026 midterm victories, Canadian investors anticipate potential tariff relief, but progress will likely be slow given President Trump's remaining two years in office and the complexity of trade negotiations. While some sectors like steel, lumber, and agriculture could benefit from reduced tariffs, Rust Belt Democrats and security concerns may limit the scope of relief.
Nvidia In Crisis: The Rise Of Jensen Huang’s Empire At The Center Of The AI Boom
This documentary examines Nvidia's rise to dominance in AI computing and the recent crisis surrounding founder Jensen Huang's resignation following allegations of affairs and potential involvement with a figure connected to Chinese AI chip diversion schemes. The narrative explores how Huang built Nvidia from a graphics card startup in 1993 into a $150+ billion company at the center of the AI boom, while also detailing geopolitical risks, export control complications, and questions about the company's future without its iconic founder.
How Democrats Won Back Union Voters
Democrats have dramatically reversed declining support among union voters, winning union households by 22 percentage points in the 2026 midterms compared to just 8 points in 2024. This turnaround was driven by aggressive union organizing efforts and increased voter enthusiasm, though questions remain about sustaining this advantage in future presidential elections.