Carmen Li's Plan to Build a Futures Market for Compute
Carmen Lee, CEO of Compute Exchange and Silicon Data, discusses her efforts to build futures markets for GPU compute on the CME, drawing parallels to oil commodity markets. She explains how GPU price indices are constructed, who the natural buyers and sellers of compute futures would be, and addresses challenges like GPU performance variance and fungibility. The conversation covers spot markets, refurbished chips, residual value calculations, and the broader question of whether AI represents a bubble.
Summary
The podcast episode features Carmen Lee, founder and CEO of Silicon Data (an index provider for GPU indices) and CEO of Compute Exchange (a spot marketplace for GPU procurement), recorded live at an Odd Lots show in New York. She was previously connected to Don Wilson of DRW, who was discussed in an earlier episode about building a compute exchange.
Carmen describes two distinct but related ventures: Silicon Data, which has developed GPU price indices now available on Bloomberg Terminal and is launching GPU futures and options on the CME pending regulatory approval; and Compute Exchange, which facilitates spot, reserve, forward, and refurbished GPU contracts. The CME partnership represents a major milestone after roughly two and a half years of index development.
On market structure, Carmen draws an extended analogy to oil markets. NeoCloud providers who own GPU hardware are likened to oil producers (like Shell) who are naturally long and want to hedge revenue volatility by shorting futures. Enterprises and AI startups who consume compute are naturally short, like airlines hedging fuel costs, and want to lock in prices. She notes the shift from on-demand to reserved and forward contracts as GPU scarcity has increased, with on-demand pricing swinging from $3 to $9 per hour depending on supply-demand dynamics.
A significant technical challenge discussed is GPU non-fungibility. Carmen references a paper published at the GPGPU conference with Jefferson Lab showing 38% performance variance for the same A100 chip across different providers and data centers. Compute Exchange addresses this through independent GPU benchmarking (described as a 'Carfax for GPUs'), verifying chips on FLOPS, memory bandwidth, tokens per second, and SLA before delivery.
The index methodology is described in detail. Rather than simple averaging, Silicon Data collects six months of historical trading data from over 100 data sources, ingests 150,000+ traded prices daily, normalizes them across chip characteristics and configurations, and calculates settlement prices. The resulting daily volatility for A100 and H100 indices runs around 20-30%, described as a healthy commodity volatility range, even though individual chip configurations at specific geolocations can show 80-100% volatility.
Carmen shows a chart of GPU rental rates for B200, H100, and A100 chips. She notes B200 prices launched high, dipped, then rose above launch prices — a steeper-than-expected demand signal. H100 prices rose ~8% in the last three months, and A100 prices (the oldest chips) rose 10-15%, indicating broad supply-demand tightening across generations.
On refurbished GPUs, Carmen describes a residual value framework using discounted cash flow analysis of forward contracts to determine break-even and resale value. She cites data showing second-year H100 resale value at approximately $0.85 on the dollar and third-year at $0.84 — a relatively shallow depreciation curve compared to automobiles.
Regarding CME futures settlement, Carmen confirms they will be financially settled like traditional commodity futures, not physically delivered. She notes Compute Exchange experimented with Polymarket contracts for GPU prices, which she described as starting organically when someone listed her product without consent, eventually leading to a collaboration.
On the AI bubble question, Carmen declines to offer price guidance as an index provider but frames the question through cash flow analysis at the machine level — whether forward contract revenue, discounted back, supports the purchase price of hardware. She notes that signed forward contracts provide some visibility into demand but acknowledges overbuilding risk and the lag between announced data center investment and actual GPU availability.
About this episode
<p>When we spoke to DRW's Don Wilson last year, he talked about building out a GPU market that might be bigger than oil. Now, a year later, he is working with Carmen Li to do just that. Li is the CEO of two companies — Silicon Data and Compute Exchange (where she works alongside Wilson). The former company is building the index for GPU pricing while the latter is a spot marketplace for GPU procurement. Today's episode — recorded at our live show at City Winery in New York — gets into how Li is building a whole new market for GPUs at her two companies. We talk about the challenge of standardizing compute, GPU price volatility, if used GPUs are like used cars, what goes into constructing a GPU index, and what it means to win the GPU lottery.</p> <p>Read more:<br /><a href="https://www.bloomberg.com/news/articles/2026-06-04/jane-street-plans-new-data-center-as-compute-power-runs-scarce?utm_medium=referral&utm_source=podcast&utm_campaign=odd_lots&utm_content=article">Jane Street Plans New Data Center as Computing Power Runs Scarce</a><br /><a href="https://www.bloomberg.com/news/articles/2026-06-05/google-buying-computing-from-spacex-in-920-million-a-month-deal?utm_medium=referral&utm_source=podcast&utm_campaign=odd_lots&utm_content=article">SpaceX Inks $30 Billion Computing Power Deal With Google</a></p> <p>Only <a href="http://bloomberg.com/">Bloomberg - Business News, Stock Markets, Finance, Breaking & World News</a> subscribers can get the Odd Lots newsletter in their inbox each week, plus unlimited access to the site and app. Subscribe at <a href="https://www.bloomberg.com/subscriptions/oddlots?in_source=oddlotspodcast">bloomberg.com/subscriptions/oddlots</a></p> <p><a href="http://bloomberg.com/subscriptions/oddlots">Subscribe to the Odd Lots Newsletter</a><br /><strong>Join the conversation:</strong> <a href="https://discord.gg/oddlots">discord.gg/oddlots</a></p><p>See <a href="https://omnystudio.com/listener">omnystudio.com/listener</a> for privacy information.</p>
Key Insights
- Carmen Lee argues there is 38% performance variance for the same A100 chip depending on the provider and data center, which she calls the 'GPU lottery' problem — meaning GPU compute is fundamentally non-homogeneous and cannot be simply averaged for index construction.
- Lee claims that Silicon Data normalizes over 150,000 traded prices daily from 100+ data sources against chip characteristics to produce settlement prices, resulting in a daily volatility of 20-30% for H100 and A100 indices — which she considers a healthy commodity volatility range comparable to other physical commodities.
- Lee observes that B200 GPU prices followed the historical pattern of launching high then declining, but the slope of decline was less steep than expected for prior generations, and prices subsequently rose above launch levels — which she interprets as a demand-supply curve in a structurally different state than previous chip generations.
- Lee states that second-year resale value for H100 refurbished chips was approximately $0.85 on the dollar and third-year approximately $0.84, arguing this shallow depreciation curve contradicts widespread narratives about rapid GPU obsolescence.
- Lee draws an explicit analogy between GPU market participants and oil markets: NeoCloud providers are like oil producers (Shell) who are naturally long and hedge by shorting futures, while AI startups and enterprises consuming compute are like airlines — naturally short and wanting to lock in cost stability.
- Lee argues that even older A100 chips saw 10-15% price increases in the past three months despite being the oldest generation, which she uses as evidence of broad supply-demand tightening across all GPU generations, not just the latest hardware.
- Lee contends that announced data center investments do not translate quickly into available GPU supply because co-location, optic fiber, and other infrastructure constraints create significant delays between capital commitment and actual compute availability.
- Lee frames the AI bubble question at the machine level through discounted cash flow analysis of signed forward contracts rather than equity valuations, arguing that if forward contract revenues support the purchase price of hardware, there is no bubble at the compute infrastructure level regardless of what happens to AI company valuations.
Topics
Transcript
What if you could have even more and more and more help to pursue your goals? At LPL Financial, we offer more ways for advisors and their clients to thrive. So, what if you could? Paid advertisement investing involves risk, including potential loss of principal. LPL Financial LLC member FINRA SIPC. So there's a lot of noise about AI, but time's too tight for more promises. So let's talk about results. At IBM, we work with our employees to integrate technology right into the systems they need. Now, a global workforce of 300,000 can use AI to fill their HR questions, resolving 94% of common questions. Not noise. Proof of how we can help companies get smarter by putting AI…
Full transcript available for MurmurCast members
Sign Up to AccessMore from Odd Lots
Why AI Might Actually Create More Work for Lawyers
Gary Wiggins, chair of law firm Lowenstein Sandler, discusses how AI is transforming legal work by improving efficiency and quality rather than replacing lawyers. While AI reduces costs for routine tasks by up to 70%, it's creating more complex work, preserving employment, and shifting the profession toward higher-value strategic work, though fundamental questions about pricing models and true economic costs remain unresolved.
The Korean Levered ETFs Shaking Markets All Around the World
Alex Altman from Barclays discusses the explosive growth of leveraged single-stock ETFs, particularly in Korea, which have ballooned from $12-13 billion to $50-55 billion in Asia-Pacific over months. These products create mechanical rebalancing flows that function as negative gamma in markets, potentially amplifying volatility, while the underlying stocks—particularly semiconductor companies like Micron and SK Hynix—have attracted retail investors seeking outsized returns.
One of the World's Largest Hedge Funds on Its 86x Growth in Token Spending
Man Group executives discuss their implementation of generative AI across asset management operations, revealing an 86x increase in token consumption since January and demonstrating how AI agents are systematizing quant research, augmenting PM workflows, and identifying novel trading signals across multiple data modalities.
These Are the Sharps Actually Making Money on Prediction Markets
This OddLots episode features journalist Adam and prediction market traders Brian and Daniel discussing how skilled traders consistently profit from prediction markets through rigorous research, data analysis, and ground-level reporting rather than luck or AI. The conversation explores market efficiency, insider trading concerns, the zero-sum nature of prediction markets, and how professional traders systematically beat retail investors.
How a Major Grocery Store Chain Can Dramatically Lower the Cost of Food
Scott Patton, Chief Commercial Officer of Aldi U.S., discusses how the grocery chain dramatically reduces costs through operational efficiency, including limited SKUs, private label dominance, direct farmer partnerships, and technological innovations like digital price labels and optimized barcode placement. The conversation covers Aldi's new Times Square location, supply chain strategies, and how consumer trends like GLP-1 adoption are reshaping grocery shopping behavior.