The Less Water Data Centers Use, The More Power They Consume. Here’s Why
AI data centers face a fundamental trade-off between water and power consumption for cooling. While liquid cooling systems use minimal water inside servers, the heat rejection process requires either significant water usage through evaporative cooling or substantial additional power for dry cooling, creating infrastructure challenges for communities nationwide.
Summary
AI data centers, particularly those running GPU-intensive workloads, generate extreme heat requiring sophisticated cooling solutions. Modern GPU racks like Nvidia's Grace Blackwell and AMD's Helios operate at temperatures around 80°C and would fail without continuous cooling. The transcript explores how data centers manage this challenge through liquid cooling systems, which are roughly 3,000 times more effective than air cooling at removing heat from chips.
Liquid cooling comes in two distinct phases: the closed-loop system inside servers that recirculates coolant without water loss, and the external heat rejection process that must expel absorbed heat to the atmosphere. Hyperscalers often claim zero water usage by only counting the internal loop, but this masks the significant water or power required for the second phase. The transcript reveals that reducing water consumption for heat rejection necessarily increases power demands, creating a critical trade-off.
Three primary cooling methods exist for heat rejection: dry cooling (using ambient air via fans), evaporative cooling (most water-intensive), and hybrid approaches. Dry cooling requires substantial power during warm months when air conditioning-style units must compensate for higher ambient temperatures. Evaporative cooling towers consume massive quantities of water through evaporation. The largest data centers can use up to 5-8 million gallons per day—equivalent to a small town of 50,000 people—straining local infrastructure.
The broader context shows over 2,000 new data centers planned across the U.S., with 71% of survey respondents opposing local data center construction. Communities face water rate increases and power shortages as data centers compete with residential needs. Solutions emerging include lower-heat chip designs from companies like DeepX and SK Hynix's IHBM with integrated cooling elements, which aim to reduce the fundamental heat generation problem before it requires aggressive cooling interventions.
Key Insights
- Water is approximately 3,000 times more effective than air at removing heat from chips, enabling much higher server density in the same physical footprint
- Hyperscalers label their closed-loop cooling systems as using zero water for most of the year, but this accounting ignores the water and power required to reject heat from the building to the ambient environment
- Saving water in data center cooling necessarily means using more power, as dry cooling systems require power-hungry air conditioning units during warm months when ambient air temperatures are high
- Equinix's global water footprint across all operations in 2025 was equivalent to approximately 16-18 holes golf courses in the southwestern United States, consuming 1.2 billion gallons with a 10% increase from 2024
- New data centers are projected to account for most of the increase in electricity demand over the next decade, prompting major tech companies to build their own power plants to meet cooling and operational needs
Topics
Transcript
[0:02] So here we can see all of the liquid cooling infrastructure for the Grace Blackwell rack inside this Equinix data center in San Jose, California. There are hundreds of server racks, some executing massive AI compute tasks for the companies renting space here to run thousands of graphics and central processing units. There are eight GPU racks in here, and each rack has 72 GPUs inside of it, and all those chips get hot under heavy workloads. Server can boil your eggs. They are running at 80°C. [0:34] The chips themselves would melt down if they weren't continuously cooled. And keeping these chips cool requires a lot of water and power, which is a major reason why there's a…
Full transcript available for MurmurCast members
Sign Up to AccessMore from CNBC
GTA 6's Billion-Dollar Hype Machine
GTA VI is projected to be the most anticipated game launch in history, with an estimated $1 billion+ development budget expected to be recouped on day one through 25 million pre-sales at $100 each. The game's release is anticipated to have massive economic ripple effects across entertainment, streaming, and traditional business sectors, with nearly 1 in 3 gamers planning to purchase it.
The rise, reinvention and uncertain future of Nvidia without Jensen Huang
Nvidia founder Jensen Huang has been removed as CEO amid allegations of multiple affairs, including with direct reports, and connections to Alice Wong, who may be a Chinese spy involved in distributing AI chips across Southeast Asia. The scandal represents the company's biggest crisis in its 33-year history, occurring during a period of strict U.S. export controls on advanced chips to China.
Could Democratic Gains Bring Tariff Relief For Canada?
Following Democrats' 2026 midterm victories, Canadian investors anticipate potential tariff relief, but progress will likely be slow given President Trump's remaining two years in office and the complexity of trade negotiations. While some sectors like steel, lumber, and agriculture could benefit from reduced tariffs, Rust Belt Democrats and security concerns may limit the scope of relief.
Nvidia In Crisis: The Rise Of Jensen Huang’s Empire At The Center Of The AI Boom
This documentary examines Nvidia's rise to dominance in AI computing and the recent crisis surrounding founder Jensen Huang's resignation following allegations of affairs and potential involvement with a figure connected to Chinese AI chip diversion schemes. The narrative explores how Huang built Nvidia from a graphics card startup in 1993 into a $150+ billion company at the center of the AI boom, while also detailing geopolitical risks, export control complications, and questions about the company's future without its iconic founder.
How Democrats Won Back Union Voters
Democrats have dramatically reversed declining support among union voters, winning union households by 22 percentage points in the 2026 midterms compared to just 8 points in 2024. This turnaround was driven by aggressive union organizing efforts and increased voter enthusiasm, though questions remain about sustaining this advantage in future presidential elections.