Nvidia’s 45°C Liquid Cooling: The Hidden Cost Saver for AI Factories

Nvidia’s Rubin AI servers run at 45°C with full liquid cooling—cutting energy costs for hyperscalers while forcing a rethink of data center design.

Nvidia’s 45°C Liquid Cooling: The Hidden Cost Saver for AI Factories
Photo by Winston Chen on Unsplash

The story of the day

Nvidia’s Rubin-generation AI servers now push liquid cooling to 45°C—hotter than a hot tub—eliminating fans entirely and claiming 100% liquid-cooled infrastructure. The move, detailed in their DSX AI factory reference design, targets hyperscalers squeezed by power and cooling costs. For builders, this means two things: lower operational overhead for high-density deployments, but also a lock-in to Nvidia’s proprietary cooling stack. The real question isn’t whether it works (it does), but whether the savings justify the vendor dependency for anyone outside the top cloud providers.

New tools & launches

Headroom — Open-source context compression layer for AI agents, reducing token usage without sacrificing performance. [GitHub]

Models & research

No actionable model/research updates today.

Industry pulse

Satya Nadella’s op-ed in the WSJ warns against letting AI giants monopolize economic gains, framing it as a systemic risk rather than a technical one. The subtext: Microsoft’s Copilot strategy hinges on avoiding the same fate—by distributing the spoils (and costs) across the ecosystem. [WSJ]

Stat of the day

45°C: The new liquid cooling ceiling for Nvidia’s Rubin AI servers, enabling fanless operation and cutting energy overhead in high-density clusters. [Nvidia]

Get the full analysis — subscribe to Gradient Pro.