How dense
can a rack run?
Rack count times density gives total load, and the density alone says which cooling regime you are in. The reference figures below are the ones this site cites.
Racks in,
regime out.
Two numbers. The total is arithmetic, and the line under it names the cooling regime the density implies.
Total kW = racks × kW per rack
Inside air cooling's range. Air tops out around 15 to 20 kW per rack.
Above roughly 20 kW, direct-to-chip cold plates or immersion stop being optional.
This density is in the cited band's open tail, which runs 40 to 130 kW and up. Liquid cooling is required above roughly 20 kW per rack.
Density figures from this site's Mining-to-AI guide.
kW per rack,
on the record.
The regimes first, then the two observed figures. Everything here reads fine with JavaScript off.
| Row | kW per rack | Note |
|---|---|---|
| Air cooling | 15 to 20 max | Where air tops out |
| Liquid cooling | Required above ~20 | Direct-to-chip cold plates or immersion |
| Modern AI racks | 40 to 130 and up | The band new GPU racks land in |
| GB200 NVL72 | 120 to 132 | One current dense rack, on the record |
Sourced from the Mining-to-AI guide on this site.
Density questions,
short answers.
Where does air cooling stop?
The figure this site cites is around 15 to 20 kW per rack, with direct-to-chip cold plates or immersion required above roughly 20 kW. NVIDIA specifies direct liquid cooling for its Blackwell racks as a requirement, not a recommendation.
Is 132 kW a spec or a range?
A cited range for one rack platform. This site cites 120 to 132 kW for a single NVIDIA GB200 NVL72 rack, in the Mining-to-AI guide.
What does the cooling overhead cost?
That is a PUE question rather than a density one. The PUE savings calculator turns the same load into annual kWh and dollars.