Hardware

An AI model runs on chips, and the chips need a building, power, cooling, and a network to act as one machine. Each door below covers one of those jobs, with figures taken from the company that makes or runs the hardware.

• Power

  Meta · OpenAI

  6.6 GW Meta nuclear package · up to · by 2035

  Watts, fuel, interconnect, and the permits that can stop them.

• Cooling

  Microsoft · Meta · AWS

  167 kW Maia 300 rack · liquid and air · Microsoft

  How heat leaves the hall.

• Chips

  Nvidia · AMD · Google · AWS · Microsoft · Meta · Cerebras · Huawei · OpenAI

  14 chips Chip families · 9 makers

  Chip families, with the stated compute on each page.

• Data centers

  xAI · Meta · OpenAI · Microsoft · AWS

  170 PB/s Colossus aggregate memory bandwidth · company

  The hall and the campus where models train.

• Networks

  xAI · Microsoft · OpenAI

  2.8 Tb/s Colossus per-server network · company

  The fabric that makes a cluster a cluster.

Reference HBM memory · TSMC and chip manufacturing · AI cloud providers · AI regulation