Speaking to DCD earlier this year, Ian Buck, Nvidia’s accelerated computing VP, said: "The fabric of NVLink, the spine, is connecting all those 72 GPUs to deliver an overall performance of 720 petaflops of training, 1.4 exaflops of inference."

The server rack Nvidia designed for Blackwell —which can connect up to 72 GPUs at a time—is reportedly causing the overheating issue. Nvidia has repeatedly redesigned the racks, which could result in GPU server shipments being delayed and new Google, Microsoft, or Meta data centers may not be able to open on schedule.

Nvidia's next-generation Blackwell processors are facing significant challenges with overheating when installed in high-capacity server racks, reports The Information. These issues have reportedly led to design changes and delays and raised concerns among customers like Google,