That is what Nvidia's Exaflop supercomputer-in-a-rack seems like — the DGX GB200 NVL72 tower most certainly makes use of 48V, 2.5kA to ship a staggering 1,440 petaflops, may value tens of millions

That is what Nvidia’s Exaflop supercomputer-in-a-rack seems like — the DGX GB200 NVL72 tower most certainly makes use of 48V, 2.5kA to ship a staggering 1,440 petaflops, may value tens of millions

[ad_1]

Nvidia just lately unveiled its DGX GB200 NVL72 supercomputer-in-a-rack at Nvidia GTC 2024 and Patrick Kennedy at Serve The Residence took a choice of nice photographs showcasing the spectacular beast.

The title of the DGX GB200 NVL72 tells you a lot of what you want to know. The GB200 signifies the Grace Blackwell GB200 compute construction, whereas the NVL72 denotes there are 72 Blackwell GPUs related by NVLink.

The Blackwell platform comprises 208 billion transistors throughout its two GPU dies. These are related by 10 TB/second chip-to-chip hyperlink right into a single, unified GPU. Blackwell, set to ship later this 12 months, will reportedly provide as much as 20 petaflops of FP4 energy and be as much as 30x quicker than Hopper for AI inference duties.

TechRadar Professional additionally snapped our personal image of the DGX GB200 at Nvidia GTC 2024 (Picture credit score: Future / Mike Moore)

120kW energy load

The rack scale system contains ten compute nodes within the prime stack, every that includes twin Infiniband ports, 4 E1.S drive trays, and administration ports. Every node is powered by two Grace Arm CPUs related to 2 Blackwell GPUs. Under these nodes are 9 NVSwitch cabinets, with gold handles for straightforward removing.

The rear of the rack reveals the facility supply system designed for blind-mate energy through the bus bar, liquid cooling nozzles, and NVLink connections for every element. This setup permits for slight motion to make sure correct blind mating.

DGX GB200 NVL72 weighs 1.36 metric tons (3,000 lbs) and consumes a 120kW, an influence load that Serve The Residence factors out, not all knowledge facilities will be capable to deal with. As many can solely help a most of 60kW racks, a future half-stack system appears a risk. The rack makes use of 2 miles (3.2 km) of copper cabling as an alternative of optics to decrease the system’s energy draw by 20kW.

You may view the remainder of the photographs taken by Kennedy at GTC 2024 right here.