| Precision | Peak (PFLOPS) | Per GPU (TFLOPS) | TFLOPS/W |
|---|---|---|---|
| FP64 | 0.3 | 34.0 | — |
| FP32 | 0.5 | 67.0 | — |
| TF32 | 4.0 | 494.5 | — |
| FP16 | 7.9 | 989.5 | — |
| BF16 | 7.9 | 989.5 | — |
| FP8 | 15.8 | 1979.0 | — |
| INT8 | 15.8 | 1979.0 | — |
All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.
NVIDIA NVLink with NVSwitch, 900 GB/s GPU-to-GPU; one-GPU-to-one-NIC topology with up to 8 NICs
A 7U eight-GPU server built on the NVIDIA HGX baseboard, with dual 5th generation Intel Xeon Scalable processors at 350 W, NVLink giving 900 GB/s directly between GPUs, and a dedicated one-GPU-to-one-NIC topology supporting up to eight NICs. It offers up to 12 PCIe slots, 32 DIMM slots, 10 NVMe bays, dual 10Gb LAN and optional OCP 3.0, with 4+2 80 PLUS Titanium supplies and support for direct-to-chip liquid cooling alongside separate CPU and GPU airflow tunnels. ASUS offered it with either the HGX H100 or the HGX H200 baseboard; the figures here are for the H200 configuration. ASUS publishes no FLOPS figure of its own, so the compute shown is NVIDIA's for the HGX H200 baseboard this machine carries. Note that ASUS's detailed specification tab does not render server-side, so chassis dimensions, weight and power supply wattages could not be read and are deliberately absent rather than estimated.