| Precision | Peak (PFLOPS) | Per GPU (TFLOPS) | TFLOPS/W |
|---|---|---|---|
| FP64 | 85.2 | 37.0 | 27.00 |
| FP32 | 172.8 | 75.0 | 54.00 |
| TF32 | 2534.4 | 1100.0 | 1500.00 |
| FP16 | 5184.0 | 2250.0 | 2700.00 |
| BF16 | 5184.0 | 2250.0 | 2700.00 |
| FP8 | 10368.0 | 4500.0 | 5400.00 |
| FP4 | 20736.0 | 9000.0 | 10800.00 |
| INT8 | 10368.0 | 4500.0 | 5400.00 |
All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.
NVLink, NVSwitch, InfiniBand
32-rack SuperPOD configuration with GB200 NVL72 systems