| Precision | Peak (EFLOPS) | Per GPU (TFLOPS) | TFLOPS/W |
|---|---|---|---|
| FP64 | 0.09 | 40 | 27.00 |
| FP32 | 0.18 | 80 | 54.00 |
| TF32 | 2.88 | 1,250 | 1500.00 |
| FP16 | 5.76 | 2,500 | 2700.00 |
| BF16 | 5.76 | 2,500 | 2700.00 |
| FP8 | 11.5 | 5,000 | 5400.00 |
| FP4 | 23.0 | 10,000 | 10800.00 |
| INT8 | 11.5 | 5,000 | 5400.00 |
All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.
NVLink, NVSwitch, InfiniBand
32-rack SuperPOD configuration with GB200 NVL72 systems