| Precision | Peak (TFLOPS) | Per GPU (TFLOPS) | TFLOPS/W |
|---|---|---|---|
| FP64 | 296 | 37 | — |
| FP32 | 600 | 75 | — |
| TF32 | 9,000 | 1,125 | — |
| FP16 | 18,000 | 2,250 | — |
| BF16 | 18,000 | 2,250 | — |
| FP8 | 36,000 | 4,500 | — |
| FP4 | 72,000 | 9,000 | — |
| INT8 | 36,000 | 4,500 | — |
All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.
NVSwitch + NVLink