| Precision | Peak (PFLOPS) | Per GPU (TFLOPS) | TFLOPS/W |
|---|---|---|---|
| FP64 | 0.3 | 37.0 | — |
| FP32 | 0.6 | 75.0 | — |
| TF32 | 8.8 | 1100.0 | — |
| FP16 | 18.0 | 2250.0 | — |
| BF16 | 18.0 | 2250.0 | — |
| FP8 | 36.0 | 4500.0 | — |
| FP4 | 72.0 | 9000.0 | — |
| INT8 | 36.0 | 4500.0 | — |
All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.
NVSwitch + NVLink