Side by side datacenter GPU specifications from the Flopper.io database.
| AMD Instinct MI350X OAM | NVIDIA H200 SXM 141GB | |
|---|---|---|
| FP32 TFLOPS | 144.2 | 67.0 |
| Memory | 288 GB | 141 GB |
| Memory Bandwidth | 8.0 TB/s | 4.8 TB/s |
| TDP | 1.0 kW | 700 W |
| Precision | AMD Instinct MI350X OAM peak TFLOPS (dense) | NVIDIA H200 SXM 141GB peak TFLOPS (dense) |
|---|---|---|
| FP64 | 72.1 | 34.0 |
| FP32 | 144.2 | 67.0 |
| TF32 | — | 494.0 |
| BF16 | 2309.6 | 990.0 |
| FP16 | 2309.6 | 990.0 |
| FP8 | 4614.0 | 1979.0 |
| FP6 | 9227.5 | — |
| FP4 | 9227.5 | — |
| INT8 | 4614.0 | 1979.0 |
| AMD Instinct MI350X OAM | NVIDIA H200 SXM 141GB | |
|---|---|---|
| Architecture | CDNA 4 | Hopper |
| Process Node | 3nm/6nm | 4nm |
| Launch Year | 2025 | 2024 |
| Form Factor | OAM | SXM |
| Memory Type | — | — |
| Interface Width | — | — |
| Interconnect | — | — |
| TDP | 1.0 kW | 700 W |
| FP32 Efficiency | 0.14 TFLOPS/W | 0.10 TFLOPS/W |