AMD Instinct MI300X vs NVIDIA H200
Side-by-side comparison of specifications, performance, and efficiency.
AMD Instinct MI300X
Architecture
CDNA 3
Year
2023
VRAM
192 GB
TDP
750 W
NVIDIA H200
Architecture
Hopper
Year
2024
VRAM
141 GB
TDP
700 W
Specifications
AMD Instinct MI300X NVIDIA H200
Architecture
CDNA 3 Hopper
Launch Year
2023 2024
Form Factor
OAM SXM
VRAM
192 GB141 GB
Memory Bandwidth
5.3 TB/s4.8 TB/s
TDP
750 W700 W
Process Node
5nm FinFET 4nm
| Spec | AMD Instinct MI300X | NVIDIA H200 |
|---|---|---|
| Architecture | CDNA 3 | Hopper |
| Launch Year | 2023 | 2024 |
| Form Factor | OAM | SXM |
| VRAM | 192 GB | 141 GB |
| Memory Bandwidth | 5.3 TB/s | 4.8 TB/s |
| TDP | 750 W | 700 W |
| Process Node | 5nm FinFET | 4nm |
Performance (TFLOPS)
AMD Instinct MI300X NVIDIA H200
FP64
81.7 TFlops34.0 TFlops
FP32
163.4 TFlops67.0 TFlops
FP16
1307.4 TFlops989.5 TFlops
BF16
1307.4 TFlops989.5 TFlops
FP8
2614.9 TFlops1979.0 TFlops
INT8
2614.9 TFlops1979.0 TFlops
| Precision | AMD Instinct MI300X | NVIDIA H200 |
|---|---|---|
| FP64 | 81.7 TFlops | 34.0 TFlops |
| FP32 | 163.4 TFlops | 67.0 TFlops |
| FP16 | 1307.4 TFlops | 989.5 TFlops |
| BF16 | 1307.4 TFlops | 989.5 TFlops |
| FP8 | 2614.9 TFlops | 1979.0 TFlops |
| INT8 | 2614.9 TFlops | 1979.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
AMD
Instinct MI300X
0.22 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.