AMD Instinct MI350X vs NVIDIA H200

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

AMD Instinct MI350X NVIDIA H200
Architecture
CDNA 4 Hopper
Launch Year
2025 2024
Form Factor
OAM SXM
VRAM
288 GB141 GB
Memory Bandwidth
8.0 TB/s4.8 TB/s
TDP
1.0 kW700 W
Process Node
3nm/6nm 4nm

Performance (TFLOPS)

AMD Instinct MI350X NVIDIA H200
FP64
72.1 TFlops34.0 TFlops
FP32
144.2 TFlops67.0 TFlops
FP16
2306.9 TFlops989.5 TFlops
BF16
2309.6 TFlops989.5 TFlops
FP8
4614.0 TFlops1979.0 TFlops
INT8
4613.7 TFlops1979.0 TFlops

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
AMD Instinct MI350X
0.14 TFLOPS/W

Where to Rent

NVIDIA H200

ProviderInstancePrice/hr
RunPod
H200 SXM $3.59 View →
DataCrunch
1H200.141S.44V $4.00 View →
Oracle Cloud (OCI)
H200 $10.00 View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.