NVIDIA H100 vs NVIDIA H200

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA H100 NVIDIA H200
Architecture
Hopper Hopper
Launch Year
2022 2024
Form Factor
SXM PCIe
VRAM
80 GB141 GB
Memory Bandwidth
3.4 TB/s4.8 TB/s
TDP
700 W600 W
Process Node
4nm 4nm

Performance (TFLOPS)

NVIDIA H100 NVIDIA H200
FP64
34.0 TFlops 30.0 TFlops
FP32
67.0 TFlops 60.0 TFlops
FP16
990.0 TFlops
1979.0 TFLOPS sparse
BF16
990.0 TFlops
1979.0 TFLOPS sparse
FP8
1979.0 TFlops
3958.0 TFLOPS sparse
INT8
1979.0 TFlops
3958.0 TOPS sparse
Tensor Core
FP64 (TC)
67.0 TFlops 60.0 TFlops

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA H200
0.10 TFLOPS/W

Where to Rent

NVIDIA H100

ProviderInstancePrice/GPU-hrChecked
DataCrunch
1H100.80S.30V (spot) $1.63 just now View →
Cudo Compute
sapphire-rapids-h100 $1.79 just now View →
RunPod
H100 SXM (Community Cloud) $2.69 just now View →
Massed Compute
gpu_1x_h100 $2.73 just now View →
DataCrunch
1H100.80S.30V (on-demand) $3.25 just now View →
RunPod
H100 SXM (Secure Cloud) $3.29 just now View →
Scaleway
H100-SXM-2-80G $3.84 just now View →
Lambda Labs
gpu_2x_h100_sxm5 $4.19 just now View →
DigitalOcean
gpu-h100x1-80gb $4.41 just now View →
Paperspace
H100 $5.99 just now View →
Oracle Cloud (OCI)
H100T $10.75 just now View →

NVIDIA H200

ProviderInstancePrice/GPU-hrChecked
RunPod
H200 NVL (Community Cloud) $0.50 just now View →
RunPod
H200 NVL (Secure Cloud) $3.79 just now View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.