NVIDIA H100 vs NVIDIA GH200

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA H100 NVIDIA GH200
Architecture
Hopper Hopper
Launch Year
2022 2024
Form Factor
SXM SXM
VRAM
80 GB144 GB
Memory Bandwidth
3.4 TB/s4.9 TB/s
TDP
700 W1.0 kW
Process Node
4nm 4nm

Performance (TFLOPS)

NVIDIA H100 NVIDIA GH200
FP64
34.0 TFlops 34.0 TFlops
FP32
67.0 TFlops 67.0 TFlops
FP16
990.0 TFlops
1979.0 TFLOPS sparse
990.0 TFlops
1979.0 TFLOPS sparse
BF16
990.0 TFlops
1979.0 TFLOPS sparse
990.0 TFlops
1979.0 TFLOPS sparse
FP8
1979.0 TFlops
3958.0 TFLOPS sparse
1979.0 TFlops
3958.0 TFLOPS sparse
INT8
1979.0 TFlops
3958.0 TOPS sparse
1979.0 TFlops
3958.0 TOPS sparse
Tensor Core
FP64 (TC)
67.0 TFlops

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA H100
0.10 TFLOPS/W

Where to Rent

NVIDIA H100

ProviderInstancePrice/GPU-hrChecked
DataCrunch
1H100.80S.30V (spot) $1.63 1h ago View →
Cudo Compute
sapphire-rapids-h100 $1.79 1h ago View →
RunPod
H100 SXM (Community Cloud) $2.69 1h ago View →
Massed Compute
gpu_1x_h100 $2.73 1h ago View →
DataCrunch
1H100.80S.30V (on-demand) $3.25 1h ago View →
RunPod
H100 SXM (Secure Cloud) $3.29 1h ago View →
Scaleway
H100-SXM-2-80G $3.84 1h ago View →
Lambda Labs
gpu_2x_h100_sxm5 $4.19 1h ago View →
DigitalOcean
gpu-h100x1-80gb $4.41 1h ago View →
Paperspace
H100 $5.99 1h ago View →
Oracle Cloud (OCI)
H100T $10.75 1h ago View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.