NVIDIA H200 vs NVIDIA A100

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA H200 NVIDIA A100
Architecture
Hopper Ampere
Launch Year
2024 2020
Form Factor
SXM SXM
VRAM
141 GB80 GB
Memory Bandwidth
4.8 TB/s2.0 TB/s
TDP
700 W400 W
Process Node
4nm 7nm

Performance (TFLOPS)

NVIDIA H200 NVIDIA A100
FP64
34.0 TFlops9.7 TFlops
FP32
67.0 TFlops19.5 TFlops
FP16
989.5 TFlops312.0 TFlops
BF16
989.5 TFlops312.0 TFlops
FP8
1979.0 TFlops
INT8
1979.0 TFlops624.0 TFlops

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA H200
0.10 TFLOPS/W

Where to Rent

NVIDIA H200

ProviderPrice/hr
RunPod
$3.59 View →
DataCrunch
$4.00 View →
Oracle Cloud (OCI)
$10.00 View →

NVIDIA A100

ProviderPrice/hr
RunPod
$1.39 View →
DataCrunch
$1.79 View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.