NVIDIA H100 vs NVIDIA A100

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA H100 NVIDIA A100
Architecture
Hopper Ampere
Launch Year
2022 2020
Form Factor
SXM SXM
VRAM
80 GB80 GB
Memory Bandwidth
3.4 TB/s2.0 TB/s
TDP
700 W400 W
Process Node
4nm 7nm

Performance (TFLOPS)

NVIDIA H100 NVIDIA A100
FP64
34.0 TFlops9.7 TFlops
FP32
67.0 TFlops19.5 TFlops
FP16
989.5 TFlops312.0 TFlops
BF16
989.5 TFlops312.0 TFlops
FP8
1979.0 TFlops
INT8
1979.0 TFlops624.0 TFlops

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA H100
0.10 TFLOPS/W

Where to Rent

NVIDIA H100

ProviderPrice/hr
RunPod
$2.69 View →
DataCrunch
$3.25 View →

NVIDIA A100

ProviderPrice/hr
RunPod
$1.39 View →
DataCrunch
$1.79 View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.