NVIDIA A100 vs NVIDIA H20
Side-by-side comparison of specifications, performance, and efficiency.
NVIDIA A100
Architecture
Ampere
Year
2020
VRAM
40 GB
TDP
250 W
NVIDIA H20
Architecture
Hopper
Year
2024
VRAM
96 GB
TDP
400 W
Specifications
NVIDIA A100 NVIDIA H20
Architecture
Ampere Hopper
Launch Year
2020 2024
Form Factor
PCIe SXM
VRAM
40 GB96 GB
Memory Bandwidth
1.6 TB/s4.0 TB/s
TDP
250 W400 W
Process Node
7nm 4nm
| Spec | NVIDIA A100 | NVIDIA H20 |
|---|---|---|
| Architecture | Ampere | Hopper |
| Launch Year | 2020 | 2024 |
| Form Factor | PCIe | SXM |
| VRAM | 40 GB | 96 GB |
| Memory Bandwidth | 1.6 TB/s | 4.0 TB/s |
| TDP | 250 W | 400 W |
| Process Node | 7nm | 4nm |
Performance (TFLOPS)
NVIDIA A100 NVIDIA H20
FP64
9.7 TFlops1.0 TFlops
FP32
19.5 TFlops44.0 TFlops
FP16
312.0 TFlops148.0 TFlops
BF16
312.0 TFlops148.0 TFlops
INT8
624.0 TFlops296.0 TFlops
| Precision | NVIDIA A100 | NVIDIA H20 |
|---|---|---|
| FP64 | 9.7 TFlops | 1.0 TFlops |
| FP32 | 19.5 TFlops | 44.0 TFlops |
| FP16 | 312.0 TFlops | 148.0 TFlops |
| BF16 | 312.0 TFlops | 148.0 TFlops |
| INT8 | 624.0 TFlops | 296.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
H20
0.11 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.