NVIDIA H100 vs NVIDIA L4
Side-by-side comparison of specifications, performance, and efficiency.
NVIDIA H100
Architecture
Hopper
Year
2022
VRAM
80 GB
TDP
350 W
NVIDIA L4
Architecture
Ada Lovelace
Year
2023
VRAM
24 GB
TDP
72 W
Specifications
NVIDIA H100 NVIDIA L4
Architecture
Hopper Ada Lovelace
Launch Year
2022 2023
Form Factor
PCIe PCIe
VRAM
80 GB24 GB
Memory Bandwidth
2.0 TB/s300 GB/s
TDP
350 W72 W
Process Node
4nm 4nm
| Spec | NVIDIA H100 | NVIDIA L4 |
|---|---|---|
| Architecture | Hopper | Ada Lovelace |
| Launch Year | 2022 | 2023 |
| Form Factor | PCIe | PCIe |
| VRAM | 80 GB | 24 GB |
| Memory Bandwidth | 2.0 TB/s | 300 GB/s |
| TDP | 350 W | 72 W |
| Process Node | 4nm | 4nm |
Performance (TFLOPS)
NVIDIA H100 NVIDIA L4
FP64
26.0 TFlops0.4 TFlops
FP32
51.0 TFlops30.3 TFlops
FP16
756.5 TFlops242.0 TFlops
BF16
756.5 TFlops242.0 TFlops
FP8
1513.0 TFlops485.0 TFlops
INT8
1513.0 TFlops485.0 TFlops
| Precision | NVIDIA H100 | NVIDIA L4 |
|---|---|---|
| FP64 | 26.0 TFlops | 0.4 TFlops |
| FP32 | 51.0 TFlops | 30.3 TFlops |
| FP16 | 756.5 TFlops | 242.0 TFlops |
| BF16 | 756.5 TFlops | 242.0 TFlops |
| FP8 | 1513.0 TFlops | 485.0 TFlops |
| INT8 | 1513.0 TFlops | 485.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
L4
0.42 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.