NVIDIA H200 vs NVIDIA L40S
Side-by-side comparison of specifications, performance, and efficiency.
NVIDIA H200
OfficialArchitecture
Hopper
Year
2024
VRAM
141 GB
TDP
700 W
NVIDIA L40S
OfficialArchitecture
Ada Lovelace
Year
2023
VRAM
48 GB
TDP
350 W
Specifications
NVIDIA H200 NVIDIA L40S
Architecture
Hopper Ada Lovelace
Launch Year
2024 2023
Form Factor
SXM PCIe
VRAM
141 GB48 GB
Memory Bandwidth
4.8 TB/s864 GB/s
TDP
700 W350 W
Process Node
4nm 4nm
| Spec | NVIDIA H200 | NVIDIA L40S |
|---|---|---|
| Architecture | Hopper | Ada Lovelace |
| Launch Year | 2024 | 2023 |
| Form Factor | SXM | PCIe |
| VRAM | 141 GB | 48 GB |
| Memory Bandwidth | 4.8 TB/s | 864 GB/s |
| TDP | 700 W | 350 W |
| Process Node | 4nm | 4nm |
Performance (TFLOPS)
NVIDIA H200 NVIDIA L40S
FP64
34.0 TFlops1.4 TFlops
FP32
67.0 TFlops91.6 TFlops
FP16
989.5 TFlops733.0 TFlops
BF16
989.5 TFlops733.0 TFlops
FP8
1979.0 TFlops733.0 TFlops
INT8
1979.0 TFlops733.0 TFlops
| Precision | NVIDIA H200 | NVIDIA L40S |
|---|---|---|
| FP64 | 34.0 TFlops | 1.4 TFlops |
| FP32 | 67.0 TFlops | 91.6 TFlops |
| FP16 | 989.5 TFlops | 733.0 TFlops |
| BF16 | 989.5 TFlops | 733.0 TFlops |
| FP8 | 1979.0 TFlops | 733.0 TFlops |
| INT8 | 1979.0 TFlops | 733.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
L40S
0.26 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.