NVIDIA A100 vs NVIDIA A40
Side-by-side comparison of specifications, performance, and efficiency.
NVIDIA A100
Architecture
Ampere
Year
2020
VRAM
80 GB
TDP
400 W
NVIDIA A40
Architecture
Ampere
Year
2021
VRAM
48 GB
TDP
300 W
Specifications
NVIDIA A100 NVIDIA A40
Architecture
Ampere Ampere
Launch Year
2020 2021
Form Factor
SXM PCIe
VRAM
80 GB48 GB
Memory Bandwidth
2.0 TB/s696 GB/s
TDP
400 W300 W
Process Node
7nm —
| Spec | NVIDIA A100 | NVIDIA A40 |
|---|---|---|
| Architecture | Ampere | Ampere |
| Launch Year | 2020 | 2021 |
| Form Factor | SXM | PCIe |
| VRAM | 80 GB | 48 GB |
| Memory Bandwidth | 2.0 TB/s | 696 GB/s |
| TDP | 400 W | 300 W |
| Process Node | 7nm | — |
Performance (TFLOPS)
NVIDIA A100 NVIDIA A40
FP64
9.7 TFlops—
FP32
19.5 TFlops37.4 TFlops
FP16
312.0 TFlops149.7 TFlops
BF16
312.0 TFlops149.7 TFlops
INT8
624.0 TFlops299.3 TFlops
| Precision | NVIDIA A100 | NVIDIA A40 |
|---|---|---|
| FP64 | 9.7 TFlops | — |
| FP32 | 19.5 TFlops | 37.4 TFlops |
| FP16 | 312.0 TFlops | 149.7 TFlops |
| BF16 | 312.0 TFlops | 149.7 TFlops |
| INT8 | 624.0 TFlops | 299.3 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
A40
0.12 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.