- Home
- Compare GPUs
- NVIDIA A100 vs NVIDIA A40
NVIDIA A100 vs NVIDIA A40
Side-by-side comparison of specifications, performance, and efficiency.
NVIDIA A100
Architecture
Ampere
Year
2020
VRAM
40 GB
TDP
250 W
NVIDIA A40
Architecture
Ampere
Year
2021
VRAM
48 GB
TDP
300 W
Specifications
NVIDIA A100 NVIDIA A40
Architecture
Ampere Ampere
Launch Year
2020 2021
Form Factor
PCIe PCIe
VRAM
40 GB48 GB
Memory Bandwidth
1.6 TB/s696 GB/s
TDP
250 W300 W
Process Node
7nm —
| Spec | NVIDIA A100 | NVIDIA A40 |
|---|---|---|
| Architecture | Ampere | Ampere |
| Launch Year | 2020 | 2021 |
| Form Factor | PCIe | PCIe |
| VRAM | 40 GB | 48 GB |
| Memory Bandwidth | 1.6 TB/s | 696 GB/s |
| TDP | 250 W | 300 W |
| Process Node | 7nm | — |
Performance (TFLOPS)
NVIDIA A100 NVIDIA A40
FP64
9.7 TFlops —
FP32
19.5 TFlops 37.4 TFlops
FP16
312.0 TFlops
624.0
TFLOPS sparse
149.7 TFlops 299.4
TFLOPS sparse
BF16
312.0 TFlops
624.0
TFLOPS sparse
149.7 TFlops 299.4
TFLOPS sparse
INT8
624.0 TFlops
1248.0
TOPS sparse
299.3 TFlops 598.6
TOPS sparse
| Precision | NVIDIA A100 | NVIDIA A40 |
|---|---|---|
| FP64 | 9.7 TFlops | — |
| FP32 | 19.5 TFlops | 37.4 TFlops |
| FP16 | 312.0 TFlops 624.0
TFLOPS sparse | 149.7 TFlops 299.4
TFLOPS sparse |
| BF16 | 312.0 TFlops 624.0
TFLOPS sparse | 149.7 TFlops 299.4
TFLOPS sparse |
| INT8 | 624.0 TFlops 1248.0
TOPS sparse | 299.3 TFlops 598.6
TOPS sparse |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
A40
0.12 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.