NVIDIA A100 vs NVIDIA A40

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA A100 NVIDIA A40
Architecture
Ampere Ampere
Launch Year
2020 2021
Form Factor
PCIe PCIe
VRAM
40 GB48 GB
Memory Bandwidth
1.6 TB/s696 GB/s
TDP
250 W300 W
Process Node
7nm

Performance (TFLOPS)

NVIDIA A100 NVIDIA A40
FP64
9.7 TFlops
FP32
19.5 TFlops 37.4 TFlops
FP16
312.0 TFlops
624.0 TFLOPS sparse
149.7 TFlops
299.4 TFLOPS sparse
BF16
312.0 TFlops
624.0 TFLOPS sparse
149.7 TFlops
299.4 TFLOPS sparse
INT8
624.0 TFlops
1248.0 TOPS sparse
299.3 TFlops
598.6 TOPS sparse

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA A40
0.12 TFLOPS/W

Where to Rent

NVIDIA A40

ProviderInstancePrice/GPU-hrChecked
RunPod
A40 (Community Cloud) $0.35 4h ago View →
RunPod
A40 (Secure Cloud) $0.44 4h ago View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.