NVIDIA GeForce RTX 3090 Ti vs NVIDIA A40

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA GeForce RTX 3090 Ti NVIDIA A40
Architecture
Ampere Ampere
Launch Year
2022 2021
Form Factor
PCIe PCIe
VRAM
24 GB48 GB
Memory Bandwidth
1.0 TB/s696 GB/s
TDP
450 W300 W
Process Node
8nm

Performance (TFLOPS)

NVIDIA GeForce RTX 3090 Ti NVIDIA A40
FP64
0.6 TFlops
FP32
40.0 TFlops 37.4 TFlops
FP16
40.0 TFlops
sparse not published
149.7 TFlops
299.4 TFLOPS sparse
BF16
40.0 TFlops
sparse not published
149.7 TFlops
299.4 TFLOPS sparse
INT8
80.0 TFlops
sparse not published
299.3 TFlops
598.6 TOPS sparse

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA A40
0.12 TFLOPS/W

Where to Rent

NVIDIA GeForce RTX 3090 Ti

ProviderInstancePrice/GPU-hrChecked
RunPod
RTX 3090 Ti (Community Cloud) $0.27 4h ago View →
RunPod
RTX 3090 Ti (Secure Cloud) $0.46 4h ago View →

NVIDIA A40

ProviderInstancePrice/GPU-hrChecked
RunPod
A40 (Community Cloud) $0.35 4h ago View →
RunPod
A40 (Secure Cloud) $0.44 4h ago View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.