NVIDIA A100 vs NVIDIA GeForce RTX 3090 Ti

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA A100 NVIDIA GeForce RTX 3090 Ti
Architecture
Ampere Ampere
Launch Year
2020 2022
Form Factor
PCIe PCIe
VRAM
40 GB24 GB
Memory Bandwidth
1.6 TB/s1.0 TB/s
TDP
250 W450 W
Process Node
7nm 8nm

Performance (TFLOPS)

NVIDIA A100 NVIDIA GeForce RTX 3090 Ti
FP64
9.7 TFlops 0.6 TFlops
FP32
19.5 TFlops 40.0 TFlops
FP16
312.0 TFlops
624.0 TFLOPS sparse
40.0 TFlops
sparse not published
BF16
312.0 TFlops
624.0 TFLOPS sparse
40.0 TFlops
sparse not published
INT8
624.0 TFlops
1248.0 TOPS sparse
80.0 TFlops
sparse not published

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA GeForce RTX 3090 Ti
0.09 TFLOPS/W

Where to Rent

NVIDIA GeForce RTX 3090 Ti

ProviderInstancePrice/GPU-hrChecked
RunPod
RTX 3090 Ti (Community Cloud) $0.27 4h ago View →
RunPod
RTX 3090 Ti (Secure Cloud) $0.46 4h ago View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.