NVIDIA A100 vs NVIDIA GeForce RTX 3090

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA A100 NVIDIA GeForce RTX 3090
Architecture
Ampere Ampere
Launch Year
2020 2020
Form Factor
PCIe PCIe
VRAM
40 GB24 GB
Memory Bandwidth
1.6 TB/s936 GB/s
TDP
250 W350 W
Process Node
7nm 8nm

Performance (TFLOPS)

NVIDIA A100 NVIDIA GeForce RTX 3090
FP64
9.7 TFlops 0.6 TFlops
FP32
19.5 TFlops 35.6 TFlops
FP16
312.0 TFlops
624.0 TFLOPS sparse
71.0 TFlops
142.0 TFLOPS sparse
BF16
312.0 TFlops
624.0 TFLOPS sparse
71.0 TFlops
142.0 TFLOPS sparse
INT8
624.0 TFlops
1248.0 TOPS sparse
284.0 TFlops
568.0 TOPS sparse

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA GeForce RTX 3090
0.10 TFLOPS/W

Where to Rent

NVIDIA GeForce RTX 3090

ProviderInstancePrice/GPU-hrChecked
RunPod
RTX 3090 (Community Cloud) $0.22 4h ago View →
RunPod
RTX 3090 (Secure Cloud) $0.50 4h ago View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.