NVIDIA A100 vs NVIDIA GeForce RTX 3090 Ti
Side-by-side comparison of specifications, performance, and efficiency.
NVIDIA A100
Architecture
Ampere
Year
2020
VRAM
40 GB
TDP
250 W
NVIDIA GeForce RTX 3090 Ti
Architecture
Ampere
Year
2022
VRAM
24 GB
TDP
450 W
Specifications
NVIDIA A100 NVIDIA GeForce RTX 3090 Ti
Architecture
Ampere Ampere
Launch Year
2020 2022
Form Factor
PCIe PCIe
VRAM
40 GB24 GB
Memory Bandwidth
1.6 TB/s1.0 TB/s
TDP
250 W450 W
Process Node
7nm 8nm
| Spec | NVIDIA A100 | NVIDIA GeForce RTX 3090 Ti |
|---|---|---|
| Architecture | Ampere | Ampere |
| Launch Year | 2020 | 2022 |
| Form Factor | PCIe | PCIe |
| VRAM | 40 GB | 24 GB |
| Memory Bandwidth | 1.6 TB/s | 1.0 TB/s |
| TDP | 250 W | 450 W |
| Process Node | 7nm | 8nm |
Performance (TFLOPS)
NVIDIA A100 NVIDIA GeForce RTX 3090 Ti
FP64
9.7 TFlops0.6 TFlops
FP32
19.5 TFlops40.0 TFlops
FP16
312.0 TFlops40.0 TFlops
BF16
312.0 TFlops40.0 TFlops
INT8
624.0 TFlops80.0 TFlops
| Precision | NVIDIA A100 | NVIDIA GeForce RTX 3090 Ti |
|---|---|---|
| FP64 | 9.7 TFlops | 0.6 TFlops |
| FP32 | 19.5 TFlops | 40.0 TFlops |
| FP16 | 312.0 TFlops | 40.0 TFlops |
| BF16 | 312.0 TFlops | 40.0 TFlops |
| INT8 | 624.0 TFlops | 80.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
GeForce RTX 3090 Ti
0.09 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.