Side by side datacenter GPU specifications from the Flopper.io database.
| NVIDIA A10 24GB | NVIDIA GeForce RTX 3090 24GB | |
|---|---|---|
| FP32 TFLOPS | 31.2 | 35.6 |
| VRAM | 24 GB | 24 GB |
| Memory Bandwidth | 600 GB/s | 936 GB/s |
| TDP | 150 W | 350 W |
| Precision | NVIDIA A10 24GB peak TFLOPS (dense) | NVIDIA GeForce RTX 3090 24GB peak TFLOPS (dense) |
|---|---|---|
| INT8 | 250.0 | 284.0 |
| INT4 | 500.0 | 568.0 |
| FP16 | 125.0 | 71.0 |
| BF16 | 125.0 | 71.0 |
| TF32 | 62.5 | 35.6 |
| FP32 | 31.2 | 35.6 |
| FP64 | — | 0.6 |
| NVIDIA A10 24GB | NVIDIA GeForce RTX 3090 24GB | |
|---|---|---|
| Architecture | Ampere | Ampere |
| Process Node | — | 8nm |
| Launch Year | 2021 | 2020 |
| Form Factor | PCIe | PCIe |
| Memory Type | GDDR6 | — |
| Interface Width | 192-bit | — |
| Interconnect | — | — |
| TDP | 150 W | 350 W |
| FP32 Efficiency | 0.21 TFLOPS/W | 0.10 TFLOPS/W |