Side by side datacenter GPU specifications from the Flopper.io database.
| NVIDIA RTX A6000 48GB | NVIDIA GeForce RTX 3080 Ti 12GB | |
|---|---|---|
| FP32 TFLOPS | 38.7 | 34.1 |
| VRAM | 48 GB | 12 GB |
| Memory Bandwidth | 768 GB/s | 912 GB/s |
| TDP | 300 W | 350 W |
| Precision | NVIDIA RTX A6000 48GB peak TFLOPS (dense) | NVIDIA GeForce RTX 3080 Ti 12GB peak TFLOPS (dense) |
|---|---|---|
| INT8 | 309.7 | 68.2 |
| INT4 | 619.3 | — |
| FP16 | 154.8 | 34.1 |
| BF16 | 154.8 | 34.1 |
| TF32 | 77.4 | 34.1 |
| FP32 | 38.7 | 34.1 |
| FP64 | 0.6 | 0.5 |
| NVIDIA RTX A6000 48GB | NVIDIA GeForce RTX 3080 Ti 12GB | |
|---|---|---|
| Architecture | Ampere | Ampere |
| Process Node | 8nm | 8nm |
| Launch Year | 2020 | 2021 |
| Form Factor | PCIe | PCIe |
| Memory Type | — | — |
| Interface Width | — | — |
| Interconnect | — | — |
| TDP | 300 W | 350 W |
| FP32 Efficiency | 0.13 TFLOPS/W | 0.10 TFLOPS/W |