Side by side datacenter GPU specifications from the Flopper.io database.
| NVIDIA GeForce RTX 3060 Ti 8GB | NVIDIA A10G 24GB | |
|---|---|---|
| FP32 TFLOPS | 16.2 | 35.0 |
| VRAM | 8 GB | 24 GB |
| Memory Bandwidth | — | 600 GB/s |
| TDP | 200 W | 300 W |
| Precision | NVIDIA GeForce RTX 3060 Ti 8GB peak TFLOPS (dense) | NVIDIA A10G 24GB peak TFLOPS (dense) |
|---|---|---|
| FP64 | 0.3 | — |
| FP32 | 16.2 | 35.0 |
| TF32 | 16.2 | 35.0 |
| BF16 | 32.4 | 70.0 |
| FP16 | 32.4 | 70.0 |
| FP8 | — | — |
| FP6 | — | — |
| FP4 | — | — |
| INT8 | 129.6 | 140.0 |
| INT4 | 259.1 | 280.0 |
| NVIDIA GeForce RTX 3060 Ti 8GB | NVIDIA A10G 24GB | |
|---|---|---|
| Architecture | Ampere | Ampere |
| Process Node | 8nm | 8nm |
| Launch Year | 2020 | 2022 |
| Form Factor | PCIe | PCIe |
| Memory Type | GDDR6 | GDDR6 |
| Interface Width | 256-bit | — |
| Interconnect | — | — |
| TDP | 200 W | 300 W |
| FP32 Efficiency | 0.08 TFLOPS/W | 0.12 TFLOPS/W |