Side by side datacenter GPU specifications from the Flopper.io database.
| NVIDIA RTX A4000 16GB | NVIDIA A100 PCIe 40GB | |
|---|---|---|
| FP32 TFLOPS | 19.2 | 19.5 |
| Memory | 16 GB | 40 GB |
| Memory Bandwidth | 448 GB/s | 1.6 TB/s |
| TDP | 140 W | 250 W |
| Precision | NVIDIA RTX A4000 16GB peak TFLOPS (dense) | NVIDIA A100 PCIe 40GB peak TFLOPS (dense) |
|---|---|---|
| FP64 | 0.3 | 9.7 |
| FP32 | 19.2 | 19.5 |
| TF32 | 19.2 | 156.0 |
| BF16 | 19.2 | 312.0 |
| FP16 | 19.2 | 312.0 |
| FP8 | — | — |
| FP6 | — | — |
| FP4 | — | — |
| INT8 | 38.3 | 624.0 |
| INT4 | — | 1248.0 |
| NVIDIA RTX A4000 16GB | NVIDIA A100 PCIe 40GB | |
|---|---|---|
| Architecture | Ampere | Ampere |
| Process Node | 8nm | 7nm |
| Launch Year | 2021 | 2020 |
| Form Factor | PCIe | PCIe |
| Memory Type | GDDR6 | — |
| Interface Width | 256-bit | — |
| Interconnect | — | — |
| TDP | 140 W | 250 W |
| FP32 Efficiency | 0.14 TFLOPS/W | 0.08 TFLOPS/W |