Flopper.io GPU Comparison Sheet
NVIDIA GeForce RTX 3090 Ti 24GB vs NVIDIA A40 48GB
Side by side datacenter GPU specifications from the Flopper.io database.
Overview
| NVIDIA GeForce RTX 3090 Ti 24GB | NVIDIA A40 48GB | |
|---|---|---|
| FP32 TFLOPS | 40.0 | 37.4 |
| VRAM | 24 GB | 48 GB |
| Memory Bandwidth | 1.0 TB/s | 696 GB/s |
| TDP | 450 W | 300 W |
Performance by Precision
| Precision | NVIDIA GeForce RTX 3090 Ti 24GB peak TFLOPS (dense) | NVIDIA A40 48GB peak TFLOPS (dense) |
|---|---|---|
| INT8 | 80.0 | 299.3 |
| INT4 | — | 598.7 |
| FP16 | 40.0 | 149.7 |
| BF16 | 40.0 | 149.7 |
| TF32 | 40.0 | 74.8 |
| FP32 | 40.0 | 37.4 |
| FP64 | 0.6 | — |
Specifications
| NVIDIA GeForce RTX 3090 Ti 24GB | NVIDIA A40 48GB | |
|---|---|---|
| Architecture | Ampere | Ampere |
| Process Node | 8nm | — |
| Launch Year | 2022 | 2021 |
| Form Factor | PCIe | PCIe |
| Memory Type | — | GDDR6 |
| Interface Width | — | 384-bit |
| Interconnect | — | — |
| TDP | 450 W | 300 W |
| FP32 Efficiency | 0.09 TFLOPS/W | 0.12 TFLOPS/W |