Side by side datacenter GPU specifications from the Flopper.io database.
| NVIDIA GeForce RTX 4080 16GB | NVIDIA L40 48GB | |
|---|---|---|
| FP32 TFLOPS | 48.7 | 90.5 |
| VRAM | 16 GB | 48 GB |
| Memory Bandwidth | 717 GB/s | 864 GB/s |
| TDP | 320 W | 300 W |
| Precision | NVIDIA GeForce RTX 4080 16GB peak TFLOPS (dense) | NVIDIA L40 48GB peak TFLOPS (dense) |
|---|---|---|
| INT8 | 195.0 | 362.0 |
| INT4 | — | 724.0 |
| FP8 | 195.0 | 362.0 |
| FP16 | 97.5 | 181.1 |
| BF16 | 97.5 | 181.1 |
| TF32 | 48.7 | 90.5 |
| FP32 | 48.7 | 90.5 |
| FP64 | 0.7 | — |
| NVIDIA GeForce RTX 4080 16GB | NVIDIA L40 48GB | |
|---|---|---|
| Architecture | Ada Lovelace | Ada Lovelace |
| Process Node | 4nm | 4nm |
| Launch Year | 2022 | 2023 |
| Form Factor | PCIe | PCIe |
| Memory Type | — | GDDR6 |
| Interface Width | — | — |
| Interconnect | — | — |
| TDP | 320 W | 300 W |
| FP32 Efficiency | 0.15 TFLOPS/W | 0.30 TFLOPS/W |