Side by side datacenter GPU specifications from the Flopper.io database.
| NVIDIA L40S 48GB | NVIDIA GeForce RTX 4090 24GB | |
|---|---|---|
| FP32 TFLOPS | 91.6 | 82.6 |
| VRAM | 48 GB | 24 GB |
| Memory Bandwidth | 864 GB/s | 1.0 TB/s |
| TDP | 350 W | 450 W |
| Precision | NVIDIA L40S 48GB peak TFLOPS (dense) | NVIDIA GeForce RTX 4090 24GB peak TFLOPS (dense) |
|---|---|---|
| INT8 | 733.0 | 330.3 |
| INT4 | 733.0 | — |
| FP8 | 733.0 | 330.3 |
| FP16 | 362.1 | 165.2 |
| BF16 | 362.1 | 165.2 |
| TF32 | 183.0 | 82.6 |
| FP32 | 91.6 | 82.6 |
| FP64 | 1.4 | 1.3 |
| NVIDIA L40S 48GB | NVIDIA GeForce RTX 4090 24GB | |
|---|---|---|
| Architecture | Ada Lovelace | Ada Lovelace |
| Process Node | 4nm | 4nm |
| Launch Year | 2023 | 2022 |
| Form Factor | PCIe | PCIe |
| Memory Type | — | — |
| Interface Width | — | — |
| Interconnect | — | — |
| TDP | 350 W | 450 W |
| FP32 Efficiency | 0.26 TFLOPS/W | 0.18 TFLOPS/W |