NVIDIA GeForce RTX 4090 vs NVIDIA L40

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA GeForce RTX 4090 NVIDIA L40
Architecture
Ada Lovelace Ada Lovelace
Launch Year
2022 2023
Form Factor
PCIe PCIe
VRAM
24 GB48 GB
Memory Bandwidth
1.0 TB/s864 GB/s
TDP
450 W300 W
Process Node
4nm 4nm

Performance (TFLOPS)

NVIDIA GeForce RTX 4090 NVIDIA L40
FP64
1.3 TFlops
FP32
82.6 TFlops 90.5 TFlops
FP16
165.2 TFlops
sparse not published
181.1 TFlops
362.1 TFLOPS sparse
BF16
165.2 TFlops
sparse not published
181.1 TFlops
362.1 TFLOPS sparse
FP8
330.3 TFlops
sparse not published
362.0 TFlops
724.0 TFLOPS sparse
INT8
330.3 TFlops
sparse not published
362.0 TFlops
724.0 TOPS sparse

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA L40
0.30 TFLOPS/W

Where to Rent

NVIDIA GeForce RTX 4090

ProviderInstancePrice/GPU-hrChecked
Vast.ai
$0.13 3h ago View →
RunPod
RTX 4090 (Community Cloud) $0.34 3h ago View →
Excess Supply
auto-rtx4090-8x-nvidia-geforce-rtx-us-central-1-6db4066c7c $0.40 3h ago View →
BoostRun
RTX4090x8 $0.49 3h ago View →
RunPod
RTX 4090 (Secure Cloud) $0.74 3h ago View →

NVIDIA L40

ProviderInstancePrice/GPU-hrChecked
RunPod
L40 (Community Cloud) $0.69 3h ago View →
RunPod
L40 (Secure Cloud) $0.82 3h ago View →
Massed Compute
gpu_1x_l40 $0.88 3h ago View →
Hyperstack
n3-L40x1 $1.00 3h ago View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.