NVIDIA GeForce RTX 4090 vs NVIDIA L40S

Side-by-side comparison of specifications, performance, and efficiency.

Specifications

NVIDIA GeForce RTX 4090 NVIDIA L40S
Architecture
Ada Lovelace Ada Lovelace
Launch Year
2022 2023
Form Factor
PCIe PCIe
VRAM
24 GB48 GB
Memory Bandwidth
1.0 TB/s864 GB/s
TDP
450 W350 W
Process Node
4nm 4nm

Performance (TFLOPS)

NVIDIA GeForce RTX 4090 NVIDIA L40S
FP64
1.3 TFlops 1.4 TFlops
FP32
82.6 TFlops 91.6 TFlops
FP16
165.2 TFlops
sparse not published
362.1 TFlops
733.0 TFLOPS sparse
BF16
165.2 TFlops
sparse not published
362.1 TFlops
733.0 TFLOPS sparse
FP8
330.3 TFlops
sparse not published
733.0 TFlops
1466.0 TFLOPS sparse
INT8
330.3 TFlops
sparse not published
733.0 TFlops
1466.0 TOPS sparse

FLOPS by Precision

Efficiency — TDP vs FP32 Performance

Analysis

Most Efficient
NVIDIA L40S
0.26 TFLOPS/W

Where to Rent

NVIDIA GeForce RTX 4090

ProviderInstancePrice/GPU-hrChecked
Vast.ai
$0.13 3h ago View →
RunPod
RTX 4090 (Community Cloud) $0.34 3h ago View →
Excess Supply
auto-rtx4090-8x-nvidia-geforce-rtx-us-central-1-6db4066c7c $0.40 3h ago View →
BoostRun
RTX4090x8 $0.49 3h ago View →
RunPod
RTX 4090 (Secure Cloud) $0.74 3h ago View →

NVIDIA L40S

ProviderInstancePrice/GPU-hrChecked
DataCrunch
1L40S.20V (spot) $0.69 3h ago View →
RunPod
L40S (Community Cloud) $0.79 3h ago View →
Cudo Compute
epyc-genoa-l40s-graphics $0.87 3h ago View →
Massed Compute
gpu_1x_l40s $0.88 3h ago View →
RunPod
L40S (Secure Cloud) $0.99 3h ago View →
DataCrunch
1L40S.20V (on-demand) $1.37 3h ago View →
Crusoe
l40s-48gb.2x $1.45 3h ago View →
Vultr
vcg-l40s-16c-180g-48vram $1.67 3h ago View →
OVHcloud
l40s-360 $1.80 3h ago View →

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.