Flopper.io Flopper.io

NVIDIA GeForce RTX 4090 24GB vs NVIDIA L40 48GB

The L40 delivers 10% more FP8 throughput than the GeForce RTX 4090 (362 vs 330 TFLOPS dense). The L40 also carries 24 GB more memory (48 GB vs 24 GB).

GeForce RTX 4090: Ada Lovelace, 2022 L40: Ada Lovelace, 2023
FP8 dense lead
+10%
L40: 362 vs 330 TFLOPS
Memory
24 vs 48 GB
24 GB more for the L40
Bandwidth
1.0 TB/s vs 864 GB/s
GeForce RTX 4090 moves data faster
TDP
450 W vs 300 W
L40 draws 150 W less
See rental pricing from $0.30/hr Download comparison sheet

Share this page

NVIDIA GeForce RTX 4090 24GB vs NVIDIA L40 48GB

A post with this link shows the card on the Image tab as its preview.

Post on X Share on LinkedIn
 Printable version →

NVIDIA GeForce RTX 4090 24GB

Full specs →

What is the NVIDIA GeForce RTX 4090?

The GeForce RTX 4090 is a GPU from NVIDIA on the Ada Lovelace architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. GeForce RTX 4090 full specifications →

Can I rent the GeForce RTX 4090 in the cloud?

Yes. Cloud providers tracked by Flopper rent the GeForce RTX 4090 by the hour, and the pricing page compares their current rates and the price history side by side. GeForce RTX 4090 rental prices →

How does the GeForce RTX 4090 compare with other accelerators?

This page sets the GeForce RTX 4090 against the L40. The GeForce RTX 4090 is the older generation of the two. Both are NVIDIA parts, and both ship as a PCIe card, so they fit the same class of system. Flopper also compares it head to head with the Wormhole n150s, across every published precision, memory and power. GeForce RTX 4090 vs Wormhole n150s →

Where do the GeForce RTX 4090 figures come from?

NVIDIA published the GeForce RTX 4090 figures in marketing material rather than a datasheet, and Flopper has no independent confirmation of them. How Flopper verifies specifications →

NVIDIA L40 48GB

Leads on FP8 Full specs →

What is the NVIDIA L40?

The L40 is a GPU from NVIDIA on the Ada Lovelace architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. L40 full specifications →

Can I rent the L40 in the cloud?

Yes. Cloud providers tracked by Flopper rent the L40 by the hour, and the pricing page compares their current rates and the price history side by side. L40 rental prices →

How does the L40 compare with other accelerators?

This page sets the L40 against the GeForce RTX 4090. The L40 is the newer generation of the two. Both are NVIDIA parts, and both ship as a PCIe card, so they fit the same class of system. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the L40 figures come from?

Every L40 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

GeForce RTX 4090
L40
Architecture
Ada LovelaceAda Lovelace
Launch Year
20222023
Form Factor
PCIePCIe
Memory
24 GB48 GB
Memory Bandwidth
1.0 TB/s864 GB/s
TDP
450 W300 W
Process Node
4nm4nm

Performance (TFLOPS)

GeForce RTX 4090
L40
1.3 TFLOPS No verified data available
83 TFLOPS 91 TFLOPS
83 TFLOPS
sparse not published
91 TFLOPS
181 TFLOPS sparse
165 TFLOPS
sparse not published
181 TFLOPS
362 TFLOPS sparse
165 TFLOPS
sparse not published
181 TFLOPS
362 TFLOPS sparse
330 TFLOPS
sparse not published
362 TFLOPS
724 TFLOPS sparse
FP6
No verified data available No verified data available
No verified data available No verified data available
661 TOPS
1,321 TOPS sparse
362 TOPS
724 TOPS sparse

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

The L40 is the newer part: Ada Lovelace (2023) against the GeForce RTX 4090's Ada Lovelace (2022).

The L40 carries 24 GB more memory (48 GB against 24 GB), so larger models fit on one GPU before you shard. Bandwidth is 1.0 TB/s against 864 GB/s, which sets the ceiling on decode speed.

Power is 450 W against 300 W, and at FP32 the L40 does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, FP8, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the GeForce RTX 4090 faster than the L40?

At FP8 precision the L40 reaches 362 TFLOPS dense against 330 TFLOPS for the GeForce RTX 4090. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the GeForce RTX 4090 or the L40?

Choose the L40 for training and high-throughput inference: it has 10% more FP8 throughput than the GeForce RTX 4090. It also carries 24 GB more memory, so larger models fit on one GPU before you shard. The L40 draws 150 W less power, which matters in an air-cooled or power-capped rack.

Which has more memory, the GeForce RTX 4090 or the L40?

The L40 carries 48 GB of memory versus 24 GB for the GeForce RTX 4090. Memory bandwidth is 1.0 TB/s for the GeForce RTX 4090 and 864 GB/s for the L40.

How much power do the GeForce RTX 4090 and the L40 draw?

The GeForce RTX 4090 is rated at 450 W TDP and the L40 at 300 W. On FP32 throughput per watt, the L40 is the more efficient part.

How much do the GeForce RTX 4090 and the L40 cost to rent?

Live cloud listings tracked by Flopper price the GeForce RTX 4090 from $0.30 per GPU-hour across 9 providers, and the L40 from $0.69 per GPU-hour across 8 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA GeForce RTX 4090 24GB

Rent from

$0.30 / GPU-hr

Lowest of 16 live listings across 9 providers · median $0.89

See all GeForce RTX 4090 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA L40 48GB

Rent from

$0.69 / GPU-hr

Lowest of 16 live listings across 8 providers · median $0.94

See all L40 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → GeForce RTX 4090 full specs L40 full specs Estimate cluster cost in the calculator →

© 2026 Flopper.io - Compare the GPUs Powering AI