NVIDIA L40 48GB vs NVIDIA RTX 4000 SFF Ada 20GB

The L40 delivers 2.4x the FP8 throughput of the RTX 4000 SFF Ada (362 vs 153 TFLOPS dense). The L40 also carries 28 GB more memory (48 GB vs 20 GB).

L40: Ada Lovelace, 2023 RTX 4000 SFF Ada: Ada Lovelace, 2023

FP8 dense lead

2.4x

L40: 362 vs 153 TFLOPS

Memory

48 vs 20 GB

28 GB more for the L40

Bandwidth

864 GB/s vs 280 GB/s

L40 moves data faster

TDP

300 W vs 70 W

RTX 4000 SFF Ada draws 230 W less

See rental pricing from $0.18/hr Download comparison sheet Printable version →

NVIDIA L40 48GB

Leads on FP8 Full specs →

What is the NVIDIA L40?

The L40 is a GPU from NVIDIA on the Ada Lovelace architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. L40 full specifications →

Can I rent the L40 in the cloud?

Yes. Cloud providers tracked by Flopper rent the L40 by the hour, and the pricing page compares their current rates and the price history side by side. L40 rental prices →

How does the L40 compare with other accelerators?

This page sets the L40 against the RTX 4000 SFF Ada. Both parts launched in the same year. Both are NVIDIA parts, and both ship as a PCIe card, so they fit the same class of system. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the L40 figures come from?

Every L40 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA RTX 4000 SFF Ada 20GB

Full specs →

What is the NVIDIA RTX 4000 SFF Ada?

The RTX 4000 SFF Ada is a GPU from NVIDIA on the Ada Lovelace architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. RTX 4000 SFF Ada full specifications →

Can I rent the RTX 4000 SFF Ada in the cloud?

Yes. Cloud providers tracked by Flopper rent the RTX 4000 SFF Ada by the hour, and the pricing page compares their current rates and the price history side by side. RTX 4000 SFF Ada rental prices →

How does the RTX 4000 SFF Ada compare with other accelerators?

This page sets the RTX 4000 SFF Ada against the L40. Both parts launched in the same year. Both are NVIDIA parts, and both ship as a PCIe card, so they fit the same class of system. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the RTX 4000 SFF Ada figures come from?

Every RTX 4000 SFF Ada figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

L40

RTX 4000 SFF Ada

Architecture

Ada LovelaceAda Lovelace

Launch Year

20232023

Form Factor

PCIePCIe

Memory

48 GB20 GB

Memory Bandwidth

864 GB/s280 GB/s

TDP

300 W70 W

Process Node

4nm4nm

Spec

L40

RTX 4000 SFF Ada

Architecture Ada LovelaceAda Lovelace

Launch Year 20232023

Form Factor PCIePCIe

Memory 48 GB20 GB

Memory Bandwidth 864 GB/s280 GB/s

TDP 300 W70 W

Process Node 4nm4nm

Performance (TFLOPS)

L40

RTX 4000 SFF Ada

0.3 TFLOPS

91 TFLOPS 19 TFLOPS

91 TFLOPS

181 TFLOPS sparse

181 TFLOPS

362 TFLOPS sparse

181 TFLOPS

362 TFLOPS sparse

362 TFLOPS

724 TFLOPS sparse

153 TFLOPS

307 TFLOPS sparse

FP6

362 TOPS

724 TOPS sparse

Precision

L40

RTX 4000 SFF Ada

0.3 TFLOPS

91 TFLOPS 19 TFLOPS

91 TFLOPS

181 TFLOPS sparse

181 TFLOPS

362 TFLOPS sparse

181 TFLOPS

362 TFLOPS sparse

362 TFLOPS

724 TFLOPS sparse

153 TFLOPS

307 TFLOPS sparse

FP6

362 TOPS

724 TOPS sparse

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

Both launched in 2023, the L40 on Ada Lovelace and the RTX 4000 SFF Ada on Ada Lovelace.

The L40 carries 28 GB more memory (48 GB against 20 GB), so larger models fit on one GPU before you shard. Bandwidth is 864 GB/s against 280 GB/s, which sets the ceiling on decode speed.

Power is 300 W against 70 W, and at FP32 the L40 does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, FP8, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the L40 faster than the RTX 4000 SFF Ada?

At FP8 precision the L40 reaches 362 TFLOPS dense against 153 TFLOPS for the RTX 4000 SFF Ada. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the L40 or the RTX 4000 SFF Ada?

Choose the L40 for training and high-throughput inference: it has 2.4x the FP8 throughput of the RTX 4000 SFF Ada. It also carries 28 GB more memory, so larger models fit on one GPU before you shard. The L40 draws 230 W more power, so budget for cooling and power delivery before you commit.

Which has more memory, the L40 or the RTX 4000 SFF Ada?

The L40 carries 48 GB of memory versus 20 GB for the RTX 4000 SFF Ada. Memory bandwidth is 864 GB/s for the L40 and 280 GB/s for the RTX 4000 SFF Ada.

How much power do the L40 and the RTX 4000 SFF Ada draw?

The L40 is rated at 300 W TDP and the RTX 4000 SFF Ada at 70 W. On FP32 throughput per watt, the L40 is the more efficient part.

How much do the L40 and the RTX 4000 SFF Ada cost to rent?

Live cloud listings tracked by Flopper price the L40 from $0.46 per GPU-hour across 8 providers, and the RTX 4000 SFF Ada from $0.18 per GPU-hour across 2 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA L40 48GB

Rent from

$0.46 / GPU-hr

Lowest of 16 live listings across 8 providers · median $0.88

See all L40 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA RTX 4000 SFF Ada 20GB

Rent from

$0.18 / GPU-hr

Lowest of 3 live listings across 2 providers

See all RTX 4000 SFF Ada rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → L40 full specs RTX 4000 SFF Ada full specs Estimate cluster cost in the calculator →

NVIDIA L40 48GB vs NVIDIA RTX 4000 SFF Ada 20GB

NVIDIA L40 48GB

What is the NVIDIA L40?

Can I rent the L40 in the cloud?

How does the L40 compare with other accelerators?

Where do the L40 figures come from?

NVIDIA RTX 4000 SFF Ada 20GB

What is the NVIDIA RTX 4000 SFF Ada?

Can I rent the RTX 4000 SFF Ada in the cloud?

How does the RTX 4000 SFF Ada compare with other accelerators?

Where do the RTX 4000 SFF Ada figures come from?

Specifications

Performance (TFLOPS)

FLOPS by Precision

What actually differs

Frequently asked questions

Is the L40 faster than the RTX 4000 SFF Ada?

Which should you choose, the L40 or the RTX 4000 SFF Ada?

Which has more memory, the L40 or the RTX 4000 SFF Ada?

How much power do the L40 and the RTX 4000 SFF Ada draw?

How much do the L40 and the RTX 4000 SFF Ada cost to rent?

Where to Rent

NVIDIA L40 48GB

NVIDIA RTX 4000 SFF Ada 20GB

Get Comparison Updates

Stay Updated on GPU Specs