NVIDIA L40S 48GB

Ada Lovelace PCIe 2023 4nm Spec confidence: Official
FP8 (dense)
733
TFLOPS
FP32
92
TFLOPS
VRAM
48 GB
Bandwidth
864 GB/s
memory
TDP
350 W
261.7 TFLOPS/kW

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
733 TOPS
1,466 with sparsity
INT4
4-bit integer
733 TOPS
1,466 with sparsity
FP8
8-bit floating point
733 TFLOPS
1,466 with sparsity
FP16
16-bit floating point
362 TFLOPS
733 with sparsity
BF16
Brain Float 16
362 TFLOPS
733 with sparsity
TF32
TensorFloat-32
183 TFLOPS
366 with sparsity
FP32
32-bit floating point
92 TFLOPS
FP64
64-bit floating point
1.4 TFLOPS
Dense Added with sparsity
2.094 TFLOPS/W FP8 at 350 W
1.034 TFLOPS/W FP16 at 350 W
0.262 TFLOPS/W FP32 at 350 W

The L40S 48GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XL40S 48GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Ada Lovelace

Form Factor

PCIe

Launch Year

2023

Process Node

4nm

Memory

48 GB

Bandwidth

864 GB/s

TDP

350 W

Max Power

~402 W

Spec Confidence

Official

Full Specifications

Memory
VRAM 48 GB
Bandwidth 864 GB/s
Power & Thermal
TDP 350 W
Enterprise Features
Sparsity Yes
General
Form Factor PCIe
Architecture Ada Lovelace
Launch Year 2023

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
NVIDIA
Published
2023-08-08

Data Quality

Spec confidence
Official
Clock basis
Boost
Precisions tracked
8
Normalization
All values in TFLOPS

Rent this GPU

$0.69 / GPU-hr

Lowest of 14 live listings across 10 providers· median $1.18

See all rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Similar GPUs

NVIDIA L40 48GB

PCIe · 2023
FP32: 91 TFLOPS
Compare vs L40

NVIDIA L20 48GB

PCIe · 2024
FP32: 60 TFLOPS
Compare vs L20

Systems Using This GPU

Pre-configured systems featuring the NVIDIA L40S

SystemGPU CountPeak PerformanceTotal Power
Wiwynn ES200G2
ES · rack ·
2x L40S -- -- View System

Frequently Asked Questions

How many TFLOPS does the NVIDIA L40S have?

The NVIDIA L40S delivers 91.6 TFLOPS for FP32 operations, 362.05 TFLOPS for FP16, and 733 TFLOPS for FP8 precision.

What is the power consumption of the NVIDIA L40S?

The NVIDIA L40S has a TDP (Thermal Design Power) rating of 350 watts.

How much memory does the NVIDIA L40S have?

The NVIDIA L40S is equipped with 48 GB of VRAM with 864 GB/s memory bandwidth.

What architecture is the NVIDIA L40S based on?

The NVIDIA L40S is based on the Ada Lovelace architecture, launched in 2023.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs