NVIDIA L40 48GB

Ada Lovelace PCIe 2023 4nm
FP32
90.5
TFLOPS
VRAM
48 GB
GDDR6
TDP
300 W
301.7 TFLOPS/kW
Bandwidth
864 GB/s
memory
View Providers

Performance Metrics

Peak theoretical throughput by precision type

PrecisionBitsPeak TFLOPSEfficiency
INT8 8 362.0 1.207 TFLOPS/W
INT4 4 724.0 2.413 TFLOPS/W
FP8 8 362.0 1.207 TFLOPS/W
FP16 16 181.1 0.604 TFLOPS/W
BF16 16 181.1 0.604 TFLOPS/W
TF32 32 90.5 0.302 TFLOPS/W
FP32 32 90.5 0.302 TFLOPS/W
FP8 Efficiency
1.207 TFLOPS/W
362.0 TFLOPS / 300W
FP16 Efficiency
0.604 TFLOPS/W
181.1 TFLOPS / 300W
FP32 Efficiency
0.302 TFLOPS/W
90.5 TFLOPS / 300W

Power Specifications

TDP

300 W

Max Power

345 W

Power Connector

PCIe 8-pin

Cooling

Air

Memory Specifications

Capacity

48 GB

Type

GDDR6

Bandwidth

864 GB/s

Interface

--

Hardware & Design

Form Factor

PCIe

Architecture

Ada Lovelace

Process Node

4nm

Launch Year

2023

Variant

48GB

Market Segment

Data Center

Common Use Cases

AI Inference Video Processing Edge Computing Computer Vision

The NVIDIA L40 is optimized for high-performance computing tasks with Ada Lovelace architecture delivering 90.5 TFLOPS of compute power.

Where to Rent

ProviderInstancePrice/hr
RunPod
L40 $0.69 View →

Prices shown are approximate. Click through for current pricing.

Similar GPUs

NVIDIA L40S 48GB

PCIe · 2023
FP32: 91.6 TFLOPS
Compare vs L40S

NVIDIA RTX 6000 Ada 48GB

PCIe · 2023
FP32: 91.1 TFLOPS
Compare vs RTX 6000 Ada

NVIDIA RTX 5000 Ada 32GB

PCIe · 2023
FP32: 65.3 TFLOPS
Compare vs RTX 5000 Ada

NVIDIA L20 48GB

PCIe · 2024
FP32: 59.8 TFLOPS
Compare vs L20

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs