Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA GeForce RTX 4090 24GB vs NVIDIA L40 48GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA GeForce RTX 4090 24GBNVIDIA L40 48GB
FP32 TFLOPS82.690.5
Memory24 GB48 GB
Memory Bandwidth1.0 TB/s864 GB/s
TDP450 W300 W

Performance by Precision

PrecisionNVIDIA GeForce RTX 4090 24GB peak TFLOPS (dense)NVIDIA L40 48GB peak TFLOPS (dense)
FP64 1.3—
FP32 82.690.5
TF32 82.690.5
BF16 165.2181.1
FP16 165.2181.1
FP8 330.3362.0
FP6 ——
FP4 ——
INT8 660.6362.0
INT4 —724.0

Specifications

NVIDIA GeForce RTX 4090 24GBNVIDIA L40 48GB
ArchitectureAda LovelaceAda Lovelace
Process Node4nm4nm
Launch Year20222023
Form FactorPCIePCIe
Memory Type—GDDR6
Interface Width——
Interconnect——
TDP450 W300 W
FP32 Efficiency0.18 TFLOPS/W0.30 TFLOPS/W