NVIDIA GeForce RTX 4090 24GB

Ada Lovelace PCIe 2022 4nm

Overview

82.6

FP32 TFLOPS

24 GB

Memory

1.0 TB/s

Memory Bandwidth

450 W

TDP

Performance Metrics

Precision	Peak (dense)	2:4 Sparse	Bits	Type
FP64	1.3	N/A	64	Standard
FP32	82.6	N/A	32	Standard
TF32	82.6	not published	32	Standard
BF16	165.2	not published	16	Standard
FP16	165.2	not published	16	Standard
FP8	330.3	not published	8	Standard
FP6	—	not published	—	Standard
FP4	—	not published	—	Standard
INT8	660.6	1321.2	8	Standard

Memory Specifications

Capacity: 24 GB
Type: —
Bandwidth: 1.0 TB/s
Interface Width: —

Power & Efficiency

TDP: 450 W
Max power (Flopper estimate): ~518 W est.
FP32 dense TFLOPS per W of TDP: 0.18 TFLOPS/W
FP16 dense TFLOPS per W of TDP: 0.37 TFLOPS/W

Flopper estimate: 450 W TDP x 1.15. The vendor publishes no maximum board power for this part. Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: NVIDIA

Architecture: Ada Lovelace

Process Node: 4nm

Form Factor: PCIe

Launch Year: 2022

Variant: 24GB

Enterprise Features

Sparsity: Yes