The figures on this entry are not sourced to a document published by the chip vendor. The reference recorded against it is third-party, so the entry is marked vendor claimed rather than official until a vendor specification can be attached.

NVIDIA GeForce RTX 4090 24GB

Ada Lovelace PCIe 2022 4nm Spec confidence: Vendor claimed
FP8 (dense)
330
TFLOPS
FP32
83
TFLOPS
VRAM
24 GB
Bandwidth
1.0 TB/s
memory
TDP
450 W
183.5 TFLOPS/kW

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
330 TOPS
sparse not published
FP8
8-bit floating point
330 TFLOPS
sparse not published
FP16
16-bit floating point
165 TFLOPS
sparse not published
BF16
Brain Float 16
165 TFLOPS
sparse not published
TF32
TensorFloat-32
83 TFLOPS
sparse not published
FP32
32-bit floating point
83 TFLOPS
FP64
64-bit floating point
1.3 TFLOPS
0.734 TFLOPS/W FP8 at 450 W
0.367 TFLOPS/W FP16 at 450 W
0.184 TFLOPS/W FP32 at 450 W

The GeForce RTX 4090 24GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XGeForce RTX 4090 24GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Ada Lovelace

Form Factor

PCIe

Launch Year

2022

Process Node

4nm

Memory

24 GB

Bandwidth

1,008 GB/s

TDP

450 W

Max Power

~518 W

Spec Confidence

Vendor claimed

Full Specifications

Memory
VRAM 24 GB
Bandwidth 1.0 TB/s
Power & Thermal
TDP 450 W
Enterprise Features
Sparsity Yes
General
Form Factor PCIe
Architecture Ada Lovelace
Launch Year 2022

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
TechPowerUp
Published
2022-10-12

Data Quality

Spec confidence
Vendor claimed
Clock basis
Boost
Precisions tracked
7
Normalization
All values in TFLOPS

Rent this GPU

$0.13 / GPU-hr

Lowest of 5 live listings across 4 providers· median $0.40

See all rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Similar GPUs

NVIDIA L40S 48GB

PCIe · 2023
FP32: 92 TFLOPS
Compare vs L40S

NVIDIA L40 48GB

PCIe · 2023
FP32: 91 TFLOPS
Compare vs L40

NVIDIA L20 48GB

PCIe · 2024
FP32: 60 TFLOPS
Compare vs L20

Frequently Asked Questions

How many TFLOPS does the NVIDIA GeForce RTX 4090 have?

The NVIDIA GeForce RTX 4090 delivers 82.58 TFLOPS for FP32 operations, 165.16 TFLOPS for FP16, and 330.3 TFLOPS for FP8 precision.

What is the power consumption of the NVIDIA GeForce RTX 4090?

The NVIDIA GeForce RTX 4090 has a TDP (Thermal Design Power) rating of 450 watts.

How much memory does the NVIDIA GeForce RTX 4090 have?

The NVIDIA GeForce RTX 4090 is equipped with 24 GB of VRAM with 1008 GB/s memory bandwidth.

What architecture is the NVIDIA GeForce RTX 4090 based on?

The NVIDIA GeForce RTX 4090 is based on the Ada Lovelace architecture, launched in 2022.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs