NVIDIA GeForce RTX 3090 24GB

Ampere PCIe 2020 8nm
FP32
35.6
TFLOPS
VRAM
24 GB
TDP
350 W
101.7 TFLOPS/kW
Bandwidth
936 GB/s
memory

Performance Metrics

Peak theoretical throughput by precision type

PrecisionPeak TFLOPSEfficiency
INT8 71.2 0.203 TFLOPS/W
FP16 35.6 0.102 TFLOPS/W
BF16 35.6 0.102 TFLOPS/W
TF32 35.6 0.102 TFLOPS/W
FP32 35.6 0.102 TFLOPS/W
FP64 0.6 0.002 TFLOPS/W
FP16 Efficiency
0.102 TFLOPS/W
35.6 TFLOPS / 350W
FP32 Efficiency
0.102 TFLOPS/W
35.6 TFLOPS / 350W

Power Specifications

TDP

350 W

Max Power

402 W

Power Connector

PCIe 16-pin

Cooling

Air

Memory Specifications

Capacity

24 GB

Type

--

Bandwidth

936 GB/s

Interface

--

Hardware & Design

Form Factor

PCIe

Architecture

Ampere

Process Node

8nm

Launch Year

2020

Variant

24GB

Market Segment

Data Center

Documentation & Resources

Common Use Cases

General Compute AI/ML Workloads Data Processing

The NVIDIA GeForce RTX 3090 is optimized for high-performance computing tasks with Ampere architecture delivering 35.58 TFLOPS of compute power.

Where to Rent

ProviderPrice/hr
RunPod
$0.22 View →

Prices shown are approximate. Click through for current pricing.

Similar GPUs

NVIDIA RTX A6000 48GB

PCIe · 2020
FP32: 38.7 TFLOPS
Compare vs RTX A6000

NVIDIA A40 48GB

PCIe · 2021
FP32: 37.4 TFLOPS
Compare vs A40

NVIDIA A10G 24GB

PCIe · 2022
FP32: 35.0 TFLOPS
Compare vs A10G

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs