NVIDIA GeForce RTX 3090 Ti 24GB

Official
Ampere PCIe 2022 8nm
FP32
40.0
TFLOPS
VRAM
24 GB
TDP
450 W
88.9 TFLOPS/kW
Bandwidth
1.0 TB/s
memory

Performance Metrics

Peak theoretical throughput by precision type

PrecisionPeak TFLOPSEfficiency
INT8 80.0 0.178 TFLOPS/W
FP16 40.0 0.089 TFLOPS/W
BF16 40.0 0.089 TFLOPS/W
TF32 40.0 0.089 TFLOPS/W
FP32 40.0 0.089 TFLOPS/W
FP64 0.6 0.001 TFLOPS/W
FP16 Efficiency
0.089 TFLOPS/W
40.0 TFLOPS / 450W
FP32 Efficiency
0.089 TFLOPS/W
40.0 TFLOPS / 450W

Power Specifications

TDP

450 W

Max Power

518 W

Power Connector

PCIe 16-pin

Cooling

Air

Memory Specifications

Capacity

24 GB

Type

--

Bandwidth

1008 GB/s

Interface

--

Hardware & Design

Form Factor

PCIe

Architecture

Ampere

Process Node

8nm

Launch Year

2022

Variant

24GB

Market Segment

Data Center

Documentation & Resources

Common Use Cases

General Compute AI/ML Workloads Data Processing

The NVIDIA GeForce RTX 3090 Ti is optimized for high-performance computing tasks with Ampere architecture delivering 40 TFLOPS of compute power.

Where to Rent

ProviderPrice/hr
RunPod
$0.27 View →

Prices shown are approximate. Click through for current pricing.

Similar GPUs

NVIDIA RTX A6000 48GB

PCIe · 2020
FP32: 38.7 TFLOPS
Compare vs RTX A6000

NVIDIA A40 48GB

PCIe · 2021
FP32: 37.4 TFLOPS
Compare vs A40

NVIDIA A10G 24GB

PCIe · 2022
FP32: 35.0 TFLOPS
Compare vs A10G

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs