NVIDIA also shipped a passively cooled Quadro RTX 6000 PCIe Server Card for data center and edge servers. That board is rated at 250 W total board power rather than 295 W, and its memory runs slower, giving up to 624 GB/s rather than 672 GB/s. This row is the active workstation card. Note also that the 295 W figure is total board power; NVIDIA lists total graphics power separately at 260 W, the difference being the up to 35 W the VirtualLink USB-C connector can deliver to a headset.

NVIDIA Quadro RTX 6000 24GB

Turing PCIe 2018 12nm Spec confidence: Official
FP32
16
TFLOPS
VRAM
24 GB
GDDR6
Bandwidth
672 GB/s
memory
TDP
295 W
55.3 TFLOPS/kW
Download datasheet

Overview

The Quadro RTX 6000 is the 24 GB member of NVIDIA's first ray tracing workstation pair, built on a 754 mm2 TU102 die with 4,608 CUDA cores, 576 second-generation Tensor cores and 72 RT cores. It is compute-identical to the Quadro RTX 8000; the only difference between the two cards is frame buffer, 24 GB here against 48 GB there. Turing tensor cores cover FP16, INT8 and INT4 and stop there, so there is no BF16, TF32 or FP8 on this part, and no structured sparsity either, which arrived a generation later with Ampere. That makes the datasheet's 130.5 TFLOPS of tensor performance a dense number directly comparable with every other accelerator on this site. Rental supply still exists on several neoclouds, where it is usually listed simply as "RTX 6000 (24 GB)". If you are comparing prices, check the memory size before assuming a listing means the far faster RTX 6000 Ada, which is a 2023 card with 48 GB and roughly five times the FP32 throughput.

Performance

Peak theoretical throughput by precision type

Precision
Peak
FP64
64-bit floating point
0.5TFLOPS
FP32
32-bit floating point
16TFLOPS
TF32
No verified data available
BF16
No verified data available
FP16
16-bit floating point
131TFLOPS
FP8
No verified data available
FP6
No verified data available
FP4
No verified data available
INT8
8-bit integer
261TOPS
INT4
4-bit integer
522TOPS
Every figure here is dense. The vendor documents no structured (2:4) sparsity mode for this part, so there is no second number to quote.
0.055 TFLOPS/W FP32 at 295 W
0.442 TFLOPS/W FP16 at 295 W

The Quadro RTX 6000 24GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XQuadro RTX 6000 24GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Turing

Form Factor

PCIe

Launch Year

2018

Process Node

12nm

Memory

24 GB GDDR6

Bandwidth

672 GB/s

TDP

295 W

Max Power

295 W

Transistors

18.6 billion

Interconnect

100 GB/s NVLink

CUDA Cores

4,608

Spec Confidence

Official

Full Specifications

Compute Engine
CUDA Cores 4,608
Tensor Cores 576 (Turing)
Streaming Multiprocessors 72
Boost Clock 1.77 GHz
Chip Design
Transistors 18.6 billion
Die Size 754 mm²
Process Node 12nm
Memory
VRAM 24 GB
Memory Type GDDR6
Bandwidth 672 GB/s
Interface Width 384-bit
Memory Clock 14 GT/s
Interconnect & I/O
GPU-to-GPU NVLink
Interconnect Bandwidth 100 GB/s
PCIe 3.0 x16
Cache
L2 Cache 6 MB
Power & Thermal
TDP 295 W
Max Board Power 295 W
Cooling Active
Enterprise Features
ECC Memory Yes
Sparsity No
Compute APIs CUDA, DirectCompute, OpenCL
Physical & Media
Card Length 266.7 mm
Width 2-slot
NVENC Engines 1
NVDEC Engines 1
General
Form Factor PCIe
Architecture Turing
Process Node 12nm
Launch Year 2018

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
NVIDIA
Published
2019-03-01

Data Quality

Spec confidence
Official
Clock basis
Boost
Core precisions with figures
4 of 9
Normalization
All values in TFLOPS

Compare cloud providers offering on-demand GPU instances for AI training, inference, and HPC workloads.

Browse GPU Cloud Providers

Similar GPUs

NVIDIA T4 16GB

PCIe · 2019
FP32: 8.1 TFLOPS
Compare vs T4

Frequently Asked Questions

How many TFLOPS does the NVIDIA Quadro RTX 6000 have?

The NVIDIA Quadro RTX 6000 delivers 16 TFLOPS FP32 and 131 TFLOPS FP16 at peak. Flopper does not currently have a verified FP8 throughput figure for it.

What is the power consumption of the NVIDIA Quadro RTX 6000?

The NVIDIA Quadro RTX 6000 has a TDP (Thermal Design Power) rating of 295 watts.

How much memory does the NVIDIA Quadro RTX 6000 have?

The NVIDIA Quadro RTX 6000 is equipped with 24 GB of VRAM with 672 GB/s of memory bandwidth.

What architecture is the NVIDIA Quadro RTX 6000 based on?

The NVIDIA Quadro RTX 6000 is based on the Turing architecture, launched in 2018.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs