NVIDIA RTX A5000 24GB

Ampere PCIe 2021 8nm Spec confidence: Official
FP32
28
TFLOPS
VRAM
24 GB
Bandwidth
768 GB/s
memory
TDP
230 W
120.9 TFLOPS/kW

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
56 TOPS
sparse not published
FP16
16-bit floating point
28 TFLOPS
sparse not published
BF16
Brain Float 16
28 TFLOPS
sparse not published
TF32
TensorFloat-32
28 TFLOPS
sparse not published
FP32
32-bit floating point
28 TFLOPS
FP64
64-bit floating point
0.4 TFLOPS
0.121 TFLOPS/W FP16 at 230 W
0.121 TFLOPS/W FP32 at 230 W

The RTX A5000 24GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XRTX A5000 24GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Ampere

Form Factor

PCIe

Launch Year

2021

Process Node

8nm

Memory

24 GB

Bandwidth

768 GB/s

TDP

230 W

Max Power

~265 W

Spec Confidence

Official

Full Specifications

Memory
VRAM 24 GB
Bandwidth 768 GB/s
Power & Thermal
TDP 230 W
Enterprise Features
Sparsity Yes
General
Form Factor PCIe
Architecture Ampere
Launch Year 2021

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
NVIDIA
Published
2021-04-12

Data Quality

Spec confidence
Official
Clock basis
Boost
Precisions tracked
6
Normalization
All values in TFLOPS

Rent this GPU

$0.16 / GPU-hr

Lowest of 3 live listings across 2 providers· median $0.27

See all rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Similar GPUs

NVIDIA RTX A6000 48GB

PCIe · 2020
FP32: 39 TFLOPS
Compare vs RTX A6000

NVIDIA A40 48GB

PCIe · 2021
FP32: 37 TFLOPS
Compare vs A40

NVIDIA A10G 24GB

PCIe · 2022
FP32: 35 TFLOPS
Compare vs A10G

Frequently Asked Questions

How many TFLOPS does the NVIDIA RTX A5000 have?

The NVIDIA RTX A5000 delivers 27.8 TFLOPS for FP32 operations, 27.8 TFLOPS for FP16, and N/A TFLOPS for FP8 precision.

What is the power consumption of the NVIDIA RTX A5000?

The NVIDIA RTX A5000 has a TDP (Thermal Design Power) rating of 230 watts.

How much memory does the NVIDIA RTX A5000 have?

The NVIDIA RTX A5000 is equipped with 24 GB of VRAM with 768 GB/s memory bandwidth.

What architecture is the NVIDIA RTX A5000 based on?

The NVIDIA RTX A5000 is based on the Ampere architecture, launched in 2021.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs