NVIDIA RTX A4000 16GB

Ampere PCIe 2021 8nm Spec confidence: Official
FP32
19
TFLOPS
Memory
16 GB
GDDR6
Bandwidth
448 GB/s
memory
TDP
140 W
136.9 FP32 dense TFLOPS/kW of TDP

Performance

Peak theoretical throughput by precision type

PrecisionDense2:4 Sparse
FP64
64-bit floating point
0.3TFLOPS Structured sparsity is a tensor-core feature; this vector precision has no sparse form
FP32
32-bit floating point
19TFLOPS Structured sparsity is a tensor-core feature; this vector precision has no sparse form
TF32
TensorFloat-32
19TFLOPS The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision
BF16
Brain Float 16
19TFLOPS The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision
FP16
16-bit floating point
19TFLOPS The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision
FP8
No verified data available The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision
FP6
No verified data available The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision
FP4
No verified data available The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision
INT8
8-bit integer
38TOPS The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision

The RTX A4000 16GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XRTX A4000 16GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Ampere

Form Factor

PCIe

Launch Year

2021

Process Node

8nm

Memory

16 GB GDDR6

Bandwidth

448 GB/s

TDP

140 W

Max power (Flopper estimate)

~161 W est. Flopper estimate: 140 W TDP x 1.15. The vendor publishes no maximum board power for this part.

CUDA Cores

6,144

Spec Confidence

Official

Full Specifications

Compute Engine
CUDA Cores 6,144
Tensor Cores 192 (3rd Gen)
Streaming Multiprocessors 48
Base Clock 735 MHz
Boost Clock 1.56 GHz
Memory
Memory 16 GB
Memory Type GDDR6
Bandwidth 448 GB/s
Interface Width 256-bit
Power & Thermal
TDP 140 W
Max power (Flopper estimate) ~161 W est.
Enterprise Features
Sparsity Yes
General
Form Factor PCIe
Architecture Ampere
Process Node 8nm
Launch Year 2021

Datasheet & Resources

Flopper Datasheet

NVIDIA RTX A4000 16GB specifications, generated from our database. Printable.

Vendor product page

NVIDIA documentation for the RTX A4000 16GB

View

NVIDIA Developer Documentation

Technical specs, programming guides

Browse

Data Provenance

Every figure traced to a source

Primary Source

Document
Publisher
NVIDIA
Published
No verified data available

Data Quality

Spec confidence
Official
Clock basis
Boost
Core precisions with figures
6 of 9
Normalization
All values in TFLOPS

Rent this GPU

$0.15 / GPU-hr

Lowest of 4 live listings across 3 providers· median $0.25

Median of each provider's cheapest on-demand listing, so a provider with many configurations counts once.

See all rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Similar GPUs

NVIDIA A100 SXM4 80GB

SXM · 2020
FP32: 20 TFLOPS
Compare vs A100

NVIDIA A100 PCIe 40GB

PCIe · 2020
FP32: 20 TFLOPS
Compare vs A100

NVIDIA A100 PCIe 80GB

PCIe · 2021
FP32: 20 TFLOPS
Compare vs A100

NVIDIA A100 SXM4 40GB

SXM · 2020
FP32: 20 TFLOPS
Compare vs A100

NVIDIA A800 PCIe 80GB

PCIe · 2022
FP32: 20 TFLOPS
Compare vs A800

Frequently Asked Questions

How many TFLOPS does the NVIDIA RTX A4000 have?

The NVIDIA RTX A4000 delivers 19 TFLOPS FP32 and 19 TFLOPS FP16 at peak. Flopper does not currently have a verified FP8 throughput figure for it.

What is the power consumption of the NVIDIA RTX A4000?

The NVIDIA RTX A4000 has a TDP (Thermal Design Power) rating of 140 watts.

How much memory does the NVIDIA RTX A4000 have?

The NVIDIA RTX A4000 is equipped with 16 GB of memory with 448 GB/s of memory bandwidth.

What architecture is the NVIDIA RTX A4000 based on?

The NVIDIA RTX A4000 is based on the Ampere architecture, launched in 2021.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs