NVIDIA RTX A4000 16GB

Ampere PCIe 2021 8nm

Overview

19.2

FP32 TFLOPS

16 GB

Memory GDDR6

448 GB/s

Memory Bandwidth

140 W

TDP

Performance Metrics

Precision	Peak (dense)	2:4 Sparse	Bits	Type
FP64	0.3	N/A	64	Standard
FP32	19.2	N/A	32	Standard
TF32	19.2	not published	32	Standard
BF16	19.2	not published	16	Standard
FP16	19.2	not published	16	Standard
FP8	—	not published	—	Standard
FP6	—	not published	—	Standard
FP4	—	not published	—	Standard
INT8	38.3	not published	8	Standard

Memory Specifications

Capacity: 16 GB
Type: GDDR6
Bandwidth: 448 GB/s
Interface Width: 256-bit

Power & Efficiency

TDP: 140 W
Max power (Flopper estimate): ~161 W est.
FP32 dense TFLOPS per W of TDP: 0.14 TFLOPS/W
FP16 dense TFLOPS per W of TDP: 0.14 TFLOPS/W

Flopper estimate: 140 W TDP x 1.15. The vendor publishes no maximum board power for this part. Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: NVIDIA

Architecture: Ampere

Process Node: 8nm

Form Factor: PCIe

Launch Year: 2021

Variant: 16GB

Compute Engine

CUDA Cores: 6,144

Tensor Cores: 192 (3rd Gen)

SMs: 48

Base Clock: 735 MHz

Boost Clock: 1.56 GHz

Enterprise Features

Sparsity: Yes