NVIDIA A40 48GB

Ampere PCIe 2021 Spec confidence: Official
FP32
37
TFLOPS
VRAM
48 GB
GDDR6
Bandwidth
696 GB/s
memory
TDP
300 W
124.7 TFLOPS/kW

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
299 TOPS
599 with sparsity
INT4
4-bit integer
599 TOPS
1,197 with sparsity
FP16
16-bit floating point
150 TFLOPS
299 with sparsity
BF16
Brain Float 16
150 TFLOPS
299 with sparsity
TF32
TensorFloat-32
75 TFLOPS
150 with sparsity
FP32
32-bit floating point
37 TFLOPS
Dense Added with sparsity
0.499 TFLOPS/W FP16 at 300 W
0.125 TFLOPS/W FP32 at 300 W

The A40 48GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XA40 48GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Ampere

Form Factor

PCIe

Launch Year

2021

Memory

48 GB GDDR6

Bandwidth

696 GB/s

TDP

300 W

Max Power

~345 W

Spec Confidence

Official

Full Specifications

Memory
VRAM 48 GB
Memory Type GDDR6
Bandwidth 696 GB/s
Interface Width 384-bit
Power & Thermal
TDP 300 W
Enterprise Features
Sparsity Yes
General
Form Factor PCIe
Architecture Ampere
Launch Year 2021

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Document
--
Publisher
NVIDIA
Published
--

Data Quality

Spec confidence
Official
Clock basis
Boost
Precisions tracked
6
Normalization
All values in TFLOPS

Rent this GPU

$0.35 / GPU-hr

Lowest of 2 live listings across 1 provider

See all rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Similar GPUs

Frequently Asked Questions

How many TFLOPS does the NVIDIA A40 have?

The NVIDIA A40 delivers 37.4 TFLOPS for FP32 operations, 149.7 TFLOPS for FP16, and N/A TFLOPS for FP8 precision.

What is the power consumption of the NVIDIA A40?

The NVIDIA A40 has a TDP (Thermal Design Power) rating of 300 watts.

How much memory does the NVIDIA A40 have?

The NVIDIA A40 is equipped with 48 GB of VRAM with 696 GB/s memory bandwidth.

What architecture is the NVIDIA A40 based on?

The NVIDIA A40 is based on the Ampere architecture, launched in 2021.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs