Flopper.io
Flopper.io GPU Specification Sheet

NVIDIA A40 48GB

Ampere PCIe 2021

Overview

37.4
FP32 TFLOPS
48 GB
Memory GDDR6
696 GB/s
Memory Bandwidth
300 W
TDP

Performance Metrics

PrecisionPeak (dense)2:4 SparseBitsType
FP64—N/A—Standard
FP3237.4N/A32Standard
TF3274.8149.632Standard
BF16149.7299.416Standard
FP16149.7299.416Standard
FP8—not published—Standard
FP6—not published—Standard
FP4—not published—Standard
INT8299.3598.68Standard
INT4598.71197.44Standard

Memory Specifications

Capacity
48 GB
Type
GDDR6
Bandwidth
696 GB/s
Interface Width
384-bit

Power & Efficiency

TDP
300 W
Max power (Flopper estimate)
~345 W est.
FP32 dense TFLOPS per W of TDP
0.12 TFLOPS/W
FP16 dense TFLOPS per W of TDP
0.50 TFLOPS/W

Flopper estimate: 300 W TDP x 1.15. The vendor publishes no maximum board power for this part. Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: NVIDIA
Architecture: Ampere
Process Node: —
Form Factor: PCIe
Launch Year: 2021
Variant: 48GB

Enterprise Features

Sparsity: Yes