Flopper.io
Flopper.io GPU Specification Sheet

NVIDIA A100 PCIe 40GB

Ampere PCIe 2020 7nm

Overview

19.5
FP32 TFLOPS
40 GB
Memory
1.6 TB/s
Memory Bandwidth
250 W
TDP

Performance Metrics

PrecisionPeak (dense)2:4 SparseBitsType
FP649.7N/A64Standard
FP3219.5N/A32Standard
TF32156.0312.032Standard
BF16312.0624.016Standard
FP16312.0624.016Standard
FP8—not published—Standard
FP6—not published—Standard
FP4—not published—Standard
INT8624.01248.08Standard
INT41248.02496.04Standard

Memory Specifications

Capacity
40 GB
Type
—
Bandwidth
1.6 TB/s
Interface Width
—

Power & Efficiency

TDP
250 W
Max power (Flopper estimate)
~288 W est.
FP32 dense TFLOPS per W of TDP
0.08 TFLOPS/W
FP16 dense TFLOPS per W of TDP
1.25 TFLOPS/W

Flopper estimate: 250 W TDP x 1.15. The vendor publishes no maximum board power for this part. Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: NVIDIA
Architecture: Ampere
Process Node: 7nm
Form Factor: PCIe
Launch Year: 2020
Variant: PCIe 40GB

Enterprise Features

Sparsity: Yes