Flopper.io
Flopper.io GPU Specification Sheet

NVIDIA A100 PCIe 80GB

Ampere PCIe 2021

Overview

19.5
FP32 TFLOPS
80 GB
Memory HBM2e
1.9 TB/s
Memory Bandwidth
300 W
TDP

Performance Metrics

PrecisionPeak (dense)2:4 SparseBitsType
FP649.7N/A64Standard
FP3219.5N/A32Standard
TF32156.0312.032Standard
BF16312.0624.016Standard
FP16312.0624.016Standard
FP8—not published—Standard
FP6—not published—Standard
FP4—not published—Standard
INT8624.01248.08Standard
INT41248.02496.04Standard

Memory Specifications

Capacity
80 GB
Type
HBM2e
Bandwidth
1.9 TB/s
Interface Width
5120-bit

Power & Efficiency

TDP
300 W
Max power (Flopper estimate)
~345 W est.
FP32 dense TFLOPS per W of TDP
0.07 TFLOPS/W
FP16 dense TFLOPS per W of TDP
1.04 TFLOPS/W

Flopper estimate: 300 W TDP x 1.15. The vendor publishes no maximum board power for this part. Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: NVIDIA
Architecture: Ampere
Process Node: —
Form Factor: PCIe
Launch Year: 2021
Variant: PCIe 80GB

Enterprise Features

Sparsity: Yes