Flopper.io
Flopper.io System Specification Sheet

NVIDIA DGX A100 320GB

8x A100 Ampere rack 2020

Overview

2.50
BF16 PFLOPS Dense
0.3 TB
Aggregate Memory
12.4 TB/s
Aggregate Bandwidth
6.0 kW
Aggregate Power

Performance Metrics

PrecisionPeak (PFLOPS)Per GPU (TFLOPS)TFLOPS/W
FP640.19.712.93
FP320.219.526.00
TF321.2156.0208.00
FP162.5312.0416.00
BF162.5312.0416.00
INT85.0624.0832.00

All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.

Configuration

Accelerator
A100 PCIe 40GB
Count
8
Memory per GPU
40 GB
Bandwidth per GPU
1.6 TB/s

Power & Efficiency

Aggregate Power
6.0 kW
TDP per GPU
250 W
BF16 Efficiency
416.00 TFLOPS/W
Aggregate Bandwidth
12.4 TB/s

System Details

Vendor: NVIDIA
Family: DGX
Architecture: Ampere
Form Factor: rack
Release Year: 2020
Process Node: 7nm

Interconnect

NVSwitch + NVLink

Notes

DGX A100 with 320GB total GPU memory