Flopper.io
Flopper.io System Specification Sheet

NVIDIA DGX A100 320GB

8x A100 Ampere rack 2020

Overview

2,496
BF16 TFLOPS Dense
0.3 TB
Aggregate Memory
12.4 TB/s
Aggregate Bandwidth
6.0 kW
Aggregate Power

Performance Metrics

PrecisionPeak (TFLOPS)Per GPU (TFLOPS)TFLOPS/W
FP64789.712.93
FP321562026.00
TF321,248156208.00
FP162,496312416.00
BF162,496312416.00
INT84,992624832.00

All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.

Configuration

Accelerator
A100 PCIe 40GB
Count
8
Memory per GPU
40 GB
Bandwidth per GPU
1.6 TB/s

Power & Efficiency

Aggregate Power
6.0 kW
TDP per GPU
250 W
BF16 Efficiency
416.00 TFLOPS/W
Aggregate Bandwidth
12.4 TB/s

System Details

Vendor: NVIDIA
Family: DGX
Architecture: Ampere
Form Factor: rack
Release Year: 2020
Process Node: 7nm

Interconnect

NVSwitch + NVLink

Notes

DGX A100 with 320GB total GPU memory