Flopper.io System Specification Sheet
October 17, 2026
flopper.io/system/nvidia-dgx-a100-640gbNVIDIA DGX A100 640GB
8x A100 Ampere rack 2020
Overview
2,496
BF16 TFLOPS Dense
0.6 TB
Aggregate Memory
16.3 TB/s
Aggregate Bandwidth
6.5 kW
Aggregate Power
Performance Metrics
| Precision | Peak (TFLOPS) | Per GPU (TFLOPS) | TFLOPS/W |
|---|---|---|---|
| FP64 | 78 | 9.7 | 11.94 |
| FP32 | 156 | 20 | 24.00 |
| TF32 | 1,248 | 156 | 192.00 |
| FP16 | 2,496 | 312 | 384.00 |
| BF16 | 2,496 | 312 | 384.00 |
| INT8 | 4,992 | 624 | 768.00 |
All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.
Configuration
- Accelerator
- A100 SXM4 80GB
- Count
- 8
- Memory per GPU
- 80 GB
- Bandwidth per GPU
- 2.0 TB/s
Power & Efficiency
- Aggregate Power
- 6.5 kW
- TDP per GPU
- 400 W
- BF16 Efficiency
- 384.00 TFLOPS/W
- Aggregate Bandwidth
- 16.3 TB/s
System Details
Vendor: NVIDIA
Family: DGX
Architecture: Ampere
Form Factor: rack
Release Year: 2020
Process Node: 7nm
Interconnect
NVSwitch + NVLink
Notes
DGX A100 with 640GB total GPU memory