Flopper.io System Specification Sheet
August 10, 2026
flopper.io/system/nvidia-hgx-a100-4-gpuNVIDIA HGX A100
4x A100 Ampere baseboard 2020
Overview
1.25
BF16 PFLOPS Dense
0.3 TB
Aggregate Memory
8.2 TB/s
Aggregate Bandwidth
3.2 kW
Aggregate Power
Performance Metrics
| Precision | Peak (PFLOPS) | Per GPU (TFLOPS) | TFLOPS/W |
|---|---|---|---|
| FP64 | 0.0 | 9.7 | 12.12 |
| FP32 | 0.1 | 19.5 | 24.38 |
| TF32 | 0.6 | 156.0 | 195.00 |
| FP16 | 1.2 | 312.0 | 390.00 |
| BF16 | 1.2 | 312.0 | 390.00 |
| INT8 | 2.5 | 624.0 | 780.00 |
All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.
Configuration
- Accelerator
- A100 SXM4 80GB
- Count
- 4
- Memory per GPU
- 80 GB
- Bandwidth per GPU
- 2.0 TB/s
Power & Efficiency
- Aggregate Power
- 3.2 kW
- TDP per GPU
- 400 W
- BF16 Efficiency
- 390.00 TFLOPS/W
- Aggregate Bandwidth
- 8.2 TB/s
System Details
Vendor: NVIDIA
Family: HGX
Architecture: Ampere
Form Factor: baseboard
Release Year: 2020
Process Node: 7nm
Interconnect
NVLink
Notes
HGX A100 4-GPU configuration