Flopper.io System Specification Sheet
October 17, 2026
flopper.io/system/nvidia-hgx-a100-4-gpuNVIDIA HGX A100
4x A100 Ampere baseboard 2020
Overview
1,248
BF16 TFLOPS Dense
0.3 TB
Aggregate Memory
8.2 TB/s
Aggregate Bandwidth
3.2 kW
Aggregate Power
Performance Metrics
| Precision | Peak (TFLOPS) | Per GPU (TFLOPS) | TFLOPS/W |
|---|---|---|---|
| FP64 | 39 | 9.7 | 12.12 |
| FP32 | 78 | 20 | 24.38 |
| TF32 | 624 | 156 | 195.00 |
| FP16 | 1,248 | 312 | 390.00 |
| BF16 | 1,248 | 312 | 390.00 |
| INT8 | 2,496 | 624 | 780.00 |
All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.
Configuration
- Accelerator
- A100 SXM4 80GB
- Count
- 4
- Memory per GPU
- 80 GB
- Bandwidth per GPU
- 2.0 TB/s
Power & Efficiency
- Aggregate Power
- 3.2 kW
- TDP per GPU
- 400 W
- BF16 Efficiency
- 390.00 TFLOPS/W
- Aggregate Bandwidth
- 8.2 TB/s
System Details
Vendor: NVIDIA
Family: HGX
Architecture: Ampere
Form Factor: baseboard
Release Year: 2020
Process Node: 7nm
Interconnect
NVLink
Notes
HGX A100 4-GPU configuration