Flopper.io
Flopper.io System Specification Sheet

NVIDIA HGX A100

8x A100 Ampere baseboard 2020

Overview

2,496
BF16 TFLOPS Dense
0.6 TB
Aggregate Memory
16.3 TB/s
Aggregate Bandwidth
6.0 kW
Aggregate Power

Performance Metrics

PrecisionPeak (TFLOPS)Per GPU (TFLOPS)TFLOPS/W
FP64789.712.93
FP321562026.00
TF321,248156208.00
FP162,496312416.00
BF162,496312416.00
INT84,992624832.00

All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.

Configuration

Accelerator
A100 SXM4 80GB
Count
8
Memory per GPU
80 GB
Bandwidth per GPU
2.0 TB/s

Power & Efficiency

Aggregate Power
6.0 kW
TDP per GPU
400 W
BF16 Efficiency
416.00 TFLOPS/W
Aggregate Bandwidth
16.3 TB/s

System Details

Vendor: NVIDIA
Family: HGX
Architecture: Ampere
Form Factor: baseboard
Release Year: 2020
Process Node: 7nm

Interconnect

NVSwitch + NVLink

Notes

HGX A100 platform for cloud providers