Flopper.io
Flopper.io System Specification Sheet

NVIDIA HGX B100

8x B100 Blackwell baseboard 2024

Overview

28.0
FP8 PFLOPS Dense
1.5 TB
Aggregate Memory
64.0 TB/s
Aggregate Bandwidth
5.6 kW
Aggregate Power

Performance Metrics

PrecisionPeak (PFLOPS)Per GPU (TFLOPS)TFLOPS/W
FP640.230.0
FP320.560.0
TF327.0875.0
FP1614.01750.0
BF1614.01750.0
FP828.03500.0
FP456.07000.0
INT828.03500.0

All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.

Configuration

Accelerator
B100 SXM 192GB
Count
8
Memory per GPU
192 GB
Bandwidth per GPU
8.0 TB/s

Power & Efficiency

Aggregate Power
5.6 kW
TDP per GPU
700 W
FP8 Efficiency
5.00 TFLOPS/W
Aggregate Bandwidth
64.0 TB/s

System Details

Vendor: NVIDIA
Family: HGX
Architecture: Blackwell
Form Factor: baseboard
Release Year: 2024
Process Node: 4nm

Interconnect

NVSwitch + NVLink