Flopper.io
Flopper.io System Specification Sheet

NVIDIA HGX B100

8x B100 Blackwell baseboard 2024

Overview

28,000
FP8 TFLOPS Dense
1.5 TB
Aggregate Memory
64.0 TB/s
Aggregate Bandwidth
5.6 kW
Aggregate Power

Performance Metrics

PrecisionPeak (TFLOPS)Per GPU (TFLOPS)TFLOPS/W
FP6424030—
FP3248060—
TF327,000875—
FP1614,0001,750—
BF1614,0001,750—
FP828,0003,500—
FP456,0007,000—
INT828,0003,500—

All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.

Configuration

Accelerator
B100 SXM 192GB
Count
8
Memory per GPU
192 GB
Bandwidth per GPU
8.0 TB/s

Power & Efficiency

Aggregate Power
5.6 kW
TDP per GPU
700 W
FP8 Efficiency
5.00 TFLOPS/W
Aggregate Bandwidth
64.0 TB/s

System Details

Vendor: NVIDIA
Family: HGX
Architecture: Blackwell
Form Factor: baseboard
Release Year: 2024
Process Node: 4nm

Interconnect

NVSwitch + NVLink