Flopper.io
Flopper.io System Specification Sheet

NVIDIA HGX H100

4x H100 Hopper baseboard 2022

Overview

7.92
FP8 PFLOPS Dense
0.3 TB
Aggregate Memory
13.4 TB/s
Aggregate Bandwidth
4.2 kW
Aggregate Power

Performance Metrics

PrecisionPeak (PFLOPS)Per GPU (TFLOPS)TFLOPS/W
FP640.134.032.38
FP320.367.063.81
TF322.0494.5941.90
FP164.0989.51884.76
BF164.0989.51884.76
FP87.91979.03769.52
INT87.91979.03769.52

All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.

Configuration

Accelerator
H100 SXM5 80GB
Count
4
Memory per GPU
80 GB
Bandwidth per GPU
3.4 TB/s

Power & Efficiency

Aggregate Power
4.2 kW
TDP per GPU
700 W
FP8 Efficiency
3769.52 TFLOPS/W
Aggregate Bandwidth
13.4 TB/s

System Details

Vendor: NVIDIA
Family: HGX
Architecture: Hopper
Form Factor: baseboard
Release Year: 2022
Process Node: 4nm

Interconnect

NVLink

Notes

HGX H100 4-GPU configuration for smaller deployments