Flopper.io
Flopper.io System Specification Sheet

NVIDIA DGX H100

8x H100 Hopper rack 2022

Overview

15.8
FP8 PFLOPS Dense
0.6 TB
Aggregate Memory
26.8 TB/s
Aggregate Bandwidth
8.5 kW
Aggregate Power

Performance Metrics

PrecisionPeak (PFLOPS)Per GPU (TFLOPS)TFLOPS/W
FP640.334.032.00
FP320.567.063.06
TF324.0494.5930.82
FP167.9989.51862.59
BF167.9989.51862.59
FP815.81979.03725.18
INT815.81979.03725.18

All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.

Configuration

Accelerator
H100 SXM5 80GB
Count
8
Memory per GPU
80 GB
Bandwidth per GPU
3.4 TB/s

Power & Efficiency

Aggregate Power
8.5 kW
TDP per GPU
700 W
FP8 Efficiency
3725.18 TFLOPS/W
Aggregate Bandwidth
26.8 TB/s

System Details

Vendor: NVIDIA
Family: DGX
Architecture: Hopper
Form Factor: rack
Release Year: 2022
Process Node: 4nm

Interconnect

NVSwitch + NVLink

Notes

Enterprise AI system with 8x H100 SXM5 GPUs