Flopper.io
Flopper.io System Specification Sheet

NVIDIA DGX H200

8x H200 Hopper rack 2024

Overview

15,832
FP8 TFLOPS Dense
1.1 TB
Aggregate Memory
38.4 TB/s
Aggregate Bandwidth
8.5 kW
Aggregate Power

Performance Metrics

PrecisionPeak (TFLOPS)Per GPU (TFLOPS)TFLOPS/W
FP642723464.00
FP3253667126.12
TF323,956495930.82
FP167,9169901862.59
BF167,9169901862.59
FP815,8321,9793725.18
INT815,8321,9793725.18

All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.

Configuration

Accelerator
H200 SXM 141GB
Count
8
Memory per GPU
141 GB
Bandwidth per GPU
4.8 TB/s

Power & Efficiency

Aggregate Power
8.5 kW
TDP per GPU
700 W
FP8 Efficiency
3725.18 TFLOPS/W
Aggregate Bandwidth
38.4 TB/s

System Details

Vendor: NVIDIA
Family: DGX
Architecture: Hopper
Form Factor: rack
Release Year: 2024
Process Node: 4nm

Interconnect

NVSwitch + NVLink

Notes

Latest DGX system with H200 GPUs and 141GB HBM3e memory per GPU