Flopper.io System Specification Sheet
October 17, 2026
flopper.io/system/nvidia-hgx-h200NVIDIA HGX H200
8x H200 Hopper baseboard 2024
Overview
15,832
FP8 TFLOPS Dense
1.1 TB
Aggregate Memory
38.4 TB/s
Aggregate Bandwidth
8.0 kW
Aggregate Power
Performance Metrics
| Precision | Peak (TFLOPS) | Per GPU (TFLOPS) | TFLOPS/W |
|---|---|---|---|
| FP64 | 272 | 34 | 68.00 |
| FP32 | 536 | 67 | 134.00 |
| TF32 | 3,956 | 495 | 989.00 |
| FP16 | 7,916 | 990 | 1979.00 |
| BF16 | 7,916 | 990 | 1979.00 |
| FP8 | 15,832 | 1,979 | 3958.00 |
| INT8 | 15,832 | 1,979 | 3958.00 |
All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.
Configuration
- Accelerator
- H200 SXM 141GB
- Count
- 8
- Memory per GPU
- 141 GB
- Bandwidth per GPU
- 4.8 TB/s
Power & Efficiency
- Aggregate Power
- 8.0 kW
- TDP per GPU
- 700 W
- FP8 Efficiency
- 3958.00 TFLOPS/W
- Aggregate Bandwidth
- 38.4 TB/s
System Details
Vendor: NVIDIA
Family: HGX
Architecture: Hopper
Form Factor: baseboard
Release Year: 2024
Process Node: 4nm
Interconnect
NVSwitch + NVLink
Notes
HGX platform for cloud providers with H200 GPUs