NVIDIA HGX H100 8-GPU

baseboard
8× H100
NVSwitch + NVLink
2022
FP64
272
TFLOPS
FP32
536
TFLOPS
Power
8.0
kW Total
Memory
640
GB Total

HGX H100 8-GPU configuration for hyperscalers

We will point you at suppliers who have it. Free, and no signup.

Systems built on this design

2 configurations

NVIDIA HGX H100 8-GPU is the baseboard. The systems above are OEM implementations of it and share its accelerator performance; they differ in chassis, CPU, memory and cooling.

FP64
272
TFLOPS
34.0 TFLOPS/kW
FP32
536
TFLOPS
67.0 TFLOPS/kW
TF32
3,956
TFLOPS
989.0 TFLOPS/kW
FP16
7,916
TFLOPS
1979.0 TFLOPS/kW

System Details

GPU Configuration

GPU Count: 8 GPUs
Architecture: Hopper
Interconnect: NVSwitch + NVLink

System Specifications

Form Factor: baseboard
Total Power: 8.0 kW
Total Memory: 640 GB
Memory Bandwidth: 26.8 TB/s

Precision Performance Breakdown

PrecisionSystem PerformancePer GPUEfficiency
272 TFLOPS 34 TFLOPS 34.0 TFLOPS/kW
536 TFLOPS 67 TFLOPS 67.0 TFLOPS/kW
3,956 TFLOPS 495 TFLOPS 989.0 TFLOPS/kW
7,916 TFLOPS 990 TFLOPS 1979.0 TFLOPS/kW
7,916 TFLOPS 990 TFLOPS 1979.0 TFLOPS/kW
15,832 TFLOPS 1,979 TFLOPS 3958.0 TFLOPS/kW
15,832 TOPS 1,979 TOPS 3958.0 TFLOPS/kW

Where a vendor states a basis, the figure shown is the dense one, and any figure it publishes is listed separately. Vendors commonly headline the sparse number instead: for NVIDIA's 2:4 structured sparsity that is exactly twice the dense figure, though other vendors' sparse modes do not all follow that ratio.

Powered by NVIDIA H100

This system utilizes 8 × NVIDIA H100 SXM5 80GB GPUs, each delivering exceptional performance for AI and HPC workloads.

Per GPU TDP

700W

Per GPU Memory

80 GB

Process Node

4nm

Architecture

Hopper

Frequently asked questions

How much does the HGX H100 8-GPU cost?

NVIDIA sells the HGX H100 8-GPU on quote through OEMs and resellers, and nobody rents a whole one by the hour. Renting its 8 H100 accelerators separately at the cheapest live rate Flopper tracks, $1.83 per GPU-hour across 29 providers, comes to about $14.64 an hour for the equivalent capacity. H100 rental prices →

How much power does the HGX H100 8-GPU require?

NVIDIA rates the HGX H100 8-GPU at 8 kW, which is the figure to plan power delivery and cooling around; per-GPU draw is listed on the accelerator's own page.

How many GPUs are in the HGX H100 8-GPU?

8. The HGX H100 8-GPU carries 8 NVIDIA H100 SXM5 80GB accelerators in a baseboard form factor, and every throughput figure on this page is the total across them. H100 specifications →

Documentation & Resources

Flopper Spec Sheet

NVIDIA HGX H100 8-GPU specifications, generated from our database. Printable.

Vendor product page

NVIDIA HGX H100 8-GPU documentation

View ↗

NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition Datasheet

NVIDIA • 2026-06-01

View Document ↗

NVIDIA DGX Documentation

System guides, deployment resources

Browse ↗

Typical Use Cases

Large Language Model Training
Distributed Deep Learning
Multi-GPU Inference
HPC Simulations
Scientific Computing

The NVIDIA HGX H100 8-GPU runs 8× H100 GPUs over NVSwitch + NVLink, delivering 15,832 TFLOPS FP8 dense.

© 2026 Flopper.io - Compare the GPUs Powering AI