HPE Cray XD670 vs NVIDIA HGX H200

Accelerator configuration, aggregate memory, bandwidth and power, side by side.

Specifications

SpecificationHPE Cray XD670NVIDIA HGX H200
VendorHPENVIDIA
Part number
Form factorrackbaseboard
Released20242024
Accelerator8x H2008x H200
Aggregate memory1.1 TB1.1 TB
Aggregate bandwidth38.4 TB/s38.4 TB/s
System power8.0 kW
InterconnectNVIDIA NVLink with NVSwitch across the eight SXM modulesNVSwitch + NVLink

Rows shown in grey are identical between the two.

HPE Cray XD670

A 5U server carrying eight NVIDIA H200 SXM GPUs at 700 W each with 141 GB of HBM3e apiece, driven by a single two-socket node of 5th generation Intel Xeon Scalable processors at up to 400 W, with 32 DDR5 DIMMs across eight channels per socket at up to 5,600 MHz. It is air cooled with a direct liquid cooling option. HPE has taken six first-place results with it in MLPerf Inference v5.1, including computer vision and LLM chat and text generation. Two things this row deliberately does not claim: HPE describes the GPUs only as "8x NVIDIA H200 SXM" and never names the HGX baseboard, though eight H200 SXM at 700 W is precisely the HGX H200 8-GPU configuration, and the compute figures shown are NVIDIA's for that baseboard rather than any HPE claim; and HPE publishes component TDPs but no system power figure, so total power is left blank rather than summing 8 x 700 W and 2 x 400 W, which would count silicon only and understate the machine. Part numbers are also not recorded, since none appears on HPE's page.

Vendor product page

NVIDIA HGX H200

HGX platform for cloud providers with H200 GPUs

Vendor product page