NVIDIA DGX B200 vs NVIDIA DGX H200

Accelerator configuration, aggregate memory, bandwidth and power, side by side.

Specifications

SpecificationNVIDIA DGX B200NVIDIA DGX H200
VendorNVIDIANVIDIA
Part number
Form factorrackrack
Released20242024
Accelerator8x B2008x H200
Aggregate memory1.4 TB1.1 TB
Aggregate bandwidth64.0 TB/s38.4 TB/s
System power14.3 kW8.5 kW
InterconnectNVLink 5.0 / 2x NVSwitch, 14.4 TB/s aggregateNVSwitch + NVLink

Rows shown in grey are identical between the two.

NVIDIA DGX B200

Unveiled at GTC March 2024. 10 RU air-cooled chassis with 2x Intel Xeon Platinum 8570 (112 cores) and 2 TB system memory, configurable to 4 TB. Networking is 4x OSFP serving 8x single-port ConnectX-7 plus 2x dual-port QSFP112 BlueField-3 DPUs, each up to 400 Gb/s. Same eight B200 SXM parts as HGX B200; the 14.3 kW figure is the whole system, against 10.2 kW for the bare baseboard.

Vendor product page

NVIDIA DGX H200

Latest DGX system with H200 GPUs and 141GB HBM3e memory per GPU

Vendor product page