Flopper.io
Flopper.io System Specification Sheet

NVIDIA DGX B200

8x B200 Blackwell rack 2024

Overview

36.0
FP8 PFLOPS Dense
1.4 TB
Aggregate Memory
64.0 TB/s
Aggregate Bandwidth
14.3 kW
Aggregate Power

Performance Metrics

PrecisionPeak (PFLOPS)Per GPU (TFLOPS)TFLOPS/W
FP640.337.0
FP320.675.0
TF328.81100.0
FP1618.02250.0
BF1618.02250.0
FP836.04500.0
FP472.09000.0
INT836.04500.0

All figures are dense. Vendors commonly headline the sparse number, which is twice the dense one.

Configuration

Accelerator
B200 SXM 180GB
Count
8
Memory per GPU
180 GB
Bandwidth per GPU
7.7 TB/s

Power & Efficiency

Aggregate Power
14.3 kW
TDP per GPU
1000 W
FP8 Efficiency
2.52 TFLOPS/W
Aggregate Bandwidth
64.0 TB/s

System Details

Vendor: NVIDIA
Family: DGX
Architecture: Blackwell
Form Factor: rack
Release Year: 2024
Process Node: 4nm

Interconnect

NVLink 5.0 / 2x NVSwitch, 14.4 TB/s aggregate

Notes

Unveiled at GTC March 2024. 10 RU air-cooled chassis with 2x Intel Xeon Platinum 8570 (112 cores) and 2 TB system memory, configurable to 4 TB. Networking is 4x OSFP serving 8x single-port ConnectX-7 plus 2x dual-port QSFP112 BlueField-3 DPUs, each up to 400 Gb/s. Same eight B200 SXM parts as HGX B200; the 14.3 kW figure is the whole system, against 10.2 kW for the bare baseboard.