Existing Confirmed

Paper on BloombergGPT

Bloomberg • March 30, 2023
Total GPUs
512
H100 Equiv
161
Power
0.4 MW
FP16
160 PF

System Equivalents

This datacenter's 512 GPUs equal:

NVIDIA DGX A100
8 GPUs/system
64
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
64

Specifications

Primary GPU NVIDIA A100
GPU Count 512
Sector Private

Additional Information

"This yields a total of 512 40GB A100 GPUs"