Existing Confirmed

Paper on Stable LM

Stability AI • January 18, 2023
Total GPUs
512
H100 Equiv
161
Power
0.4 MW
FP16
160 PF

System Equivalents

This datacenter's 512 GPUs equal:

NVIDIA DGX A100
8 GPUs/system
64
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
64

Specifications

Primary GPUNVIDIA A100 SXM4 40 GB
GPU Count512
SectorPrivate

Additional Information

"Hardware: Stable LM 2 1.6B was trained on the Stability AI cluster across 512 NVIDIA A100 40GB GPUs (AWS P4d instances)."