Existing Likely

Paper on YaLM

Yandex • June 23, 2022
Total GPUs
800
H100 Equiv
252
Power
0.7 MW
FP16
250 PF

System Equivalents

This datacenter's 800 GPUs equal:

NVIDIA DGX A100
8 GPUs/system
100
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
100

Specifications

Primary GPUNVIDIA A100
GPU Count800

Additional Information

"It took us 65 days to train the model on a pool of 800 A100 graphics cards"