Existing Confirmed

Paper on HyperCLOVA

NAVER • Korea (Republic of) • September 10, 2021
Total GPUs
1.0K
H100 Equiv
322
Power
0.9 MW
FP16
319 PF

System Equivalents

This datacenter's 1.0K GPUs equal:

NVIDIA DGX A100
8 GPUs/system
128
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
128

Specifications

Primary GPUNVIDIA A100
GPU Count1.0K
SectorPrivate

Additional Information

"Our model is based on megatron-LM (Shoeybi et al., 2019) and trained on the NVIDIA Superpod, which includes 128 strongly clustered DGX servers with 1,024 A100 GPUs."