- Home
- Datacenters
- Paper on GLM-130B
Existing Confirmed
Paper on GLM-130B
Zhipu AI • October 5, 2022
Total GPUs
768
H100 Equiv
242
Power
0.7 MW
FP16
240 PF
System Equivalents
This datacenter's 768 GPUs equal:
NVIDIA DGX A100
8 GPUs/system
96
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
96
Specifications
| Primary GPU | NVIDIA A100 |
| GPU Count | 768 |
| Sector | Public/Private |
Additional Information
"Specifically, GLM-130B is a bilingual (English and Chinese) bidirectional dense model with 130 billion parameters, pre-trained over 400 billion tokens on a cluster of 96 NVIDIA DGX-A100 (8×40G) GPU nodes"