Flopper.io Flopper.io
Existing Confirmed

Paper on xTrimoPGLM

BioMap Research • July 6, 2023
Total GPUs
768
H100 Equiv
242
Power
0.6 MW
FP16
240 PF

System Equivalents

This datacenter's 768 GPUs equal:

NVIDIA DGX A100
8 GPUs/system
96
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
96

Specifications

Primary GPUNVIDIA A100
GPU Count768
SectorPublic/Private

Additional Information

xTrimoPGLM-100B is trained on a cluster of 96 DGX-A100 GPU (8×40G) servers. Calculation - 96 servers×8 GPUs/server= 768 GPUs ​

Related Datacenters

Oracle OCI Supercluster A100s
10.3K H100 equiv
Existing
Microsoft GPT-4 cluster
7.9K H100 equiv
Existing
Meta Research SuperCluster (RSC-1) Phase 2
5.0K H100 equiv
Existing
EuroHPC Leonardo
4.4K H100 equiv
Existing
Amazon Titan training cluster
4.3K H100 equiv
Existing

Data Source

Data from Epoch AI (CC-BY 4.0)

Sources:

Explore More

View All Datacenters