Flopper.io Flopper.io
Existing Confirmed

MosaicML MPT training cluster

MosaicML • March 5, 2023
Total GPUs
440
H100 Equiv
138
Power
0.4 MW
FP16
137 PF

System Equivalents

This datacenter's 440 GPUs equal:

NVIDIA DGX A100
8 GPUs/system
55
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
55

Specifications

Primary GPUNVIDIA A100
GPU Count440

Additional Information

"over 9.5 days on 440 GPUs,"

Related Datacenters

Oracle OCI Supercluster A100s
10.3K H100 equiv
Existing
Microsoft GPT-4 cluster
7.9K H100 equiv
Existing
Meta Research SuperCluster (RSC-1) Phase 2
5.0K H100 equiv
Existing
EuroHPC Leonardo
4.4K H100 equiv
Existing
Amazon Titan training cluster
4.3K H100 equiv
Existing

Data Source

Data from Epoch AI (CC-BY 4.0)

Sources:

Explore More

View All Datacenters