Flopper.io Flopper.io
Existing Confirmed

Paper on Polyglot

EleutherAI,Stability AI • June 4, 2023
Total GPUs
256
H100 Equiv
80
Power
0.2 MW
FP16
80 PF

System Equivalents

This datacenter's 256 GPUs equal:

NVIDIA DGX A100
8 GPUs/system
32
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
32

Specifications

Primary GPUNVIDIA A100
GPU Count256
SectorPrivate

Additional Information

"Additionally, we received invaluable assistance from Stability AI2 , who provided access to 256 A100s (8 * 32 nodes) on HPC clusters"

Related Datacenters

Oracle OCI Supercluster A100s
10.3K H100 equiv
Existing
Microsoft GPT-4 cluster
7.9K H100 equiv
Existing
Meta Research SuperCluster (RSC-1) Phase 2
5.0K H100 equiv
Existing
EuroHPC Leonardo
4.4K H100 equiv
Existing
Amazon Titan training cluster
4.3K H100 equiv
Existing

Data Source

Data from Epoch AI (CC-BY 4.0)

Sources:

Explore More

View All Datacenters