Flopper.io Flopper.io
Existing Confirmed

Paper on LLaMA

Meta AI • February 27, 2023
Total GPUs
2.0K
H100 Equiv
645
Power
1.7 MW
FP16
639 PF

System Equivalents

This datacenter's 2.0K GPUs equal:

NVIDIA DGX A100
8 GPUs/system
256
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
256

Specifications

Primary GPUNVIDIA A100 SXM4 80 GB
GPU Count2.0K
SectorPrivate

Additional Information

"Finally, we estimate that we used 2048 A100-80GB for a period of approximately 5 months to develop our models."

Related Datacenters

Meta $200B Campus Rumor
20.3M H100 equiv
Planned
Meta Louisiana Datacenter
5.1M H100 equiv
Planned
Meta Prometheus New Albany
1.3M H100 equiv
Planned
Meta 100k
100.0K H100 equiv
Existing
Meta GenAI 2024a
24.6K H100 equiv
Existing

Data Source

Data from Epoch AI (CC-BY 4.0)

Sources:

Explore More

View All Datacenters