Existing Confirmed

Meta GenAI 2024a

Meta AI • United States of America • March 12, 2024
Total GPUs
24.6K
H100 Equiv
24.6K
Power
35.1 MW
FP16
24.3K PF

System Equivalents

This datacenter's 24.6K GPUs equal:

NVIDIA DGX H100
8 GPUs/system
3.1K
NVIDIA HGX H100 (8-GPU)
8 GPUs/system
3.1K
NVIDIA HGX H100 (4-GPU)
4 GPUs/system
6.1K

Specifications

Primary GPUNVIDIA H100 SXM5 80GB
GPU Count24.6K
SectorPrivate

Additional Information

Today, we’re sharing details on two versions of our 24,576-GPU data center scale cluster at Meta

At least one of these was used to train Llama 3