Existing Confirmed

Paper on Chameleon

Meta AI • May 16, 2024
Total GPUs
3.1K
H100 Equiv
968
Power
2.5 MW
FP16
958 PF

System Equivalents

This datacenter's 3.1K GPUs equal:

NVIDIA DGX A100
8 GPUs/system
384
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
384

Specifications

Primary GPUNVIDIA A100
GPU Count3.1K
SectorPrivate

Additional Information

"NVIDIA A100 80GB GPUs power both environments."

Table 2 Chemeleon Model Pre-Training Resource Usage lists 3072 Concurrent GPUs for the 34B model.