Existing Confirmed

Paper on Llama 3.1

Meta AI • July 23, 2024
Total GPUs
16.4K
H100 Equiv
16.4K
Power
23.4 MW
FP16
16.2K PF

System Equivalents

This datacenter's 16.4K GPUs equal:

NVIDIA DGX H100
8 GPUs/system
2.0K
NVIDIA HGX H100 (8-GPU)
8 GPUs/system
2.0K
NVIDIA HGX H100 (4-GPU)
4 GPUs/system
4.1K

Specifications

Primary GPUNVIDIA H100 SXM5 80GB
GPU Count16.4K
SectorPrivate