Existing Confirmed

Microsoft Azure MLPerf 3.1 Submission

Microsoft • United States of America • November 8, 2023
Total GPUs
10.8K
H100 Equiv
10.8K
Power
15.6 MW
FP16
10.6K PF

System Equivalents

This datacenter's 10.8K GPUs equal:

NVIDIA DGX H100
8 GPUs/system
1.3K
NVIDIA HGX H100 (8-GPU)
8 GPUs/system
1.3K
NVIDIA HGX H100 (4-GPU)
4 GPUs/system
2.7K

Specifications

Primary GPUNVIDIA H100 SXM5 80GB
GPU Count10.8K
SectorPrivate

Additional Information

The GPT-3 LLM model and its 175 billion parameters were trained to completion in four minutes on 1,344 ND H100 v5 virtual machines (VMs), which represent 10,752 NVIDIA H100 Tensor Core GPUs

Likely is CoreWeave Eos-DFW Phase 1