Existing Likely

OpenAI/Microsoft Goodyear Arizona

Microsoft,OpenAI • United States of America • October 2, 2024
Total GPUs
100.0K
H100 Equiv
100.0K
Power
142.7 MW
FP16
98.9K PF

System Equivalents

This datacenter's 100.0K GPUs equal:

NVIDIA DGX H100
8 GPUs/system
12.5K
NVIDIA HGX H100 (8-GPU)
8 GPUs/system
12.5K
NVIDIA HGX H100 (4-GPU)
4 GPUs/system
25.0K

Specifications

Primary GPUNVIDIA H100 SXM5 80GB
GPU Count100.0K
Location33°24'28.7"N 112°21'54.3"W Goodyear, Arizona, USA
SectorPrivate

Additional Information

"You already have 100K clusters. OpenAI in Arizona" "Our data shows one of OpenAI’s next training supercomputers in Arizona was going to have more than 75,000+ GPUs in a singular site by the middle of next year"

It seems likely that this became operational in phases. It seems like 75k were likely available sometime mid 2024, and ~160k will be available in the future. There is very little official public data about this cluster, it's almost all infrences/rumors Microsoft appears to own it and rent it to OpenAI The Semianalysis lecture estimates that there are 32k H100s (48MW) per building. Satellite data as of Dec 2024 seems to show that 5 building are now complete (though this doesn't imply that the clusters inside have been built or are operational). This would imply that the cluster is growing to ~160k GPUs. It's also unclear if the newer buildings would still have Hoppers or would have Blackwell chips I personally suspect that this cluster was one of the primary clusters for training GPT4.5