Existing Likely

Oracle OCI Supercluster A100s

Oracle • United States of America • November 15, 2023
Total GPUs
32.8K
H100 Equiv
10.3K
Power
27.2 MW
FP16
10.2K PF

System Equivalents

This datacenter's 32.8K GPUs equal:

NVIDIA DGX A100
8 GPUs/system
4.1K
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
4.1K

Specifications

Primary GPUNVIDIA A100
GPU Count32.8K
SectorPrivate

Additional Information

OCI Supercluster networking can now scale up to 4,096 OCI Compute Bare Metal instances with 32,768 A100 GPUs

Unclear exactly when this first became operational, if it was ever built. The announcement March 2023 states Oracle OCI can now scale to 32k A100s, but it's unclear whether this implies that a 32k A100 cluster has already been built, or just that they have the capacity to build one. It seems likely that a cluster of this size was built, but there's little direct evidence for this. I estimate Q4 2023 to be slightly conservative on the timing for when it was first operational.