Planned Likely

Google A3 VMs

Google • United States of America
Total GPUs
26.0K
H100 Equiv
26.0K
Power
36.4 MW
FP16
25.7K PF

System Equivalents

This datacenter's 26.0K GPUs equal:

NVIDIA DGX H100
8 GPUs/system
3.3K
NVIDIA HGX H100 (8-GPU)
8 GPUs/system
3.3K
NVIDIA HGX H100 (4-GPU)
4 GPUs/system
6.5K

Specifications

Primary GPUNVIDIA H100 SXM5 80GB
GPU Count26.0K
SectorPrivate

Additional Information

"“For our largest customers, we can build A3 supercomputers up to 26,000 GPUs in a single cluster and are working to build multiple clusters in our largest regions,” a Google spokeswoman said in an email"

The A3 supercomputer seems to refer to an amalgamation of different clusters available as a virtual machine via the cloud and is operational. 26k is the size of the largest individual cluster they say they can build as part of this. It is unclear if a cluster of this size has been constructed. If it has, it could have been in 2024