Existing Confirmed

Google TPU v4 Pod

Google • United States of America • May 19, 2021
Total GPUs
4.1K
H100 Equiv
569
Power
1.5 MW
FP16
1.1K PF

Specifications

Primary GPUGoogle TPU v4
GPU Count4.1K
SectorPrivate

Additional Information

"Google deploys the chips in its own data centers, combining them in pods of 4,096 TPUs" "TPU v3. 4,096 of these TPU v4 chips are networked together to create a TPU v4 Pod"

Used in July 2021 MLPerf benchmark, mentioned May 2021, likely operational beforehand