Existing Confirmed

Paper on Flamingo

Google • United States of America • April 29, 2022
Total GPUs
1.5K
H100 Equiv
213
Power
0.6 MW
FP16
422 PF

Specifications

Primary GPUGoogle TPU v4
GPU Count1.5K
SectorPrivate

Additional Information

"All training and evaluation was performed on TPUv4 instances. The largest model containing 80 billion parameters is trained on 1536 chips"