Existing Confirmed

Paper on PaLI

Google • United States of America • September 14, 2022
Total GPUs
1.0K
H100 Equiv
142
Power
0.4 MW
FP16
282 PF

Specifications

Primary GPUGoogle TPU v4
GPU Count1.0K
SectorPrivate

Additional Information

"The largest model, PaLI-17B, is pretrained using 1,024 GCP-TPUv4 chips for 7 days."