Existing Confirmed

Paper on PaLI

Google • United States of America • September 14, 2022
Total GPUs
1.0K
H100 Equiv
142
Power
0.4 MW
FP16
282 PF

Specifications

Primary GPU Google TPU v4
GPU Count 1.0K
Sector Private

Additional Information

"The largest model, PaLI-17B, is pretrained using 1,024 GCP-TPUv4 chips for 7 days."