- Home
- Datacenters
- Paper on PaLM
Existing Confirmed
Paper on PaLM
Google • United States of America • April 5, 2022
Total GPUs
6.1K
H100 Equiv
853
Power
2.2 MW
FP16
1.7K PF
Specifications
| Primary GPU | Google TPU v4 |
| GPU Count | 6.1K |
| Sector | Private |
Additional Information
"We trained PaLM on 6144 TPU v4 chips using Pathways,"