- Home
- Datacenters
- Paper on Gemma 2 27B
Existing Confirmed
Paper on Gemma 2 27B
Google • June 27, 2024
Total GPUs
6.1K
H100 Equiv
2.9K
FP16
2.8K PF
Specifications
| Primary GPU | Google TPU v5p |
| GPU Count | 6.1K |
| Sector | Private |
Additional Information
we train on an 8x24x32 configuration of TPUv5p, totaling 6144 chips
'Table 3 | Training infrastructure with sharding' in 27B row lists 6144 in #Chips column