- Home
- Datacenters
- Paper on Gemma 2 9B
Existing Confirmed
Paper on Gemma 2 9B
Google • United States of America • June 27, 2024
Total GPUs
4.1K
H100 Equiv
569
Power
1.4 MW
FP16
1.1K PF
Specifications
| Primary GPU | Google TPU v4 |
| GPU Count | 4.1K |
| Sector | Private |
Additional Information
"For the 9B model, we train on an 8x16x32 configuration of TPUv4, totaling 4096 chips,"