- Home
- Datacenters
- Paper on ViT-22B
Existing Confirmed
Paper on ViT-22B
Google • United States of America • February 10, 2023
Total GPUs
1.0K
H100 Equiv
142
Power
0.4 MW
FP16
282 PF
Specifications
| Primary GPU | Google TPU v4 |
| GPU Count | 1.0K |
| Sector | Private |
Additional Information
"ViT-22B was trained on 1024 TPU V4 chips for 177K steps"