Existing Confirmed

Paper on Meena

Google • January 27, 2020
Total GPUs
1.0K
H100 Equiv
63
Power
0.5 MW
FP16
126 PF

Specifications

Primary GPUGoogle TPU v3
GPU Count1.0K
SectorPrivate

Additional Information

"We trained our best model for 30 days on a TPUv3 Pod (2,048 TPU cores)"