Existing Confirmed

Paper on LaMDA

Google • January 20, 2022
Total GPUs
1.0K
H100 Equiv
63
Power
0.5 MW
FP16
126 PF

Specifications

Primary GPUGoogle TPU v3
GPU Count1.0K
SectorPrivate

Additional Information

"We pre-trained LaMDA on 1024 TPU-v3 chips"