Existing Confirmed

Paper on AFM-on-device

Google • June 10, 2024
Total GPUs
2.0K
H100 Equiv
950
FP16
940 PF

Specifications

Primary GPUGoogle TPU v5p
GPU Count2.0K
SectorPrivate

Additional Information

"AFM-on-device was trained on one slice of 2048 TPUv5p chips." "The AFM models are pre-trained on v4 and v5p Cloud TPU clusters"

Cloud TPU clusters implies they trained on Google infrastructure