Existing Confirmed

Paper on SEER

Meta AI • March 2, 2021
Total GPUs
512
H100 Equiv
32
Power
0.3 MW
FP16
64 PF

Specifications

Primary GPUNVIDIA V100
GPU Count512
SectorPrivate

Additional Information

"Training this model on 1 billion images requires 114,890 training iterations for a batch size of 8, 704 images, summing to 8 days of training over 512 GPUs."