Existing Likely

Paper on T5

Google • October 23, 2019
Total GPUs
512
H100 Equiv
31
Power
0.3 MW
FP16
63 PF