- Home
- Datacenters
- AWS Fast BERT Training
Existing Confirmed
AWS Fast BERT Training
Amazon • United States of America • December 3, 2019
Total GPUs
2.0K
H100 Equiv
129
Power
1.4 MW
FP16
256 PF
Specifications
| Primary GPU | NVIDIA V100 |
| GPU Count | 2.0K |
| Sector | Private |
Additional Information
With TensorFlow, we achieved unprecedented scale with 2,048 GPUs on 256 P3dn.24xlarge instances to train BERT in 62 minutes