- Home
- Datacenters
- Paper on RoBERTa
Existing Confirmed
Paper on RoBERTa
Meta AI • United States of America • July 26, 2019
Total GPUs
1.0K
H100 Equiv
64
Power
0.6 MW
FP16
128 PF
Specifications
| Primary GPU | NVIDIA Tesla V100 DGXS 32 GB |
| GPU Count | 1.0K |
| Sector | Private |
Additional Information
We pretrain our model using 1024 V100 GPUs for approximately one day