- Home
- Datacenters
- Paper on OPT
Existing Confirmed
Paper on OPT
Meta AI • May 2, 2022
Total GPUs
992
H100 Equiv
312
Power
0.8 MW
FP16
310 PF
System Equivalents
This datacenter's 992 GPUs equal:
NVIDIA DGX A100
8 GPUs/system
124
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
124
Specifications
| Primary GPU | NVIDIA A100 SXM4 80 GB |
| GPU Count | 992 |
| Sector | Private |
Additional Information
"We are also releasing both the logbook of our model creation as well as our codebase, metaseq,3 which enabled training OPT-175B on 992 80GB A100 GPUs,"