- Home
- Datacenters
- Paper on Pythia
Existing Confirmed
Paper on Pythia
EleutherAI • April 3, 2023
Total GPUs
256
H100 Equiv
80
Power
0.2 MW
FP16
80 PF
System Equivalents
This datacenter's 256 GPUs equal:
NVIDIA DGX A100
8 GPUs/system
32
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
32
Specifications
| Primary GPU | NVIDIA A100 |
| GPU Count | 256 |
| Sector | Private |
Additional Information
"All GPUs are A100s with 40GB of memory",
Appendix D table with GPU counts for each model size