- Home
- Datacenters
- Paper on EVA
Existing Confirmed
Paper on EVA
• November 14, 2022
Total GPUs
256
H100 Equiv
80
Power
0.2 MW
FP16
80 PF
System Equivalents
This datacenter's 256 GPUs equal:
NVIDIA DGX A100
8 GPUs/system
32
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
32
Specifications
| Primary GPU | NVIDIA A100 |
| GPU Count | 256 |
| Sector | Public/Private |
Additional Information
"These modifications allow us to train a 1.1B CLIP with a batch size of 41k on 256× NVIDIA A100 40GB GPUs."