- Home
- Datacenters
- Paper on Falcon 180B
Existing Confirmed
Paper on Falcon 180B
Amazon • November 28, 2023
Total GPUs
4.1K
H100 Equiv
1.3K
Power
3.4 MW
FP16
1.3K PF
System Equivalents
This datacenter's 4.1K GPUs equal:
NVIDIA DGX A100
8 GPUs/system
512
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
512
Specifications
| Primary GPU | NVIDIA A100 |
| GPU Count | 4.1K |
| Sector | Private |
Additional Information
pretrain these models on up to 4,096 A100s on cloud AWS infrastructure