- Home
- Datacenters
- Paper on M6-T
Existing Confirmed
Paper on M6-T
Alibaba • May 31, 2021
Total GPUs
480
H100 Equiv
30
Power
0.3 MW
FP16
60 PF
Specifications
| Primary GPU | NVIDIA Tesla V100 SXM2 32 GB |
| GPU Count | 480 |
| Sector | Private |
Additional Information
Weadvance our models to 1 trillion parameters and successfully implement it on solely 480 NVIDIA V100-32GB GPUs, in comparison with the recent SOTAs on 2048 TPU cores.