- Home
- Datacenters
- Paper on Megatron-LM
Existing Confirmed
Paper on Megatron-LM
NVIDIA • United States of America • September 17, 2019
Total GPUs
512
H100 Equiv
32
Power
0.3 MW
FP16
64 PF
Specifications
| Primary GPU | NVIDIA Tesla V100 DGXS 32 GB |
| GPU Count | 512 |
| Sector | Private |