Existing Likely

Tesla Training Cluster

Tesla • United States of America • August 20, 2021
Total GPUs
4.0K
H100 Equiv
1.3K
Power
3.5 MW
FP16
1.3K PF

System Equivalents

This datacenter's 4.0K GPUs equal:

NVIDIA DGX A100
8 GPUs/system
504
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
504

Specifications

Primary GPUNVIDIA A100
GPU Count4.0K
SectorPrivate

Additional Information

as well as the previously mentioned 5670 system which is used for training, it has a second, 4032 GPU system for training and a 1752 GPU system for auto-labeling

I'm assuming these are A100s because H100s weren't out yet at the time and that is what the other cluster mentioned has