Existing Confirmed

Tesla 10k H100 Cluster

Tesla • United States of America • August 28, 2023
Total GPUs
10.0K
H100 Equiv
10.0K
Power
14.5 MW
FP16
9.9K PF

System Equivalents

This datacenter's 10.0K GPUs equal:

NVIDIA DGX H100
8 GPUs/system
1.3K
NVIDIA HGX H100 (8-GPU)
8 GPUs/system
1.3K
NVIDIA HGX H100 (4-GPU)
4 GPUs/system
2.5K

Specifications

Primary GPUNVIDIA H100 SXM5 80GB
GPU Count10.0K
Location"on prem" for Tesla
SectorPrivate

Additional Information

Tomorrow, @Tesla will turn on a massive and very expensive 10,000 unit NVIDIA H100 GPU cluster to help it train FSD

There are claims of the cluster costing $300 million, however, that was not an official anouncement and might just be a BOTEC "30k per H100 times 10,000