Existing Likely

Together AI H100 Cluster

Together • United States of America • October 16, 2023
Total GPUs
4.4K
H100 Equiv
4.4K
Power
6.4 MW
FP16
4.4K PF

System Equivalents

This datacenter's 4.4K GPUs equal:

NVIDIA DGX H100
8 GPUs/system
553
NVIDIA HGX H100 (8-GPU)
8 GPUs/system
553
NVIDIA HGX H100 (4-GPU)
4 GPUs/system
1.1K

Specifications

Primary GPUNVIDIA H100 SXM5 80GB
GPU Count4.4K
SectorPrivate

Additional Information

Our first large H100 cluster (4424 GPUs) starts coming online today!

Unclear if all the GPUs are networked together