Existing Likely

Together AI H100 Cluster

Together AI • United States of America • October 16, 2023
Total GPUs
4.4K
H100 Equiv
4.4K
Power
6.4 MW
FP16
4.4K PF

System Equivalents

This datacenter's 4.4K GPUs equal:

NVIDIA DGX H100
8 GPUs/system
553
NVIDIA HGX H100 (8-GPU)
8 GPUs/system
553
NVIDIA HGX H100 (4-GPU)
4 GPUs/system
1.1K

Specifications

Primary GPU NVIDIA H100 SXM5 80GB
GPU Count 4.4K
Sector Private

Additional Information

Our first large H100 cluster (4424 GPUs) starts coming online today!

Unclear if all the GPUs are networked together