Existing Likely

AWS EC2 P5 UltraClusters

Amazon • United States of America • July 26, 2023
Total GPUs
20.0K
H100 Equiv
20.0K
Power
29.0 MW
FP16
19.8K PF

System Equivalents

This datacenter's 20.0K GPUs equal:

NVIDIA DGX H100
8 GPUs/system
2.5K
NVIDIA HGX H100 (8-GPU)
8 GPUs/system
2.5K
NVIDIA HGX H100 (4-GPU)
4 GPUs/system
5.0K

Specifications

Primary GPUNVIDIA H100 SXM5 80GB
GPU Count20.0K
LocationUnited States of America
SectorPrivate

Additional Information

To address customer needs for large-scale and low latency, P5 instances are deployed in the second-generation EC2 UltraClusters, which now provide customers with lower latency across up to 20,000+ NVIDIA H100 Tensor Core GPUs.

Likely several such clusters in the same availability zone