Existing Likely

ND A100 v4

Microsoft • United States of America • June 1, 2021
Total GPUs
2.0K
H100 Equiv
630
Power
1.7 MW
FP16
624 PF

System Equivalents

This datacenter's 2.0K GPUs equal:

NVIDIA DGX A100
8 GPUs/system
250
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
250

Specifications

Primary GPUNVIDIA A100
GPU Count2.0K
SectorPrivate

Additional Information

"The ND A100 v4 series starts with a single VM and eight NVIDIA Ampere A100 40GB Tensor Core GPUs. ND A100 v4-based deployments can scale up to thousands of GPUs"

They ran the high performance LINPACK benchmark on a pool of 164 8xA100 VMs, so the clusters can include at least 1312 A100s. This might be a slice of a larger cluster. Estimating as 2k since it says "thousands"