Flopper.io Flopper.io
Existing Confirmed

Paper on Florence

Microsoft • November 22, 2021
Total GPUs
512
H100 Equiv
161
Power
0.4 MW
FP16
160 PF

System Equivalents

This datacenter's 512 GPUs equal:

NVIDIA DGX A100
8 GPUs/system
64
NVIDIA HGX A100 (8-GPU)
8 GPUs/system
64

Specifications

Primary GPUNVIDIA A100 SXM4 40 GB
GPU Count512
SectorPrivate

Additional Information

"The model takes 10 days to train on 512 NVIDIA-A100 GPUs with 40GB memory per GPU."

Related Datacenters

Microsoft NVIDIA partnership
15.0K H100 equiv
Planned
Microsoft Azure Eagle
14.4K H100 equiv
Existing
Microsoft Azure MLPerf 3.1 Submission
10.8K H100 equiv
Existing
Microsoft Sweden Sandviken
6.7K H100 equiv
Planned
Microsoft Sweden Gävle
6.7K H100 equiv
Planned

Data Source

Data from Epoch AI (CC-BY 4.0)

Sources:

Explore More

View All Datacenters