NVIDIA DGX A100 640GB

rack
8× A100
NVSwitch + NVLink
2020
FP64
0.1
PFLOPS
FP32
0.2
PFLOPS
Power
6.5
kW Total
Memory
640
GB Total

DGX A100 with 640GB total GPU memory

We will point you at suppliers who have it. Free, and no signup.

FP64
0.08
PFLOPS
11.9 TFLOPS/kW
FP32
0.16
PFLOPS
24.0 TFLOPS/kW
TF32
1.25
PFLOPS
192.0 TFLOPS/kW
FP16
2.50
PFLOPS
384.0 TFLOPS/kW

System Details

GPU Configuration

GPU Count: 8 GPUs
Architecture: Ampere
Interconnect: NVSwitch + NVLink

System Specifications

Form Factor: rack
Total Power: 6.5 kW
Total Memory: 640 GB
Memory Bandwidth: 16.3 TB/s

Precision Performance Breakdown

PrecisionSystem PerformancePer GPUEfficiency
0.078 PFLOPS 9.7 TFLOPS 11.9 TFLOPS/kW
0.156 PFLOPS 19.5 TFLOPS 24.0 TFLOPS/kW
1.248 PFLOPS 156.0 TFLOPS 192.0 TFLOPS/kW
2.496 PFLOPS 312.0 TFLOPS 384.0 TFLOPS/kW
2.496 PFLOPS 312.0 TFLOPS 384.0 TFLOPS/kW
4.992 PFLOPS 624.0 TFLOPS 768.0 TFLOPS/kW

Where a vendor states a basis, the figure shown is the dense one, and any figure it publishes is listed separately. Vendors commonly headline the sparse number instead: for NVIDIA's 2:4 structured sparsity that is exactly twice the dense figure, though other vendors' sparse modes do not all follow that ratio.

Powered by NVIDIA A100

This system utilizes 8 × NVIDIA A100 SXM4 80GB GPUs, each delivering exceptional performance for AI and HPC workloads.

Per GPU TDP

400W

Per GPU Memory

80 GB

Process Node

7nm

Architecture

Ampere

Documentation & Resources

Flopper Spec Sheet

NVIDIA DGX A100 640GB specifications, generated from our database. Printable.

Vendor product page

NVIDIA DGX A100 640GB documentation

View ↗

workstation-datasheet-dgx-spark-gtc25-spring-nvidia-us-3716899-web.pdf

NVIDIA • 2025-10-16

View Document ↗

NVIDIA DGX Documentation

System guides, deployment resources

Browse ↗

Typical Use Cases

Large Language Model Training
Distributed Deep Learning
Multi-GPU Inference
HPC Simulations
Scientific Computing

The NVIDIA DGX A100 640GB runs 8× A100 GPUs over NVSwitch + NVLink, delivering 2.50 PFLOPS BF16 dense.