NVIDIA DGX A100 320GB

rack
8× A100
NVSwitch + NVLink
2020
FP64
78
TFLOPS
FP32
156
TFLOPS
Power
6.0
kW Total
Memory
320
GB Total

DGX A100 with 320GB total GPU memory

We will point you at suppliers who have it. Free, and no signup.

FP64
78
TFLOPS
12.9 TFLOPS/kW
FP32
156
TFLOPS
26.0 TFLOPS/kW
TF32
1,248
TFLOPS
208.0 TFLOPS/kW
FP16
2,496
TFLOPS
416.0 TFLOPS/kW

System Details

GPU Configuration

GPU Count: 8 GPUs
Architecture: Ampere
Interconnect: NVSwitch + NVLink

System Specifications

Form Factor: rack
Total Power: 6.0 kW
Total Memory: 320 GB
Memory Bandwidth: 12.4 TB/s

Precision Performance Breakdown

PrecisionSystem PerformancePer GPUEfficiency
78 TFLOPS 9.7 TFLOPS 12.9 TFLOPS/kW
156 TFLOPS 20 TFLOPS 26.0 TFLOPS/kW
1,248 TFLOPS 156 TFLOPS 208.0 TFLOPS/kW
2,496 TFLOPS 312 TFLOPS 416.0 TFLOPS/kW
2,496 TFLOPS 312 TFLOPS 416.0 TFLOPS/kW
4,992 TOPS 624 TOPS 832.0 TFLOPS/kW

Where a vendor states a basis, the figure shown is the dense one, and any figure it publishes is listed separately. Vendors commonly headline the sparse number instead: for NVIDIA's 2:4 structured sparsity that is exactly twice the dense figure, though other vendors' sparse modes do not all follow that ratio.

Powered by NVIDIA A100

This system utilizes 8 × NVIDIA A100 PCIe 40GB GPUs, each delivering exceptional performance for AI and HPC workloads.

Per GPU TDP

250W

Per GPU Memory

40 GB

Process Node

7nm

Architecture

Ampere

Frequently asked questions

How much does the DGX A100 320GB cost?

NVIDIA sells the DGX A100 320GB on quote through OEMs and resellers, and Flopper has no live rental listing for its A100 accelerator to derive an hourly figure from. System rental pricing →

How much power does the DGX A100 320GB require?

NVIDIA rates the DGX A100 320GB at 6 kW, which is the figure to plan power delivery and cooling around; per-GPU draw is listed on the accelerator's own page.

How many GPUs are in the DGX A100 320GB?

8. The DGX A100 320GB carries 8 NVIDIA A100 PCIe 40GB accelerators in a rack form factor, and every throughput figure on this page is the total across them. A100 specifications →

Documentation & Resources

Need this system?

Tell us the quantity, timeframe and region. We reply by email with who can supply it.

Flopper Spec Sheet

NVIDIA DGX A100 320GB specifications, generated from our database. Printable.

Vendor product page

NVIDIA DGX A100 320GB documentation

View ↗

NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition Datasheet

NVIDIA • 2026-06-01

View Document ↗

NVIDIA DGX Documentation

System guides, deployment resources

Browse ↗

Typical Use Cases

Large Language Model Training
Distributed Deep Learning
Multi-GPU Inference
HPC Simulations
Scientific Computing

The NVIDIA DGX A100 320GB runs 8× A100 GPUs over NVSwitch + NVLink, delivering 2,496 TFLOPS BF16 dense.

© 2026 Flopper.io - Compare the GPUs Powering AI