NVIDIA HGX A100 4-GPU

baseboard
4× A100
NVLink
2020
FP64
39
TFLOPS
FP32
78
TFLOPS
Power
3.2
kW Total
Memory
320
GB Total

HGX A100 4-GPU configuration

We will point you at suppliers who have it. Free, and no signup.

FP64
39
TFLOPS
12.1 TFLOPS/kW
FP32
78
TFLOPS
24.4 TFLOPS/kW
TF32
624
TFLOPS
195.0 TFLOPS/kW
FP16
1,248
TFLOPS
390.0 TFLOPS/kW

System Details

GPU Configuration

GPU Count: 4 GPUs
Architecture: Ampere
Interconnect: NVLink

System Specifications

Form Factor: baseboard
Total Power: 3.2 kW
Total Memory: 320 GB
Memory Bandwidth: 8.2 TB/s

Precision Performance Breakdown

PrecisionSystem PerformancePer GPUEfficiency
39 TFLOPS 9.7 TFLOPS 12.1 TFLOPS/kW
78 TFLOPS 20 TFLOPS 24.4 TFLOPS/kW
624 TFLOPS 156 TFLOPS 195.0 TFLOPS/kW
1,248 TFLOPS 312 TFLOPS 390.0 TFLOPS/kW
1,248 TFLOPS 312 TFLOPS 390.0 TFLOPS/kW
2,496 TOPS 624 TOPS 780.0 TFLOPS/kW

Where a vendor states a basis, the figure shown is the dense one, and any figure it publishes is listed separately. Vendors commonly headline the sparse number instead: for NVIDIA's 2:4 structured sparsity that is exactly twice the dense figure, though other vendors' sparse modes do not all follow that ratio.

Powered by NVIDIA A100

This system utilizes 4 × NVIDIA A100 SXM4 80GB GPUs, each delivering exceptional performance for AI and HPC workloads.

Per GPU TDP

400W

Per GPU Memory

80 GB

Process Node

7nm

Architecture

Ampere

Frequently asked questions

How much does the HGX A100 4-GPU cost?

NVIDIA sells the HGX A100 4-GPU on quote through OEMs and resellers, and nobody rents a whole one by the hour. Renting its 4 A100 accelerators separately at the cheapest live rate Flopper tracks, $1.07 per GPU-hour across 23 providers, comes to about $4.28 an hour for the equivalent capacity. A100 rental prices →

How much power does the HGX A100 4-GPU require?

NVIDIA rates the HGX A100 4-GPU at 3.2 kW, which is the figure to plan power delivery and cooling around; per-GPU draw is listed on the accelerator's own page.

How many GPUs are in the HGX A100 4-GPU?

4. The HGX A100 4-GPU carries 4 NVIDIA A100 SXM4 80GB accelerators in a baseboard form factor, and every throughput figure on this page is the total across them. A100 specifications →

Documentation & Resources

Flopper Spec Sheet

NVIDIA HGX A100 4-GPU specifications, generated from our database. Printable.

Vendor product page

NVIDIA HGX A100 4-GPU documentation

View ↗

NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition Datasheet

NVIDIA • 2026-06-01

View Document ↗

NVIDIA DGX Documentation

System guides, deployment resources

Browse ↗

Typical Use Cases

Large Language Model Training
Distributed Deep Learning
Multi-GPU Inference
HPC Simulations
Scientific Computing

The NVIDIA HGX A100 4-GPU runs 4× A100 GPUs over NVLink, delivering 1,248 TFLOPS BF16 dense.

© 2026 Flopper.io - Compare the GPUs Powering AI