NVIDIA A100 PCIe 80GB vs NVIDIA A100 SXM4 40GB

The A100 PCIe 80GB and the A100 SXM4 40GB deliver near-identical FP16 throughput (312 vs 312 TFLOPS dense). The A100 PCIe 80GB also carries 40 GB more memory (80 GB vs 40 GB).

A100 PCIe 80GB: Ampere, 2021 A100 SXM4 40GB: Ampere, 2020

Memory

80 vs 40 GB

40 GB more for the A100 PCIe 80GB

Bandwidth

1.9 TB/s vs 1.6 TB/s

A100 PCIe 80GB moves data faster

TDP

300 W vs 400 W

A100 PCIe 80GB draws 100 W less

See rental pricing from $0.45/hr Download comparison sheet Printable version →

NVIDIA A100 PCIe 80GB

Full specs →

What is the NVIDIA A100 PCIe 80GB?

The A100 PCIe 80GB is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. A100 PCIe 80GB full specifications →

Can I rent the A100 PCIe 80GB in the cloud?

Yes. Cloud providers tracked by Flopper rent the A100 PCIe 80GB by the hour, and the pricing page compares their current rates and the price history side by side. A100 PCIe 80GB rental prices →

How does the A100 PCIe 80GB compare with other accelerators?

This page sets the A100 PCIe 80GB against the A100 SXM4 40GB. The A100 PCIe 80GB is the newer generation of the two. Both are NVIDIA parts; the A100 PCIe 80GB is a PCIe card while the A100 SXM4 40GB is an SXM module. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the A100 PCIe 80GB figures come from?

Every A100 PCIe 80GB figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA A100 SXM4 40GB

Full specs →

What is the NVIDIA A100 SXM4 40GB?

The A100 SXM4 40GB is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is an SXM module, the mezzanine format used in dense multi-GPU servers. A100 SXM4 40GB full specifications →

Can I rent the A100 SXM4 40GB in the cloud?

Yes. Cloud providers tracked by Flopper rent the A100 SXM4 40GB by the hour, and the pricing page compares their current rates and the price history side by side. A100 SXM4 40GB rental prices →

How does the A100 SXM4 40GB compare with other accelerators?

This page sets the A100 SXM4 40GB against the A100 PCIe 80GB. The A100 SXM4 40GB is the older generation of the two. Both are NVIDIA parts; the A100 SXM4 40GB is an SXM module while the A100 PCIe 80GB is a PCIe card. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the A100 SXM4 40GB figures come from?

Every A100 SXM4 40GB figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

A100 PCIe 80GB

A100 SXM4 40GB

Architecture

AmpereAmpere

Launch Year

20212020

Form Factor

PCIeSXM

Memory

80 GB40 GB

Memory Bandwidth

1.9 TB/s1.6 TB/s

TDP

300 W400 W

Process Node

—7nm

Spec

A100 PCIe 80GB

A100 SXM4 40GB

Architecture AmpereAmpere

Launch Year 20212020

Form Factor PCIeSXM

Memory 80 GB40 GB

Memory Bandwidth 1.9 TB/s1.6 TB/s

TDP 300 W400 W

Process Node —7nm

Performance (TFLOPS)

A100 PCIe 80GB

A100 SXM4 40GB

9.7 TFLOPS 9.7 TFLOPS

20 TFLOPS 20 TFLOPS

156 TFLOPS

312 TFLOPS sparse

156 TFLOPS

312 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

FP6

624 TOPS

1,248 TOPS sparse

624 TOPS

1,248 TOPS sparse

Precision

A100 PCIe 80GB

A100 SXM4 40GB

9.7 TFLOPS 9.7 TFLOPS

20 TFLOPS 20 TFLOPS

156 TFLOPS

312 TFLOPS sparse

156 TFLOPS

312 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

FP6

624 TOPS

1,248 TOPS sparse

624 TOPS

1,248 TOPS sparse

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

The A100 PCIe 80GB is the newer part: Ampere (2021) against the A100 SXM4 40GB's Ampere (2020).

The A100 PCIe 80GB carries 40 GB more memory (80 GB against 40 GB), so larger models fit on one GPU before you shard. Bandwidth is 1.9 TB/s against 1.6 TB/s, which sets the ceiling on decode speed.

Power is 300 W against 400 W, and at FP32 the A100 PCIe 80GB does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the A100 PCIe 80GB faster than the A100 SXM4 40GB?

They are close on paper: both deliver about 312 TFLOPS of dense FP16 throughput. Memory, bandwidth, and power are the deciding differences.

Which should you choose, the A100 PCIe 80GB or the A100 SXM4 40GB?

On raw FP16 throughput the A100 PCIe 80GB and the A100 SXM4 40GB are level, so the decision rests on memory, power and price. Choose the A100 PCIe 80GB when the model has to fit on one GPU: it carries 40 GB more memory. The A100 PCIe 80GB draws 100 W less power, which matters in an air-cooled or power-capped rack. Packaging differs too: the A100 PCIe 80GB is a PCIe card while the A100 SXM4 40GB is an SXM module, so check what your servers accept.

Which has more memory, the A100 PCIe 80GB or the A100 SXM4 40GB?

The A100 PCIe 80GB carries 80 GB of memory versus 40 GB for the A100 SXM4 40GB. Memory bandwidth is 1.9 TB/s for the A100 PCIe 80GB and 1.6 TB/s for the A100 SXM4 40GB.

How much power do the A100 PCIe 80GB and the A100 SXM4 40GB draw?

The A100 PCIe 80GB is rated at 300 W TDP and the A100 SXM4 40GB at 400 W. On FP32 throughput per watt, the A100 PCIe 80GB is the more efficient part.

How much do the A100 PCIe 80GB and the A100 SXM4 40GB cost to rent?

Live cloud listings tracked by Flopper price the A100 PCIe 80GB from $0.86 per GPU-hour across 9 providers, and the A100 SXM4 40GB from $0.45 per GPU-hour across 9 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA A100 PCIe 80GB

Rent from

$0.86 / GPU-hr

Lowest of 15 live listings across 9 providers · median $1.65

See all A100 PCIe 80GB rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA A100 SXM4 40GB

Rent from

$0.45 / GPU-hr

Lowest of 14 live listings across 9 providers · median $2.05

See all A100 SXM4 40GB rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → A100 PCIe 80GB full specs A100 SXM4 40GB full specs Estimate cluster cost in the calculator →

NVIDIA A100 PCIe 80GB vs NVIDIA A100 SXM4 40GB

NVIDIA A100 PCIe 80GB

What is the NVIDIA A100 PCIe 80GB?

Can I rent the A100 PCIe 80GB in the cloud?

How does the A100 PCIe 80GB compare with other accelerators?

Where do the A100 PCIe 80GB figures come from?

NVIDIA A100 SXM4 40GB

What is the NVIDIA A100 SXM4 40GB?

Can I rent the A100 SXM4 40GB in the cloud?

How does the A100 SXM4 40GB compare with other accelerators?

Where do the A100 SXM4 40GB figures come from?

Specifications

Performance (TFLOPS)

FLOPS by Precision

What actually differs

Frequently asked questions

Is the A100 PCIe 80GB faster than the A100 SXM4 40GB?

Which should you choose, the A100 PCIe 80GB or the A100 SXM4 40GB?

Which has more memory, the A100 PCIe 80GB or the A100 SXM4 40GB?

How much power do the A100 PCIe 80GB and the A100 SXM4 40GB draw?

How much do the A100 PCIe 80GB and the A100 SXM4 40GB cost to rent?

Where to Rent

NVIDIA A100 PCIe 80GB

NVIDIA A100 SXM4 40GB

Get Comparison Updates

Stay Updated on GPU Specs