NVIDIA A100 SXM4 80GB vs NVIDIA A100 PCIe 40GB

The A100 SXM4 80GB and the A100 PCIe 40GB deliver near-identical FP16 throughput (312 vs 312 TFLOPS dense). The A100 SXM4 80GB also carries 40 GB more memory (80 GB vs 40 GB).

A100 SXM4 80GB: Ampere, 2020 A100 PCIe 40GB: Ampere, 2020

Memory

80 vs 40 GB

40 GB more for the A100 SXM4 80GB

Bandwidth

2.0 TB/s vs 1.6 TB/s

A100 SXM4 80GB moves data faster

TDP

400 W vs 250 W

A100 PCIe 40GB draws 150 W less

See rental pricing from $0.59/hr Download comparison sheet Printable version →

NVIDIA A100 SXM4 80GB

Full specs →

What is the NVIDIA A100 SXM4 80GB?

The A100 SXM4 80GB is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is an SXM module, the mezzanine format used in dense multi-GPU servers. A100 SXM4 80GB full specifications →

Can I rent the A100 SXM4 80GB in the cloud?

Yes. Cloud providers tracked by Flopper rent the A100 SXM4 80GB by the hour, and the pricing page compares their current rates and the price history side by side. A100 SXM4 80GB rental prices →

How does the A100 SXM4 80GB compare with other accelerators?

This page sets the A100 SXM4 80GB against the A100 PCIe 40GB. Both parts launched in the same year. Both are NVIDIA parts; the A100 SXM4 80GB is an SXM module while the A100 PCIe 40GB is a PCIe card. Flopper also compares it head to head with the H100 SXM5 80GB, B200 SXM 180GB and H200 SXM 141GB, across every published precision, memory and power. A100 SXM4 80GB vs H100 SXM5 80GB →

Where do the A100 SXM4 80GB figures come from?

Every A100 SXM4 80GB figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA A100 PCIe 40GB

Full specs →

What is the NVIDIA A100 PCIe 40GB?

The A100 PCIe 40GB is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. A100 PCIe 40GB full specifications →

Can I rent the A100 PCIe 40GB in the cloud?

Yes. Cloud providers tracked by Flopper rent the A100 PCIe 40GB by the hour, and the pricing page compares their current rates and the price history side by side. A100 PCIe 40GB rental prices →

How does the A100 PCIe 40GB compare with other accelerators?

This page sets the A100 PCIe 40GB against the A100 SXM4 80GB. Both parts launched in the same year. Both are NVIDIA parts; the A100 PCIe 40GB is a PCIe card while the A100 SXM4 80GB is an SXM module. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the A100 PCIe 40GB figures come from?

Every A100 PCIe 40GB figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

A100 SXM4 80GB

A100 PCIe 40GB

Architecture

AmpereAmpere

Launch Year

20202020

Form Factor

SXMPCIe

Memory

80 GB40 GB

Memory Bandwidth

2.0 TB/s1.6 TB/s

TDP

400 W250 W

Process Node

7nm7nm

Spec

A100 SXM4 80GB

A100 PCIe 40GB

Architecture AmpereAmpere

Launch Year 20202020

Form Factor SXMPCIe

Memory 80 GB40 GB

Memory Bandwidth 2.0 TB/s1.6 TB/s

TDP 400 W250 W

Process Node 7nm7nm

Performance (TFLOPS)

A100 SXM4 80GB

A100 PCIe 40GB

9.7 TFLOPS 9.7 TFLOPS

20 TFLOPS 20 TFLOPS

156 TFLOPS

312 TFLOPS sparse

156 TFLOPS

312 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

FP6

624 TOPS

1,248 TOPS sparse

624 TOPS

1,248 TOPS sparse

Precision

A100 SXM4 80GB

A100 PCIe 40GB

9.7 TFLOPS 9.7 TFLOPS

20 TFLOPS 20 TFLOPS

156 TFLOPS

312 TFLOPS sparse

156 TFLOPS

312 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

FP6

624 TOPS

1,248 TOPS sparse

624 TOPS

1,248 TOPS sparse

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

Both launched in 2020, the A100 SXM4 80GB on Ampere and the A100 PCIe 40GB on Ampere.

The A100 SXM4 80GB carries 40 GB more memory (80 GB against 40 GB), so larger models fit on one GPU before you shard. Bandwidth is 2.0 TB/s against 1.6 TB/s, which sets the ceiling on decode speed.

Power is 400 W against 250 W, and at FP32 the A100 PCIe 40GB does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the A100 SXM4 80GB faster than the A100 PCIe 40GB?

They are close on paper: both deliver about 312 TFLOPS of dense FP16 throughput. Memory, bandwidth, and power are the deciding differences.

Which should you choose, the A100 SXM4 80GB or the A100 PCIe 40GB?

On raw FP16 throughput the A100 SXM4 80GB and the A100 PCIe 40GB are level, so the decision rests on memory, power and price. Choose the A100 SXM4 80GB when the model has to fit on one GPU: it carries 40 GB more memory. The A100 PCIe 40GB draws 150 W less power, which matters in an air-cooled or power-capped rack. Packaging differs too: the A100 SXM4 80GB is an SXM module while the A100 PCIe 40GB is a PCIe card, so check what your servers accept.

Which has more memory, the A100 SXM4 80GB or the A100 PCIe 40GB?

The A100 SXM4 80GB carries 80 GB of memory versus 40 GB for the A100 PCIe 40GB. Memory bandwidth is 2.0 TB/s for the A100 SXM4 80GB and 1.6 TB/s for the A100 PCIe 40GB.

How much power do the A100 SXM4 80GB and the A100 PCIe 40GB draw?

The A100 SXM4 80GB is rated at 400 W TDP and the A100 PCIe 40GB at 250 W. On FP32 throughput per watt, the A100 PCIe 40GB is the more efficient part.

How much do the A100 SXM4 80GB and the A100 PCIe 40GB cost to rent?

Live cloud listings tracked by Flopper price the A100 SXM4 80GB from $1.01 per GPU-hour across 27 providers, and the A100 PCIe 40GB from $0.59 per GPU-hour across 1 provider. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA A100 SXM4 80GB

Rent from

$1.01 / GPU-hr

Lowest of 58 live listings across 27 providers · median $1.79

See all A100 SXM4 80GB rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA A100 PCIe 40GB

Rent from

$0.59 / GPU-hr

Lowest of 1 live listing across 1 provider

See all A100 PCIe 40GB rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → A100 SXM4 80GB full specs A100 PCIe 40GB full specs Estimate cluster cost in the calculator →

NVIDIA A100 SXM4 80GB vs NVIDIA A100 PCIe 40GB

NVIDIA A100 SXM4 80GB

What is the NVIDIA A100 SXM4 80GB?

Can I rent the A100 SXM4 80GB in the cloud?

How does the A100 SXM4 80GB compare with other accelerators?

Where do the A100 SXM4 80GB figures come from?

NVIDIA A100 PCIe 40GB

What is the NVIDIA A100 PCIe 40GB?

Can I rent the A100 PCIe 40GB in the cloud?

How does the A100 PCIe 40GB compare with other accelerators?

Where do the A100 PCIe 40GB figures come from?

Specifications

Performance (TFLOPS)

FLOPS by Precision

What actually differs

Frequently asked questions

Is the A100 SXM4 80GB faster than the A100 PCIe 40GB?

Which should you choose, the A100 SXM4 80GB or the A100 PCIe 40GB?

Which has more memory, the A100 SXM4 80GB or the A100 PCIe 40GB?

How much power do the A100 SXM4 80GB and the A100 PCIe 40GB draw?

How much do the A100 SXM4 80GB and the A100 PCIe 40GB cost to rent?

Where to Rent

NVIDIA A100 SXM4 80GB

NVIDIA A100 PCIe 40GB

Related comparisons

Get Comparison Updates

Stay Updated on GPU Specs