NVIDIA A100 PCIe 80GB vs NVIDIA Jetson AGX Orin 64GB

The A100 delivers 7.3x the FP16 throughput of the Jetson AGX Orin (312 vs 43 TFLOPS dense). The A100 also carries 16 GB more memory (80 GB vs 64 GB).

A100: Ampere, 2021 Jetson AGX Orin: Ampere, 2021

FP16 dense lead

7.3x

A100: 312 vs 43 TFLOPS

Memory

80 vs 64 GB

16 GB more for the A100

Bandwidth

1.9 TB/s vs 205 GB/s

A100 moves data faster

TDP

300 W vs 60 W

Jetson AGX Orin draws 240 W less

See rental pricing from $0.95/hr Download comparison sheet Printable version →

NVIDIA A100 PCIe 80GB

Leads on FP16 Full specs →

What is the NVIDIA A100?

The A100 is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. A100 full specifications →

Can I rent the A100 in the cloud?

Yes. Cloud providers tracked by Flopper rent the A100 by the hour, and the pricing page compares their current rates and the price history side by side. A100 rental prices →

How does the A100 compare with other accelerators?

This page sets the A100 against the Jetson AGX Orin. Both parts launched in the same year. Both are NVIDIA parts; the A100 is a PCIe card while the Jetson AGX Orin is an embedded module. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the A100 figures come from?

Every A100 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA Jetson AGX Orin 64GB

Full specs →

What is the NVIDIA Jetson AGX Orin?

The Jetson AGX Orin is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is a module for embedded and edge systems rather than a card. Jetson AGX Orin full specifications →

Can I rent the Jetson AGX Orin in the cloud?

Flopper is not tracking any live rental listings for the Jetson AGX Orin yet. The provider directory lists the clouds that rent comparable accelerators on demand. GPU cloud providers →

How does the Jetson AGX Orin compare with other accelerators?

This page sets the Jetson AGX Orin against the A100. Both parts launched in the same year. Both are NVIDIA parts; the Jetson AGX Orin is an embedded module while the A100 is a PCIe card. Flopper also compares it head to head with the Jetson AGX Thor T5000 128GB, Jetson AGX Thor T4000 64GB and Jetson Orin Nano Super 8GB, across every published precision, memory and power. Jetson AGX Orin vs Jetson AGX Thor T5000 128GB →

Where do the Jetson AGX Orin figures come from?

Every Jetson AGX Orin figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

A100

Jetson AGX Orin

Architecture

AmpereAmpere

Launch Year

20212021

Form Factor

PCIeModule

Memory

80 GB64 GB

Memory Bandwidth

1.9 TB/s205 GB/s

TDP

300 W60 W

Process Node

——

Spec

A100

Jetson AGX Orin

Architecture AmpereAmpere

Launch Year 20212021

Form Factor PCIeModule

Memory 80 GB64 GB

Memory Bandwidth 1.9 TB/s205 GB/s

TDP 300 W60 W

Process Node ——

Performance (TFLOPS)

A100

Jetson AGX Orin

9.7 TFLOPS

20 TFLOPS 5.3 TFLOPS

156 TFLOPS

312 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

43 TFLOPS

85 TFLOPS sparse

FP6

624 TOPS

1,248 TOPS sparse

85 TOPS

170 TOPS sparse

Precision

A100

Jetson AGX Orin

9.7 TFLOPS

20 TFLOPS 5.3 TFLOPS

156 TFLOPS

312 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

43 TFLOPS

85 TFLOPS sparse

FP6

624 TOPS

1,248 TOPS sparse

85 TOPS

170 TOPS sparse

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

Both launched in 2021, the A100 on Ampere and the Jetson AGX Orin on Ampere.

The A100 carries 16 GB more memory (80 GB against 64 GB), so larger models fit on one GPU before you shard. Bandwidth is 1.9 TB/s against 205 GB/s, which sets the ceiling on decode speed.

Power is 300 W against 60 W, and at FP32 the Jetson AGX Orin does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the A100 faster than the Jetson AGX Orin?

At FP16 precision the A100 reaches 312 TFLOPS dense against 43 TFLOPS for the Jetson AGX Orin. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the A100 or the Jetson AGX Orin?

Choose the A100 for training and high-throughput inference: it has 7.3x the FP16 throughput of the Jetson AGX Orin. It also carries 16 GB more memory, so larger models fit on one GPU before you shard. The A100 draws 240 W more power, so budget for cooling and power delivery before you commit. Packaging differs too: the A100 is a PCIe card while the Jetson AGX Orin is an embedded module, so check what your servers accept.

Which has more memory, the A100 or the Jetson AGX Orin?

The A100 carries 80 GB of memory versus 64 GB for the Jetson AGX Orin. Memory bandwidth is 1.9 TB/s for the A100 and 205 GB/s for the Jetson AGX Orin.

How much power do the A100 and the Jetson AGX Orin draw?

The A100 is rated at 300 W TDP and the Jetson AGX Orin at 60 W. On FP32 throughput per watt, the Jetson AGX Orin is the more efficient part.

How much do the A100 and the Jetson AGX Orin cost to rent?

Live cloud listings tracked by Flopper price the A100 from $0.95 per GPU-hour across 8 providers, and no live listings yet for the Jetson AGX Orin. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA A100 PCIe 80GB

Rent from

$0.95 / GPU-hr

Lowest of 14 live listings across 8 providers · median $1.65

See all A100 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA Jetson AGX Orin 64GB

No live rental listings tracked for the Jetson AGX Orin yet.

Browse GPU cloud providers

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → A100 full specs Jetson AGX Orin full specs Estimate cluster cost in the calculator →

NVIDIA A100 PCIe 80GB vs NVIDIA Jetson AGX Orin 64GB

NVIDIA A100 PCIe 80GB

What is the NVIDIA A100?

Can I rent the A100 in the cloud?

How does the A100 compare with other accelerators?

Where do the A100 figures come from?

NVIDIA Jetson AGX Orin 64GB

What is the NVIDIA Jetson AGX Orin?

Can I rent the Jetson AGX Orin in the cloud?

How does the Jetson AGX Orin compare with other accelerators?

Where do the Jetson AGX Orin figures come from?

Specifications

Performance (TFLOPS)

FLOPS by Precision

What actually differs

Frequently asked questions

Is the A100 faster than the Jetson AGX Orin?

Which should you choose, the A100 or the Jetson AGX Orin?

Which has more memory, the A100 or the Jetson AGX Orin?

How much power do the A100 and the Jetson AGX Orin draw?

How much do the A100 and the Jetson AGX Orin cost to rent?

Where to Rent

NVIDIA A100 PCIe 80GB

NVIDIA Jetson AGX Orin 64GB

Related comparisons

Get Comparison Updates

Stay Updated on GPU Specs