Flopper.io Flopper.io

NVIDIA A800 PCIe 80GB vs NVIDIA RTX A4000 16GB

The A800 delivers 16.3x the FP16 throughput of the RTX A4000 (312 vs 19 TFLOPS dense). The A800 also carries 64 GB more memory (80 GB vs 16 GB).

A800: Ampere, 2022 RTX A4000: Ampere, 2021
FP16 dense lead
16.3x
A800: 312 vs 19 TFLOPS
Memory
80 vs 16 GB
64 GB more for the A800
Bandwidth
1.9 TB/s vs 448 GB/s
A800 moves data faster
TDP
300 W vs 140 W
RTX A4000 draws 160 W less
See rental pricing from $0.09/hr Download comparison sheet

Share this page

NVIDIA A800 PCIe 80GB vs NVIDIA RTX A4000 16GB

A post with this link shows the card on the Image tab as its preview.

Post on X Share on LinkedIn
 Printable version →

NVIDIA A800 PCIe 80GB

Leads on FP16 Full specs →

What is the NVIDIA A800?

The A800 is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. A800 full specifications →

Can I rent the A800 in the cloud?

Yes. Cloud providers tracked by Flopper rent the A800 by the hour, and the pricing page compares their current rates and the price history side by side. A800 rental prices →

How does the A800 compare with other accelerators?

This page sets the A800 against the RTX A4000. The A800 is the newer generation of the two. Both are NVIDIA parts, and both ship as a PCIe card, so they fit the same class of system. Flopper also compares it head to head with the A800 SXM4, across every published precision, memory and power. A800 vs A800 SXM4 →

Where do the A800 figures come from?

Every A800 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA RTX A4000 16GB

Full specs →

What is the NVIDIA RTX A4000?

The RTX A4000 is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. RTX A4000 full specifications →

Can I rent the RTX A4000 in the cloud?

Yes. Cloud providers tracked by Flopper rent the RTX A4000 by the hour, and the pricing page compares their current rates and the price history side by side. RTX A4000 rental prices →

How does the RTX A4000 compare with other accelerators?

This page sets the RTX A4000 against the A800. The RTX A4000 is the older generation of the two. Both are NVIDIA parts, and both ship as a PCIe card, so they fit the same class of system. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the RTX A4000 figures come from?

Every RTX A4000 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

A800
RTX A4000
Architecture
AmpereAmpere
Launch Year
20222021
Form Factor
PCIePCIe
Memory
80 GB16 GB
Memory Bandwidth
1.9 TB/s448 GB/s
TDP
300 W140 W
Process Node
7nm8nm

Performance (TFLOPS)

A800
RTX A4000
9.7 TFLOPS 0.3 TFLOPS
20 TFLOPS 19 TFLOPS
156 TFLOPS
sparse not published
19 TFLOPS
sparse not published
312 TFLOPS
sparse not published
19 TFLOPS
sparse not published
312 TFLOPS
sparse not published
19 TFLOPS
sparse not published
No verified data available No verified data available
FP6
No verified data available No verified data available
No verified data available No verified data available
624 TOPS
sparse not published
38 TOPS
sparse not published

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

The A800 is the newer part: Ampere (2022) against the RTX A4000's Ampere (2021).

The A800 carries 64 GB more memory (80 GB against 16 GB), so larger models fit on one GPU before you shard. Bandwidth is 1.9 TB/s against 448 GB/s, which sets the ceiling on decode speed.

Power is 300 W against 140 W, and at FP32 the RTX A4000 does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the A800 faster than the RTX A4000?

At FP16 precision the A800 reaches 312 TFLOPS dense against 19 TFLOPS for the RTX A4000. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the A800 or the RTX A4000?

Choose the A800 for training and high-throughput inference: it has 16.3x the FP16 throughput of the RTX A4000. It also carries 64 GB more memory, so larger models fit on one GPU before you shard. The A800 draws 160 W more power, so budget for cooling and power delivery before you commit.

Which has more memory, the A800 or the RTX A4000?

The A800 carries 80 GB of memory versus 16 GB for the RTX A4000. Memory bandwidth is 1.9 TB/s for the A800 and 448 GB/s for the RTX A4000.

How much power do the A800 and the RTX A4000 draw?

The A800 is rated at 300 W TDP and the RTX A4000 at 140 W. On FP32 throughput per watt, the RTX A4000 is the more efficient part.

How much do the A800 and the RTX A4000 cost to rent?

Live cloud listings tracked by Flopper price the A800 from $0.47 per GPU-hour across 1 provider, and the RTX A4000 from $0.09 per GPU-hour across 6 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA A800 PCIe 80GB

Rent from

$0.47 / GPU-hr

Lowest of 1 live listing across 1 provider

See all A800 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA RTX A4000 16GB

Rent from

$0.09 / GPU-hr

Lowest of 10 live listings across 6 providers · median $0.25

See all RTX A4000 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → A800 full specs RTX A4000 full specs Estimate cluster cost in the calculator →

© 2026 Flopper.io - Compare the GPUs Powering AI