NVIDIA GeForce RTX 4090 24GB vs NVIDIA RTX A5000 24GB

The GeForce RTX 4090 delivers 5.9x the FP16 throughput of the RTX A5000 (165 vs 28 TFLOPS dense).

GeForce RTX 4090: Ada Lovelace, 2022 RTX A5000: Ampere, 2021
FP16 dense lead
5.9x
GeForce RTX 4090: 165 vs 28 TFLOPS
Memory
24 vs 24 GB
Same capacity
Bandwidth
1.0 TB/s vs 768 GB/s
GeForce RTX 4090 moves data faster
TDP
450 W vs 230 W
RTX A5000 draws 220 W less
See rental pricing from $0.16/hr Download comparison sheet

Share this page

NVIDIA GeForce RTX 4090 24GB vs NVIDIA RTX A5000 24GB

A post with this link shows the card on the Image tab as its preview.

Printable version →

NVIDIA GeForce RTX 4090 24GB

Leads on FP16 Full specs →

What is the NVIDIA GeForce RTX 4090?

The GeForce RTX 4090 is a GPU from NVIDIA on the Ada Lovelace architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. GeForce RTX 4090 full specifications →

Can I rent the GeForce RTX 4090 in the cloud?

Yes. Cloud providers tracked by Flopper rent the GeForce RTX 4090 by the hour, and the pricing page compares their current rates and the price history side by side. GeForce RTX 4090 rental prices →

How does the GeForce RTX 4090 compare with other accelerators?

This page sets the GeForce RTX 4090 against the RTX A5000. The GeForce RTX 4090 is the newer generation of the two. Both are NVIDIA parts, and both ship as a PCIe card, so they fit the same class of system. Flopper also compares it head to head with the Wormhole n150s, across every published precision, memory and power. GeForce RTX 4090 vs Wormhole n150s →

Where do the GeForce RTX 4090 figures come from?

NVIDIA published the GeForce RTX 4090 figures in marketing material rather than a datasheet, and Flopper has no independent confirmation of them. How Flopper verifies specifications →

NVIDIA RTX A5000 24GB

Full specs →

What is the NVIDIA RTX A5000?

The RTX A5000 is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. RTX A5000 full specifications →

Can I rent the RTX A5000 in the cloud?

Yes. Cloud providers tracked by Flopper rent the RTX A5000 by the hour, and the pricing page compares their current rates and the price history side by side. RTX A5000 rental prices →

How does the RTX A5000 compare with other accelerators?

This page sets the RTX A5000 against the GeForce RTX 4090. The RTX A5000 is the older generation of the two. Both are NVIDIA parts, and both ship as a PCIe card, so they fit the same class of system. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the RTX A5000 figures come from?

Every RTX A5000 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

GeForce RTX 4090
RTX A5000
Architecture
Ada LovelaceAmpere
Launch Year
20222021
Form Factor
PCIePCIe
Memory
24 GB24 GB
Memory Bandwidth
1.0 TB/s768 GB/s
TDP
450 W230 W
Process Node
4nm8nm

Performance (TFLOPS)

GeForce RTX 4090
RTX A5000
1.3 TFLOPS 0.4 TFLOPS
83 TFLOPS 28 TFLOPS
83 TFLOPS
sparse not published
28 TFLOPS
sparse not published
165 TFLOPS
sparse not published
28 TFLOPS
sparse not published
165 TFLOPS
sparse not published
28 TFLOPS
sparse not published
330 TFLOPS
sparse not published
No verified data available
FP6
No verified data available No verified data available
No verified data available No verified data available
661 TOPS
1,321 TOPS sparse
56 TOPS
sparse not published

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

The GeForce RTX 4090 is the newer part: Ada Lovelace (2022) against the RTX A5000's Ampere (2021).

Both carry 24 GB of memory. Bandwidth is 1.0 TB/s against 768 GB/s, which sets the ceiling on decode speed.

Power is 450 W against 230 W, and at FP32 the GeForce RTX 4090 does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, FP8, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

What is better, the GeForce RTX 4090 or the RTX A5000?

The GeForce RTX 4090, on throughput. At FP16 precision the GeForce RTX 4090 reaches 165 TFLOPS dense against 28 TFLOPS for the RTX A5000. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the GeForce RTX 4090 or the RTX A5000?

Choose the GeForce RTX 4090 for training and high-throughput inference: it has 5.9x the FP16 throughput of the RTX A5000. The GeForce RTX 4090 draws 220 W more power, so budget for cooling and power delivery before you commit.

Which has more memory, the GeForce RTX 4090 or the RTX A5000?

Both GPUs carry 24 GB of memory. Memory bandwidth is 1.0 TB/s for the GeForce RTX 4090 and 768 GB/s for the RTX A5000.

How much power do the GeForce RTX 4090 and the RTX A5000 draw?

The GeForce RTX 4090 is rated at 450 W TDP and the RTX A5000 at 230 W. On FP32 throughput per watt, the GeForce RTX 4090 is the more efficient part.

How much do the GeForce RTX 4090 and the RTX A5000 cost to rent?

Live cloud listings tracked by Flopper price the GeForce RTX 4090 from $0.34 per GPU-hour across 9 providers, and the RTX A5000 from $0.16 per GPU-hour across 5 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA GeForce RTX 4090 24GB

Rent from

$0.34 / GPU-hr

Lowest of 16 live listings across 9 providers · median $0.89

See all GeForce RTX 4090 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA RTX A5000 24GB

Rent from

$0.16 / GPU-hr

Lowest of 10 live listings across 5 providers

See all RTX A5000 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

© 2026 Flopper.io - Compare the GPUs Powering AI