NVIDIA A100 SXM4 rental pricing
Ampere architecture · 40 GB HBM2e memory · 1.6 TB/s bandwidth · 400 W board power · Released 2020
Price history by provider
Every provider's cheapest daily on-demand rate for the NVIDIA A100 SXM4, last 30 days
One line per provider, reconstructed from recorded price changes for listings currently live. Click a name in the key to hide or show it.
At a glance
prices checked 5h ago- Cheapest in stock
- $0.61/hr
- Community · 1× A100 SXM4 · GPU.ai
- Median price
- $2.05/hr
- On-demand · 6 providers
- 90-day trend
- Flat
- Weekly median on-demand, 4 weeks
- Coverage
- 9 providers
- 14 price points
- $ per FP16 PFLOP-hour
- $3.49
- Rank 2 of 17 priced GPUs · lower is better
Why the SXM4 costs what it does
Against the other priced NVIDIA A100 variants: the price floor, what a GB-hour and a PFLOP-hour cost, and the specs that explain the gap.
The SXM4 rents from $0.61 per GPU-hour, 11% more than the SXM4 at $0.55.
The SXM4 carries 80 GB against 40 GB, 100% more memory and it still rents for less; per GB-hour that is $0.007 against $0.015.
Memory bandwidth is 2.0 TB/s on the SXM4 against 1.6 TB/s on the SXM4, 31% more, which is what sets decode throughput for inference.
25 providers list the SXM4 against 9 for the SXM4; a deeper market tends to price lower.
Per FP16 PFLOP-hour and per GB-hour the SXM4 is the better buy: $1.77 against $1.96 per PFLOP-hour, and $0.007 against $0.015 per GB-hour.
Floors are the cheapest live listing of any pricing type; medians are of each provider's cheapest on-demand rate. Per GB-hour divides the floor by memory, per PFLOP-hour by dense throughput on the family's basis.
Every provider we track
Cheapest listing per provider and pricing type. Sold-out rows stay so you can see who normally carries it.
| Provider | Configuration | Price/GPU-hr | Checked | |
|---|---|---|---|---|
 GPU.ai | 1× A100 SXM4 Community | $0.61 | 5h ago | View → |
 Civo | 1× A100 SXM4 Reserved | $0.69 | 5h ago | View → |
| 1× A100 SXM4 Spot | $0.83 | 5h ago | View → | |
| 1× A100 SXM4 Community | $1.00 | 5h ago | View → | |
| Civo | 1× A100 SXM4 | $1.09 | 5h ago | View → |
| 1× A100 SXM4 | $1.66 | 5h ago | View → | |
 Cerebrium | 1× A100 SXM4 | $2.00 | 5h ago | View → |
| 1× A100 SXM4 | $2.10 | Stale · 41d ago | View → | |
 Cirrascale | 8× A100 SXM4 Reserved | $2.30 | 6d ago | View → |
| 8× A100 SXM4 | $2.74 | 5h ago | View → | |
| 8× A100 SXM4 | $3.40 | 11h ago | View → |
Per GPU-hour. Spot, reserved and community pricing differ from on-demand; click through for the provider's current figure.
What can the NVIDIA A100 SXM4 run?
Memory for the weights plus one sequence of context, how many GPUs hold it, and what that replica costs at the cheapest in-stock on-demand rate.
| Model | Params | Memory | GPUs | $/hr |
|---|---|---|---|---|
| gpt-oss-20b OpenAI | 20.9B· 3.6B active | 20 GiB | 1 | $1.09 |
| Gemma 3 27B Google | 27.4B | 26 GiB | 1 | $1.09 |
| Qwen3-32B Alibaba | 32.8B | 32 GiB | 1 | $1.09 |
| Llama 3.3 70B Instruct Meta | 70.6B | 67 GiB | 2 | $2.18 |
| gpt-oss-120b OpenAI | 117B· 5.1B active | 109 GiB | 4 | $4.36 |
| Qwen3-235B-A22B Alibaba | 235B· 22.0B active | 220 GiB | 8 | $8.72 |
| DeepSeek-R1 DeepSeek | 684B· 37.0B active | 638 GiB | Over 16 | — |
| Kimi K3 Moonshot AI | 2.78T· 104B active | 2.53 TiB | Over 16 | — |
Sized for one sequence at 4K context with 16-bit KV cache and 10% of memory held back. Serving many users at once needs more; the LLM GPU calculator sizes for concurrency and throughput.
NVIDIA A100 SXM4 pricing questions
How much does it cost to rent a NVIDIA A100 SXM4 per hour?
The cheapest NVIDIA A100 SXM4 in stock right now is $0.61 per GPU-hour community from GPU.ai for the 1× A100 SXM4 configuration. The median on-demand rate across 6 providers is $2.05 per GPU-hour.
How much does a NVIDIA A100 SXM4 cost per month?
Running one NVIDIA A100 SXM4 around the clock for a month (730 hours) costs about $445 at the cheapest in-stock rate of $0.61 per hour. At the median on-demand rate it is about $1,495 a month. Reserved terms usually come in below that; ask the provider for a quote.
Which provider has the cheapest NVIDIA A100 SXM4?
GPU.ai has the cheapest NVIDIA A100 SXM4 in stock right now at $0.61 per GPU-hour community for the 1× A100 SXM4 configuration. That is a community rate; see the provider table for the cheapest on-demand listing. Rates change often, so check the provider table for today's figure before you commit.
Are NVIDIA A100 SXM4 rental prices going up or down?
The weekly median on-demand rate for the NVIDIA A100 SXM4 has been flat, moving 0.0% over the last 4 weeks, from $2.05 to $2.05 per GPU-hour.
What is the difference between on-demand, spot and reserved NVIDIA A100 SXM4 pricing?
On-demand is pay-as-you-go with no commitment. Spot is spare capacity sold at a discount that the provider can reclaim at short notice. Reserved is a committed term, usually months, in exchange for a lower rate. Community is capacity from individual hosts on a marketplace, cheaper and less uniform. This week's median rates for the NVIDIA A100 SXM4 are on-demand $2.05 (6 providers), spot $0.83 (1 provider), reserved $1.49 (2 providers), community $0.87 (2 providers), per GPU-hour.
How many cloud providers rent the NVIDIA A100 SXM4?
We track 9 providers with 14 live prices for the NVIDIA A100 SXM4. Sold-out listings stay in the table so you can see who normally carries it, but never set the cheapest figure.
What LLMs can you run on one NVIDIA A100 SXM4?
With 8-bit weights and a single sequence of context, one NVIDIA A100 SXM4 holds gpt-oss-20b (20.9B), Gemma 3 27B (27.4B), Qwen3-32B (32.8B). See the model fit table for the full ladder.
How does the NVIDIA A100 SXM4 compare on price per PFLOP-hour?
At its cheapest in-stock on-demand rate the NVIDIA A100 SXM4 delivers dense FP16 compute at $3.49 per PFLOP-hour, which ranks 2 of 17 priced GPUs we cover on that basis. Lower is better: it is the rental price divided by peak FP16 throughput.
Where does this NVIDIA A100 SXM4 pricing data come from?
Prices are read daily from each provider's public price list or API and recorded whenever they change. Listings are shown per GPU-hour on-demand unless marked otherwise, and the chart covers the last 30 days. The newest listing was checked 5h ago.
Why does the SXM4 cost more than the SXM4?
The SXM4 rents from $0.61 per GPU-hour, 11% more than the SXM4 at $0.55. The SXM4 carries 80 GB against 40 GB, 100% more memory and it still rents for less; per GB-hour that is $0.007 against $0.015.