NVIDIA A100 SXM4 rental pricing
Ampere architecture · 40 GB HBM2e memory · 1.6 TB/s bandwidth · 400 W board power · Released 2020
Price history
Weekly median price per GPU per hour
At a glance
prices checked just now- Cheapest in stock
- $0.43/hr
- Community · 2× A100 SXM4 · Vast.ai
- Median price
- $2.00/hr
- On-demand · 7 providers
- 90-day trend
- Too early
- Last 30 days · fills in as prices are checked
- Coverage
- 10 providers
- 16 price points
- $ per FP16 PFLOP-hour
- $2.85
- Rank 3 of 19 priced GPUs · lower is better
Every provider we track
Cheapest listing per provider and pricing type. Sold-out rows stay so you can see who normally carries it.
| Provider | Configuration | Price/GPU-hr | Checked | |
|---|---|---|---|---|
| 2× A100 SXM4 Community | $0.43 | just now | View → | |
 GPU.ai | 1× A100 SXM4 Community | $0.54 | just now | View → |
| 1× A100 SXM4 Spot | $0.64 | just now | View → | |
 Civo | 1× A100 SXM4 Reserved | $0.69 | just now | View → |
| GPU.ai | 1× A100 SXM4 | $0.89 | just now | View → |
| 1× A100 SXM4 Community | $1.00 | just now | View → | |
| Civo | 1× A100 SXM4 | $1.09 | just now | View → |
| 1× A100 SXM4 | $1.28 | just now | View → | |
 Cerebrium | 1× A100 SXM4 | $2.00 | just now | View → |
| 1× A100 SXM4 | $2.10 | just now | View → | |
 Cirrascale | 8× A100 SXM4 Reserved | $2.30 | just now | View → |
| 8× A100 SXM4 | $2.74 | just now | View → | |
| 8× A100 SXM4 | $3.40 | just now | View → |
Per GPU-hour. Spot, reserved and community pricing differ from on-demand; click through for the provider's current figure.
What can the NVIDIA A100 SXM4 run?
Memory for the weights plus one sequence of context, how many GPUs hold it, and what that replica costs at the cheapest in-stock on-demand rate.
| Model | Params | Memory | GPUs | $/hr |
|---|---|---|---|---|
| gpt-oss-20b OpenAI | 20.9B· 3.6B active | 20 GiB | 1 | $0.89 |
| Gemma 3 27B Google | 27.4B | 26 GiB | 1 | $0.89 |
| Qwen3-32B Alibaba | 32.8B | 32 GiB | 1 | $0.89 |
| Llama 3.3 70B Instruct Meta | 70.6B | 67 GiB | 2 | $1.78 |
| gpt-oss-120b OpenAI | 117B· 5.1B active | 109 GiB | 4 | $3.56 |
| Qwen3-235B-A22B Alibaba | 235B· 22.0B active | 220 GiB | 8 | $7.12 |
| DeepSeek-R1 DeepSeek | 684B· 37.0B active | 638 GiB | Over 16 | — |
| Kimi K3 Moonshot AI | 2.78T· 104B active | 2.53 TiB | Over 16 | — |
Sized for one sequence at 4K context with 16-bit KV cache and 10% of memory held back. Serving many users at once needs more; the LLM GPU calculator sizes for concurrency and throughput.
NVIDIA A100 SXM4 pricing questions
How much does it cost to rent a NVIDIA A100 SXM4 per hour?
The cheapest NVIDIA A100 SXM4 in stock right now is $0.43 per GPU-hour community from Vast.ai for the 2× A100 SXM4 configuration. The median on-demand rate across 7 providers is $2.00 per GPU-hour.
How much does a NVIDIA A100 SXM4 cost per month?
Running one NVIDIA A100 SXM4 around the clock for a month (730 hours) costs about $312 at the cheapest in-stock rate of $0.43 per hour. At the median on-demand rate it is about $1,459 a month. Reserved terms usually come in below that; ask the provider for a quote.
Which provider has the cheapest NVIDIA A100 SXM4?
Vast.ai has the cheapest NVIDIA A100 SXM4 in stock right now at $0.43 per GPU-hour community for the 2× A100 SXM4 configuration. That is a community rate; see the provider table for the cheapest on-demand listing. Rates change often, so check the provider table for today's figure before you commit.
Are NVIDIA A100 SXM4 rental prices going up or down?
We have 5 weeks of price history for the NVIDIA A100 SXM4, not yet enough like-for-like weeks to call a trend: the set of providers we track is still growing, and a median over more sellers is not a price move. The chart above fills in as our daily checks accumulate.
What is the difference between on-demand, spot and reserved NVIDIA A100 SXM4 pricing?
On-demand is pay-as-you-go with no commitment. Spot is spare capacity sold at a discount that the provider can reclaim at short notice. Reserved is a committed term, usually months, in exchange for a lower rate. Community is capacity from individual hosts on a marketplace, cheaper and less uniform. This week's median rates for the NVIDIA A100 SXM4 are on-demand $2.00 (7 providers), spot $0.64 (1 provider), reserved $1.49 (2 providers), community $0.69 (3 providers), per GPU-hour.
How many cloud providers rent the NVIDIA A100 SXM4?
We track 10 providers with 16 live prices for the NVIDIA A100 SXM4. Sold-out listings stay in the table so you can see who normally carries it, but never set the cheapest figure.
What LLMs can you run on one NVIDIA A100 SXM4?
With 8-bit weights and a single sequence of context, one NVIDIA A100 SXM4 holds gpt-oss-20b (20.9B), Gemma 3 27B (27.4B), Qwen3-32B (32.8B). See the model fit table for the full ladder.
How does the NVIDIA A100 SXM4 compare on price per PFLOP-hour?
At its cheapest in-stock on-demand rate the NVIDIA A100 SXM4 delivers dense FP16 compute at $2.85 per PFLOP-hour, which ranks 3 of 19 priced GPUs we cover on that basis. Lower is better: it is the rental price divided by peak FP16 throughput.
Where does this NVIDIA A100 SXM4 pricing data come from?
Prices are read daily from each provider's public price list or API and recorded whenever they change. Listings are shown per GPU-hour on-demand unless marked otherwise, and the chart covers the last 30 days. The newest listing was checked just now.