NVIDIA H200 NVL rental pricing
Hopper architecture · 141 GB HBM3e memory · 4.8 TB/s bandwidth · 600 W board power · Released 2024
Price history
Weekly median price per GPU per hour
At a glance
prices checked just now- Cheapest in stock
- $3.29/hr
- On-demand · 1× H200 NVL · GPU.ai
- Median price
- $3.79/hr
- On-demand · 3 providers
- 90-day trend
- Down 2.9%
- Weekly median on-demand, 4 weeks
- Coverage
- 4 providers
- 5 price points
Every provider we track
Cheapest listing per provider and pricing type. Sold-out rows stay so you can see who normally carries it.
Per GPU-hour. Spot, reserved and community pricing differ from on-demand; click through for the provider's current figure.
What can the NVIDIA H200 NVL run?
Memory for the weights plus one sequence of context, how many GPUs hold it, and what that replica costs at the cheapest in-stock on-demand rate.
| Model | Params | Memory | GPUs | $/hr |
|---|---|---|---|---|
| gpt-oss-20b OpenAI | 20.9B· 3.6B active | 20 GiB | 1 | $3.29 |
| Gemma 3 27B Google | 27.4B | 26 GiB | 1 | $3.29 |
| Qwen3-32B Alibaba | 32.8B | 32 GiB | 1 | $3.29 |
| Llama 3.3 70B Instruct Meta | 70.6B | 67 GiB | 1 | $3.29 |
| gpt-oss-120b OpenAI | 117B· 5.1B active | 109 GiB | 1 | $3.29 |
| Qwen3-235B-A22B Alibaba | 235B· 22.0B active | 220 GiB | 2 | $6.58 |
| DeepSeek-R1 DeepSeek | 684B· 37.0B active | 638 GiB | 8 | $26.32 |
| Kimi K3 Moonshot AI | 2.78T· 104B active | 2.53 TiB | Over 16 | — |
Sized for one sequence at 4K context with 16-bit KV cache and 10% of memory held back. Serving many users at once needs more; the LLM GPU calculator sizes for concurrency and throughput.
NVIDIA H200 NVL pricing questions
How much does it cost to rent a NVIDIA H200 NVL per hour?
The cheapest NVIDIA H200 NVL in stock right now is $3.29 per GPU-hour on-demand from GPU.ai for the 1× H200 NVL configuration. The median on-demand rate across 3 providers is $3.79 per GPU-hour.
How much does a NVIDIA H200 NVL cost per month?
Running one NVIDIA H200 NVL around the clock for a month (730 hours) costs about $2,402 at the cheapest in-stock rate of $3.29 per hour. At the median on-demand rate it is about $2,767 a month. Reserved terms usually come in below that; ask the provider for a quote.
Which provider has the cheapest NVIDIA H200 NVL?
GPU.ai has the cheapest NVIDIA H200 NVL in stock right now at $3.29 per GPU-hour on-demand for the 1× H200 NVL configuration. Rates change often, so check the provider table for today's figure before you commit.
Are NVIDIA H200 NVL rental prices going up or down?
The weekly median on-demand rate for the NVIDIA H200 NVL is down 2.9% over the last 4 weeks, from $3.90 to $3.79 per GPU-hour.
What is the difference between on-demand, spot and reserved NVIDIA H200 NVL pricing?
On-demand is pay-as-you-go with no commitment. Community is capacity from individual hosts on a marketplace, cheaper and less uniform. This week's median rates for the NVIDIA H200 NVL are on-demand $3.79 (3 providers), community $3.86 (2 providers), per GPU-hour.
How many cloud providers rent the NVIDIA H200 NVL?
We track 4 providers with 5 live prices for the NVIDIA H200 NVL. Sold-out listings stay in the table so you can see who normally carries it, but never set the cheapest figure.
What LLMs can you run on one NVIDIA H200 NVL?
With 8-bit weights and a single sequence of context, one NVIDIA H200 NVL holds gpt-oss-20b (20.9B), Gemma 3 27B (27.4B), Qwen3-32B (32.8B), Llama 3.3 70B Instruct (70.6B), gpt-oss-120b (117B). See the model fit table for the full ladder.
Where does this NVIDIA H200 NVL pricing data come from?
Prices are read daily from each provider's public price list or API and recorded whenever they change. Listings are shown per GPU-hour on-demand unless marked otherwise, and the chart covers the last 30 days. The newest listing was checked just now.