AMD Instinct MI300X 192GB vs NVIDIA H100 NVL 94GB
The Instinct MI300X delivers 2.7x the FP32 throughput of the H100 (163 vs 60 TFLOPS dense). The Instinct MI300X also carries 98 GB more memory (192 GB vs 94 GB).
AMD Instinct MI300X 192GB
Full specs →NVIDIA H100 NVL 94GB
Full specs →Specifications
Performance (TFLOPS)
FLOPS by Precision
What actually differs
Both GPUs launched in 2023: the Instinct MI300X on CDNA 3 and the H100 on Hopper.
Dense throughput for the Instinct MI300X against the H100: FP64 82 vs 30 TFLOPS, FP32 163 vs 60 TFLOPS. Sparse figures, where the vendor publishes them, appear under each dense number in the performance table.
Memory is 192 GB against 94 GB, fed at 5.3 TB/s versus 3.9 TB/s. More memory per GPU means larger models fit before you have to shard across cards, which often matters more than raw TFLOPS for inference.
Power budgets are 750 W for the Instinct MI300X and 400 W for the H100. At FP32 that works out to 0.22 against 0.15 TFLOPS per watt.
For LLM training and inference, weight the FP8 and FP16 rows and memory capacity most heavily. For scientific and HPC workloads, the FP64 row is the one to read.
Frequently asked questions
Is the Instinct MI300X faster than the H100?
At FP32 precision the Instinct MI300X reaches 163 TFLOPS dense against 60 TFLOPS for the H100. The performance table on this page lists every published precision for both GPUs.
Which has more memory, the Instinct MI300X or the H100?
The Instinct MI300X carries 192 GB of memory versus 94 GB for the H100. Memory bandwidth is 5.3 TB/s for the Instinct MI300X and 3.9 TB/s for the H100.
How much power do the Instinct MI300X and the H100 draw?
The Instinct MI300X is rated at 750 W TDP and the H100 at 400 W. On FP32 throughput per watt, the Instinct MI300X is the more efficient part.
Can I rent the Instinct MI300X or the H100 in the cloud?
Yes. Live cloud listings tracked by Flopper start at $2.00 per GPU hour. The rental pricing section on this page lists current providers and rates for both GPUs.
Where to Rent
AMD Instinct MI300X 192GB
| Provider | Configuration | Price/GPU-hr | Checked | |
|---|---|---|---|---|
 RunPod | 1× Instinct MI300X 192GB | $2.39 | just now | View → |
 DigitalOcean | 1× Instinct MI300X 192GB | $2.59 | just now | View → |
| DigitalOcean | 8× Instinct MI300X 192GB | $2.59 | just now | View → |
 Crusoe | 1× Instinct MI300X 192GB | $3.45 | just now | View → |
 Oracle Cloud (OCI) | 1× Instinct MI300X 192GB | $6.00 | just now | View → |
 Microsoft Azure | 8× Instinct MI300X 192GB | $6.00 | 6h ago | View → |
| Microsoft Azure | 8× Instinct MI300X 192GB | $6.00 | 6h ago | View → |
NVIDIA H100 NVL 94GB
| Provider | Configuration | Price/GPU-hr | Checked | |
|---|---|---|---|---|
 Vast.ai | 1× H100 NVL Community | $2.00 | just now | View → |
| RunPod | 1× H100 NVL Community | $2.59 | just now | View → |
| RunPod | 1× H100 NVL | $3.19 | just now | View → |
| Microsoft Azure | 1× H100 NVL | $6.98 | 6h ago | View → |
| Microsoft Azure | 2× H100 NVL | $6.98 | 6h ago | View → |
| Microsoft Azure | 1× H100 NVL | $6.98 | 6h ago | View → |
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.