AMD Instinct MI300X 192GB vs NVIDIA H200 SXM 141GB

The Instinct MI300X delivers 32% more FP8 throughput than the H200 (2,615 vs 1,979 TFLOPS dense). The Instinct MI300X also carries 51 GB more memory (192 GB vs 141 GB).

Instinct MI300X: CDNA 3, 2023 H200: Hopper, 2024

FP8 dense lead

+32%

Instinct MI300X: 2,615 vs 1,979 TFLOPS

Memory

192 vs 141 GB

51 GB more for the Instinct MI300X

Bandwidth

5.3 TB/s vs 4.8 TB/s

Instinct MI300X moves data faster

TDP

750 W vs 700 W

H200 draws 50 W less

See rental pricing from $0.50/hr Download comparison sheet Printable version →

AMD Instinct MI300X 192GB

Leads on FP8 Full specs →

What is the AMD Instinct MI300X?

The Instinct MI300X is a GPU from AMD on the CDNA 3 architecture, an accelerator for AI training, inference and high-performance computing. It is an OAM module, the open accelerator format used in multi-GPU servers. Instinct MI300X full specifications →

Can I rent the Instinct MI300X in the cloud?

Yes. Cloud providers tracked by Flopper rent the Instinct MI300X by the hour, and the pricing page compares their current rates and the price history side by side. Instinct MI300X rental prices →

How does the Instinct MI300X compare with other accelerators?

This page sets the Instinct MI300X against the H200. The Instinct MI300X is the older generation of the two. This is a cross-vendor matchup, AMD against NVIDIA; the Instinct MI300X is an OAM module while the H200 is an SXM module. Flopper also compares it head to head with the H100 SXM5 80GB, across every published precision, memory and power. Instinct MI300X vs H100 SXM5 80GB →

Where do the Instinct MI300X figures come from?

Every Instinct MI300X figure on this page traces to AMD's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA H200 SXM 141GB

Full specs →

What is the NVIDIA H200?

The H200 is a GPU from NVIDIA on the Hopper architecture, an accelerator for AI training, inference and high-performance computing. It is an SXM module, the mezzanine format used in dense multi-GPU servers. H200 full specifications →

Can I rent the H200 in the cloud?

Yes. Cloud providers tracked by Flopper rent the H200 by the hour, and the pricing page compares their current rates and the price history side by side. H200 rental prices →

How does the H200 compare with other accelerators?

This page sets the H200 against the Instinct MI300X. The H200 is the newer generation of the two. This is a cross-vendor matchup, NVIDIA against AMD; the H200 is an SXM module while the Instinct MI300X is an OAM module. Flopper also compares it head to head with the H100 SXM5 80GB, B300 SXM 262GB and A100 SXM4 80GB, across every published precision, memory and power. H200 vs H100 SXM5 80GB →

Where do the H200 figures come from?

Every H200 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

Instinct MI300X

H200

Architecture

CDNA 3Hopper

Launch Year

20232024

Form Factor

OAMSXM

Memory

192 GB141 GB

Memory Bandwidth

5.3 TB/s4.8 TB/s

TDP

750 W700 W

Process Node

5nm FinFET4nm

Spec

Instinct MI300X

H200

Architecture CDNA 3Hopper

Launch Year 20232024

Form Factor OAMSXM

Memory 192 GB141 GB

Memory Bandwidth 5.3 TB/s4.8 TB/s

TDP 750 W700 W

Process Node 5nm FinFET4nm

Performance (TFLOPS)

Instinct MI300X

H200

82 TFLOPS 34 TFLOPS

163 TFLOPS 67 TFLOPS

654 TFLOPS

1,307 TFLOPS sparse

494 TFLOPS

989 TFLOPS sparse

1,307 TFLOPS

2,615 TFLOPS sparse

990 TFLOPS

1,979 TFLOPS sparse

1,307 TFLOPS

2,615 TFLOPS sparse

990 TFLOPS

1,979 TFLOPS sparse

2,615 TFLOPS

5,230 TFLOPS sparse

1,979 TFLOPS

3,958 TFLOPS sparse

FP6

2,615 TOPS

5,230 TOPS sparse

1,979 TOPS

3,958 TOPS sparse

Precision

Instinct MI300X

H200

82 TFLOPS 34 TFLOPS

163 TFLOPS 67 TFLOPS

654 TFLOPS

1,307 TFLOPS sparse

494 TFLOPS

989 TFLOPS sparse

1,307 TFLOPS

2,615 TFLOPS sparse

990 TFLOPS

1,979 TFLOPS sparse

1,307 TFLOPS

2,615 TFLOPS sparse

990 TFLOPS

1,979 TFLOPS sparse

2,615 TFLOPS

5,230 TFLOPS sparse

1,979 TFLOPS

3,958 TFLOPS sparse

FP6

2,615 TOPS

5,230 TOPS sparse

1,979 TOPS

3,958 TOPS sparse

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

The H200 is the newer part: Hopper (2024) against the Instinct MI300X's CDNA 3 (2023).

The Instinct MI300X carries 51 GB more memory (192 GB against 141 GB), so larger models fit on one GPU before you shard. Bandwidth is 5.3 TB/s against 4.8 TB/s, which sets the ceiling on decode speed.

Power is 750 W against 700 W, and at FP32 the Instinct MI300X does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, FP8, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the Instinct MI300X faster than the H200?

At FP8 precision the Instinct MI300X reaches 2,615 TFLOPS dense against 1,979 TFLOPS for the H200. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the Instinct MI300X or the H200?

Choose the Instinct MI300X for training and high-throughput inference: it has 32% more FP8 throughput than the H200. It also carries 51 GB more memory, so larger models fit on one GPU before you shard. The Instinct MI300X draws 50 W more power, so budget for cooling and power delivery before you commit. Packaging differs too: the Instinct MI300X is an OAM module while the H200 is an SXM module, so check what your servers accept.

Which has more memory, the Instinct MI300X or the H200?

The Instinct MI300X carries 192 GB of memory versus 141 GB for the H200. Memory bandwidth is 5.3 TB/s for the Instinct MI300X and 4.8 TB/s for the H200.

How much power do the Instinct MI300X and the H200 draw?

The Instinct MI300X is rated at 750 W TDP and the H200 at 700 W. On FP32 throughput per watt, the Instinct MI300X is the more efficient part.

How much do the Instinct MI300X and the H200 cost to rent?

Live cloud listings tracked by Flopper price the Instinct MI300X from $0.50 per GPU-hour across 6 providers, and the H200 from $0.79 per GPU-hour across 30 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

AMD Instinct MI300X 192GB

Rent from

$0.50 / GPU-hr

Lowest of 15 live listings across 6 providers · median $2.99

See all Instinct MI300X rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA H200 SXM 141GB

Rent from

$0.79 / GPU-hr

Lowest of 57 live listings across 30 providers · median $4.38

See all H200 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → Instinct MI300X full specs H200 full specs Estimate cluster cost in the calculator →

AMD Instinct MI300X 192GB vs NVIDIA H200 SXM 141GB

AMD Instinct MI300X 192GB

What is the AMD Instinct MI300X?

Can I rent the Instinct MI300X in the cloud?

How does the Instinct MI300X compare with other accelerators?

Where do the Instinct MI300X figures come from?

NVIDIA H200 SXM 141GB

What is the NVIDIA H200?

Can I rent the H200 in the cloud?

How does the H200 compare with other accelerators?

Where do the H200 figures come from?

Specifications

Performance (TFLOPS)

FLOPS by Precision

What actually differs

Frequently asked questions

Is the Instinct MI300X faster than the H200?

Which should you choose, the Instinct MI300X or the H200?

Which has more memory, the Instinct MI300X or the H200?

How much power do the Instinct MI300X and the H200 draw?

How much do the Instinct MI300X and the H200 cost to rent?

Where to Rent

AMD Instinct MI300X 192GB

NVIDIA H200 SXM 141GB

Related comparisons

Get Comparison Updates

Stay Updated on GPU Specs