Flopper.io Flopper.io

NVIDIA H100 NVL 94GB vs NVIDIA H200 SXM 141GB

The H200 delivers 12% more FP32 throughput than the H100 (67 vs 60 TFLOPS dense). The H200 also carries 47 GB more memory (141 GB vs 94 GB).

H100: Hopper, 2023 H200: Hopper, 2024
FP32 dense lead
+12%
H200: 67 vs 60 TFLOPS
Memory
94 vs 141 GB
47 GB more for the H200
Bandwidth
3.9 TB/s vs 4.8 TB/s
H200 moves data faster
TDP
400 W vs 700 W
H100 draws 300 W less
See rental pricing from $2.09/hr Download comparison sheet

Share this page

NVIDIA H100 NVL 94GB vs NVIDIA H200 SXM 141GB

A post with this link shows the card on the Image tab as its preview.

Post on X Share on LinkedIn
 Printable version →

NVIDIA H100 NVL 94GB

Full specs →

What is the NVIDIA H100?

The H100 is a GPU from NVIDIA on the Hopper architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. H100 full specifications →

Can I rent the H100 in the cloud?

Yes. Cloud providers tracked by Flopper rent the H100 by the hour, and the pricing page compares their current rates and the price history side by side. H100 rental prices →

How does the H100 compare with other accelerators?

This page sets the H100 against the H200. The H100 is the older generation of the two. Both are NVIDIA parts; the H100 is a PCIe card while the H200 is an SXM module. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the H100 figures come from?

Every H100 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA H200 SXM 141GB

Leads on FP32 Full specs →

What is the NVIDIA H200?

The H200 is a GPU from NVIDIA on the Hopper architecture, an accelerator for AI training, inference and high-performance computing. It is an SXM module, the mezzanine format used in dense multi-GPU servers. H200 full specifications →

Can I rent the H200 in the cloud?

Yes. Cloud providers tracked by Flopper rent the H200 by the hour, and the pricing page compares their current rates and the price history side by side. H200 rental prices →

How does the H200 compare with other accelerators?

This page sets the H200 against the H100. The H200 is the newer generation of the two. Both are NVIDIA parts; the H200 is an SXM module while the H100 is a PCIe card. Flopper also compares it head to head with the H100 SXM5 80GB, B300 SXM 262GB and A100 SXM4 80GB, across every published precision, memory and power. H200 vs H100 SXM5 80GB →

Where do the H200 figures come from?

Every H200 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

H100
H200
Architecture
HopperHopper
Launch Year
20232024
Form Factor
PCIeSXM
Memory
94 GB141 GB
Memory Bandwidth
3.9 TB/s4.8 TB/s
TDP
400 W700 W
Process Node
4nm4nm

Performance (TFLOPS)

H100
H200
30 TFLOPS 34 TFLOPS
60 TFLOPS 67 TFLOPS
The vendor publishes only the 2:4 sparse figure for this precision
835 TFLOPS sparse
494 TFLOPS
989 TFLOPS sparse
The vendor publishes only the 2:4 sparse figure for this precision
1,671 TFLOPS sparse
990 TFLOPS
1,979 TFLOPS sparse
The vendor publishes only the 2:4 sparse figure for this precision
1,671 TFLOPS sparse
990 TFLOPS
1,979 TFLOPS sparse
The vendor publishes only the 2:4 sparse figure for this precision
3,341 TFLOPS sparse
1,979 TFLOPS
3,958 TFLOPS sparse
FP6
No verified data available No verified data available
No verified data available No verified data available
The vendor publishes only the 2:4 sparse figure for this precision
3,341 TOPS sparse
1,979 TOPS
3,958 TOPS sparse
Tensor Core
60 TFLOPS No verified data available

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

The H200 is the newer part: Hopper (2024) against the H100's Hopper (2023).

The H200 carries 47 GB more memory (141 GB against 94 GB), so larger models fit on one GPU before you shard. Bandwidth is 3.9 TB/s against 4.8 TB/s, which sets the ceiling on decode speed.

Power is 400 W against 700 W, and at FP32 the H100 does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, FP8, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the H100 faster than the H200?

At FP32 precision the H200 reaches 67 TFLOPS dense against 60 TFLOPS for the H100. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the H100 or the H200?

Choose the H200 for training and high-throughput inference: it has 12% more FP32 throughput than the H100. It also carries 47 GB more memory, so larger models fit on one GPU before you shard. The H200 draws 300 W more power, so budget for cooling and power delivery before you commit. Packaging differs too: the H100 is a PCIe card while the H200 is an SXM module, so check what your servers accept.

Which has more memory, the H100 or the H200?

The H200 carries 141 GB of memory versus 94 GB for the H100. Memory bandwidth is 3.9 TB/s for the H100 and 4.8 TB/s for the H200.

How much power do the H100 and the H200 draw?

The H100 is rated at 400 W TDP and the H200 at 700 W. On FP32 throughput per watt, the H100 is the more efficient part.

How much do the H100 and the H200 cost to rent?

Live cloud listings tracked by Flopper price the H100 from $2.59 per GPU-hour across 4 providers, and the H200 from $2.09 per GPU-hour across 29 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA H100 NVL 94GB

Rent from

$2.59 / GPU-hr

Lowest of 7 live listings across 4 providers · median $3.19

See all H100 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA H200 SXM 141GB

Rent from

$2.09 / GPU-hr

Lowest of 52 live listings across 29 providers · median $4.29

See all H200 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → H100 full specs H200 full specs Estimate cluster cost in the calculator →

© 2026 Flopper.io - Compare the GPUs Powering AI