NVIDIA H200 SXM 141GB vs NVIDIA A100 SXM4 80GB

The H200 delivers 3.2x the FP16 throughput of the A100 (990 vs 312 TFLOPS dense). The H200 also carries 61 GB more memory (141 GB vs 80 GB).

H200: Hopper, 2024 A100: Ampere, 2020

FP16 dense lead

3.2x

H200: 990 vs 312 TFLOPS

Memory

141 vs 80 GB

61 GB more for the H200

Bandwidth

4.8 TB/s vs 2.0 TB/s

H200 moves data faster

TDP

700 W vs 400 W

A100 draws 300 W less

See rental pricing from $1.01/hr Download comparison sheet Printable version →

NVIDIA H200 SXM 141GB

Leads on FP16 Full specs →

What is the NVIDIA H200?

The H200 is a GPU from NVIDIA on the Hopper architecture, an accelerator for AI training, inference and high-performance computing. It is an SXM module, the mezzanine format used in dense multi-GPU servers. H200 full specifications →

Can I rent the H200 in the cloud?

Yes. Cloud providers tracked by Flopper rent the H200 by the hour, and the pricing page compares their current rates and the price history side by side. H200 rental prices →

How does the H200 compare with other accelerators?

This page sets the H200 against the A100. The H200 is the newer generation of the two. Both are NVIDIA parts, and both ship as an SXM module, so they fit the same class of system. Flopper also compares it head to head with the H100 SXM5 80GB, B300 SXM 262GB and Instinct MI300X 192GB, across every published precision, memory and power. H200 vs H100 SXM5 80GB →

Where do the H200 figures come from?

Every H200 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA A100 SXM4 80GB

Full specs →

What is the NVIDIA A100?

The A100 is a GPU from NVIDIA on the Ampere architecture, an accelerator for AI training, inference and high-performance computing. It is an SXM module, the mezzanine format used in dense multi-GPU servers. A100 full specifications →

Can I rent the A100 in the cloud?

Yes. Cloud providers tracked by Flopper rent the A100 by the hour, and the pricing page compares their current rates and the price history side by side. A100 rental prices →

How does the A100 compare with other accelerators?

This page sets the A100 against the H200. The A100 is the older generation of the two. Both are NVIDIA parts, and both ship as an SXM module, so they fit the same class of system. Flopper also compares it head to head with the H100 SXM5 80GB, B200 SXM 180GB and A100 PCIe 40GB, across every published precision, memory and power. A100 vs H100 SXM5 80GB →

Where do the A100 figures come from?

Every A100 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

H200

A100

Architecture

HopperAmpere

Launch Year

20242020

Form Factor

SXMSXM

Memory

141 GB80 GB

Memory Bandwidth

4.8 TB/s2.0 TB/s

TDP

700 W400 W

Process Node

4nm7nm

Spec

H200

A100

Architecture HopperAmpere

Launch Year 20242020

Form Factor SXMSXM

Memory 141 GB80 GB

Memory Bandwidth 4.8 TB/s2.0 TB/s

TDP 700 W400 W

Process Node 4nm7nm

Performance (TFLOPS)

H200

A100

34 TFLOPS 9.7 TFLOPS

67 TFLOPS 20 TFLOPS

494 TFLOPS

989 TFLOPS sparse

156 TFLOPS

312 TFLOPS sparse

990 TFLOPS

1,979 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

990 TFLOPS

1,979 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

1,979 TFLOPS

3,958 TFLOPS sparse

FP6

1,979 TOPS

3,958 TOPS sparse

624 TOPS

1,248 TOPS sparse

Precision

H200

A100

34 TFLOPS 9.7 TFLOPS

67 TFLOPS 20 TFLOPS

494 TFLOPS

989 TFLOPS sparse

156 TFLOPS

312 TFLOPS sparse

990 TFLOPS

1,979 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

990 TFLOPS

1,979 TFLOPS sparse

312 TFLOPS

624 TFLOPS sparse

1,979 TFLOPS

3,958 TFLOPS sparse

FP6

1,979 TOPS

3,958 TOPS sparse

624 TOPS

1,248 TOPS sparse

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

The H200 is the newer part: Hopper (2024) against the A100's Ampere (2020).

The H200 carries 61 GB more memory (141 GB against 80 GB), so larger models fit on one GPU before you shard. Bandwidth is 4.8 TB/s against 2.0 TB/s, which sets the ceiling on decode speed.

Power is 700 W against 400 W, and at FP32 the H200 does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, FP8, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

What is better, the H200 or the A100?

The H200, on throughput. At FP16 precision the H200 reaches 990 TFLOPS dense against 312 TFLOPS for the A100. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the H200 or the A100?

Choose the H200 for training and high-throughput inference: it has 3.2x the FP16 throughput of the A100. It also carries 61 GB more memory, so larger models fit on one GPU before you shard. The H200 draws 300 W more power, so budget for cooling and power delivery before you commit.

Which has more memory, the H200 or the A100?

The H200 carries 141 GB of memory versus 80 GB for the A100. Memory bandwidth is 4.8 TB/s for the H200 and 2.0 TB/s for the A100.

How much power do the H200 and the A100 draw?

The H200 is rated at 700 W TDP and the A100 at 400 W. On FP32 throughput per watt, the H200 is the more efficient part.

How much do the H200 and the A100 cost to rent?

Live cloud listings tracked by Flopper price the H200 from $2.09 per GPU-hour across 31 providers, and the A100 from $1.01 per GPU-hour across 27 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA H200 SXM 141GB

Rent from

$2.09 / GPU-hr

Lowest of 54 live listings across 31 providers · median $4.47

See all H200 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA A100 SXM4 80GB

Rent from

$1.01 / GPU-hr

Lowest of 58 live listings across 27 providers · median $1.79

See all A100 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → H200 full specs A100 full specs Estimate cluster cost in the calculator →

NVIDIA H200 SXM 141GB vs NVIDIA A100 SXM4 80GB

NVIDIA H200 SXM 141GB

What is the NVIDIA H200?

Can I rent the H200 in the cloud?

How does the H200 compare with other accelerators?

Where do the H200 figures come from?

NVIDIA A100 SXM4 80GB

What is the NVIDIA A100?

Can I rent the A100 in the cloud?

How does the A100 compare with other accelerators?

Where do the A100 figures come from?

Specifications

Performance (TFLOPS)

FLOPS by Precision

What actually differs

Frequently asked questions

What is better, the H200 or the A100?

Which should you choose, the H200 or the A100?

Which has more memory, the H200 or the A100?

How much power do the H200 and the A100 draw?

How much do the H200 and the A100 cost to rent?

Where to Rent

NVIDIA H200 SXM 141GB

NVIDIA A100 SXM4 80GB

Related comparisons

Get Comparison Updates

Stay Updated on GPU Specs