NVIDIA H100 SXM5 80GB vs NVIDIA H100 PCIe 80GB

The H100 SXM5 80GB delivers 31% more FP8 throughput than the H100 PCIe 80GB (1,979 vs 1,513 TFLOPS dense).

H100 SXM5 80GB: Hopper, 2022 H100 PCIe 80GB: Hopper, 2022

FP8 dense lead

+31%

H100 SXM5 80GB: 1,979 vs 1,513 TFLOPS

Memory

80 vs 80 GB

Same capacity

Bandwidth

3.4 TB/s vs 2.0 TB/s

H100 SXM5 80GB moves data faster

TDP

700 W vs 350 W

H100 PCIe 80GB draws 350 W less

See rental pricing from $0.79/hr Download comparison sheet Printable version →

NVIDIA H100 SXM5 80GB

Leads on FP8 Full specs →

What is the NVIDIA H100 SXM5 80GB?

The H100 SXM5 80GB is a GPU from NVIDIA on the Hopper architecture, an accelerator for AI training, inference and high-performance computing. It is an SXM module, the mezzanine format used in dense multi-GPU servers. H100 SXM5 80GB full specifications →

Can I rent the H100 SXM5 80GB in the cloud?

Yes. Cloud providers tracked by Flopper rent the H100 SXM5 80GB by the hour, and the pricing page compares their current rates and the price history side by side. H100 SXM5 80GB rental prices →

How does the H100 SXM5 80GB compare with other accelerators?

This page sets the H100 SXM5 80GB against the H100 PCIe 80GB. Both parts launched in the same year. Both are NVIDIA parts; the H100 SXM5 80GB is an SXM module while the H100 PCIe 80GB is a PCIe card. Flopper also compares it head to head with the A100 SXM4 80GB, H200 SXM 141GB and Instinct MI300X 192GB, across every published precision, memory and power. H100 SXM5 80GB vs A100 SXM4 80GB →

Where do the H100 SXM5 80GB figures come from?

Every H100 SXM5 80GB figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA H100 PCIe 80GB

Full specs →

What is the NVIDIA H100 PCIe 80GB?

The H100 PCIe 80GB is a GPU from NVIDIA on the Hopper architecture, an accelerator for AI training, inference and high-performance computing. It is a PCIe add-in card, so it fits standard servers and workstations. H100 PCIe 80GB full specifications →

Can I rent the H100 PCIe 80GB in the cloud?

Yes. Cloud providers tracked by Flopper rent the H100 PCIe 80GB by the hour, and the pricing page compares their current rates and the price history side by side. H100 PCIe 80GB rental prices →

How does the H100 PCIe 80GB compare with other accelerators?

This page sets the H100 PCIe 80GB against the H100 SXM5 80GB. Both parts launched in the same year. Both are NVIDIA parts; the H100 PCIe 80GB is a PCIe card while the H100 SXM5 80GB is an SXM module. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the H100 PCIe 80GB figures come from?

Every H100 PCIe 80GB figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

H100 SXM5 80GB

H100 PCIe 80GB

Architecture

HopperHopper

Launch Year

20222022

Form Factor

SXMPCIe

Memory

80 GB80 GB

Memory Bandwidth

3.4 TB/s2.0 TB/s

TDP

700 W350 W

Process Node

4nm4nm

Spec

H100 SXM5 80GB

H100 PCIe 80GB

Architecture HopperHopper

Launch Year 20222022

Form Factor SXMPCIe

Memory 80 GB80 GB

Memory Bandwidth 3.4 TB/s2.0 TB/s

TDP 700 W350 W

Process Node 4nm4nm

Performance (TFLOPS)

H100 SXM5 80GB

H100 PCIe 80GB

34 TFLOPS 26 TFLOPS

67 TFLOPS 51 TFLOPS

494 TFLOPS

989 TFLOPS sparse

378 TFLOPS

sparse not published

990 TFLOPS

1,979 TFLOPS sparse

757 TFLOPS

sparse not published

990 TFLOPS

1,979 TFLOPS sparse

757 TFLOPS

sparse not published

1,979 TFLOPS

3,958 TFLOPS sparse

1,513 TFLOPS

sparse not published

FP6

1,979 TOPS

3,958 TOPS sparse

1,513 TOPS

sparse not published

Tensor Core

67 TFLOPS

Precision

H100 SXM5 80GB

H100 PCIe 80GB

34 TFLOPS 26 TFLOPS

67 TFLOPS 51 TFLOPS

494 TFLOPS

989 TFLOPS sparse

378 TFLOPS

sparse not published

990 TFLOPS

1,979 TFLOPS sparse

757 TFLOPS

sparse not published

990 TFLOPS

1,979 TFLOPS sparse

757 TFLOPS

sparse not published

1,979 TFLOPS

3,958 TFLOPS sparse

1,513 TFLOPS

sparse not published

FP6

1,979 TOPS

3,958 TOPS sparse

1,513 TOPS

sparse not published

Tensor Core

67 TFLOPS

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

Both launched in 2022, the H100 SXM5 80GB on Hopper and the H100 PCIe 80GB on Hopper.

Both carry 80 GB of memory. Bandwidth is 3.4 TB/s against 2.0 TB/s, which sets the ceiling on decode speed.

Power is 700 W against 350 W, and at FP32 the H100 PCIe 80GB does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, FP8, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the H100 SXM5 80GB faster than the H100 PCIe 80GB?

At FP8 precision the H100 SXM5 80GB reaches 1,979 TFLOPS dense against 1,513 TFLOPS for the H100 PCIe 80GB. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the H100 SXM5 80GB or the H100 PCIe 80GB?

Choose the H100 SXM5 80GB for training and high-throughput inference: it has 31% more FP8 throughput than the H100 PCIe 80GB. The H100 SXM5 80GB draws 350 W more power, so budget for cooling and power delivery before you commit. Packaging differs too: the H100 SXM5 80GB is an SXM module while the H100 PCIe 80GB is a PCIe card, so check what your servers accept.

Which has more memory, the H100 SXM5 80GB or the H100 PCIe 80GB?

Both GPUs carry 80 GB of memory. Memory bandwidth is 3.4 TB/s for the H100 SXM5 80GB and 2.0 TB/s for the H100 PCIe 80GB.

How much power do the H100 SXM5 80GB and the H100 PCIe 80GB draw?

The H100 SXM5 80GB is rated at 700 W TDP and the H100 PCIe 80GB at 350 W. On FP32 throughput per watt, the H100 PCIe 80GB is the more efficient part.

How much do the H100 SXM5 80GB and the H100 PCIe 80GB cost to rent?

Live cloud listings tracked by Flopper price the H100 SXM5 80GB from $0.79 per GPU-hour across 32 providers, and the H100 PCIe 80GB from $1.66 per GPU-hour across 10 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA H100 SXM5 80GB

Rent from

$0.79 / GPU-hr

Lowest of 68 live listings across 32 providers · median $3.95

See all H100 SXM5 80GB rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA H100 PCIe 80GB

Rent from

$1.66 / GPU-hr

Lowest of 20 live listings across 10 providers · median $2.50

See all H100 PCIe 80GB rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → H100 SXM5 80GB full specs H100 PCIe 80GB full specs Estimate cluster cost in the calculator →

NVIDIA H100 SXM5 80GB vs NVIDIA H100 PCIe 80GB

NVIDIA H100 SXM5 80GB

What is the NVIDIA H100 SXM5 80GB?

Can I rent the H100 SXM5 80GB in the cloud?

How does the H100 SXM5 80GB compare with other accelerators?

Where do the H100 SXM5 80GB figures come from?

NVIDIA H100 PCIe 80GB

What is the NVIDIA H100 PCIe 80GB?

Can I rent the H100 PCIe 80GB in the cloud?

How does the H100 PCIe 80GB compare with other accelerators?

Where do the H100 PCIe 80GB figures come from?

Specifications

Performance (TFLOPS)

FLOPS by Precision

What actually differs

Frequently asked questions

Is the H100 SXM5 80GB faster than the H100 PCIe 80GB?

Which should you choose, the H100 SXM5 80GB or the H100 PCIe 80GB?

Which has more memory, the H100 SXM5 80GB or the H100 PCIe 80GB?

How much power do the H100 SXM5 80GB and the H100 PCIe 80GB draw?

How much do the H100 SXM5 80GB and the H100 PCIe 80GB cost to rent?

Where to Rent

NVIDIA H100 SXM5 80GB

NVIDIA H100 PCIe 80GB

Related comparisons

Get Comparison Updates

Stay Updated on GPU Specs