NVIDIA GH200 96GB HBM3 vs NVIDIA H100 SXM5 80GB

The GH200 and the H100 deliver near-identical FP8 throughput (1,979 vs 1,979 TFLOPS dense). The GH200 also carries 16 GB more memory (96 GB vs 80 GB).

GH200: Hopper, 2023 H100: Hopper, 2022
Memory
96 vs 80 GB
16 GB more for the GH200
Bandwidth
4.0 TB/s vs 3.4 TB/s
GH200 moves data faster
TDP
1.0 kW vs 700 W
H100 draws 300 W less
See rental pricing from $1.73/hr Download comparison sheet

Share this page

NVIDIA GH200 96GB HBM3 vs NVIDIA H100 SXM5 80GB

A post with this link shows the card on the Image tab as its preview.

Printable version →

NVIDIA GH200 96GB HBM3

Full specs →

What is the NVIDIA GH200?

The GH200 is a GPU from NVIDIA on the Hopper architecture, an accelerator for AI training, inference and high-performance computing. It is a superchip that pairs a CPU and accelerators on one board for rack-scale systems. GH200 full specifications →

Can I rent the GH200 in the cloud?

Yes. Cloud providers tracked by Flopper rent the GH200 by the hour, and the pricing page compares their current rates and the price history side by side. GH200 rental prices →

How does the GH200 compare with other accelerators?

This page sets the GH200 against the H100. The GH200 is the newer generation of the two. Both are NVIDIA parts; the GH200 is a superchip while the H100 is an SXM module. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the GH200 figures come from?

Every GH200 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

NVIDIA H100 SXM5 80GB

Full specs →

What is the NVIDIA H100?

The H100 is a GPU from NVIDIA on the Hopper architecture, an accelerator for AI training, inference and high-performance computing. It is an SXM module, the mezzanine format used in dense multi-GPU servers. H100 full specifications →

Can I rent the H100 in the cloud?

Yes. Cloud providers tracked by Flopper rent the H100 by the hour, and the pricing page compares their current rates and the price history side by side. H100 rental prices →

How does the H100 compare with other accelerators?

This page sets the H100 against the GH200. The H100 is the older generation of the two. Both are NVIDIA parts; the H100 is an SXM module while the GH200 is a superchip. Flopper also compares it head to head with the A100 SXM4 80GB, H200 SXM 141GB and Instinct MI300X 192GB, across every published precision, memory and power. H100 vs A100 SXM4 80GB →

Where do the H100 figures come from?

Every H100 figure on this page traces to NVIDIA's own datasheet or specification table. How Flopper verifies specifications →

Specifications

GH200
H100
Architecture
HopperHopper
Launch Year
20232022
Form Factor
SuperchipSXM
Memory
96 GB80 GB
Memory Bandwidth
4.0 TB/s3.4 TB/s
TDP
1.0 kW700 W
Process Node
4nm4nm

Performance (TFLOPS)

GH200
H100
34 TFLOPS 34 TFLOPS
67 TFLOPS 67 TFLOPS
494 TFLOPS
989 TFLOPS sparse
494 TFLOPS
989 TFLOPS sparse
990 TFLOPS
1,979 TFLOPS sparse
990 TFLOPS
1,979 TFLOPS sparse
990 TFLOPS
1,979 TFLOPS sparse
990 TFLOPS
1,979 TFLOPS sparse
1,979 TFLOPS
3,958 TFLOPS sparse
1,979 TFLOPS
3,958 TFLOPS sparse
FP6
No verified data available No verified data available
No verified data available No verified data available
1,979 TOPS
3,958 TOPS sparse
1,979 TOPS
3,958 TOPS sparse
Tensor Core
67 TFLOPS 67 TFLOPS

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

The GH200 is the newer part: Hopper (2023) against the H100's Hopper (2022).

The GH200 carries 16 GB more memory (96 GB against 80 GB), so larger models fit on one GPU before you shard. Bandwidth is 4.0 TB/s against 3.4 TB/s, which sets the ceiling on decode speed.

Power is 1.0 kW against 700 W, and at FP32 the H100 does more work per watt. Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP64, FP32, TF32, BF16, FP16, FP8, INT8, Sparsity and TFLOPS. For how the generations relate, see NVIDIA architectures explained.

Frequently asked questions

Is the GH200 faster than the H100?

They are close on paper: both deliver about 1,979 TFLOPS of dense FP8 throughput. Memory, bandwidth, and power are the deciding differences.

Which should you choose, the GH200 or the H100?

On raw FP8 throughput the GH200 and the H100 are level, so the decision rests on memory, power and price. Choose the GH200 when the model has to fit on one GPU: it carries 16 GB more memory. The H100 draws 300 W less power, which matters in an air-cooled or power-capped rack. Packaging differs too: the GH200 is a superchip while the H100 is an SXM module, so check what your servers accept.

Which has more memory, the GH200 or the H100?

The GH200 carries 96 GB of memory versus 80 GB for the H100. Memory bandwidth is 4.0 TB/s for the GH200 and 3.4 TB/s for the H100.

How much power do the GH200 and the H100 draw?

The GH200 is rated at 1.0 kW TDP and the H100 at 700 W. On FP32 throughput per watt, the H100 is the more efficient part.

How much do the GH200 and the H100 cost to rent?

Live cloud listings tracked by Flopper price the GH200 from $2.29 per GPU-hour across 4 providers, and the H100 from $1.73 per GPU-hour across 34 providers. The rental section on this page links to every provider, rate and the price history for each GPU.

Where to Rent

NVIDIA GH200 96GB HBM3

Rent from

$2.29 / GPU-hr

Lowest of 4 live listings across 4 providers · median $3.63

See all GH200 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

NVIDIA H100 SXM5 80GB

Rent from

$1.73 / GPU-hr

Lowest of 66 live listings across 34 providers · median $3.85

See all H100 rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

© 2026 Flopper.io - Compare the GPUs Powering AI