NVIDIA H100 PCIe 80GB

Hopper PCIe 2022 4nm Spec confidence: Official
FP8 (dense)
1,513
TFLOPS
FP32
51
TFLOPS
VRAM
80 GB
Bandwidth
2.0 TB/s
memory
TDP
350 W
145.7 TFLOPS/kW

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
1,513 TOPS
sparse not published
FP8
8-bit floating point
1,513 TFLOPS
sparse not published
FP16
16-bit floating point
757 TFLOPS
sparse not published
BF16
Brain Float 16
757 TFLOPS
sparse not published
TF32
TensorFloat-32
378 TFLOPS
sparse not published
FP32
32-bit floating point
51 TFLOPS
FP64
64-bit floating point
26 TFLOPS
4.323 TFLOPS/W FP8 at 350 W
2.161 TFLOPS/W FP16 at 350 W
0.146 TFLOPS/W FP32 at 350 W

The H100 PCIe 80GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XH100 PCIe 80GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Hopper

Form Factor

PCIe

Launch Year

2022

Process Node

4nm

Memory

80 GB

Bandwidth

2,000 GB/s

TDP

350 W

Max Power

~402 W

Spec Confidence

Official

Full Specifications

Memory
VRAM 80 GB
Bandwidth 2.0 TB/s
Power & Thermal
TDP 350 W
Enterprise Features
Sparsity Yes
General
Form Factor PCIe
Architecture Hopper
Launch Year 2022

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
NVIDIA
Published
2022-03-22

Data Quality

Spec confidence
Official
Clock basis
Boost
Precisions tracked
7
Normalization
All values in TFLOPS

Rent this GPU

$1.99 / GPU-hr

Lowest of 4 live listings across 2 providers· median $2.25

See all rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Similar GPUs

NVIDIA H100 SXM5 80GB

SXM · 2022
FP32: 67 TFLOPS
Compare vs H100

NVIDIA H200 SXM 141GB

SXM · 2024
FP32: 67 TFLOPS
Compare vs H200

NVIDIA GH200 96GB HBM3

SXM · 2023
FP32: 67 TFLOPS
Compare vs GH200

NVIDIA GH200 144GB HBM3e

SXM · 2024
FP32: 67 TFLOPS
Compare vs GH200

NVIDIA H100 NVL 94GB

PCIe · 2023
FP32: 60 TFLOPS
Compare vs H100

Frequently Asked Questions

How many TFLOPS does the NVIDIA H100 have?

The NVIDIA H100 delivers 51 TFLOPS for FP32 operations, 756.5 TFLOPS for FP16, and 1513 TFLOPS for FP8 precision.

What is the power consumption of the NVIDIA H100?

The NVIDIA H100 has a TDP (Thermal Design Power) rating of 350 watts.

How much memory does the NVIDIA H100 have?

The NVIDIA H100 is equipped with 80 GB of VRAM with 2000 GB/s memory bandwidth.

What architecture is the NVIDIA H100 based on?

The NVIDIA H100 is based on the Hopper architecture, launched in 2022.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs