NVIDIA H20 96GB

Official
Hopper SXM 2024 4nm
FP32
44.0
TFLOPS
VRAM
96 GB
HBM3
TDP
400 W
110.0 TFLOPS/kW
Bandwidth
4.0 TB/s
memory
View Providers

Performance Metrics

Peak theoretical throughput by precision type

PrecisionPeak TFLOPSEfficiency
INT8 296.0 0.740 TFLOPS/W
FP16 148.0 0.370 TFLOPS/W
BF16 148.0 0.370 TFLOPS/W
TF32 74.0 0.185 TFLOPS/W
FP32 44.0 0.110 TFLOPS/W
FP64 1.0 0.003 TFLOPS/W
FP16 Efficiency
0.370 TFLOPS/W
148.0 TFLOPS / 400W
FP32 Efficiency
0.110 TFLOPS/W
44.0 TFLOPS / 400W

Power Specifications

TDP

400 W

Max Power

460 W

Power Connector

PCIe 16-pin

Cooling

Liquid

Memory Specifications

Capacity

96 GB

Type

HBM3

Bandwidth

4000 GB/s

Interface

--

Hardware & Design

Form Factor

SXM

Architecture

Hopper

Process Node

4nm

Launch Year

2024

Variant

96GB

Market Segment

Data Center

Common Use Cases

General Compute AI/ML Workloads Data Processing

The NVIDIA H20 is optimized for high-performance computing tasks with Hopper architecture delivering 44 TFLOPS of compute power.

Where to Rent

Compare cloud providers offering on-demand GPU instances for AI training, inference, and HPC workloads.

Browse GPU Cloud Providers

Similar GPUs

NVIDIA H100 SXM5 80GB

SXM · 2022
FP32: 67.0 TFLOPS
Compare vs H100

NVIDIA H200 SXM 141GB

SXM · 2024
FP32: 67.0 TFLOPS
Compare vs H200

NVIDIA GH200

SXM · 2023
FP32: 67.0 TFLOPS
Compare vs GH200

NVIDIA H100 NVL 94GB

PCIe · 2023
FP32: 60.0 TFLOPS
Compare vs H100

NVIDIA H200 NVL 141GB

PCIe · 2024
FP32: 60.0 TFLOPS
Compare vs H200

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs