NVIDIA H200 SXM 141GB

Hopper SXM 2024 4nm Spec confidence: Official
FP8 (dense)
1,979
TFLOPS
FP32
67
TFLOPS
VRAM
141 GB
Bandwidth
4.8 TB/s
memory
TDP
700 W
95.7 TFLOPS/kW

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
1,979 TOPS
3,958 with sparsity
FP8
8-bit floating point
1,979 TFLOPS
3,958 with sparsity
FP16
16-bit floating point
990 TFLOPS
1,979 with sparsity
BF16
Brain Float 16
990 TFLOPS
1,979 with sparsity
TF32
TensorFloat-32
494 TFLOPS
989 with sparsity
FP32
32-bit floating point
67 TFLOPS
FP64
64-bit floating point
34 TFLOPS
Dense Added with sparsity
2.827 TFLOPS/W FP8 at 700 W
1.414 TFLOPS/W FP16 at 700 W
0.096 TFLOPS/W FP32 at 700 W

The H200 SXM 141GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XH200 SXM 141GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Hopper

Form Factor

SXM

Launch Year

2024

Process Node

4nm

Memory

141 GB

Bandwidth

4,800 GB/s

TDP

700 W

Max Power

~805 W

Spec Confidence

Official

Full Specifications

Memory
VRAM 141 GB
Bandwidth 4.8 TB/s
Power & Thermal
TDP 700 W
Enterprise Features
Sparsity Yes
General
Form Factor SXM
Architecture Hopper
Launch Year 2024

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
NVIDIA
Published
2024-01-15

Data Quality

Spec confidence
Official
Clock basis
Boost
Precisions tracked
7
Normalization
All values in TFLOPS

Rent this GPU

$2.00 / GPU-hr

Lowest of 16 live listings across 10 providers· median $4.38

See all rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Similar GPUs

NVIDIA H100 SXM5 80GB

SXM · 2022
FP32: 67 TFLOPS
Compare vs H100

NVIDIA GH200 96GB HBM3

SXM · 2023
FP32: 67 TFLOPS
Compare vs GH200

NVIDIA GH200 144GB HBM3e

SXM · 2024
FP32: 67 TFLOPS
Compare vs GH200

NVIDIA H100 NVL 94GB

PCIe · 2023
FP32: 60 TFLOPS
Compare vs H100

NVIDIA H200 NVL 141GB

PCIe · 2024
FP32: 60 TFLOPS
Compare vs H200

Systems Using This GPU

Pre-configured systems featuring the NVIDIA H200

SystemGPU CountPeak PerformanceTotal Power
HPE ProLiant Compute XD685 (HGX H200)
ProLiant Compute XD · rack · 2025
8x H200 15.83 PFLOPS -- View System
HPE Cray XD670
Cray · rack · 2024
8x H200 15.83 PFLOPS -- View System
NVIDIA DGX H200
DGX · rack · 2024
8x H200 15.83 PFLOPS 8.5 kW View System
Gigabyte G593-SD1-LAX3
G593 · rack · 2024
8x H200 15.83 PFLOPS -- View System
Supermicro GPU SuperServer AS -8125GS-TNHR (HGX H200)
GPU SuperServer · rack · 2024
8x H200 15.83 PFLOPS -- View System
Supermicro GPU SuperServer SYS-821GE-TNHR
GPU SuperServer · rack · 2024
8x H200 15.83 PFLOPS -- View System
NVIDIA HGX H200
HGX · baseboard · 2024
8x H200 15.83 PFLOPS 8.0 kW View System
Dell PowerEdge XE9680
PowerEdge · rack · 2024
8x H200 15.83 PFLOPS -- View System
Penguin Solutions Altus XE2318GTv2
Altus · rack ·
4x H200 -- -- View System
Penguin Solutions Altus XE5318GTSv2
Altus · rack ·
8x H200 -- -- View System
ASUS ESC N8-E11
ESC · rack ·
8x H200 15.83 PFLOPS -- View System
QCT QuantaGrid D74F-7U
QuantaGrid · rack ·
8x H200 -- -- View System
QCT QuantaGrid D75F-7U
QuantaGrid · rack ·
8x H200 -- -- View System
Penguin Solutions Relion XE3314GTS
Relion · rack ·
4x H200 -- -- View System
Penguin Solutions Relion XE5318GTS
Relion · rack ·
8x H200 -- -- View System

Frequently Asked Questions

How many TFLOPS does the NVIDIA H200 have?

The NVIDIA H200 delivers 67 TFLOPS for FP32 operations, 990 TFLOPS for FP16, and 1979 TFLOPS for FP8 precision.

What is the power consumption of the NVIDIA H200?

The NVIDIA H200 has a TDP (Thermal Design Power) rating of 700 watts.

How much memory does the NVIDIA H200 have?

The NVIDIA H200 is equipped with 141 GB of VRAM with 4800 GB/s memory bandwidth.

What architecture is the NVIDIA H200 based on?

The NVIDIA H200 is based on the Hopper architecture, launched in 2024.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs