NVIDIA H100 SXM5 80GB
Performance
Peak theoretical throughput by precision type
The H100 SXM5 80GB in the GPU landscape
Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper
Higher and further left is better: more half-precision throughput for less power.
Specifications
Architecture
Hopper
Form Factor
SXM
Launch Year
2022
Process Node
4nm
Memory
80 GB
Bandwidth
3,350 GB/s
TDP
700 W
Max Power
~805 W
Spec Confidence
Official
Full Specifications
| Memory | |
|---|---|
| VRAM | 80 GB |
| Bandwidth | 3.4 TB/s |
| Power & Thermal | |
| TDP | 700 W |
| Enterprise Features | |
| Sparsity | Yes |
| General | |
| Form Factor | SXM |
| Architecture | Hopper |
| Launch Year | 2022 |
Datasheet & Resources
Flopper Datasheet
NVIDIA H100 SXM5 80GB specifications, generated from our database. Printable.
Vendor product page
NVIDIA documentation for the H100 SXM5 80GB
NVIDIA H100 Tensor Core GPU
NVIDIA · 2022-03-22
NVIDIA Developer Documentation
Technical specs, programming guides
Data Provenance
Every figure traced to a source
Primary Source
- Document
- NVIDIA H100 Tensor Core GPU
- Publisher
- NVIDIA
- Published
- 2022-03-22
Data Quality
- Spec confidence
- Official
- Clock basis
- Boost
- Precisions tracked
- 8
- Normalization
- All values in TFLOPS
Rent this GPU
$1.63 / GPU-hr
Lowest of 11 live listings across 9 providers· median $3.29
Price history and every provider on the pricing page. Some links are affiliate links.
Similar GPUs
Systems Using This GPU
Pre-configured systems featuring the NVIDIA H100
| System | GPU Count | Peak Performance | Total Power | |
|---|---|---|---|---|
Supermicro GPU SuperServer AS -8125GS-TNHR (HGX H100) GPU SuperServer · rack · 2024 | 8x H100 | 15.83 PFLOPS | -- | View System |
NVIDIA DGX H100 DGX · rack · 2022 | 8x H100 | 15.83 PFLOPS | 8.5 kW | View System |
NVIDIA HGX H100 4-GPU HGX · baseboard · 2022 | 4x H100 | 7.92 PFLOPS | 4.2 kW | View System |
NVIDIA HGX H100 8-GPU HGX · baseboard · 2022 | 8x H100 | 15.83 PFLOPS | 8.0 kW | View System |
Lenovo ThinkSystem SR780a V3 (HGX H100) ThinkSystem · rack · | 8x H100 | -- | -- | View System |
Frequently Asked Questions
How many TFLOPS does the NVIDIA H100 have?
The NVIDIA H100 delivers 67 TFLOPS for FP32 operations, 990 TFLOPS for FP16, and 1979 TFLOPS for FP8 precision.
What is the power consumption of the NVIDIA H100?
The NVIDIA H100 has a TDP (Thermal Design Power) rating of 700 watts.
How much memory does the NVIDIA H100 have?
The NVIDIA H100 is equipped with 80 GB of VRAM with 3350 GB/s memory bandwidth.
What architecture is the NVIDIA H100 based on?
The NVIDIA H100 is based on the Hopper architecture, launched in 2022.
Stay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
No spam, unsubscribe anytime.