NVIDIA H100 SXM5 80GB
Official
Hopper SXM 2022 4nm
FP32
67.0
TFLOPS
VRAM
80 GB
TDP
700 W
95.7 TFLOPS/kW
Bandwidth
3.4 TB/s
memory
Performance Metrics
Peak theoretical throughput by precision type
| Precision | Description | Bits | Peak TFLOPS | Efficiency |
|---|---|---|---|---|
| INT8 | 8-bit integer | 8 | 1979.0 | 2.827 TFLOPS/W |
| FP8 | 8-bit floating point | 8 | 1979.0 | 2.827 TFLOPS/W |
| FP16 | 16-bit floating point | 16 | 989.5 | 1.414 TFLOPS/W |
| BF16 | Brain Float 16 | 16 | 989.5 | 1.414 TFLOPS/W |
| TF32 | TensorFloat-32 | 32 | 494.5 | 0.706 TFLOPS/W |
| FP32 | 32-bit floating point | 32 | 67.0 | 0.096 TFLOPS/W |
| FP64 | 64-bit floating point | 64 | 34.0 | 0.049 TFLOPS/W |
FP8 Efficiency
2.827 TFLOPS/W
1979.0 TFLOPS / 700W
FP16 Efficiency
1.414 TFLOPS/W
989.5 TFLOPS / 700W
FP32 Efficiency
0.096 TFLOPS/W
67.0 TFLOPS / 700W
Power Specifications
TDP
700 W
Max Power
805 W
Power Connector
PCIe 16-pin
Cooling
Liquid
Memory Specifications
Capacity
80 GB
Type
--
Bandwidth
3350 GB/s
Interface
--
Hardware & Design
Form Factor
SXM
Architecture
Hopper
Process Node
4nm
Launch Year
2022
Variant
SXM5 80GB
Market Segment
Data Center
Documentation & Resources
Common Use Cases
LLM Training LLM Inference Scientific Computing HPC Workloads
The NVIDIA H100 is optimized for high-performance computing tasks with Hopper architecture delivering 67 TFLOPS of compute power.
Where to Rent
| Provider | Instance | Price/hr | |
|---|---|---|---|
Vast.ai | — | $1.47 | View → |
RunPod | H100 SXM | $2.69 | View → |
DataCrunch | 1H100.80S.30V | $3.25 | View → |
Prices shown are approximate. Click through for current pricing.
Similar GPUs
Systems Using This GPU
Pre-configured systems featuring the NVIDIA H100
| System | GPU Count | Peak Performance | Total Power | Interconnect | |
|---|---|---|---|---|---|
NVIDIA DGX H100 DGX · rack · 2022 | 8x H100 | 15.83 PFLOPS | 8.5 kW | NVSwitch + NVLink | View System |
NVIDIA HGX H100 4-GPU HGX · baseboard · 2022 | 4x H100 | 7.92 PFLOPS | 4.2 kW | NVLink | View System |
NVIDIA HGX H100 8-GPU HGX · baseboard · 2022 | 8x H100 | 15.83 PFLOPS | 8.0 kW | NVSwitch + NVLink | View System |
Stay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
Loading verification...
No spam, unsubscribe anytime.