NVIDIA H20 96GB
Overview
The NVIDIA H20 is a Hopper architecture datacenter GPU designed for the Chinese market under U.S. export regulations. Featuring 96GB HBM3 memory with 4.0 TB/s bandwidth, it delivers 44 TFLOPS FP32 and 74 TFLOPS TF32 at 400W TDP. While compute is constrained compared to the H100, its exceptional memory bandwidth suits large language model inference.
Performance
Peak theoretical throughput by precision type
| Precision | Dense | 2:4 Sparse |
|---|---|---|
FP64 64-bit floating point | 1TFLOPS | Structured sparsity is a tensor-core feature; this vector precision has no sparse form |
FP32 32-bit floating point | 44TFLOPS | Structured sparsity is a tensor-core feature; this vector precision has no sparse form |
TF32 TensorFloat-32 | 74TFLOPS | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
BF16 Brain Float 16 | 148TFLOPS | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP16 16-bit floating point | 148TFLOPS | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP8 8-bit floating point | 296TFLOPS | 592TFLOPS |
FP6 | No verified data available | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP4 | No verified data available | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
INT8 8-bit integer | 296TOPS | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
Dense peak divided by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead. TDP for this part: 400 W.
The H20 96GB in the GPU landscape
Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper
Higher and further left is better: more half-precision throughput for less power.
Specifications
Architecture
Hopper
Form Factor
SXM
Launch Year
2024
Process Node
4nm
Memory
96 GB HBM3
Bandwidth
4,000 GB/s
TDP
400 W
Max power (Flopper estimate)
~460 W est. Flopper estimate: 400 W TDP x 1.15. The vendor publishes no maximum board power for this part.
Spec Confidence
Official
Full Specifications
| Memory | |
|---|---|
| Memory | 96 GB |
| Memory Type | HBM3 |
| Bandwidth | 4.0 TB/s |
| Interface Width | No verified data available |
| Power & Thermal | |
| TDP | 400 W |
| Max power (Flopper estimate) | ~460 W est. |
| Enterprise Features | |
| Sparsity | Yes |
| General | |
| Form Factor | SXM |
| Architecture | Hopper |
| Process Node | 4nm |
| Launch Year | 2024 |
Datasheet & Resources
Data Provenance
Every figure traced to a source
Primary Source
- Document
- —
- Publisher
- NVIDIA
- Published
- No verified data available
Data Quality
- Spec confidence
- Official
- Clock basis
- Boost
- Core precisions with figures
- 7 of 9
- Normalization
- All values in TFLOPS
Compare cloud providers offering on-demand GPU instances for AI training, inference, and HPC workloads.
Browse GPU Cloud ProvidersSimilar GPUs
Frequently Asked Questions
How many TFLOPS does the NVIDIA H20 have?
The NVIDIA H20 delivers 44 TFLOPS FP32, 148 TFLOPS FP16 and 296 TFLOPS FP8 at peak.
What is the power consumption of the NVIDIA H20?
The NVIDIA H20 has a TDP (Thermal Design Power) rating of 400 watts.
How much memory does the NVIDIA H20 have?
The NVIDIA H20 is equipped with 96 GB of memory with 4,000 GB/s of memory bandwidth.
What architecture is the NVIDIA H20 based on?
The NVIDIA H20 is based on the Hopper architecture, launched in 2024.
Stay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
No spam, unsubscribe anytime.