NVIDIA GH200 96GB HBM3
Performance
Peak theoretical throughput by precision type
The GH200 96GB HBM3 in the GPU landscape
Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper
Higher and further left is better: more half-precision throughput for less power.
Specifications
Architecture
Hopper
Form Factor
SXM
Launch Year
2023
Process Node
4nm
Memory
96 GB HBM3
Bandwidth
4,000 GB/s
TDP
1.0 kW
Max Power
~1.1 kW
Interconnect
900 GB/s NVLink-C2C
Spec Confidence
Official
Full Specifications
| Memory | |
|---|---|
| VRAM | 96 GB |
| Memory Type | HBM3 |
| Bandwidth | 4.0 TB/s |
| Interconnect & I/O | |
| GPU-to-GPU | NVLink-C2C |
| Interconnect Bandwidth | 900 GB/s |
| Power & Thermal | |
| TDP | 1.0 kW |
| Enterprise Features | |
| Sparsity | Yes |
| General | |
| Form Factor | SXM |
| Architecture | Hopper |
| Launch Year | 2023 |
Datasheet & Resources
Flopper Datasheet
NVIDIA GH200 96GB HBM3 specifications, generated from our database. Printable.
Vendor product page
NVIDIA documentation for the GH200 96GB HBM3
NVIDIA GH200 Grace Hopper Superchip Datasheet (doc 3154100, rev Mar24)
NVIDIA · 2024-03-01
NVIDIA Developer Documentation
Technical specs, programming guides
Data Provenance
Every figure traced to a source
Primary Source
- Publisher
- NVIDIA
- Published
- 2024-03-01
Data Quality
- Spec confidence
- Official
- Clock basis
- Boost
- Precisions tracked
- 7
- Normalization
- All values in TFLOPS
Rent this GPU
$6.50 / GPU-hr
Lowest of 1 live listing across 1 provider
Price history and every provider on the pricing page. Some links are affiliate links.
Similar GPUs
Systems Using This GPU
Pre-configured systems featuring the NVIDIA GH200
| System | GPU Count | Peak Performance | Total Power | |
|---|---|---|---|---|
HPE Cray Supercomputing EX254n Cray Supercomputing EX · blade · | 8x GH200 | -- | -- | View System |
QCT QuantaGrid S74G-2U QuantaGrid · rack · | 1x GH200 | -- | -- | View System |
Frequently Asked Questions
How many TFLOPS does the NVIDIA GH200 have?
The NVIDIA GH200 delivers 67 TFLOPS for FP32 operations, 990 TFLOPS for FP16, and 1979 TFLOPS for FP8 precision.
What is the power consumption of the NVIDIA GH200?
The NVIDIA GH200 has a TDP (Thermal Design Power) rating of 1000 watts.
How much memory does the NVIDIA GH200 have?
The NVIDIA GH200 is equipped with 96 GB of VRAM with 4000 GB/s memory bandwidth.
What architecture is the NVIDIA GH200 based on?
The NVIDIA GH200 is based on the Hopper architecture, launched in 2023.
Stay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
No spam, unsubscribe anytime.