Intel Gaudi 2 96GB
Performance
Peak theoretical throughput by precision type
| Precision | Peak |
|---|---|
FP64 | No verified data available |
FP32 32-bit floating point | 45TFLOPS |
TF32 TensorFloat-32 | 362TFLOPS |
BF16 Brain Float 16 | 432TFLOPS |
FP16 16-bit floating point | 432TFLOPS |
FP8 8-bit floating point | 865TFLOPS |
FP6 | No verified data available |
FP4 | No verified data available |
INT8 8-bit integer | 865TOPS |
Dense peak divided by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead. TDP for this part: 600 W.
The Gaudi 2 96GB in the GPU landscape
Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper
Higher and further left is better: more half-precision throughput for less power.
Specifications
Architecture
Gaudi 2
Form Factor
OAM
Launch Year
2022
Process Node
7nm
Memory
96 GB
Bandwidth
2,450 GB/s
TDP
600 W
Max power (Flopper estimate)
~690 W est. Flopper estimate: 600 W TDP x 1.15. The vendor publishes no maximum board power for this part.
Spec Confidence
Official
Full Specifications
| Memory | |
|---|---|
| Memory | 96 GB |
| Memory Type | No verified data available |
| Bandwidth | 2.5 TB/s |
| Interface Width | No verified data available |
| Power & Thermal | |
| TDP | 600 W |
| Max power (Flopper estimate) | ~690 W est. |
| General | |
| Form Factor | OAM |
| Architecture | Gaudi 2 |
| Process Node | 7nm |
| Launch Year | 2022 |
Datasheet & Resources
Flopper Datasheet
Intel Gaudi 2 96GB specifications, generated from our database. Printable.
Vendor product page
Intel documentation for the Gaudi 2 96GB
Intel Gaudi 2 AI Accelerator
Intel · 2022-05-10
Intel Data Center GPU Documentation
oneAPI guides, Xe architecture
Data Provenance
Every figure traced to a source
Primary Source
- Document
- Intel Gaudi 2 AI Accelerator
- Publisher
- Intel
- Published
- 2022-05-10
Data Quality
- Spec confidence
- Official
- Clock basis
- Boost
- Core precisions with figures
- 6 of 9
- Normalization
- All values in TFLOPS
Rent this GPU
$1.10 / GPU-hr
Lowest of 1 live listing across 1 provider
Price history and every provider on the pricing page. Some links are affiliate links.
Frequently Asked Questions
How many TFLOPS does the Intel Gaudi 2 have?
The Intel Gaudi 2 delivers 45 TFLOPS FP32, 432 TFLOPS FP16 and 865 TFLOPS FP8 at peak.
What is the power consumption of the Intel Gaudi 2?
The Intel Gaudi 2 has a TDP (Thermal Design Power) rating of 600 watts.
How much memory does the Intel Gaudi 2 have?
The Intel Gaudi 2 is equipped with 96 GB of memory with 2,450 GB/s of memory bandwidth.
What architecture is the Intel Gaudi 2 based on?
The Intel Gaudi 2 is based on the Gaudi 2 architecture, launched in 2022.
How much does the Intel Gaudi 2 cost to rent?
The Intel Gaudi 2 rents from $1.10 per GPU-hour across 1 cloud provider, the lowest of 1 live listing Flopper tracks. The pricing page lists every provider and the price history.
When did the Intel Gaudi 2 come out?
The Intel Gaudi 2 launched in 2022 on the Gaudi 2 architecture.
Stay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
No spam, unsubscribe anytime.