Intel Gaudi 2 96GB
Gaudi 2 OAM 2022 7nm
FP32
45.2
TFLOPS
VRAM
96 GB
TDP
600 W
75.3 TFLOPS/kW
Bandwidth
2.5 TB/s
memory
Performance Metrics
Peak theoretical throughput by precision type
| Precision | Peak TFLOPS | Efficiency |
|---|---|---|
| INT8 | 865.0 | 1.442 TFLOPS/W |
| FP8 | 865.0 | 1.442 TFLOPS/W |
| FP16 | 432.0 | 0.720 TFLOPS/W |
| BF16 | 432.0 | 0.720 TFLOPS/W |
| TF32 | 362.0 | 0.603 TFLOPS/W |
| FP32 | 45.2 | 0.075 TFLOPS/W |
FP8 Efficiency
1.442 TFLOPS/W
865.0 TFLOPS / 600W
FP16 Efficiency
0.720 TFLOPS/W
432.0 TFLOPS / 600W
FP32 Efficiency
0.075 TFLOPS/W
45.2 TFLOPS / 600W
Power Specifications
TDP
600 W
Max Power
690 W
Power Connector
PCIe 16-pin
Cooling
Air
Memory Specifications
Capacity
96 GB
Type
--
Bandwidth
2450 GB/s
Interface
--
Hardware & Design
Form Factor
OAM
Architecture
Gaudi 2
Process Node
7nm
Launch Year
2022
Variant
96GB
Market Segment
Data Center
Documentation & Resources
Common Use Cases
General Compute AI/ML Workloads Data Processing
The Intel Gaudi 2 is optimized for high-performance computing tasks with Gaudi 2 architecture delivering 45.2 TFLOPS of compute power.
Where to Rent
Compare cloud providers offering on-demand GPU instances for AI training, inference, and HPC workloads.
Browse GPU Cloud ProvidersStay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
Loading verification...
No spam, unsubscribe anytime.