Flopper.io GPU Specification Sheet
September 1, 2026
flopper.io/gpu/intel-gaudi-3-128gbIntel Gaudi 3 128GB
Gaudi 3 OAM 2024 5nm
Overview
229.0
FP32 TFLOPS
128 GB
VRAM HBM2E
3.7 TB/s
Memory Bandwidth
900 W
TDP
Performance Metrics
| Precision | Peak (dense) | Bits | Type |
|---|---|---|---|
| FP8 | 1678.0 | 8 | Standard |
| FP16 | 459.0 | 16 | Standard |
| BF16 | 1678.0 | 16 | Standard |
| TF32 | 459.0 | 32 | Standard |
| FP32 | 229.0 | 32 | Standard |
Memory Specifications
- Capacity
- 128 GB
- Type
- HBM2E
- Bandwidth
- 3.7 TB/s
- Interface Width
- —
Power & Efficiency
- TDP
- 900 W
- Est. Max Power
- 1.0 kW
- FP32 Efficiency
- 0.25 TFLOPS/W
- FP16 Efficiency
- 0.51 TFLOPS/W
Hardware Details
Vendor: Intel
Architecture: Gaudi 3
Process Node: 5nm
Form Factor: OAM
Launch Year: 2024
Variant: 128GB
Interconnect
GPU-to-GPU: RoCE v2 RDMA (24x 200GbE), 1200 GB/s bidirectional
Bandwidth: 1.2 TB/s
Enterprise Features
Sparsity: No