Flop
per.io
GPU Specification Sheet
August 11, 2026
flopper.io/gpu/intel-gaudi-3-hl-338
Intel Gaudi 3 HL-338
Gaudi 3
PCIe
5nm
Overview
229.0
FP32 TFLOPS
128 GB
VRAM HBM2E
3.7 TB/s
Memory Bandwidth
600 W
TDP
Performance Metrics
Precision
Peak TFLOPS
Bits
Type
FP8
1678.0
8
Standard
FP16
459.0
16
Standard
BF16
1678.0
16
Standard
TF32
459.0
32
Standard
FP32
229.0
32
Standard
Memory Specifications
Capacity
128 GB
Type
HBM2E
Bandwidth
3.7 TB/s
Interface Width
—
Power & Efficiency
TDP
600 W
Est. Max Power
690 W
FP32 Efficiency
0.38 TFLOPS/W
FP16 Efficiency
0.77 TFLOPS/W
Hardware Details
Vendor:
Intel
Architecture:
Gaudi 3
Process Node:
5nm
Form Factor:
PCIe
Launch Year:
—
Variant:
HL-338
Compute Engine
Tensor Processor Cores:
64
Interconnect
GPU-to-GPU:
RoCE v2 RDMA over top bridge (HLTB-304A/304B), 900 GB/s per card in a 4-card quad
Bandwidth:
900 GB/s
PCIe:
Gen 5 x16