Intel Gaudi 3 HL-338
Overview
The Intel Gaudi 3 HL-338 is the PCIe add-in-card form of Gaudi 3, putting the same 5nm processor as the HL-325L OAM mezzanine into a full-height dual-slot card 10.5 inches long at a 600 W card-level TDP, two thirds the OAM card's 900 W. It carries the same eight MME engines and 64 programmable Tensor Processor Cores, the same 128 GB of HBM2E at 3.7 TB/s and the same 96 MB of on-die L2, and connects to the host over PCIe 5.0 x16 at up to 128 GB/s. Intel positions it for inference and fine-tuning rather than large-scale training, and it is the variant that fits existing servers without an OAM baseboard. Scale-up is by top bridge rather than a baseboard: the HLTB-304A and HLTB-304B boards aggregate four cards into a quad at 900 GB/s per card, and Intel documents 2x4, 1x4 and 4x1 topologies, with two quads providing 512 GB of pooled HBM2E memory. Intel publishes no dense or sparse labelling for Gaudi 3 and no sparse figure; the matrix throughput figures come from Table 5 of Intel's technical paper, which footnotes them as projected maximums.
Performance
Peak theoretical throughput by precision type
| Precision | Peak |
|---|---|
FP64 | No verified data available |
FP32 32-bit floating point | 229TFLOPS |
TF32 TensorFloat-32 | 459TFLOPS |
BF16 Brain Float 16 | 1,678TFLOPS |
FP16 16-bit floating point | 459TFLOPS |
FP8 8-bit floating point | 1,678TFLOPS |
FP6 | No verified data available |
FP4 | No verified data available |
INT8 | No verified data available |
Every figure here is dense. The vendor documents no structured (2:4) sparsity mode for this part, so there is no second number to quote.
Dense peak divided by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead. TDP for this part: 600 W.
The Gaudi 3 HL-338 in the GPU landscape
Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper
Higher and further left is better: more half-precision throughput for less power.
Specifications
Architecture
Gaudi 3
Form Factor
PCIe
Launch Year
No verified data available
Process Node
5nm
Memory
128 GB HBM2E
Bandwidth
3,700 GB/s
TDP
600 W
Max power (Flopper estimate)
~690 W est. Flopper estimate: 600 W TDP x 1.15. The vendor publishes no maximum board power for this part.
Interconnect
900 GB/s RoCE v2 RDMA over top bridge (HLTB-304A/304B), 900 GB/s per card in a 4-card quad
direction and scope not stated by vendor
Tensor Processor Cores
64
Spec Confidence
Official
Full Specifications
| Compute Engine | |
|---|---|
| Tensor Processor Cores | 64 |
| Memory | |
| Memory | 128 GB |
| Memory Type | HBM2E |
| Bandwidth | 3.7 TB/s |
| Interface Width | No verified data available |
| Interconnect & I/O | |
| GPU-to-GPU | RoCE v2 RDMA over top bridge (HLTB-304A/304B), 900 GB/s per card in a 4-card quad |
| Interconnect Bandwidth | 900 GB/s direction and scope not stated by vendor |
| PCIe | Gen 5 x16 |
| Cache | |
| L2 Cache | 96 MB |
| Power & Thermal | |
| TDP | 600 W |
| Max power (Flopper estimate) | ~690 W est. |
| Enterprise Features | |
| Sparsity | No |
| Physical & Media | |
| Card Length | 266.7 mm |
| Width | 2-slot |
| General | |
| Form Factor | PCIe |
| Architecture | Gaudi 3 |
| Process Node | 5nm |
| Launch Year | No verified data available |
Datasheet & Resources
Flopper Datasheet
Intel Gaudi 3 HL-338 specifications, generated from our database. Printable.
Vendor product page
Intel documentation for the Gaudi 3 HL-338
Intel Gaudi 3 AI Accelerator HL-338 PCIe Card product brief
Intel · Latest version
Intel Data Center GPU Documentation
oneAPI guides, Xe architecture
Data Provenance
Every figure traced to a source
Primary Source
- Publisher
- Intel
- Published
- No verified data available
Data Quality
- Spec confidence
- Official
- Clock basis
- Boost
- Core precisions with figures
- 5 of 9
- Normalization
- All values in TFLOPS
Compare cloud providers offering on-demand GPU instances for AI training, inference, and HPC workloads.
Browse GPU Cloud ProvidersSimilar GPUs
Frequently Asked Questions
How many TFLOPS does the Intel Gaudi 3 have?
The Intel Gaudi 3 delivers 229 TFLOPS FP32, 459 TFLOPS FP16 and 1,678 TFLOPS FP8 at peak.
What is the power consumption of the Intel Gaudi 3?
The Intel Gaudi 3 has a TDP (Thermal Design Power) rating of 600 watts.
How much memory does the Intel Gaudi 3 have?
The Intel Gaudi 3 is equipped with 128 GB of memory with 3,700 GB/s of memory bandwidth.
What architecture is the Intel Gaudi 3 based on?
The Intel Gaudi 3 is based on the Gaudi 3 architecture. Flopper does not currently have a verified launch year for it.
How much does the Intel Gaudi 3 cost to rent?
Flopper is not tracking any live rental listings for the Intel Gaudi 3. The provider directory lists the clouds that rent comparable accelerators on demand.
When did the Intel Gaudi 3 come out?
Flopper does not currently hold a verified launch date for the Intel Gaudi 3.
Stay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
No spam, unsubscribe anytime.