Intel Gaudi 3 HL-338

Type: ASICArchitecture: Gaudi 3Form factor: PCIeProcess: 5nmSpec confidence: Official
FP8 (dense)
1,678
TFLOPS
FP32
229
TFLOPS
Memory
128 GB
HBM2E
Bandwidth
3.7 TB/s
memory
TDP
600 W
381.7 FP32 dense TFLOPS/kW of TDP

Overview

The Intel Gaudi 3 HL-338 is the PCIe add-in-card form of Gaudi 3, putting the same 5nm processor as the HL-325L OAM mezzanine into a full-height dual-slot card 10.5 inches long at a 600 W card-level TDP, two thirds the OAM card's 900 W. It carries the same eight MME engines and 64 programmable Tensor Processor Cores, the same 128 GB of HBM2E at 3.7 TB/s and the same 96 MB of on-die L2, and connects to the host over PCIe 5.0 x16 at up to 128 GB/s. Intel positions it for inference and fine-tuning rather than large-scale training, and it is the variant that fits existing servers without an OAM baseboard. Scale-up is by top bridge rather than a baseboard: the HLTB-304A and HLTB-304B boards aggregate four cards into a quad at 900 GB/s per card, and Intel documents 2x4, 1x4 and 4x1 topologies, with two quads providing 512 GB of pooled HBM2E memory. Intel publishes no dense or sparse labelling for Gaudi 3 and no sparse figure; the matrix throughput figures come from Table 5 of Intel's technical paper, which footnotes them as projected maximums.

Performance

Peak theoretical throughput by precision type

PrecisionPeak
FP64
No verified data available
FP32
32-bit floating point
229TFLOPS
TF32
TensorFloat-32
459TFLOPS
BF16
Brain Float 16
1,678TFLOPS
FP16
16-bit floating point
459TFLOPS
FP8
8-bit floating point
1,678TFLOPS
FP6
No verified data available
FP4
No verified data available
INT8
No verified data available

Every figure here is dense. The vendor documents no structured (2:4) sparsity mode for this part, so there is no second number to quote.

The Gaudi 3 HL-338 in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XGaudi 3 HL-338

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Gaudi 3

Form Factor

PCIe

Launch Year

No verified data available

Process Node

5nm

Memory

128 GB HBM2E

Bandwidth

3,700 GB/s

TDP

600 W

Max power (Flopper estimate)

~690 W est. Flopper estimate: 600 W TDP x 1.15. The vendor publishes no maximum board power for this part.

Interconnect

900 GB/s RoCE v2 RDMA over top bridge (HLTB-304A/304B), 900 GB/s per card in a 4-card quad

direction and scope not stated by vendor

Tensor Processor Cores

64

Spec Confidence

Official

Full Specifications

Compute Engine
Tensor Processor Cores 64
Memory
Memory 128 GB
Memory Type HBM2E
Bandwidth 3.7 TB/s
Interface Width No verified data available
Interconnect & I/O
GPU-to-GPU RoCE v2 RDMA over top bridge (HLTB-304A/304B), 900 GB/s per card in a 4-card quad
Interconnect Bandwidth 900 GB/s direction and scope not stated by vendor
PCIe Gen 5 x16
Cache
L2 Cache 96 MB
Power & Thermal
TDP 600 W
Max power (Flopper estimate) ~690 W est.
Enterprise Features
Sparsity No
Physical & Media
Card Length 266.7 mm
Width 2-slot
General
Form Factor PCIe
Architecture Gaudi 3
Process Node 5nm
Launch Year No verified data available

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
Intel
Published
No verified data available

Data Quality

Spec confidence
Official
Clock basis
Boost
Core precisions with figures
5 of 9
Normalization
All values in TFLOPS

Compare cloud providers offering on-demand GPU instances for AI training, inference, and HPC workloads.

Browse GPU Cloud Providers

Similar GPUs

Intel Gaudi 3 128GB

OAM · 2024
FP32: 229 TFLOPS
Compare vs Gaudi 3

Frequently Asked Questions

How many TFLOPS does the Intel Gaudi 3 have?

The Intel Gaudi 3 delivers 229 TFLOPS FP32, 459 TFLOPS FP16 and 1,678 TFLOPS FP8 at peak.

What is the power consumption of the Intel Gaudi 3?

The Intel Gaudi 3 has a TDP (Thermal Design Power) rating of 600 watts.

How much memory does the Intel Gaudi 3 have?

The Intel Gaudi 3 is equipped with 128 GB of memory with 3,700 GB/s of memory bandwidth.

What architecture is the Intel Gaudi 3 based on?

The Intel Gaudi 3 is based on the Gaudi 3 architecture. Flopper does not currently have a verified launch year for it.

How much does the Intel Gaudi 3 cost to rent?

Flopper is not tracking any live rental listings for the Intel Gaudi 3. The provider directory lists the clouds that rent comparable accelerators on demand.

When did the Intel Gaudi 3 come out?

Flopper does not currently hold a verified launch date for the Intel Gaudi 3.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs

© 2026 Flopper.io - Compare the GPUs Powering AI