Intel Gaudi 3 128GB

Name: Intel Gaudi 3 128GB
Brand: Intel

Gaudi 3 OAM 2024 5nm Spec confidence: Official

FP8 (dense)

1,678

TFLOPS

FP32

229

TFLOPS

VRAM

128 GB

HBM2E

Bandwidth

3.7 TB/s

memory

TDP

900 W

254.4 TFLOPS/kW

Download datasheet

Performance

Peak theoretical throughput by precision type

FP8

8-bit floating point

1,678 TFLOPS

FP16

16-bit floating point

459 TFLOPS

BF16

Brain Float 16

1,678 TFLOPS

TF32

TensorFloat-32

459 TFLOPS

FP32

32-bit floating point

229 TFLOPS

Every figure here is dense. The vendor documents no structured (2:4) sparsity mode for this part, so there is no second number to quote.

1.864 TFLOPS/W FP8 at 900 W

0.510 TFLOPS/W FP16 at 900 W

0.254 TFLOPS/W FP32 at 900 W

The Gaudi 3 128GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Gaudi 3

Form Factor

OAM

Launch Year

2024

Process Node

5nm

Memory

128 GB HBM2E

Bandwidth

3,700 GB/s

TDP

900 W

Max Power

~1.0 kW

Interconnect

1.2 TB/s RoCE v2 RDMA (24x 200GbE), 1200 GB/s bidirectional

Spec Confidence

Official

Full Specifications

Memory
VRAM	128 GB
Memory Type	HBM2E
Bandwidth	3.7 TB/s
Interconnect & I/O
GPU-to-GPU	RoCE v2 RDMA (24x 200GbE), 1200 GB/s bidirectional
Interconnect Bandwidth	1.2 TB/s
Cache
L2 Cache	96 MB
Power & Thermal
TDP	900 W
Enterprise Features
Sparsity	No
General
Form Factor	OAM
Architecture	Gaudi 3
Launch Year	2024

Datasheet & Resources

Flopper Datasheet

Intel Gaudi 3 128GB specifications, generated from our database. Printable.

View PDF

Vendor product page

Intel documentation for the Gaudi 3 128GB

View

Intel Gaudi 3 AI Accelerator

Intel · 2024-04-09

View

Intel Data Center GPU Documentation

oneAPI guides, Xe architecture

Browse

Data Provenance

Every figure traced to a source

Primary Source

Document: Intel Gaudi 3 AI Accelerator
Publisher: Intel
Published: 2024-04-09

Data Quality

Spec confidence: Official
Clock basis: Boost
Precisions tracked: 5
Normalization: All values in TFLOPS

Compare cloud providers offering on-demand GPU instances for AI training, inference, and HPC workloads.

Browse GPU Cloud Providers

Similar GPUs

Intel Gaudi 3 HL-338

PCIe ·

FP32: 229 TFLOPS

Compare vs Gaudi 3

Systems Using This GPU

Pre-configured systems featuring the Intel Gaudi 3

System	GPU Count	Peak Performance	Total Power	Interconnect
Intel Gaudi 3 HLB-325 Baseboard Gaudi · baseboard · 2024	8x Gaudi 3	--	7.6 kW	Direct all-to-all between the eight accelerators at 4.2 TB/s bidirectional with no switching IC, plus 1.2 TB/s bidirectional scale-out over 6 OSFP connectors as 24x 200 Gbps RDMA (RoCE v2); host attach is 8x PCIe Gen 5.0 x16	View System
Supermicro X14 Gaudi 3 AI Training Platform X14 · rack · 2024	8x Gaudi 3	--	--	Eight Gaudi 3 accelerators all-to-all on an OAM 2.0 universal baseboard, with six on-board OSFP 800GbE ports for scale-out over standard Ethernet	View System
Ingrasys GB6181I GB · rack ·	8x Gaudi 3	--	--	Eight Gaudi 3 accelerators on a universal baseboard, with twenty PCIe 5.0 x16 slots available for scale-out networking	View System

Frequently Asked Questions

How many TFLOPS does the Intel Gaudi 3 have?

The Intel Gaudi 3 delivers 229 TFLOPS for FP32 operations, 459 TFLOPS for FP16, and 1678 TFLOPS for FP8 precision.

What is the power consumption of the Intel Gaudi 3?

The Intel Gaudi 3 has a TDP (Thermal Design Power) rating of 900 watts.

How much memory does the Intel Gaudi 3 have?

The Intel Gaudi 3 is equipped with 128 GB of VRAM with 3700 GB/s memory bandwidth.

What architecture is the Intel Gaudi 3 based on?

The Intel Gaudi 3 is based on the Gaudi 3 architecture, launched in 2024.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs