Intel Gaudi 2 96GB

Gaudi 2 OAM 2022 7nm

Overview

45.2

FP32 TFLOPS

96 GB

Memory

2.5 TB/s

Memory Bandwidth

600 W

TDP

Performance Metrics

Precision	Peak (dense)	Bits	Type
FP64	—	—	Standard
FP32	45.2	32	Standard
TF32	362.0	32	Standard
BF16	432.0	16	Standard
FP16	432.0	16	Standard
FP8	865.0	8	Standard
FP6	—	—	Standard
FP4	—	—	Standard
INT8	865.0	8	Standard

Memory Specifications

Capacity: 96 GB
Type: —
Bandwidth: 2.5 TB/s
Interface Width: —

Power & Efficiency

TDP: 600 W
Max power (Flopper estimate): ~690 W est.
FP32 dense TFLOPS per W of TDP: 0.08 TFLOPS/W
FP16 dense TFLOPS per W of TDP: 0.72 TFLOPS/W

Flopper estimate: 600 W TDP x 1.15. The vendor publishes no maximum board power for this part. Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: Intel

Architecture: Gaudi 2

Process Node: 7nm

Form Factor: OAM

Launch Year: 2022

Variant: 96GB