Intel Gaudi 2 96GB

Gaudi 2 OAM 2022 7nm Spec confidence: Official
FP8 (dense)
865
TFLOPS
FP32
45
TFLOPS
VRAM
96 GB
Bandwidth
2.5 TB/s
memory
TDP
600 W
75.3 TFLOPS/kW
Download datasheet

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
865 TOPS
FP8
8-bit floating point
865 TFLOPS
FP16
16-bit floating point
432 TFLOPS
BF16
Brain Float 16
432 TFLOPS
TF32
TensorFloat-32
362 TFLOPS
FP32
32-bit floating point
45 TFLOPS
1.442 TFLOPS/W FP8 at 600 W
0.720 TFLOPS/W FP16 at 600 W
0.075 TFLOPS/W FP32 at 600 W

The Gaudi 2 96GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XGaudi 2 96GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

Gaudi 2

Form Factor

OAM

Launch Year

2022

Process Node

7nm

Memory

96 GB

Bandwidth

2,450 GB/s

TDP

600 W

Max Power

~690 W

Spec Confidence

Official

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
Intel
Published
2022-05-10

Data Quality

Spec confidence
Official
Clock basis
Boost
Precisions tracked
6
Normalization
All values in TFLOPS

Compare cloud providers offering on-demand GPU instances for AI training, inference, and HPC workloads.

Browse GPU Cloud Providers

Frequently Asked Questions

How many TFLOPS does the Intel Gaudi 2 have?

The Intel Gaudi 2 delivers 45.2 TFLOPS for FP32 operations, 432 TFLOPS for FP16, and 865 TFLOPS for FP8 precision.

What is the power consumption of the Intel Gaudi 2?

The Intel Gaudi 2 has a TDP (Thermal Design Power) rating of 600 watts.

How much memory does the Intel Gaudi 2 have?

The Intel Gaudi 2 is equipped with 96 GB of VRAM with 2450 GB/s memory bandwidth.

What architecture is the Intel Gaudi 2 based on?

The Intel Gaudi 2 is based on the Gaudi 2 architecture, launched in 2022.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs