Intel Gaudi 2 vs NVIDIA H200
Side-by-side comparison of specifications, performance, and efficiency.
Intel Gaudi 2
Architecture
Gaudi 2
Year
2022
VRAM
96 GB
TDP
600 W
NVIDIA H200
Architecture
Hopper
Year
2024
VRAM
141 GB
TDP
700 W
Specifications
Intel Gaudi 2 NVIDIA H200
Architecture
Gaudi 2 Hopper
Launch Year
2022 2024
Form Factor
OAM SXM
VRAM
96 GB141 GB
Memory Bandwidth
2.5 TB/s4.8 TB/s
TDP
600 W700 W
Process Node
7nm 4nm
| Spec | Intel Gaudi 2 | NVIDIA H200 |
|---|---|---|
| Architecture | Gaudi 2 | Hopper |
| Launch Year | 2022 | 2024 |
| Form Factor | OAM | SXM |
| VRAM | 96 GB | 141 GB |
| Memory Bandwidth | 2.5 TB/s | 4.8 TB/s |
| TDP | 600 W | 700 W |
| Process Node | 7nm | 4nm |
Performance (TFLOPS)
Intel Gaudi 2 NVIDIA H200
FP64
—34.0 TFlops
FP32
45.2 TFlops67.0 TFlops
FP16
432.0 TFlops989.5 TFlops
BF16
432.0 TFlops989.5 TFlops
FP8
865.0 TFlops1979.0 TFlops
INT8
865.0 TFlops1979.0 TFlops
| Precision | Intel Gaudi 2 | NVIDIA H200 |
|---|---|---|
| FP64 | — | 34.0 TFlops |
| FP32 | 45.2 TFlops | 67.0 TFlops |
| FP16 | 432.0 TFlops | 989.5 TFlops |
| BF16 | 432.0 TFlops | 989.5 TFlops |
| FP8 | 865.0 TFlops | 1979.0 TFlops |
| INT8 | 865.0 TFlops | 1979.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
NVIDIA
H200
0.10 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.