Intel Gaudi 3 vs NVIDIA H20
Side-by-side comparison of specifications, performance, and efficiency.
Intel Gaudi 3
Architecture
Gaudi 3
Year
2024
VRAM
128 GB
TDP
900 W
NVIDIA H20
Architecture
Hopper
Year
2024
VRAM
96 GB
TDP
400 W
Specifications
Intel Gaudi 3 NVIDIA H20
Architecture
Gaudi 3 Hopper
Launch Year
2024 2024
Form Factor
OAM SXM
VRAM
128 GB96 GB
Memory Bandwidth
3.7 TB/s4.0 TB/s
TDP
900 W400 W
Process Node
5nm 4nm
| Spec | Intel Gaudi 3 | NVIDIA H20 |
|---|---|---|
| Architecture | Gaudi 3 | Hopper |
| Launch Year | 2024 | 2024 |
| Form Factor | OAM | SXM |
| VRAM | 128 GB | 96 GB |
| Memory Bandwidth | 3.7 TB/s | 4.0 TB/s |
| TDP | 900 W | 400 W |
| Process Node | 5nm | 4nm |
Performance (TFLOPS)
Intel Gaudi 3 NVIDIA H20
FP64
—1.0 TFlops
FP32
229.0 TFlops44.0 TFlops
FP16
1835.0 TFlops148.0 TFlops
BF16
1835.0 TFlops148.0 TFlops
FP8
1835.0 TFlops—
INT8
1835.0 TFlops296.0 TFlops
| Precision | Intel Gaudi 3 | NVIDIA H20 |
|---|---|---|
| FP64 | — | 1.0 TFlops |
| FP32 | 229.0 TFlops | 44.0 TFlops |
| FP16 | 1835.0 TFlops | 148.0 TFlops |
| BF16 | 1835.0 TFlops | 148.0 TFlops |
| FP8 | 1835.0 TFlops | — |
| INT8 | 1835.0 TFlops | 296.0 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
Intel
Gaudi 3
0.25 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.