Flopper.io GPU Comparison Sheet
September 14, 2026
flopper.io/compare/intel-gaudi-2-96gb-vs-nvidia-a100-sxm4-80gbIntel Gaudi 2 96GB vs NVIDIA A100 SXM4 80GB
Side by side datacenter GPU specifications from the Flopper.io database.
Overview
| Intel Gaudi 2 96GB | NVIDIA A100 SXM4 80GB | |
|---|---|---|
| FP32 TFLOPS | 45.2 | 19.5 |
| Memory | 96 GB | 80 GB |
| Memory Bandwidth | 2.5 TB/s | 2.0 TB/s |
| TDP | 600 W | 400 W |
Performance by Precision
| Precision | Intel Gaudi 2 96GB peak TFLOPS (dense) | NVIDIA A100 SXM4 80GB peak TFLOPS (dense) |
|---|---|---|
| FP64 | — | 9.7 |
| FP32 | 45.2 | 19.5 |
| TF32 | 362.0 | 156.0 |
| BF16 | 432.0 | 312.0 |
| FP16 | 432.0 | 312.0 |
| FP8 | 865.0 | — |
| FP6 | — | — |
| FP4 | — | — |
| INT8 | 865.0 | 624.0 |
| INT4 | — | 1248.0 |
Specifications
| Intel Gaudi 2 96GB | NVIDIA A100 SXM4 80GB | |
|---|---|---|
| Architecture | Gaudi 2 | Ampere |
| Process Node | 7nm | 7nm |
| Launch Year | 2022 | 2020 |
| Form Factor | OAM | SXM |
| Memory Type | — | — |
| Interface Width | — | — |
| Interconnect | — | — |
| TDP | 600 W | 400 W |
| FP32 Efficiency | 0.08 TFLOPS/W | 0.05 TFLOPS/W |