Side by side datacenter GPU specifications from the Flopper.io database.
| AMD Instinct MI100 32GB | AMD Instinct MI250 128GB | |
|---|---|---|
| FP32 TFLOPS | 23.1 | 45.3 |
| Memory | 32 GB | 128 GB |
| Memory Bandwidth | 1.2 TB/s | 3.3 TB/s |
| TDP | 300 W | 500 W |
| Precision | AMD Instinct MI100 32GB peak TFLOPS (dense) | AMD Instinct MI250 128GB peak TFLOPS (dense) |
|---|---|---|
| FP64 | 11.5 | 45.3 |
| FP32 | 23.1 | 45.3 |
| TF32 | — | — |
| BF16 | 92.3 | 362.1 |
| FP16 | 184.6 | 362.1 |
| FP8 | — | — |
| FP6 | — | — |
| FP4 | — | — |
| INT8 | 184.6 | 362.1 |
| INT4 | 184.6 | 362.1 |
| AMD Instinct MI100 32GB | AMD Instinct MI250 128GB | |
|---|---|---|
| Architecture | CDNA | CDNA 2 |
| Process Node | 7nm | 6nm |
| Launch Year | 2020 | 2021 |
| Form Factor | PCIe | OAM |
| Memory Type | HBM2 | HBM2e |
| Interface Width | — | — |
| Interconnect | — | — |
| TDP | 300 W | 500 W |
| FP32 Efficiency | 0.08 TFLOPS/W | 0.09 TFLOPS/W |