Side by side datacenter GPU specifications from the Flopper.io database.
| AMD Instinct MI250 128GB | AMD Instinct MI300A 128GB | |
|---|---|---|
| FP32 TFLOPS | 45.3 | 122.6 |
| Memory | 128 GB | 128 GB |
| Memory Bandwidth | 3.3 TB/s | 5.3 TB/s |
| TDP | 500 W | 760 W |
| Precision | AMD Instinct MI250 128GB peak TFLOPS (dense) | AMD Instinct MI300A 128GB peak TFLOPS (dense) |
|---|---|---|
| FP64 | 45.3 | 61.3 |
| FP32 | 45.3 | 122.6 |
| TF32 | — | 490.3 |
| BF16 | 362.1 | 980.6 |
| FP16 | 362.1 | 980.6 |
| FP8 | — | 1961.2 |
| FP6 | — | — |
| FP4 | — | — |
| INT8 | 362.1 | 1961.2 |
| INT4 | 362.1 | — |
| AMD Instinct MI250 128GB | AMD Instinct MI300A 128GB | |
|---|---|---|
| Architecture | CDNA 2 | CDNA 3 |
| Process Node | 6nm | 5nm FinFET |
| Launch Year | 2021 | 2023 |
| Form Factor | OAM | APU SH5 socket |
| Memory Type | HBM2e | — |
| Interface Width | — | — |
| Interconnect | — | — |
| TDP | 500 W | 760 W |
| FP32 Efficiency | 0.09 TFLOPS/W | 0.16 TFLOPS/W |