AMD Instinct MI300X vs NVIDIA RTX A6000
Side-by-side comparison of specifications, performance, and efficiency.
AMD Instinct MI300X
Architecture
CDNA 3
Year
2023
VRAM
192 GB
TDP
750 W
NVIDIA RTX A6000
Architecture
Ampere
Year
2020
VRAM
48 GB
TDP
300 W
Specifications
AMD Instinct MI300X NVIDIA RTX A6000
Architecture
CDNA 3 Ampere
Launch Year
2023 2020
Form Factor
OAM PCIe
VRAM
192 GB48 GB
Memory Bandwidth
5.3 TB/s768 GB/s
TDP
750 W300 W
Process Node
5nm FinFET 8nm
| Spec | AMD Instinct MI300X | NVIDIA RTX A6000 |
|---|---|---|
| Architecture | CDNA 3 | Ampere |
| Launch Year | 2023 | 2020 |
| Form Factor | OAM | PCIe |
| VRAM | 192 GB | 48 GB |
| Memory Bandwidth | 5.3 TB/s | 768 GB/s |
| TDP | 750 W | 300 W |
| Process Node | 5nm FinFET | 8nm |
Performance (TFLOPS)
AMD Instinct MI300X NVIDIA RTX A6000
FP64
81.7 TFlops0.6 TFlops
FP32
163.4 TFlops38.7 TFlops
FP16
1307.4 TFlops38.7 TFlops
BF16
1307.4 TFlops38.7 TFlops
FP8
2614.9 TFlops—
INT8
2614.9 TFlops77.4 TFlops
| Precision | AMD Instinct MI300X | NVIDIA RTX A6000 |
|---|---|---|
| FP64 | 81.7 TFlops | 0.6 TFlops |
| FP32 | 163.4 TFlops | 38.7 TFlops |
| FP16 | 1307.4 TFlops | 38.7 TFlops |
| BF16 | 1307.4 TFlops | 38.7 TFlops |
| FP8 | 2614.9 TFlops | — |
| INT8 | 2614.9 TFlops | 77.4 TFlops |
FLOPS by Precision
Efficiency — TDP vs FP32 Performance
Analysis
Most Efficient
AMD
Instinct MI300X
0.22 TFLOPS/W
Get Comparison Updates
New GPUs added weekly. Be the first to see how they compare.