AMD Instinct MI300X 192GB
Performance
Peak theoretical throughput by precision type
| Precision | Dense | 2:4 Sparse |
|---|---|---|
FP64 64-bit floating point | 82TFLOPS | Structured sparsity is a tensor-core feature; this vector precision has no sparse form |
FP32 32-bit floating point | 163TFLOPS | Structured sparsity is a tensor-core feature; this vector precision has no sparse form |
TF32 TensorFloat-32 | 654TFLOPS | 1,307TFLOPS |
BF16 Brain Float 16 | 1,307TFLOPS | 2,615TFLOPS |
FP16 16-bit floating point | 1,307TFLOPS | 2,615TFLOPS |
FP8 8-bit floating point | 2,615TFLOPS | 5,230TFLOPS |
FP6 | No verified data available | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
FP4 | No verified data available | The part supports 2:4 sparsity, but the vendor publishes no sparse figure for this precision |
INT8 8-bit integer | 2,615TOPS | 5,230TOPS |
Dense peak divided by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead. TDP for this part: 750 W.
The Instinct MI300X 192GB in the GPU landscape
Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper
Higher and further left is better: more half-precision throughput for less power.
Specifications
Architecture
CDNA 3
Form Factor
OAM
Launch Year
2023
Process Node
5nm FinFET
Memory
192 GB
Bandwidth
5,300 GB/s
TDP
750 W
Max power (Flopper estimate)
~862 W est. Flopper estimate: 750 W TDP x 1.15. The vendor publishes no maximum board power for this part.
Spec Confidence
Official
Full Specifications
| Memory | |
|---|---|
| Memory | 192 GB |
| Memory Type | No verified data available |
| Bandwidth | 5.3 TB/s |
| Interface Width | No verified data available |
| Power & Thermal | |
| TDP | 750 W |
| Max power (Flopper estimate) | ~862 W est. |
| Enterprise Features | |
| Sparsity | Yes |
| General | |
| Form Factor | OAM |
| Architecture | CDNA 3 |
| Process Node | 5nm FinFET |
| Launch Year | 2023 |
Datasheet & Resources
Flopper Datasheet
AMD Instinct MI300X 192GB specifications, generated from our database. Printable.
Vendor product page
AMD documentation for the Instinct MI300X 192GB
AMD Instinct MI300X
AMD · 2023-12-06
AMD Instinct Documentation
ROCm guides, architecture details
Data Provenance
Every figure traced to a source
Primary Source
- Document
- AMD Instinct MI300X
- Publisher
- AMD
- Published
- 2023-12-06
Data Quality
- Spec confidence
- Official
- Clock basis
- Boost
- Core precisions with figures
- 7 of 9
- Normalization
- All values in TFLOPS
Rent this GPU
$0.50 / GPU-hr
Lowest of 16 live listings across 7 providers· median $3.22
Median of each provider's cheapest on-demand listing, so a provider with many configurations counts once.
Price history and every provider on the pricing page. Some links are affiliate links.
Similar GPUs
Systems Using This GPU
Pre-configured systems featuring the AMD Instinct MI300X
| System | GPU Count | Peak Performance | Total Power | |
|---|---|---|---|---|
AMD Instinct MI300X Platform Instinct Platform · baseboard · 2023 | 8x Instinct MI300X | 20.9 PFLOPS | 6.0 kW | View System |
Penguin Solutions Altus XE5318GTO Altus · rack · | 8x Instinct MI300X | No verified data available | No verified data available | View System |
Penguin Solutions Relion XE5318GTO Relion · rack · | 8x Instinct MI300X | No verified data available | No verified data available | View System |
Lenovo ThinkSystem SR685a V3 ThinkSystem · rack · | 8x Instinct MI300X | No verified data available | No verified data available | View System |
Frequently Asked Questions
How many TFLOPS does the AMD Instinct MI300X have?
The AMD Instinct MI300X delivers 163 TFLOPS FP32, 1,307 TFLOPS FP16 and 2,615 TFLOPS FP8 at peak.
What is the power consumption of the AMD Instinct MI300X?
The AMD Instinct MI300X has a TDP (Thermal Design Power) rating of 750 watts.
How much memory does the AMD Instinct MI300X have?
The AMD Instinct MI300X is equipped with 192 GB of memory with 5,300 GB/s of memory bandwidth.
What architecture is the AMD Instinct MI300X based on?
The AMD Instinct MI300X is based on the CDNA 3 architecture, launched in 2023.
How much does the AMD Instinct MI300X cost to rent?
The AMD Instinct MI300X rents from $0.50 per GPU-hour across 7 cloud providers, the lowest of 16 live listings Flopper tracks. The pricing page lists every provider and the price history.
When did the AMD Instinct MI300X come out?
The AMD Instinct MI300X launched in 2023 on the CDNA 3 architecture.
Stay Updated on GPU Releases
Get notified when new GPUs are added or specifications are updated.
No spam, unsubscribe anytime.