AMD Instinct MI300X 192GB

CDNA 3 OAM 2023 5nm FinFET Spec confidence: Official
FP8 (dense)
2,615
TFLOPS
FP32
163
TFLOPS
VRAM
192 GB
Bandwidth
5.3 TB/s
memory
TDP
750 W
217.9 TFLOPS/kW

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
2,615 TOPS
5,230 with sparsity
FP8
8-bit floating point
2,615 TFLOPS
5,230 with sparsity
FP16
16-bit floating point
1,307 TFLOPS
2,615 with sparsity
BF16
Brain Float 16
1,307 TFLOPS
2,615 with sparsity
TF32
TensorFloat-32
654 TFLOPS
1,307 with sparsity
FP32
32-bit floating point
163 TFLOPS
FP64
64-bit floating point
82 TFLOPS
Dense Added with sparsity
3.487 TFLOPS/W FP8 at 750 W
1.743 TFLOPS/W FP16 at 750 W
0.218 TFLOPS/W FP32 at 750 W

The Instinct MI300X 192GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XInstinct MI300X 192GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

CDNA 3

Form Factor

OAM

Launch Year

2023

Process Node

5nm FinFET

Memory

192 GB

Bandwidth

5,300 GB/s

TDP

750 W

Max Power

~862 W

Spec Confidence

Official

Full Specifications

Memory
VRAM 192 GB
Bandwidth 5.3 TB/s
Power & Thermal
TDP 750 W
Enterprise Features
Sparsity Yes
General
Form Factor OAM
Architecture CDNA 3
Launch Year 2023

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
AMD
Published
2023-12-06

Data Quality

Spec confidence
Official
Clock basis
Boost
Precisions tracked
7
Normalization
All values in TFLOPS

Rent this GPU

$0.50 / GPU-hr

Lowest of 8 live listings across 5 providers· median $3.02

See all rental prices →

Price history and every provider on the pricing page. Some links are affiliate links.

Similar GPUs

AMD Instinct MI300A 128GB

APU SH5 socket · 2023
FP32: 123 TFLOPS
Compare vs Instinct MI300A

Systems Using This GPU

Pre-configured systems featuring the AMD Instinct MI300X

SystemGPU CountPeak PerformanceTotal Power
Penguin Solutions Altus XE5318GTO
Altus · rack ·
8x Instinct MI300X -- -- View System
Penguin Solutions Relion XE5318GTO
Relion · rack ·
8x Instinct MI300X -- -- View System
Lenovo ThinkSystem SR685a V3
ThinkSystem · rack ·
8x Instinct MI300X -- -- View System

Frequently Asked Questions

How many TFLOPS does the AMD Instinct MI300X have?

The AMD Instinct MI300X delivers 163.4 TFLOPS for FP32 operations, 1307.4 TFLOPS for FP16, and 2614.9 TFLOPS for FP8 precision.

What is the power consumption of the AMD Instinct MI300X?

The AMD Instinct MI300X has a TDP (Thermal Design Power) rating of 750 watts.

How much memory does the AMD Instinct MI300X have?

The AMD Instinct MI300X is equipped with 192 GB of VRAM with 5300 GB/s memory bandwidth.

What architecture is the AMD Instinct MI300X based on?

The AMD Instinct MI300X is based on the CDNA 3 architecture, launched in 2023.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs