AMD Instinct MI300A 128GB

CDNA 3 APU SH5 socket 2023 5nm FinFET Spec confidence: Official
FP8 (dense)
1,961
TFLOPS
FP32
123
TFLOPS
VRAM
128 GB
Bandwidth
5.3 TB/s
memory
TDP
760 W
161.3 TFLOPS/kW
Download datasheet

Performance

Peak theoretical throughput by precision type

INT8
8-bit integer
1,961 TOPS
3,922 with sparsity
FP8
8-bit floating point
1,961 TFLOPS
3,922 with sparsity
FP16
16-bit floating point
981 TFLOPS
1,961 with sparsity
BF16
Brain Float 16
981 TFLOPS
1,961 with sparsity
TF32
TensorFloat-32
490 TFLOPS
981 with sparsity
FP32
32-bit floating point
123 TFLOPS
FP64
64-bit floating point
61 TFLOPS
Dense Added with sparsity
2.581 TFLOPS/W FP8 at 760 W
1.290 TFLOPS/W FP16 at 760 W
0.161 TFLOPS/W FP32 at 760 W

The Instinct MI300A 128GB in the GPU landscape

Peak FP16 TFLOPS (dense) against TDP, single-GPU parts tracked by Flopper

06001,2001,8002,4003,0000 W250 W500 W750 W1000 W1250 W1500 WInstinct MI355XInstinct MI300A 128GB

Higher and further left is better: more half-precision throughput for less power.

Specifications

Architecture

CDNA 3

Form Factor

APU SH5 socket

Launch Year

2023

Process Node

5nm FinFET

Memory

128 GB

Bandwidth

5,300 GB/s

TDP

760 W

Max Power

~874 W

Spec Confidence

Official

Full Specifications

Memory
VRAM 128 GB
Bandwidth 5.3 TB/s
Power & Thermal
TDP 760 W
Enterprise Features
Sparsity Yes
General
Form Factor APU SH5 socket
Architecture CDNA 3
Launch Year 2023

Datasheet & Resources

Data Provenance

Every figure traced to a source

Primary Source

Publisher
AMD
Published
2023-12-06

Data Quality

Spec confidence
Official
Clock basis
Boost
Precisions tracked
7
Normalization
All values in TFLOPS

Compare cloud providers offering on-demand GPU instances for AI training, inference, and HPC workloads.

Browse GPU Cloud Providers

Similar GPUs

Frequently Asked Questions

How many TFLOPS does the AMD Instinct MI300A have?

The AMD Instinct MI300A delivers 122.6 TFLOPS for FP32 operations, 980.6 TFLOPS for FP16, and 1961.2 TFLOPS for FP8 precision.

What is the power consumption of the AMD Instinct MI300A?

The AMD Instinct MI300A has a TDP (Thermal Design Power) rating of 760 watts.

How much memory does the AMD Instinct MI300A have?

The AMD Instinct MI300A is equipped with 128 GB of VRAM with 5300 GB/s memory bandwidth.

What architecture is the AMD Instinct MI300A based on?

The AMD Instinct MI300A is based on the CDNA 3 architecture, launched in 2023.

Stay Updated on GPU Releases

Get notified when new GPUs are added or specifications are updated.

Loading verification...

No spam, unsubscribe anytime.

Back to GPUs