Flopper.io
Flopper.io GPU Specification Sheet

AMD Instinct MI300A 128GB

CDNA 3 APU SH5 socket 2023 5nm FinFET

Overview

122.6
FP32 TFLOPS
128 GB
Memory
5.3 TB/s
Memory Bandwidth
760 W
TDP

Performance Metrics

PrecisionPeak (dense)2:4 SparseBitsType
FP6461.3N/A64Standard
FP32122.6N/A32Standard
TF32490.3980.632Standard
BF16980.61961.216Standard
FP16980.61961.216Standard
FP81961.23922.38Standard
FP6—not published—Standard
FP4—not published—Standard
INT81961.23922.38Standard

Memory Specifications

Capacity
128 GB
Type
—
Bandwidth
5.3 TB/s
Interface Width
—

Power & Efficiency

TDP
760 W
Max power (Flopper estimate)
~874 W est.
FP32 dense TFLOPS per W of TDP
0.16 TFLOPS/W
FP16 dense TFLOPS per W of TDP
1.29 TFLOPS/W

Flopper estimate: 760 W TDP x 1.15. The vendor publishes no maximum board power for this part. Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: AMD
Architecture: CDNA 3
Process Node: 5nm FinFET
Form Factor: APU SH5 socket
Launch Year: 2023
Variant: 128GB

Enterprise Features

Sparsity: Yes