AMD Instinct MI100 32GB

CDNA PCIe 2020 7nm

Overview

23.1

FP32 TFLOPS

32 GB

Memory HBM2

1.2 TB/s

Memory Bandwidth

300 W

TDP

Performance Metrics

Precision	Peak (dense)	Bits	Type
FP64	11.5	64	Standard
FP32	23.1	32	Standard
TF32	—	—	Standard
BF16	92.3	16	Standard
FP16	184.6	16	Standard
FP8	—	—	Standard
FP6	—	—	Standard
FP4	—	—	Standard
INT8	184.6	8	Standard
INT4	184.6	4	Standard

Memory Specifications

Capacity: 32 GB
Type: HBM2
Bandwidth: 1.2 TB/s
Interface Width: —

Power & Efficiency

TDP: 300 W
Max power (Flopper estimate): ~345 W est.
FP32 dense TFLOPS per W of TDP: 0.08 TFLOPS/W
FP16 dense TFLOPS per W of TDP: 0.62 TFLOPS/W

Flopper estimate: 300 W TDP x 1.15. The vendor publishes no maximum board power for this part. Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: AMD

Architecture: CDNA

Process Node: 7nm

Form Factor: PCIe

Launch Year: 2020

Variant: 32GB

Enterprise Features

Sparsity: No