Flopper.io
Flopper.io GPU Comparison Sheet

AWS Inferentia2 vs AWS Trainium

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

AWS Inferentia2AWS Trainium
FP32 TFLOPS47.547.5
Memory32 GB32 GB
Memory Bandwidth820 GB/s820 GB/s
TDP——

Performance by Precision

PrecisionAWS Inferentia2 peak TFLOPS (dense)AWS Trainium peak TFLOPS (dense)
FP64 ——
FP32 47.547.5
TF32 190.0190.0
BF16 190.0190.0
FP16 190.0190.0
FP8 190.0190.0
FP6 ——
FP4 ——
INT8 380.0380.0

Specifications

AWS Inferentia2AWS Trainium
ArchitectureNeuronCore-v2NeuronCore-v2
Process Node——
Launch Year20222020
Form Factor——
Memory TypeHBMHBM
Interface Width——
InterconnectNeuronLink-v2NeuronLink-v2
TDP——
FP32 Efficiency——