Flopper.io
Flopper.io GPU Comparison Sheet

AWS Inferentia vs AWS Trainium2

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

AWS InferentiaAWS Trainium2
FP32 TFLOPS—181.0
Memory8 GB96 GB
Memory Bandwidth50 GB/s2.9 TB/s
TDP——

Performance by Precision

PrecisionAWS Inferentia peak TFLOPS (dense)AWS Trainium2 peak TFLOPS (dense)
FP64 ——
FP32 —181.0
TF32 —667.0
BF16 64.0667.0
FP16 64.0667.0
FP8 —1299.0
FP6 ——
FP4 ——
INT8 128.0—

Specifications

AWS InferentiaAWS Trainium2
ArchitectureNeuronCore-v1NeuronCore-v3
Process Node——
Launch Year20182024
Form Factor——
Memory TypeDDR4—
Interface Width——
InterconnectNeuronLink-v1NeuronLink-v3
TDP——
FP32 Efficiency——