Flopper.io
Flopper.io GPU Comparison Sheet

AWS Inferentia2 vs AWS Trainium2

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

AWS Inferentia2AWS Trainium2
FP32 TFLOPS47.5181.0
Memory32 GB96 GB
Memory Bandwidth820 GB/s2.9 TB/s
TDP——

Performance by Precision

PrecisionAWS Inferentia2 peak TFLOPS (dense)AWS Trainium2 peak TFLOPS (dense)
FP64 ——
FP32 47.5181.0
TF32 190.0667.0
BF16 190.0667.0
FP16 190.0667.0
FP8 190.01299.0
FP6 ——
FP4 ——
INT8 380.0—

Specifications

AWS Inferentia2AWS Trainium2
ArchitectureNeuronCore-v2NeuronCore-v3
Process Node——
Launch Year20222024
Form Factor——
Memory TypeHBM—
Interface Width——
InterconnectNeuronLink-v2NeuronLink-v3
TDP——
FP32 Efficiency——