AWS Trainium vs AWS Trainium2

The Trainium2 delivers 6.8x the FP8 throughput of the Trainium (1,299 vs 190 TFLOPS dense). The Trainium2 also carries 64 GB more memory (96 GB vs 32 GB).

Trainium: NeuronCore-v2, 2020 Trainium2: NeuronCore-v3, 2024

FP8 dense lead

6.8x

Trainium2: 1,299 vs 190 TFLOPS

Memory

32 vs 96 GB

64 GB more for the Trainium2

Bandwidth

820 GB/s vs 2.9 TB/s

Trainium2 moves data faster

Download comparison sheet Printable version →

AWS Trainium

Full specs →

What is the AWS Trainium?

The Trainium is an ASIC from AWS on the NeuronCore-v2 architecture, an accelerator built for AI workloads. Trainium full specifications →

Can I rent the Trainium in the cloud?

Flopper is not tracking any live rental listings for the Trainium yet. The provider directory lists the clouds that rent comparable accelerators on demand. GPU cloud providers →

How does the Trainium compare with other accelerators?

This page sets the Trainium against the Trainium2. The Trainium is the older generation of the two. Both are AWS parts. The compare tool builds the same comparison for any two parts in the catalogue. All GPU comparisons →

Where do the Trainium figures come from?

Every Trainium figure on this page traces to AWS's own datasheet or specification table. How Flopper verifies specifications →

AWS Trainium2

Leads on FP8 Full specs →

What is the AWS Trainium2?

The Trainium2 is an ASIC from AWS on the NeuronCore-v3 architecture, an accelerator built for AI workloads. Trainium2 full specifications →

Can I rent the Trainium2 in the cloud?

Flopper is not tracking any live rental listings for the Trainium2 yet. The provider directory lists the clouds that rent comparable accelerators on demand. GPU cloud providers →

How does the Trainium2 compare with other accelerators?

This page sets the Trainium2 against the Trainium. The Trainium2 is the newer generation of the two. Both are AWS parts. Flopper also compares it head to head with the H100 SXM5 80GB, across every published precision, memory and power. Trainium2 vs H100 SXM5 80GB →

Where do the Trainium2 figures come from?

Every Trainium2 figure on this page traces to AWS's own datasheet or specification table. How Flopper verifies specifications →

Specifications

Trainium

Trainium2

Architecture

NeuronCore-v2NeuronCore-v3

Launch Year

20202024

Form Factor

——

Memory

32 GB96 GB

Memory Bandwidth

820 GB/s2.9 TB/s

TDP

——

Process Node

——

Spec

Trainium

Trainium2

Architecture NeuronCore-v2NeuronCore-v3

Launch Year 20202024

Form Factor ——

Memory 32 GB96 GB

Memory Bandwidth 820 GB/s2.9 TB/s

TDP ——

Process Node ——

Performance (TFLOPS)

Trainium

Trainium2

48 TFLOPS 181 TFLOPS

190 TFLOPS 667 TFLOPS

2,563 TFLOPS sparse

190 TFLOPS 667 TFLOPS

2,563 TFLOPS sparse

190 TFLOPS 667 TFLOPS

2,563 TFLOPS sparse

190 TFLOPS 1,299 TFLOPS

2,563 TFLOPS sparse

FP6

380 TOPS

Precision

Trainium

Trainium2

48 TFLOPS 181 TFLOPS

190 TFLOPS 667 TFLOPS

2,563 TFLOPS sparse

190 TFLOPS 667 TFLOPS

2,563 TFLOPS sparse

190 TFLOPS 667 TFLOPS

2,563 TFLOPS sparse

190 TFLOPS 1,299 TFLOPS

2,563 TFLOPS sparse

FP6

380 TOPS

Figures are dense. Where a vendor publishes a figure it sits under the dense one and never decides a winner. Hover any precision for its definition, or read the GPU glossary.

FLOPS by Precision

What actually differs

The Trainium2 is the newer part: NeuronCore-v3 (2024) against the Trainium's NeuronCore-v2 (2020).

The Trainium2 carries 64 GB more memory (96 GB against 32 GB), so larger models fit on one GPU before you shard. Bandwidth is 820 GB/s against 2.9 TB/s, which sets the ceiling on decode speed.

Weight the FP8 and FP16 rows for LLM work and the FP64 row for HPC.

New to the terms? The glossary explains FP32, TF32, BF16, FP16, FP8, INT8, Sparsity and TFLOPS.

Frequently asked questions

What is better, the Trainium or the Trainium2?

The Trainium2, on throughput. At FP8 precision the Trainium2 reaches 1,299 TFLOPS dense against 190 TFLOPS for the Trainium. The performance table on this page lists every published precision for both GPUs.

Which should you choose, the Trainium or the Trainium2?

Choose the Trainium2 for training and high-throughput inference: it has 6.8x the FP8 throughput of the Trainium. It also carries 64 GB more memory, so larger models fit on one GPU before you shard.

Which has more memory, the Trainium or the Trainium2?

The Trainium2 carries 96 GB of memory versus 32 GB for the Trainium. Memory bandwidth is 820 GB/s for the Trainium and 2.9 TB/s for the Trainium2.

Get Comparison Updates

New GPUs added weekly. Be the first to see how they compare.

Open in Full Compare Tool → Trainium full specs Trainium2 full specs Estimate cluster cost in the calculator →

AWS Trainium vs AWS Trainium2

AWS Trainium

What is the AWS Trainium?

Can I rent the Trainium in the cloud?

How does the Trainium compare with other accelerators?

Where do the Trainium figures come from?

AWS Trainium2

What is the AWS Trainium2?

Can I rent the Trainium2 in the cloud?

How does the Trainium2 compare with other accelerators?

Where do the Trainium2 figures come from?

Specifications

Performance (TFLOPS)

FLOPS by Precision

What actually differs

Frequently asked questions

What is better, the Trainium or the Trainium2?

Which should you choose, the Trainium or the Trainium2?

Which has more memory, the Trainium or the Trainium2?

Related comparisons

Get Comparison Updates

Stay Updated on GPU Specs