Flopper.io
Flopper.io GPU Specification Sheet

AWS Inferentia2

NeuronCore-v2 2022

Overview

47.5
FP32 TFLOPS
32 GB
Memory HBM
820 GB/s
Memory Bandwidth
—
TDP

Performance Metrics

PrecisionPeak (dense)BitsType
FP64——Standard
FP3247.532Standard
TF32190.032Standard
BF16190.016Standard
FP16190.016Standard
FP8190.08Standard
FP6——Standard
FP4——Standard
INT8380.08Standard

Memory Specifications

Capacity
32 GB
Type
HBM
Bandwidth
820 GB/s
Interface Width
—

Power & Efficiency

TDP
—
Max power
—
FP32 dense TFLOPS per W of TDP
—
FP16 dense TFLOPS per W of TDP
—

Per W of TDP figures divide dense peak by accelerator TDP. Board power only: excludes host CPUs, networking, cooling and facility overhead.

Hardware Details

Vendor: AWS
Architecture: NeuronCore-v2
Process Node: —
Form Factor: —
Launch Year: 2022

Compute Engine

NeuronCore-v2: 2

Interconnect

GPU-to-GPU: NeuronLink-v2
Bandwidth: 192 GB/s direction and scope not stated by vendor