Flopper.io
Flopper.io GPU Comparison Sheet

AWS Inferentia2 vs NVIDIA L4 24GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

AWS Inferentia2NVIDIA L4 24GB
FP32 TFLOPS47.530.3
Memory32 GB24 GB
Memory Bandwidth820 GB/s300 GB/s
TDP—72 W

Performance by Precision

PrecisionAWS Inferentia2 peak TFLOPS (dense)NVIDIA L4 24GB peak TFLOPS (dense)
FP64 —0.4
FP32 47.530.3
TF32 190.060.0
BF16 190.0121.0
FP16 190.0121.0
FP8 190.0242.5
FP6 ——
FP4 ——
INT8 380.0242.5

Specifications

AWS Inferentia2NVIDIA L4 24GB
ArchitectureNeuronCore-v2Ada Lovelace
Process Node—4nm
Launch Year20222023
Form Factor—PCIe
Memory TypeHBM—
Interface Width——
InterconnectNeuronLink-v2—
TDP—72 W
FP32 Efficiency—0.42 TFLOPS/W