Side by side datacenter GPU specifications from the Flopper.io database.
| AWS Inferentia2 | NVIDIA L4 24GB | |
|---|---|---|
| FP32 TFLOPS | 47.5 | 30.3 |
| Memory | 32 GB | 24 GB |
| Memory Bandwidth | 820 GB/s | 300 GB/s |
| TDP | — | 72 W |
| Precision | AWS Inferentia2 peak TFLOPS (dense) | NVIDIA L4 24GB peak TFLOPS (dense) |
|---|---|---|
| FP64 | — | 0.4 |
| FP32 | 47.5 | 30.3 |
| TF32 | 190.0 | 60.0 |
| BF16 | 190.0 | 121.0 |
| FP16 | 190.0 | 121.0 |
| FP8 | 190.0 | 242.5 |
| FP6 | — | — |
| FP4 | — | — |
| INT8 | 380.0 | 242.5 |
| AWS Inferentia2 | NVIDIA L4 24GB | |
|---|---|---|
| Architecture | NeuronCore-v2 | Ada Lovelace |
| Process Node | — | 4nm |
| Launch Year | 2022 | 2023 |
| Form Factor | — | PCIe |
| Memory Type | HBM | — |
| Interface Width | — | — |
| Interconnect | NeuronLink-v2 | — |
| TDP | — | 72 W |
| FP32 Efficiency | — | 0.42 TFLOPS/W |