Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A16 16GB vs NVIDIA A40 48GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A16 16GBNVIDIA A40 48GB
FP32 TFLOPS4.537.4
Memory16 GB48 GB
Memory Bandwidth200 GB/s696 GB/s
TDP300 W

Performance by Precision

PrecisionNVIDIA A16 16GB peak TFLOPS (dense)NVIDIA A40 48GB peak TFLOPS (dense)
FP64
FP32 4.537.4
TF32 9.074.8
BF16 149.7
FP16 17.9149.7
FP8
FP6
FP4
INT8 35.9299.3
INT4 598.7

Specifications

NVIDIA A16 16GBNVIDIA A40 48GB
ArchitectureAmpereAmpere
Process Node
Launch Year20212021
Form FactorPCIePCIe
Memory TypeGDDR6GDDR6
Interface Width384-bit
Interconnect
TDP300 W
FP32 Efficiency0.12 TFLOPS/W