Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A100 SXM4 80GB vs NVIDIA A2 16GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A100 SXM4 80GBNVIDIA A2 16GB
FP32 TFLOPS19.54.5
Memory80 GB16 GB
Memory Bandwidth2.0 TB/s200 GB/s
TDP400 W60 W

Performance by Precision

PrecisionNVIDIA A100 SXM4 80GB peak TFLOPS (dense)NVIDIA A2 16GB peak TFLOPS (dense)
FP64 9.7—
FP32 19.54.5
TF32 156.09.0
BF16 312.018.0
FP16 312.018.0
FP8 ——
FP6 ——
FP4 ——
INT8 624.036.0
INT4 1248.072.0

Specifications

NVIDIA A100 SXM4 80GBNVIDIA A2 16GB
ArchitectureAmpereAmpere
Process Node7nm—
Launch Year20202021
Form FactorSXMPCIe
Memory Type—GDDR6
Interface Width—128-bit
Interconnect——
TDP400 W60 W
FP32 Efficiency0.05 TFLOPS/W0.07 TFLOPS/W