Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A16 16GB vs NVIDIA GeForce RTX 3090 24GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A16 16GBNVIDIA GeForce RTX 3090 24GB
FP32 TFLOPS4.535.6
Memory16 GB24 GB
Memory Bandwidth200 GB/s936 GB/s
TDP350 W

Performance by Precision

PrecisionNVIDIA A16 16GB peak TFLOPS (dense)NVIDIA GeForce RTX 3090 24GB peak TFLOPS (dense)
FP64 0.6
FP32 4.535.6
TF32 9.035.6
BF16 71.0
FP16 17.971.0
FP8
FP6
FP4
INT8 35.9284.0
INT4 568.0

Specifications

NVIDIA A16 16GBNVIDIA GeForce RTX 3090 24GB
ArchitectureAmpereAmpere
Process Node8nm
Launch Year20212020
Form FactorPCIePCIe
Memory TypeGDDR6
Interface Width
Interconnect
TDP350 W
FP32 Efficiency0.10 TFLOPS/W