Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A100 PCIe 80GB vs NVIDIA RTX A4000 16GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A100 PCIe 80GBNVIDIA RTX A4000 16GB
FP32 TFLOPS19.519.2
Memory80 GB16 GB
Memory Bandwidth1.9 TB/s448 GB/s
TDP300 W140 W

Performance by Precision

PrecisionNVIDIA A100 PCIe 80GB peak TFLOPS (dense)NVIDIA RTX A4000 16GB peak TFLOPS (dense)
FP64 9.70.3
FP32 19.519.2
TF32 156.019.2
BF16 312.019.2
FP16 312.019.2
FP8 ——
FP6 ——
FP4 ——
INT8 624.038.3
INT4 1248.0—

Specifications

NVIDIA A100 PCIe 80GBNVIDIA RTX A4000 16GB
ArchitectureAmpereAmpere
Process Node—8nm
Launch Year20212021
Form FactorPCIePCIe
Memory TypeHBM2eGDDR6
Interface Width5120-bit256-bit
Interconnect——
TDP300 W140 W
FP32 Efficiency0.07 TFLOPS/W0.14 TFLOPS/W