Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA RTX A4000 16GB vs NVIDIA A100 PCIe 40GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA RTX A4000 16GBNVIDIA A100 PCIe 40GB
FP32 TFLOPS19.219.5
Memory16 GB40 GB
Memory Bandwidth448 GB/s1.6 TB/s
TDP140 W250 W

Performance by Precision

PrecisionNVIDIA RTX A4000 16GB peak TFLOPS (dense)NVIDIA A100 PCIe 40GB peak TFLOPS (dense)
FP64 0.39.7
FP32 19.219.5
TF32 19.2156.0
BF16 19.2312.0
FP16 19.2312.0
FP8
FP6
FP4
INT8 38.3624.0
INT4 1248.0

Specifications

NVIDIA RTX A4000 16GBNVIDIA A100 PCIe 40GB
ArchitectureAmpereAmpere
Process Node8nm7nm
Launch Year20212020
Form FactorPCIePCIe
Memory TypeGDDR6
Interface Width256-bit
Interconnect
TDP140 W250 W
FP32 Efficiency0.14 TFLOPS/W0.08 TFLOPS/W