Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA GeForce RTX 4090 24GB vs NVIDIA RTX A5000 24GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA GeForce RTX 4090 24GBNVIDIA RTX A5000 24GB
FP32 TFLOPS82.627.8
Memory24 GB24 GB
Memory Bandwidth1.0 TB/s768 GB/s
TDP450 W230 W

Performance by Precision

PrecisionNVIDIA GeForce RTX 4090 24GB peak TFLOPS (dense)NVIDIA RTX A5000 24GB peak TFLOPS (dense)
FP64 1.30.4
FP32 82.627.8
TF32 82.627.8
BF16 165.227.8
FP16 165.227.8
FP8 330.3—
FP6 ——
FP4 ——
INT8 660.655.6

Specifications

NVIDIA GeForce RTX 4090 24GBNVIDIA RTX A5000 24GB
ArchitectureAda LovelaceAmpere
Process Node4nm8nm
Launch Year20222021
Form FactorPCIePCIe
Memory Type——
Interface Width——
Interconnect——
TDP450 W230 W
FP32 Efficiency0.18 TFLOPS/W0.12 TFLOPS/W