Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA GeForce RTX 3090 24GB vs NVIDIA A40 48GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA GeForce RTX 3090 24GBNVIDIA A40 48GB
FP32 TFLOPS35.637.4
VRAM24 GB48 GB
Memory Bandwidth936 GB/s696 GB/s
TDP350 W300 W

Performance by Precision

PrecisionNVIDIA GeForce RTX 3090 24GB peak TFLOPS (dense)NVIDIA A40 48GB peak TFLOPS (dense)
INT8 284.0299.3
INT4 568.0598.7
FP16 71.0149.7
BF16 71.0149.7
TF32 35.674.8
FP32 35.637.4
FP64 0.6

Specifications

NVIDIA GeForce RTX 3090 24GBNVIDIA A40 48GB
ArchitectureAmpereAmpere
Process Node8nm
Launch Year20202021
Form FactorPCIePCIe
Memory TypeGDDR6
Interface Width384-bit
Interconnect
TDP350 W300 W
FP32 Efficiency0.10 TFLOPS/W0.12 TFLOPS/W