Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A40 48GB vs NVIDIA GeForce RTX 4090 24GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A40 48GBNVIDIA GeForce RTX 4090 24GB
FP32 TFLOPS37.482.6
Memory48 GB24 GB
Memory Bandwidth696 GB/s1.0 TB/s
TDP300 W450 W

Performance by Precision

PrecisionNVIDIA A40 48GB peak TFLOPS (dense)NVIDIA GeForce RTX 4090 24GB peak TFLOPS (dense)
FP64 —1.3
FP32 37.482.6
TF32 74.882.6
BF16 149.7165.2
FP16 149.7165.2
FP8 —330.3
FP6 ——
FP4 ——
INT8 299.3660.6
INT4 598.7—

Specifications

NVIDIA A40 48GBNVIDIA GeForce RTX 4090 24GB
ArchitectureAmpereAda Lovelace
Process Node—4nm
Launch Year20212022
Form FactorPCIePCIe
Memory TypeGDDR6—
Interface Width384-bit—
Interconnect——
TDP300 W450 W
FP32 Efficiency0.12 TFLOPS/W0.18 TFLOPS/W