Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A40 48GB vs NVIDIA GeForce RTX 3090 Ti 24GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A40 48GBNVIDIA GeForce RTX 3090 Ti 24GB
FP32 TFLOPS37.440.0
VRAM48 GB24 GB
Memory Bandwidth696 GB/s1.0 TB/s
TDP300 W450 W

Performance by Precision

PrecisionNVIDIA A40 48GB peak TFLOPS (dense)NVIDIA GeForce RTX 3090 Ti 24GB peak TFLOPS (dense)
INT8 299.380.0
INT4 598.7
FP16 149.740.0
BF16 149.740.0
TF32 74.840.0
FP32 37.440.0
FP64 0.6

Specifications

NVIDIA A40 48GBNVIDIA GeForce RTX 3090 Ti 24GB
ArchitectureAmpereAmpere
Process Node8nm
Launch Year20212022
Form FactorPCIePCIe
Memory TypeGDDR6
Interface Width384-bit
Interconnect
TDP300 W450 W
FP32 Efficiency0.12 TFLOPS/W0.09 TFLOPS/W