Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA GeForce RTX 3090 24GB vs NVIDIA RTX A6000 48GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA GeForce RTX 3090 24GBNVIDIA RTX A6000 48GB
FP32 TFLOPS35.638.7
VRAM24 GB48 GB
Memory Bandwidth936 GB/s768 GB/s
TDP350 W300 W

Performance by Precision

PrecisionNVIDIA GeForce RTX 3090 24GB peak TFLOPS (dense)NVIDIA RTX A6000 48GB peak TFLOPS (dense)
INT8 284.0309.7
INT4 568.0619.3
FP16 71.0154.8
BF16 71.0154.8
TF32 35.677.4
FP32 35.638.7
FP64 0.60.6

Specifications

NVIDIA GeForce RTX 3090 24GBNVIDIA RTX A6000 48GB
ArchitectureAmpereAmpere
Process Node8nm8nm
Launch Year20202020
Form FactorPCIePCIe
Memory Type
Interface Width
Interconnect
TDP350 W300 W
FP32 Efficiency0.10 TFLOPS/W0.13 TFLOPS/W