Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA GeForce RTX 3090 Ti 24GB vs NVIDIA RTX A6000 48GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA GeForce RTX 3090 Ti 24GBNVIDIA RTX A6000 48GB
FP32 TFLOPS40.038.7
VRAM24 GB48 GB
Memory Bandwidth1.0 TB/s768 GB/s
TDP450 W300 W

Performance by Precision

PrecisionNVIDIA GeForce RTX 3090 Ti 24GB peak TFLOPS (dense)NVIDIA RTX A6000 48GB peak TFLOPS (dense)
INT8 80.0309.7
INT4 619.3
FP16 40.0154.8
BF16 40.0154.8
TF32 40.077.4
FP32 40.038.7
FP64 0.60.6

Specifications

NVIDIA GeForce RTX 3090 Ti 24GBNVIDIA RTX A6000 48GB
ArchitectureAmpereAmpere
Process Node8nm8nm
Launch Year20222020
Form FactorPCIePCIe
Memory Type
Interface Width
Interconnect
TDP450 W300 W
FP32 Efficiency0.09 TFLOPS/W0.13 TFLOPS/W