Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A100 PCIe 80GB vs NVIDIA GeForce RTX 3090 Ti 24GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A100 PCIe 80GBNVIDIA GeForce RTX 3090 Ti 24GB
FP32 TFLOPS19.540.0
VRAM80 GB24 GB
Memory Bandwidth1.9 TB/s1.0 TB/s
TDP300 W450 W

Performance by Precision

PrecisionNVIDIA A100 PCIe 80GB peak TFLOPS (dense)NVIDIA GeForce RTX 3090 Ti 24GB peak TFLOPS (dense)
INT8 624.080.0
INT4 1248.0
FP16 312.040.0
BF16 312.040.0
TF32 156.040.0
FP32 19.540.0
FP64 9.70.6

Specifications

NVIDIA A100 PCIe 80GBNVIDIA GeForce RTX 3090 Ti 24GB
ArchitectureAmpereAmpere
Process Node8nm
Launch Year20212022
Form FactorPCIePCIe
Memory TypeHBM2e
Interface Width5120-bit
Interconnect
TDP300 W450 W
FP32 Efficiency0.07 TFLOPS/W0.09 TFLOPS/W