Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A100 SXM4 40GB vs NVIDIA GeForce RTX 3060 Ti 8GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A100 SXM4 40GBNVIDIA GeForce RTX 3060 Ti 8GB
FP32 TFLOPS19.516.2
Memory40 GB8 GB
Memory Bandwidth1.6 TB/s—
TDP400 W200 W

Performance by Precision

PrecisionNVIDIA A100 SXM4 40GB peak TFLOPS (dense)NVIDIA GeForce RTX 3060 Ti 8GB peak TFLOPS (dense)
FP64 9.70.3
FP32 19.516.2
TF32 156.016.2
BF16 312.032.4
FP16 312.032.4
FP8 ——
FP6 ——
FP4 ——
INT8 624.0129.6
INT4 1248.0259.1

Specifications

NVIDIA A100 SXM4 40GBNVIDIA GeForce RTX 3060 Ti 8GB
ArchitectureAmpereAmpere
Process Node7nm8nm
Launch Year20202020
Form FactorSXMPCIe
Memory TypeHBM2eGDDR6
Interface Width4096-bit256-bit
Interconnect——
TDP400 W200 W
FP32 Efficiency0.05 TFLOPS/W0.08 TFLOPS/W