Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A100 PCIe 40GB vs NVIDIA A40 48GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A100 PCIe 40GBNVIDIA A40 48GB
FP32 TFLOPS19.537.4
VRAM40 GB48 GB
Memory Bandwidth1.6 TB/s696 GB/s
TDP250 W300 W

Performance by Precision

PrecisionNVIDIA A100 PCIe 40GB peak TFLOPS (dense)NVIDIA A40 48GB peak TFLOPS (dense)
INT8 624.0299.3
INT4 1248.0598.7
FP16 312.0149.7
BF16 312.0149.7
TF32 156.074.8
FP32 19.537.4
FP64 9.7

Specifications

NVIDIA A100 PCIe 40GBNVIDIA A40 48GB
ArchitectureAmpereAmpere
Process Node7nm
Launch Year20202021
Form FactorPCIePCIe
Memory TypeGDDR6
Interface Width384-bit
Interconnect
TDP250 W300 W
FP32 Efficiency0.08 TFLOPS/W0.12 TFLOPS/W