Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A100 PCIe 40GB vs NVIDIA A800 SXM4

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A100 PCIe 40GBNVIDIA A800 SXM4
FP32 TFLOPS19.519.5
Memory40 GB80 GB
Memory Bandwidth1.6 TB/s2.0 TB/s
TDP250 W400 W

Performance by Precision

PrecisionNVIDIA A100 PCIe 40GB peak TFLOPS (dense)NVIDIA A800 SXM4 peak TFLOPS (dense)
FP64 9.79.7
FP32 19.519.5
TF32 156.0156.0
BF16 312.0312.0
FP16 312.0312.0
FP8 ——
FP6 ——
FP4 ——
INT8 624.0624.0
INT4 1248.01248.0

Specifications

NVIDIA A100 PCIe 40GBNVIDIA A800 SXM4
ArchitectureAmpereAmpere
Process Node7nm7nm
Launch Year20202022
Form FactorPCIeSXM
Memory Type—HBM2e
Interface Width——
Interconnect—NVLink
TDP250 W400 W
FP32 Efficiency0.08 TFLOPS/W0.05 TFLOPS/W