Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A800 SXM4 vs NVIDIA A100 SXM4 40GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A800 SXM4NVIDIA A100 SXM4 40GB
FP32 TFLOPS19.519.5
Memory80 GB40 GB
Memory Bandwidth2.0 TB/s1.6 TB/s
TDP400 W400 W

Performance by Precision

PrecisionNVIDIA A800 SXM4 peak TFLOPS (dense)NVIDIA A100 SXM4 40GB peak TFLOPS (dense)
FP64 9.79.7
FP32 19.519.5
TF32 156.0156.0
BF16 312.0312.0
FP16 312.0312.0
FP8 ——
FP6 ——
FP4 ——
INT8 624.0624.0
INT4 1248.01248.0

Specifications

NVIDIA A800 SXM4NVIDIA A100 SXM4 40GB
ArchitectureAmpereAmpere
Process Node7nm7nm
Launch Year20222020
Form FactorSXMSXM
Memory TypeHBM2eHBM2e
Interface Width—4096-bit
InterconnectNVLink—
TDP400 W400 W
FP32 Efficiency0.05 TFLOPS/W0.05 TFLOPS/W