Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA A100 SXM4 40GB vs NVIDIA A800 SXM4

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA A100 SXM4 40GBNVIDIA A800 SXM4
FP32 TFLOPS19.519.5
Memory40 GB80 GB
Memory Bandwidth1.6 TB/s2.0 TB/s
TDP400 W400 W

Performance by Precision

PrecisionNVIDIA A100 SXM4 40GB peak TFLOPS (dense)NVIDIA A800 SXM4 peak TFLOPS (dense)
FP64 9.79.7
FP32 19.519.5
TF32 156.0156.0
BF16 312.0312.0
FP16 312.0312.0
FP8 ——
FP6 ——
FP4 ——
INT8 624.0624.0
INT4 1248.01248.0

Specifications

NVIDIA A100 SXM4 40GBNVIDIA A800 SXM4
ArchitectureAmpereAmpere
Process Node7nm7nm
Launch Year20202022
Form FactorSXMSXM
Memory TypeHBM2eHBM2e
Interface Width4096-bit—
Interconnect—NVLink
TDP400 W400 W
FP32 Efficiency0.05 TFLOPS/W0.05 TFLOPS/W