Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA H200 SXM 141GB vs NVIDIA A100 SXM4 80GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA H200 SXM 141GBNVIDIA A100 SXM4 80GB
FP32 TFLOPS67.019.5
VRAM141 GB80 GB
Memory Bandwidth4.8 TB/s2.0 TB/s
TDP700 W400 W

Performance by Precision

PrecisionNVIDIA H200 SXM 141GB peak TFLOPS (dense)NVIDIA A100 SXM4 80GB peak TFLOPS (dense)
INT8 1979.0624.0
INT4 1248.0
FP8 1979.0
FP16 990.0312.0
BF16 990.0312.0
TF32 494.0156.0
FP32 67.019.5
FP64 34.09.7

Specifications

NVIDIA H200 SXM 141GBNVIDIA A100 SXM4 80GB
ArchitectureHopperAmpere
Process Node4nm7nm
Launch Year20242020
Form FactorSXMSXM
Memory Type
Interface Width
Interconnect
TDP700 W400 W
FP32 Efficiency0.10 TFLOPS/W0.05 TFLOPS/W