Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA H100 SXM5 80GB vs NVIDIA GH200 96GB HBM3

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA H100 SXM5 80GBNVIDIA GH200 96GB HBM3
FP32 TFLOPS67.067.0
Memory80 GB96 GB
Memory Bandwidth3.4 TB/s4.0 TB/s
TDP700 W1.0 kW

Performance by Precision

PrecisionNVIDIA H100 SXM5 80GB peak TFLOPS (dense)NVIDIA GH200 96GB HBM3 peak TFLOPS (dense)
FP64 34.034.0
FP64_TC Tensor Core67.067.0
FP32 67.067.0
TF32 494.0494.0
BF16 990.0990.0
FP16 990.0990.0
FP8 1979.01979.0
FP6 ——
FP4 ——
INT8 1979.01979.0

Specifications

NVIDIA H100 SXM5 80GBNVIDIA GH200 96GB HBM3
ArchitectureHopperHopper
Process Node4nm4nm
Launch Year20222023
Form FactorSXMSuperchip
Memory Type—HBM3
Interface Width——
Interconnect—NVLink-C2C
TDP700 W1.0 kW
FP32 Efficiency0.10 TFLOPS/W0.07 TFLOPS/W