Flopper.io
Flopper.io GPU Comparison Sheet

NVIDIA GH200 96GB HBM3 vs NVIDIA H100 SXM5 80GB

Side by side datacenter GPU specifications from the Flopper.io database.

Overview

NVIDIA GH200 96GB HBM3NVIDIA H100 SXM5 80GB
FP32 TFLOPS67.067.0
Memory96 GB80 GB
Memory Bandwidth4.0 TB/s3.4 TB/s
TDP1.0 kW700 W

Performance by Precision

PrecisionNVIDIA GH200 96GB HBM3 peak TFLOPS (dense)NVIDIA H100 SXM5 80GB peak TFLOPS (dense)
FP64 34.034.0
FP64_TC Tensor Core67.067.0
FP32 67.067.0
TF32 494.0494.0
BF16 990.0990.0
FP16 990.0990.0
FP8 1979.01979.0
FP6 ——
FP4 ——
INT8 1979.01979.0

Specifications

NVIDIA GH200 96GB HBM3NVIDIA H100 SXM5 80GB
ArchitectureHopperHopper
Process Node4nm4nm
Launch Year20232022
Form FactorSuperchipSXM
Memory TypeHBM3—
Interface Width——
InterconnectNVLink-C2C—
TDP1.0 kW700 W
FP32 Efficiency0.07 TFLOPS/W0.10 TFLOPS/W