Flopper.io
Flopper.io GPU Specification Sheet

NVIDIA GH200 96GB HBM3

Hopper Superchip 2023 4nm

Overview

67.0
FP32 TFLOPS
96 GB
VRAM HBM3
4.0 TB/s
Memory Bandwidth
1.0 kW
TDP

Performance Metrics

PrecisionPeak (dense)2:4 SparseBitsType
FP6434.0N/A64Standard
FP64 Tensor67.0N/A64Tensor Core
FP3267.0N/A32Standard
TF32494.0989.032Standard
BF16990.01979.016Standard
FP16990.01979.016Standard
FP81979.03958.08Standard
FP6not publishedStandard
FP4not publishedStandard
INT81979.03958.08Standard

Memory Specifications

Capacity
96 GB
Type
HBM3
Bandwidth
4.0 TB/s
Interface Width

Power & Efficiency

TDP
1.0 kW
Est. Max Power
1.1 kW
FP32 Efficiency
0.07 TFLOPS/W
FP16 Efficiency
0.99 TFLOPS/W

Hardware Details

Vendor: NVIDIA
Architecture: Hopper
Process Node: 4nm
Form Factor: Superchip
Launch Year: 2023
Variant: 96GB HBM3

Interconnect

GPU-to-GPU: NVLink-C2C
Bandwidth: 900 GB/s

Enterprise Features

Sparsity: Yes