NVIDIA GH200 144GB HBM3e

The 144 GB HBM3e configuration of the NVIDIA GH200 Grace Hopper Superchip, and the one most cloud providers rent. It keeps the 72-core Grace CPU, the Hopper H100 GPU and the 900 GB/s NVLink-C2C link of the 96 GB part, and changes only the memory system: 144 GB of HBM3e at 4.9 TB/s in place of 96 GB of HBM3 at 4 TB/s. With up to 480 GB of LPDDR5X on the CPU side that gives 624 GB of fast-access memory in one coherent address space. Compute is unchanged, because NVIDIA publishes a single performance table for both configurations, so the 50 percent extra capacity and 23 percent extra bandwidth are the whole of the difference. That matters most where the working set rather than the arithmetic is the constraint, which is why this part shows up under long-context inference and large-embedding retrieval rather than under training benchmarks.