Existing Confirmed

Google Hypercomputer TPU v5p pod

Google • December 6, 2023
Total GPUs
9.0K
H100 Equiv
4.2K
FP16
4.1K PF

Specifications

Primary GPUGoogle TPU v5p
GPU Count9.0K
SectorPrivate

Additional Information

Each TPU v5p pod composes together 8,960 chips over our highest-bandwidth inter-chip interconnect (ICI) at 4,800 Gbps/chip in a 3D torus topology.

The "Hypercomputer" is a cloud network, a TPU v5p pod seems to just be one component. Versions of this pod likely exist in multiple locations, possibly around the world