Existing Confirmed

Google Hypercomputer TPU v5p pod

Google • December 6, 2023
Total GPUs
9.0K
H100 Equiv
4.2K
FP16
4.1K PF

Specifications

Primary GPU Google TPU v5p
GPU Count 9.0K
Sector Private

Additional Information

Each TPU v5p pod composes together 8,960 chips over our highest-bandwidth inter-chip interconnect (ICI) at 4,800 Gbps/chip in a 3D torus topology.

The "Hypercomputer" is a cloud network, a TPU v5p pod seems to just be one component. Versions of this pod likely exist in multiple locations, possibly around the world