Cerebras CS-3

The Cerebras CS-3 is a single 16 RU liquid-cooled system built around one Wafer Scale Engine 3, drawing up to 27 kW. Its memory is 44 GB of on-chip SRAM running at 21 PB/s, with no DRAM of any kind, and system I/O is 1.2 Tb/s. Cerebras rates it at 125 petaFLOPS of FP16, but a footnote on its own datasheet states that FLOPS are shown as sparse, and the sparsity is unstructured rather than 2:4 structured, so no dense equivalent can be derived by halving and none is published. This entry therefore carries no precision figures rather than a sparse number that would be compared against the dense figures used everywhere else on this site. Cooling is water at 100 L/min per system, 20 +/- 2 C, with 50 um filtering and PG25 chemistry.