Graphcore C600

The C600 is the only Colossus MK2 part Graphcore sold as a card, launched in November 2022 and aimed squarely at inference. It is a dual-slot full-height PCIe Gen4 card carrying one Mk2 IPU with FP8 support added, clocked at 1.5 GHz for 560 TFLOPS of FP8 and 280 TFLOPS of FP16 inside a 185 W thermal envelope, passively cooled. All 900 MB of its memory is inside the processor and there is no DRAM on the board at all, which the datasheet states outright: the whole card is one chip and its SRAM. Four IPU-Links carrying 1 Tbps between them let eight cards be cabled into a cluster inside a single chassis without a switch, so a model too large for one card can be split across the group and still stay off DRAM. Against a contemporary inference GPU the memory is tiny and the latency is the product.