NVIDIA GeForce RTX 5060 Ti 16GB

The GeForce RTX 5060 Ti in its 16 GB form is the cheapest new NVIDIA card that will hold a 13B model quantised to four bits with room for context. It has 4,608 Blackwell CUDA cores and 144 fifth-generation Tensor cores on the GB206 die, and 16 GB of GDDR7 on a narrow 128-bit bus, which caps bandwidth at 448 GB/s. That bandwidth is the bottleneck for token generation, not the 189.8 TFLOPS of dense FP8 the Tensor cores can reach, so expect it to behave like a capacity card rather than a throughput one. It draws 180 W and needs only a 600 W system, which makes it straightforward to put two in a desktop. NVIDIA does not publish a per-SKU precision table for GB206, so the ladder below is anchored on its published 759 AI TOPS figure, which its own footnote defines as sparse FP4.