FP4

A 4-bit floating-point format introduced with NVIDIA Blackwell, halving the memory and bandwidth footprint of FP8 again. Used for inference on very large models where the accuracy cost is acceptable. Blackwell-era headline performance figures are almost always quoted in FP4.