FP8

8-bit floating-point precision format introduced in Hopper architecture. Enables up to 2x throughput improvement over FP16/BF16 while maintaining model accuracy through dynamic range management in the Transformer Engine. Essential for training large language models efficiently.