INT8
precision
Also known as: 8-bit integer,quantization
Definition
An 8-bit integer format for quantized inference, mapping weights and activations onto 256 discrete levels to cut memory and bandwidth against FP16 at some accuracy cost. Tensor-core throughput usually matches FP8, and it is quoted in TOPS as often as TFLOPS.