What are Tensor Cores?
hardware
394 views
Answer
Tensor Cores are specialized hardware units designed to accelerate matrix multiplication operations used in deep learning. Each generation adds new capabilities: Gen 1 (Volta) introduced FP16, Gen 2 (Turing) added INT8, Gen 3 (Ampere) brought TF32 and structural sparsity, Gen 4 (Hopper/Ada) added FP8 and Transformer Engine, and Gen 5 (Blackwell) introduced FP4 precision. They provide 10-20x speedup over CUDA cores for AI workloads.