Huawei Atlas 800I A3

The inference member of Huawei's Atlas 800 A3 family: a 10U air-cooled rack server with eight Ascend 910 NPUs and four Kunpeng 920 CPUs, rated at 4.48 PFLOPS of FP16 with 1,024 GB of on-chip memory across the eight NPUs at 3.2 TB/s each. That works out at 560 TFLOPS per NPU against the 750 of the training-oriented Atlas 800T A3 in the same chassis, which is a genuine inference bin rather than a transcription difference: Huawei's own family page lists three Atlas 800 A3 models at 6.0, 5.0 and 4.48 PFLOPS FP16. Memory is offered as 8 x 128 GB or 8 x 64 GB; the 128 GB configuration is recorded here. Networking is eight 400GE QSFP-DD ports direct from the NPUs over RoCE plus fifty-six more over Huawei's bus protocol, with 784 GB/s of bidirectional device-to-device bandwidth. Power is up to 14.6 kW from six hot-swap 3.0 kW supplies in 5+1 redundancy, air cooled. Huawei publishes no INT8 figure for this machine and labels nothing dense or sparse, so only the FP16 rate it states is recorded and nothing is derived.