Huawei Atlas 300I Duo 96GB

The Huawei Atlas 300I Duo is a dual-chip inference card carrying two Ascend 310P processors on a single-slot full-height full-length board. Its headline figures of 280 TOPS INT8 and 140 TFLOPS FP16 are whole-card numbers covering both chips, so a like-for-like comparison against a single-chip card means halving them: per chip it is 140 TOPS and 70 TFLOPS, exactly what the single-chip Atlas 300I Pro publishes. Memory is 96 GB of LPDDR4X with ECC at a combined 408 GB/s, which is Huawei's own figure and very slightly under the 409.6 GB/s that two 204.8 GB/s single-chip cards would suggest. The card also carries a 16-core 1.9 GHz host CPU and a large media block rated at 256 channels of 1080p30 decode, or 32 channels of 4K60, plus 48 channels of 1080p30 encode. Two naming collisions are worth knowing about. This card is built on the Ascend 310P, not the Ascend 310B that many specification aggregators report. And it should not be confused with the Atlas 300I A2, a different card built on an Ascend 910B4 whose figures are 560 TOPS INT8 and 280 TFLOPS FP16, where the numeral 280 attaches to a different precision entirely.