Subtractor-Based CNN Inference Accelerator

Abstract

This paper presents a novel method to boost the performance of CNN inference accelerators utilizing subtractors. The proposed CNN preprocessing accelerator relies on sorting, grouping, and rounding the weights in order to create combinations that allow for the replacement of one multiplication operation and addition operation by a single subtraction operation. Given the high cost of multiplication in terms of power and area, replacing it with subtraction allows for a performance boost by reducing the power and area. The proposed method allows for controlling the trade-off between the performance gains and the accuracy loss through increasing or decreasing the usage of subtractors. Using a rounding size of 0.05 on LeNet-5 with the MNIST dataset, the proposed design can achieve 32.03% power savings and a 24.59% reduction in the area at the cost of only 0.1% in terms of accuracy loss.