摘要:近年来，卷积神经网络（CNN）展现了强大的性能，被广泛应用到了众多领域.由于CNN参数数量庞大，且存储和计算能力需求高，其难以部署在资源受限设备上.因此，对CNN的压缩和加速成为一个迫切需要解决的问题.随着自动化机器学习（AutoML）的研究与发展，AutoML对神经网络发展产生了深远的影响.受此启发，提出了基于参数估计和基于遗传算法的两种自动化加速卷积神经网络算法.该算法能够在给定精度损失范围内自动计算出最优的CNN加速模型，有效地解决了张量分解中，人工选择秩带来的误差问题，能够有效地提升CNN的压缩和加速效果.通过在MNIST和CIFAR-10数据集上的严格测试，与原网络相比，在MNIST数据集上准确率稍微下降了0.35%，模型的运行时间获得了4.1倍的大幅提升；在CIFAR-10数据集上，准确率稍微下降了5.13%，模型的运行时间获得了0.8倍的大幅提升.



Abstract:Recently, convolutional neural network (CNN) have demonstrated strong performance and are widely used in many fields. Due to the large number of CNN parameters and high storage and computing power requirements, it is difficult to deploy on resource-constrained devices. Therefore, compression and acceleration of CNN models have become an urgent problem to be solved. With the research and development of automatic machine learning (AutoML), AutoML has profoundly impacted the development of neural networks. Inspired by this, this study proposes two automated accelerated CNN algorithms based on parameter estimation and genetic algorithms, which can calculate the optimal accelerated CNN model within a given accuracy loss range, effectively solving the error caused by artificially selected rank in tensor decomposition. It can effectively improve the compression and acceleration effects of the convolutional neural network. By rigorous testing on the MNIST and CIFAR-10 data sets, the accuracy rate on the MNIST dataset is slightly reduced by 0.35% compared to the original network, and the running time of the model is greatly reduced by 4.1 times, the accuracy rate on the CIFAR-10 dataset dropped slightly by 5.13%, and the running time of the model was greatly decreased by 0.8 times.



PDF全文下载地址:

http://jos.org.cn/jos/article/pdf/6057