徐宁2,,,
尚蕴浩2,
楚昕2
1.常州工学院 常州 213032
2.河海大学常州校区 常州 213022
基金项目:国家自然科学基金(61872199)，中央高校基本业务费(B210202083)
详细信息
作者简介:鲍静益：女，1984年生，讲师，研究方向为模式识别与现代信号处理
徐宁：男，1981年生，副教授，研究方向为模式识别与现代信号处理
尚蕴浩：男，1997年生，硕士生，研究方向为图像处理和深度学习
楚昕：女，1995年生，硕士生，研究方向为图像处理和深度学习
通讯作者:徐宁 20101832@hhu.edu.cn
中图分类号:TP181; TN911.73计量
文章访问数:201
HTML全文浏览量:84
PDF下载量:20
被引次数:0
出版历程
收稿日期:2020-12-30
修回日期:2021-07-01
网络出版日期:2021-07-08
刊出日期:2021-11-23
Optimization in Capsule Network Based on Mutual Information Autoencoder and Variational Routing
Jingyi BAO1,Ning XU2,,,
Yunhao SHANG2,
Xin CHU2
1. Changzhou Institute of Technology, Changzhou 213032, China
2. Hohai University Changzhou Campus, Changzhou 213022, China
Funds:The National Natural Science Foundation of China (61872199), The Fundamental Research Funds for the Central Universities (B210202083)
摘要
摘要:胶囊网络是一类有别于卷积神经网络的新型网络模型。该文尝试提高其泛化性和精准性：首先，利用变分路由来缓解经典路由对先验信息依赖性强、易导致模型过拟合的问题。通过使用高斯混合模型(GMM)来拟合低级矩阵胶囊，并利用变分法求取近似分布，避免了参数最大似然点估计的误差，用置信度评估来获得泛化性能的提高；其次，考虑到实际数据大多无标签或者标注困难，构建互信息评价标准的胶囊自编码器，实现特征参数的有效筛选。即通过引入局部编码器，只保留胶囊中对原始输入识别最有效的特征，在减轻网络负担的同时提高了其分类识别的精准性。该文的方法在MNIST, FashionMNIST, CIFAR-10和CIFAR-100等数据集上进行了对比测试，实验结果表明：该文方法对比经典胶囊网络，其性能得到显著改善。
关键词:胶囊网络/
变分路由/
基于互信息评价的胶囊自编码器
Abstract:Capsule network is a new type of network model which is different from convolutional neural network. This paper attempts to improve its generalization and accuracy. Firstly, variational routing is used to alleviate the problem of classic routing that is highly dependent on prior information and can easily lead to model overfitting. By using the Gaussian Mixture Model (GMM) to fit the low-level matrix capsule and using the variational method to fit the approximation distribution, the error of the maximum likelihood point estimation is avoided, and the confidence calculation is used to improve the generalization performance; Secondly, considering that the actual data is mostly untagged or difficult to label, a capsule autoencoder with mutual information evaluation criterion is constructed to achieve effective selection of feature parameters. That is, by introducing a local encoder, only the most effective features in the capsule for identifying and classifying the original input are retained, which reduces the computational burden of the network while improving the accuracy of classification and recognition at the same time. The method in this paper is compared and tested on datasets such as MNIST, FashionMNIST, CIFAR-10, and CIFAR-100. The experimental results show that the performance of the proposed method is significantly improved compared with the classic capsule network.
Key words:Capsule network/
Variational routing/
Capsule autoencoder based on mutual information
PDF全文下载地址:
https://jeit.ac.cn/article/exportPdf?id=04c547f0-9b1d-492f-ad68-27477a48855e
