厚雅伟
1.天津理工大学电气电子工程学院 天津 300384
2.天津市复杂系统控制理论及应用重点实验室 天津 300384
详细信息
作者简介:张惊雷：男，1969，教授，博士，研究方向为模式识别、图像处理等
厚雅伟：男，1995，硕士生，研究方向为图像处理、目标检测等
通讯作者:张惊雷 zhangjinglei@tjut.edu.cn
中图分类号:TN911.73; TP317计量
文章访问数:3501
HTML全文浏览量:1286
PDF下载量:217
被引次数:0
出版历程
收稿日期:2019-06-05
修回日期:2019-12-23
网络出版日期:2019-12-31
刊出日期:2020-06-04
Image-to-image Translation Based on Improved Cycle-consistent Generative Adversarial Network
Jinglei ZHANG,,Yawei HOU
1. School of Electrical and Electronic Engineering, Tianjin University of Technology, Tianjin 300384, China
2. Tianjin Key Laboratory of Complex System Control Theory and Application, Tianjin 300384, China
摘要
摘要:图像间的风格迁移是一类将图片在不同领域进行转换的方法。随着生成式对抗网络在深度学习中的快速发展，其在图像风格迁移领域中的应用被日益关注。但经典算法存在配对训练数据较难获取，生成图片效果差的缺点。该文提出一种改进循环生成式对抗网络(CycleGAN++)，取消了环形网络，并在图像生成阶段将目标域与源域的先验信息与相应图片进行纵深级联；优化了损失函数，采用分类损失代替循环一致损失，实现了不依赖训练数据映射的图像风格迁移。采用CelebA和Cityscapes数据集进行实验评测，结果表明在亚马逊劳务平台感知研究(AMT perceptual studies)与全卷积网络得分(FCN score)两个经典测试指标中，该文算法比CycleGAN, IcGAN, CoGAN, DIAT等经典算法取得了更高的精度。
关键词:图像风格迁移/
深度学习/
生成式对抗网络/
损失函数
Abstract:Image-to-image translation is a method to convert images in different domains. With the rapid development of the Generative Adversarial Network(GAN) in deep learning, GAN applications are increasingly concerned in the field of image-to-image translation. However, classical algorithms have disadvantages that the paired training data is difficult to obtain and the convert effect of generation image is poor. An improved Cycle-consistent Generative Adversarial Network(CycleGAN++) is proposed. New algorithm removes the loop network, and cascades the prior information of the target domain and the source domain in the image generation stage, The loss function is optimized as well, using classification loss instead of cycle consistency loss, realizing image-to-image translation without training data mapping. The evaluation of experiments on the CelebA and Cityscapes dataset show that new method can reach higher precision under the two classical criteria—Amazon Mechanical Turk perceptual studies(AMT perceptual studies) and Full-Convolutional Network score(FCN score), than the classical algorithms such as CycleGAN, IcGAN, CoGAN, and DIAT.
Key words:Image-to-image translation/
Deep learning/
Generative Adversarial Network (GAN)/
Loss function
PDF全文下载地址:
https://jeit.ac.cn/article/exportPdf?id=fec23b87-129a-4348-9a26-502e15ea0388
