雷大江^1,,,
张策¹,
李智星¹,
吴渝²
1.重庆邮电大学计算机科学与技术学院 重庆 400065
2.重庆邮电大学网络智能研究所 重庆 400065
基金项目:重庆市留学归国人员创新创业项目(cx2018120)，国家社会科学基金(17XFX013)，重庆市基础研究与前沿探索项目(cstc2015jcyjA40018)

详细信息

作者简介:雷大江：男，1979年生，副教授，研究方向为机器学习
张策：男，1994年生，硕士生，研究方向为图像处理
李智星：男，1985年生，副教授，研究方向为自然语言处理
吴渝：女，1970年生，教授，研究方向为网络智能

通讯作者:雷大江　leidj@cqupt.edu.cn

中图分类号:TN911.73; TP751

计量

文章访问数:1197
HTML全文浏览量:561
PDF下载量:109
被引次数:0

出版历程

收稿日期:2019-04-19
修回日期:2020-02-21
网络出版日期:2020-06-26
刊出日期:2020-08-18

Remote Sensing Image Fusion Based on Generative Adversarial Network with Multi-stream Fusion Architecture

Dajiang LEI^1,,,
Ce ZHANG¹,
Zhixing LI¹,
Yu WU²
1. College of Computer, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
2. Institute of Web Intelligence, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
Funds:The Chongqing Innovative Project of Overseas Study (cx2018120), The National Social Science Foundation of China (17XFX013), The Natural Science Foundation of Chongqing (cstc2015jcyjA40018)


摘要
摘要:由于强大的高质量图像生成能力，生成对抗网络在图像融合和图像超分辨率等计算机视觉的研究中得到了广泛关注。目前基于生成对抗网络的遥感图像融合方法只使用网络学习图像之间的映射，缺乏对遥感图像中特有的全锐化领域知识的应用。该文提出一种融入全色图空间结构信息的优化生成对抗网络遥感图像融合方法。通过梯度算子提取全色图空间结构信息，将提取的特征同时加入判别器和具有多流融合架构的生成器，设计相应的优化目标和融合规则，从而提高融合图像的质量。结合WorldView-3卫星获取的图像进行实验，结果表明，所提方法能够生成高质量的融合图像，在主观视觉和客观评价指标上都优于大多先进的遥感图像融合方法。
关键词:遥感图像融合/
计算机视觉/
生成对抗网络/
多流融合架构
Abstract:The generative adversarial network receives extensive attention in the study of computer vision such as image fusion and image super-resolution, due to its strong ability of generating high quality images. At present, the remote sensing image fusion method based on generative adversarial network only learns the mapping between the images, and lacks the unique Pan-sharpening domain knowledge. This paper proposes a remote sensing image fusion method based on optimized generative adversarial network with the integration of the spatial structure information of panchromatic image. The proposed algorithm extracts the spatial structure information of the panchromatic image by the gradient operator. The extracted feature would be added to both the discriminator and the generator which uses a multi-stream fusion architecture. The corresponding optimization objective and fusion rules are then designed to improve the quality of the fused image. Experiments on images acquired by WorldView-3 satellites demonstrate that the proposed method can generate high quality fused images, which is better than the most of advanced remote sensing image fusion methods in both subjective visual and objective evaluation indicators.
Key words:Remote sensing image fusion/
Computer vision/
Generative adversarial network/
Multi-stream fusion architecture



PDF全文下载地址:

https://jeit.ac.cn/article/exportPdf?id=16c7d5f4-570e-4196-abe2-f36bc9ee9454