Remote Sensing Image Fusion Algorithm Based on Two-Stream Fusion Network and Residual Channel Attention Mechanism
Open Access
- 11 January 2022
- journal article
- research article
- Published by Hindawi Limited in Wireless Communications and Mobile Computing
- Vol. 2022, 1-14
- https://doi.org/10.1155/2022/8476000
Abstract
A two-stream remote sensing image fusion network (RCAMTFNet) based on the residual channel attention mechanism is proposed by introducing the residual channel attention mechanism (RCAM) in this paper. In the RCAMTFNet, the spatial features of PAN and the spectral features of MS are extracted, respectively, by a two-channel feature extraction layer. Multiresidual connections allow the network to adapt to a deeper network structure without the degradation. The residual channel attention mechanism is introduced to learn the interdependence between channels, and then the correlation features among channels are adapted on the basis of the dependency. In this way, image spatial information and spectral information are extracted exclusively. What is more, pansharpening images are reconstructed across the board. Experiments are conducted on two satellite datasets, GaoFen-2 and WorldView-2. The experimental results show that the proposed algorithm is superior to the algorithms to some existing literature in the comparison of the values of reference evaluation indicators and nonreference evaluation indicators.Keywords
Funding Information
- Hainan University (KYQD(ZR)-21008, KYQD(ZR)-21007, HDQN202103, 2019CXTD400, 2018YFB1404400)
This publication has 40 references indexed in Scilit:
- When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNsIEEE Transactions on Geoscience and Remote Sensing, 2018
- Deep learning for pixel-level image fusion: Recent advances and future prospectsInformation Fusion, 2017
- Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual NetworkIEEE Geoscience and Remote Sensing Letters, 2017
- A Novel Geometric Dictionary Construction Approach for Sparse Representation Based Image FusionEntropy, 2017
- Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image DenoisingIEEE Transactions on Image Processing, 2017
- Nonlinear Fusion of Multispectral Citrus Fruit Image Data with Information ContentsSensors, 2017
- Pansharpening by Convolutional Neural NetworksRemote Sensing, 2016
- Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised LearningIEEE Transactions on Geoscience and Remote Sensing, 2016
- Hyperspectral and multispectral image fusion using CNMF with minimum endmember simplex volume and abundance sparsity constraintsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- A Fast Intensity–Hue–Saturation Fusion Technique With Spectral Adjustment for IKONOS ImageryIEEE Geoscience and Remote Sensing Letters, 2004