{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:31:25Z","timestamp":1760239885890,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2019,1,8]],"date-time":"2019-01-08T00:00:00Z","timestamp":1546905600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Yecai Guo","award":["61673222"],"award-info":[{"award-number":["61673222"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Pansharpening is a domain-specific task of satellite imagery processing, which aims at fusing a multispectral image with a corresponding panchromatic one to enhance the spatial resolution of multispectral image. Most existing traditional methods fuse multispectral and panchromatic images in linear manners, which greatly restrict the fusion accuracy. In this paper, we propose a highly efficient inference network to cope with pansharpening, which breaks the linear limitation of traditional methods. In the network, we adopt a dilated multilevel block coupled with a skip connection to perform local and overall compensation. By using dilated multilevel block, the proposed model can make full use of the extracted features and enlarge the receptive field without introducing extra computational burden. Experiment results reveal that our network tends to induce competitive even superior pansharpening performance compared with deeper models. As our network is shallow and trained with several techniques to prevent overfitting, our model is robust to the inconsistencies across different satellites.<\/jats:p>","DOI":"10.3390\/a12010016","type":"journal-article","created":{"date-parts":[[2019,1,9]],"date-time":"2019-01-09T03:06:06Z","timestamp":1547003166000},"page":"16","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Learning an Efficient Convolution Neural Network for Pansharpening"],"prefix":"10.3390","volume":"12","author":[{"given":"Yecai","family":"Guo","sequence":"first","affiliation":[{"name":"Jiangsu Key Laboratory of Meteorological Observation and Information Processing, Jiangsu Technology and Engineering Center of Meteorological Sensor Network, School of Electronic and Information Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8556-4694","authenticated-orcid":false,"given":"Fei","family":"Ye","sequence":"additional","affiliation":[{"name":"Jiangsu Key Laboratory of Meteorological Observation and Information Processing, Jiangsu Technology and Engineering Center of Meteorological Sensor Network, School of Electronic and Information Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"given":"Hao","family":"Gong","sequence":"additional","affiliation":[{"name":"Jiangsu Key Laboratory of Meteorological Observation and Information Processing, Jiangsu Technology and Engineering Center of Meteorological Sensor Network, School of Electronic and Information Engineering, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,1,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2565","DOI":"10.1109\/TGRS.2014.2361734","article-title":"A Critical Comparison Among Pansharpening Algorithms","volume":"53","author":"Vivone","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.inffus.2016.03.003","article-title":"A review of remote sensing image fusion methods","volume":"32","author":"Ghassemian","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.inffus.2015.06.006","article-title":"Combining the spectral PCA and spatial PCA fusion methods by an optimal filter","volume":"27","author":"Shahdoosti","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"7380","DOI":"10.1109\/TGRS.2014.2311815","article-title":"High-Fidelity Component Substitution Pansharpening by the Fitting of Substitution Data","volume":"52","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","unstructured":"Laben, C.A., and Brower, B.V. (2000). Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening. (6, 011,875), U.S. Patent."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3674","DOI":"10.1109\/TGRS.2006.881758","article-title":"Estimation of the Number of Decomposition Levels for a Wavelet-Based Multiresolution Multisensor Image Fusion","volume":"44","author":"Pradhan","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"753","DOI":"10.1109\/TGRS.2016.2614367","article-title":"Context-Adaptive Pansharpening Based on Image Segmentation","volume":"55","author":"Restaino","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2255","DOI":"10.1109\/JSTARS.2016.2546061","article-title":"MTF-Based Deblurring Using a Wiener Filter for CS and MRA Pansharpening Methods","volume":"9","author":"Palsson","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4213","DOI":"10.1109\/TIP.2015.2456415","article-title":"SIRF: Simultaneous Satellite Image Registration and Fusion in a Unified Framework","volume":"24","author":"Chen","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"7135","DOI":"10.1109\/TGRS.2016.2596290","article-title":"An Integrated Framework for the Spatio\u2013Temporal\u2013Spectral Fusion of Remote Sensing Images","volume":"54","author":"Shen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2596","DOI":"10.1109\/TIP.2014.2316641","article-title":"A Regularized Model-Based Optimization Framework for Pan-Sharpening","volume":"23","author":"Aly","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1109\/JSTARS.2018.2794888","article-title":"A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening","volume":"11","author":"Yuan","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Masi, G., Cozzolino, D., Verdoliva, L., Scarpa, G., Masi, G., Cozzolino, D., Verdoliva, L., and Scarpa, G. (2016). Pansharpening by Convolutional Neural Networks. Remote Sens., 8.","DOI":"10.3390\/rs8070594"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yang, J., Fu, X., Hu, Y., Huang, Y., Ding, X., and Paisley, J. (2017, January 22\u201329). PanNet: A Deep Network Architecture for Pan-Sharpening. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.193"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1109\/LGRS.2017.2736020","article-title":"Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network","volume":"14","author":"Wei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1007\/s11220-016-0135-6","article-title":"Remote Sensing Image Fusion with Convolutional Neural Network","volume":"17","author":"Zhong","year":"2016","journal-title":"Sens. Imaging"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image Super-Resolution Using Deep Convolutional Networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_19","unstructured":"Yu, F., and Koltun, V. (arXiv, 2015). Multi-Scale Context Aggregation by Dilated Convolutions, arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhang, K., Zuo, W., Gu, S., and Zhang, L. (2017, January 22\u201325). Learning Deep CNN Denoiser Prior for Image Restoration. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.300"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Divakar, N., and Babu, R.V. (2017, January 21). Image Denoising via CNNs: An Adversarial Approach. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.145"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"4608","DOI":"10.1109\/TIP.2018.2839891","article-title":"FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, K., Zuo, W., and Zhang, L. (2018, January 19\u201321). Learning a Single Convolutional Super-Resolution Network for Multiple Degradations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00344"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lefkimmiatis, S. (2018, January 19\u201321). Universal Denoising Networks: A Novel CNN Architecture for Image Denoising. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00338"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Tian, Y., Ukong, Y., Zhong, B., and Fu, Y. (2018, January 19\u201321). Residual Dense Network for Image Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00262"},{"key":"ref_26","unstructured":"Wald, L. (2002). Data Fusion: Definitions and Architectures: Fusion of Images of Different Spatial Resolutions, Presses de l\u2019Ecole."},{"key":"ref_27","first-page":"691","article-title":"Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images","volume":"63","author":"Wald","year":"1997","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"591","DOI":"10.14358\/PERS.72.5.591","article-title":"MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery","volume":"72","author":"Aiazzi","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_29","unstructured":"Pascanu, R., Mikolov, T., and Bengio, Y. (2013, January 16\u201321). On the difficulty of training recurrent neural networks. Proceedings of the International Conference on Machine Learning, Atlanta, GA, USA."},{"key":"ref_30","unstructured":"Sutskever, I., Martens, J., Dahl, G., and Hinton, G. (2013, January 16\u201321). On the importance of initialization and momentum in deep learning. Proceedings of the International Conference on Machine Learning, Atlanta, GA, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girshick, R., Guadarrama, S., and Darrell, T. (2014, January 3\u20137). Caffe: Convolutional Architecture for Fast Feature Embedding. Proceedings of the ACM International Conference on Multimedia, Orlando, FL, USA.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1109\/TGRS.2007.907604","article-title":"Optimal MMSE Pan Sharpening of Very High Resolution Multispectral Images","volume":"46","author":"Garzelli","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1606","DOI":"10.1109\/LGRS.2016.2597271","article-title":"Nonlinear IHS: A Promising Method for Pan-Sharpening","volume":"13","author":"Ghahremani","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/LGRS.2007.909934","article-title":"Indusion: Fusion of Multispectral and Panchromatic Images Using the Induction Scaling Technique","volume":"5","author":"Khan","year":"2008","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2882","DOI":"10.1109\/TIP.2016.2556944","article-title":"Fusion of Multispectral and Panchromatic Images Based on Morphological Operators","volume":"25","author":"Restaino","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1170","DOI":"10.1080\/2150704X.2016.1222098","article-title":"Pan-sharpening with structural consistency and \u21131\/2 gradient prior","volume":"7","author":"Zeng","year":"2016","journal-title":"Remote Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A universal image quality index","volume":"9","author":"Zhou","year":"2002","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1109\/LGRS.2004.836784","article-title":"A Global Quality Measurement of Pan-Sharpened Multispectral Imagery","volume":"1","author":"Alparone","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1080\/014311698215973","article-title":"A wavelet transform method to merge Landsat TM and SPOT panchromatic data","volume":"19","author":"Zhou","year":"1998","journal-title":"Int. J. Remote Sens."},{"key":"ref_40","unstructured":"Yuhas, R.H., Goetz, A.F.H., and Boardman, J.W. (1992, January 1\u20135). Discrimination among semi-arid landscape endmembers using the Spectral Angle Mapper (SAM) algorithm. Proceedings of the 3rd Annual JPL Airborne Geoscience Workshop; AVIRIS Workshop, Pasadena, CA, USA."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"193","DOI":"10.14358\/PERS.74.2.193","article-title":"Multispectral and Panchromatic Data Fusion Assessment Without Reference","volume":"74","author":"Alparone","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Chen, C., Li, Y., Liu, W., and Huang, J. (2014, January 24\u201327). Image Fusion with Local Spectral Consistency and Dynamic Gradient Sparsity. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.347"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/1\/16\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:24:24Z","timestamp":1760185464000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/12\/1\/16"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,8]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,1]]}},"alternative-id":["a12010016"],"URL":"https:\/\/doi.org\/10.3390\/a12010016","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2019,1,8]]}}}