{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T16:19:26Z","timestamp":1761581966552,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,5,23]],"date-time":"2020-05-23T00:00:00Z","timestamp":1590192000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No.61701327 and No.61711540303"],"award-info":[{"award-number":["No.61701327 and No.61711540303"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Science Foundation of Sichuan Science and Technology Department","award":["No.2018GZ0178."],"award-info":[{"award-number":["No.2018GZ0178."]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>High-resolution multi-spectral images are desired for applications in remote sensing. However, multi-spectral images can only be provided in low resolutions by optical remote sensing satellites. The technique of pan-sharpening wants to generate high-resolution multi-spectral (MS) images based on a panchromatic (PAN) image and the low-resolution counterpart. The conventional deep learning based pan-sharpening methods process the panchromatic and the low-resolution image in a feedforward manner where shallow layers fail to access useful information from deep layers. To make full use of the powerful deep features that have strong representation ability, we propose a two-path network with feedback connections, through which the deep features can be rerouted for refining the shallow features in a feedback manner. Specifically, we leverage the structure of a recurrent neural network to pass the feedback information. Besides, a power feature extraction block with multiple projection pairs is designed to handle the feedback information and to produce power deep features. Extensive experimental results show the effectiveness of our proposed method.<\/jats:p>","DOI":"10.3390\/rs12101674","type":"journal-article","created":{"date-parts":[[2020,5,25]],"date-time":"2020-05-25T11:42:02Z","timestamp":1590406922000},"page":"1674","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Two-Path Network with Feedback Connections for Pan-Sharpening in Remote Sensing"],"prefix":"10.3390","volume":"12","author":[{"given":"Shipeng","family":"Fu","sequence":"first","affiliation":[{"name":"College of Electronics and Information Engineering, Sichuan University, Chengdu 610064, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weihua","family":"Meng","sequence":"additional","affiliation":[{"name":"College of Electronics and Information Engineering, Sichuan University, Chengdu 610064, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0651-4278","authenticated-orcid":false,"given":"Gwanggil","family":"Jeon","sequence":"additional","affiliation":[{"name":"Department of Embedded System Engineering, Incheon National University, Incheon 22012, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4193-6062","authenticated-orcid":false,"given":"Abdellah","family":"Chehri","sequence":"additional","affiliation":[{"name":"Applied Sciences Department, Universit\u00e9 du Qu\u00e9bec \u00e0 Chicoutimi Chicoutimi, Saguenay, QC G7H 2B1, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rongzhu","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Electronics and Information Engineering, Sichuan University, Chengdu 610064, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaomin","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Electronics and Information Engineering, Sichuan University, Chengdu 610064, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.inffus.2016.03.003","article-title":"A review of remote sensing image fusion methods","volume":"32","author":"Ghassemian","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"647","DOI":"10.14358\/PERS.74.5.647","article-title":"Comparison of nine fusion techniques for very high resolution data","volume":"74","author":"Nikolakopoulos","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1080\/014311698215748","article-title":"Review article multisensor image fusion in remote sensing: Concepts, methods and applications","volume":"19","author":"Pohl","year":"1998","journal-title":"Int. J. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2565","DOI":"10.1109\/TGRS.2014.2361734","article-title":"A critical comparison among pansharpening algorithms","volume":"53","author":"Vivone","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.inffus.2019.07.010","article-title":"Remote sensing image fusion based on two-stream fusion network","volume":"55","author":"Liu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1109\/LGRS.2017.2736020","article-title":"Boosting the accuracy of multispectral image pansharpening by learning a deep residual network","volume":"14","author":"Wei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Masi, G., Cozzolino, D., Verdoliva, L., and Scarpa, G. (2016). Pansharpening by convolutional neural networks. Remote Sens., 8.","DOI":"10.3390\/rs8070594"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/S1566-2535(01)00036-7","article-title":"A new look at IHS-like image fusion methods","volume":"2","author":"Tu","year":"2001","journal-title":"Inf. Fusion"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1109\/LGRS.2004.834804","article-title":"A fast intensity-hue-saturation fusion technique with spectral adjustment for IKONOS imagery","volume":"1","author":"Tu","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.inffus.2015.06.006","article-title":"Combining the spectral PCA and spatial PCA fusion methods by an optimal filter","volume":"27","author":"Shahdoosti","year":"2016","journal-title":"Inf. Fusion"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"7380","DOI":"10.1109\/TGRS.2014.2311815","article-title":"High-fidelity component substitution pansharpening by the fitting of substitution data","volume":"52","author":"Xu","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","first-page":"111","article-title":"Increasing geometric resolution of data supplied by quickbird multispectral sensors","volume":"156","author":"Parente","year":"2013","journal-title":"Sens. Transducers"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3674","DOI":"10.1109\/TGRS.2006.881758","article-title":"Estimation of the number of decomposition levels for a wavelet-based multiresolution multisensor image fusion","volume":"44","author":"Pradhan","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1204","DOI":"10.1109\/36.763274","article-title":"Multiresolution-based image fusion with additive wavelet decomposition","volume":"37","author":"Nunez","year":"1999","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.inffus.2006.02.001","article-title":"Remote sensing image fusion using the curvelet transform","volume":"8","author":"Nencini","year":"2007","journal-title":"Inf. Fusion"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2822","DOI":"10.1109\/TIP.2013.2258355","article-title":"A variational approach for pan-sharpening","volume":"22","author":"Fang","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1792","DOI":"10.1109\/JSTARS.2013.2283236","article-title":"Two-step sparse coding for the pan-sharpening of remote sensing images","volume":"7","author":"Jiang","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_18","unstructured":"Padwick, C., Deskevich, M., Pacifici, F., and Smallwood, S. (2010, January 26\u201330). WorldView-2 pan-sharpening. Proceedings of the ASPRS 2010 Annual Conference, San Diego, CA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TGRS.2010.2051674","article-title":"A new adaptive component-substitution-based satellite image fusion by using partial replacement","volume":"49","author":"Choi","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.jpdc.2017.06.022","article-title":"Implications of deep learning for the automation of design patterns organization","volume":"117","author":"Hussain","year":"2018","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1598","DOI":"10.1109\/JIOT.2017.2787779","article-title":"A robust features-based person tracker for overhead views in industrial environment","volume":"5","author":"Ahmed","year":"2017","journal-title":"IEEE Internet Things J."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014). Learning a deep convolutional network for image super-resolution. European Conference on Computer Vision, Zurich, Switzerland, 6\u201312 September 2014, Springer.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.ins.2016.03.016","article-title":"Locally estimated heterogeneity property and its fuzzy filter application for deinterlacing","volume":"354","author":"Jeon","year":"2016","journal-title":"Inf. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1007\/s11220-016-0135-6","article-title":"Remote sensing image fusion with convolutional neural network","volume":"17","author":"Zhong","year":"2016","journal-title":"Sens. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5549","DOI":"10.1109\/TGRS.2019.2900419","article-title":"Pan-Sharpening Using an Efficient Bidirectional Pyramid Network","volume":"57","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zamir, A.R., Wu, T.L., Sun, L., Shen, W.B., Shi, B.E., Malik, J., and Savarese, S. (2017, January 21\u201326). Feedback networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.196"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, Z., Yang, J., Liu, Z., Yang, X., Jeon, G., and Wu, W. (2019, January 15\u201320). Feedback Network for Image Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00399"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Timofte, R., Rothe, R., and Van Gool, L. (2016, January 27\u201330). Seven ways to improve example-based single image super resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.206"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Haris, M., Shakhnarovich, G., and Ukita, N. (2018, January 8\u201314). Deep back-projection networks for super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Munich, Germany.","DOI":"10.1109\/CVPR.2018.00179"},{"key":"ref_30","first-page":"691","article-title":"Fusion of Satellite Images of Different Spatial Resolutions: Assessing the Quality of Resulting Images","volume":"63","author":"Wald","year":"1997","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"784","DOI":"10.1038\/29537","article-title":"Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons","volume":"394","author":"James","year":"1998","journal-title":"Nature"},{"key":"ref_32","unstructured":"Carreira, J., Agrawal, P., Fragkiadaki, K., and Malik, J. (July, January 26). Human pose estimation with iterative error feedback. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Cao, C., Liu, X., Yang, Y., Yu, Y., Wang, J., Wang, Z., Huang, Y., Wang, L., Huang, C., and Xu, W. (2015, January 7\u201313). Look and think twice: Capturing top-down visual attention with feedback convolutional neural networks. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.338"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Han, W., Chang, S., Liu, D., Yu, M., Witbrock, M., and Huang, T.S. (2018, January 8). Image super-resolution via dual-state recurrent networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2018.00178"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Mu Lee, K. (2017, January 21\u201326). Enhanced deep residual networks for single image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_37","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2020, April 13). PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems. Available online: http:\/\/papers.nips.cc\/paper\/9015-pytorch-an-imperative-style-high-performance-deep-learning-library."},{"key":"ref_38","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_39","unstructured":"Yuhas, R.H., Goetz, A.F., and Boardman, J.W. (1992, January 1\u20135). Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm. Proceedings of the Summaries 3rd Annual JPL Airborne Geoscience Workshop, Pasadena, CA, USA."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1109\/LGRS.2004.836784","article-title":"A global quality measurement of pan-sharpened multispectral imagery","volume":"1","author":"Alparone","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12518-016-0179-2","article-title":"Evaluation of pan-sharpening methods for spatial and spectral quality","volume":"9","author":"Pushparaj","year":"2017","journal-title":"Appl. Geomat."},{"key":"ref_42","unstructured":"Wald, L. (2000, January 26\u201328). Quality of high resolution synthesised images: Is there a simple criterion?. Proceedings of the Fusion of Earth Data: Merging Point Measurements, Raster Maps, and Remotely Sensed Image, Nice, France."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yang, J., Fu, X., Hu, Y., Huang, Y., Ding, X., and Paisley, J. (2017, January 22\u201329). PanNet: A deep network architecture for pan-sharpening. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.193"},{"key":"ref_44","unstructured":"Kim, J., Kwon Lee, J., and Mu Lee, K. (July, January 26). Accurate image super-resolution using very deep convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1109\/TCI.2016.2644865","article-title":"Loss functions for image restoration with neural networks","volume":"3","author":"Zhao","year":"2016","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"080599","DOI":"10.1117\/1.JRS.8.080599","article-title":"Wavelet-domain satellite image fusion based on a generalized fusion equation","volume":"8","author":"Jin","year":"2014","journal-title":"J. Appl. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"5088","DOI":"10.1109\/TGRS.2013.2286827","article-title":"Pansharpening with matting model","volume":"52","author":"Kang","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.sigpro.2014.12.017","article-title":"Sparse representation based pansharpening with details injection model","volume":"113","author":"Yin","year":"2015","journal-title":"Signal Proc."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/10\/1674\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:31:50Z","timestamp":1760175110000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/10\/1674"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,23]]},"references-count":48,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["rs12101674"],"URL":"https:\/\/doi.org\/10.3390\/rs12101674","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2020,5,23]]}}}