{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:53:18Z","timestamp":1760151198799,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,2,22]],"date-time":"2022-02-22T00:00:00Z","timestamp":1645488000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Hainan Provincial Natural Science Foundation of China","award":["2019CXTD400"],"award-info":[{"award-number":["2019CXTD400"]}]},{"name":"the National Key Research and Development Program of China","award":["2018YFB1404400"],"award-info":[{"award-number":["2018YFB1404400"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Multispectral (MS) pansharpening is crucial to improve the spatial resolution of MS images. MS pansharpening has the potential to provide images with high spatial and spectral resolutions. Pansharpening technique based on deep learning is a topical issue to deal with the distortion of spatio-spectral information. To improve the preservation of spatio-spectral information, we propose a novel three-stage detail injection pansharpening network (TDPNet) for remote sensing images. First, we put forward a dual-branch multiscale feature extraction block, which extracts four scale details of panchromatic (PAN) images and the difference between duplicated PAN and MS images. Next, cascade cross-scale fusion (CCSF) employs fine-scale fusion information as prior knowledge for the coarse-scale fusion to compensate for the lost information during downsampling and retain high-frequency details. CCSF combines the fine-scale and coarse-scale fusion based on residual learning and prior information of four scales. Last, we design a multiscale detail compensation mechanism and a multiscale skip connection block to reconstruct injecting details, which strengthen spatial details and reduce parameters. Abundant experiments implemented on three satellite data sets at degraded and full resolutions confirm that TDPNet trades off the spectral information and spatial details and improves the fidelity of sharper MS images. Both the quantitative and subjective evaluation results indicate that TDPNet outperforms the compared state-of-the-art approaches in generating MS images with high spatial resolution.<\/jats:p>","DOI":"10.3390\/rs14051077","type":"journal-article","created":{"date-parts":[[2022,2,22]],"date-time":"2022-02-22T22:35:00Z","timestamp":1645569300000},"page":"1077","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A Three Stages Detail Injection Network for Remote Sensing Images Pansharpening"],"prefix":"10.3390","volume":"14","author":[{"given":"Yuanyuan","family":"Wu","sequence":"first","affiliation":[{"name":"School of Information and Communication Engineering, Hainan University, Haikou 570228, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siling","family":"Feng","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Hainan University, Haikou 570228, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cong","family":"Lin","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Hainan University, Haikou 570228, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haijie","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Hainan University, Haikou 570228, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mengxing","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Information and Communication Engineering, Hainan University, Haikou 570228, China"},{"name":"State Key Laboratory of Marine Resource Utilization in South China Sea, Hainan University, Haikou 570228, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.inffus.2021.10.001","article-title":"A theoretical and practical survey of image fusion methods for multispectral pansharpening","volume":"79","author":"Yilmaz","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.isprsjprs.2020.11.001","article-title":"A review of image fusion techniques for pan-sharpening of high-resolution satellite imagery","volume":"171","author":"Javan","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"8584","DOI":"10.1109\/TGRS.2020.3016526","article-title":"A Feature Discretization Method for Classification of High-Resolution Remote Sensing Images in Coastal Areas","volume":"59","author":"Chen","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","first-page":"3168464","article-title":"A Shadow Capture Deep Neural Network for Underwater Forward-Looking Sonar Image Detection","volume":"2021","author":"Xiao","year":"2021","journal-title":"Mob. Inf. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.inffus.2018.05.006","article-title":"Review of the pansharpening methods for remote sensing images based on the idea of meta-analysis: Practical discussion and challenges","volume":"46","author":"Meng","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Yang, C., Zhan, Q., Liu, H., and Ma, R. (2018). An IHS-based pan-sharpening method for spectral fidelity improvement using ripplet transform and compressed sensing. Sensors, 18.","DOI":"10.3390\/s18113624"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"7942","DOI":"10.1080\/01431161.2018.1479791","article-title":"A novel remote-sensing image fusion method based on hybrid visual saliency analysis","volume":"39","author":"Zhang","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"046008","DOI":"10.1117\/1.JRS.12.046008","article-title":"Generalized IHS-BT framework for the pansharpening of high-resolution satellite imagery","volume":"12","author":"Hsu","year":"2018","journal-title":"J. Appl. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MGRS.2020.2976696","article-title":"A large-scale benchmark data set for evaluating pansharpening performance: Overview and implementation","volume":"9","author":"Meng","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TGRS.2010.2051674","article-title":"A new adaptive component-substitution-based satellite image fusion by using partial replacement","volume":"49","author":"Choi","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"016518","DOI":"10.1117\/1.JRS.14.016518","article-title":"Remote sensing image fusion method based on discrete wavelet and multiscale morphological transform in the IHS color space","volume":"14","author":"Liu","year":"2020","journal-title":"J. Appl. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1016\/j.future.2018.06.022","article-title":"Multi-spectral and panchromatic image fusion approach using stationary wavelet transform and swarm flower pollination optimization for remote sensing applications","volume":"88","author":"Gharbia","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/LGRS.2007.909934","article-title":"Indusion: Fusion of multispectral and panchromatic images using the induction scaling technique","volume":"5","author":"Khan","year":"2008","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6152","DOI":"10.1109\/TGRS.2020.2974806","article-title":"Pansharpening: Context-Based Generalized Laplacian Pyramids by Robust Regression","volume":"58","author":"Vivone","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"591","DOI":"10.14358\/PERS.72.5.591","article-title":"MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery","volume":"72","author":"Aiazzi","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2464","DOI":"10.1109\/78.157290","article-title":"The discrete wavelet transform: Wedding the \u00e0 trous and Mallat algorithms","volume":"40","author":"Shensa","year":"1992","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Dong, W., Xiao, S., Li, Y., and Qu, J. (2018). Hyperspectral Pansharpening Based on Intrinsic Image Decomposition and Weighted Least Squares Filter. Remote Sens., 10.","DOI":"10.3390\/rs10030445"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Constans, Y., Fabre, S., Seymour, M., Crombez, V., Deville, Y., and Briottet, X. (2022). Hyperspectral Pansharpening in the Reflective Domain with a Second Panchromatic Channel in the SWIR II Spectral Domain. Remote Sens., 14.","DOI":"10.3390\/rs14010113"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ghaderpour, E., Pagiatakis, S.D., and Hassan, Q.K. (2021). A Survey on Change Detection and Time Series Analysis with Applications. Appl. Sci., 11.","DOI":"10.3390\/app11136141"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Fu, X., Lin, Z., Huang, Y., and Ding, X. (2019, January 16\u201320). A variational pan-sharpening with local gradient constraints. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01051"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1180","DOI":"10.1109\/LSP.2020.3007325","article-title":"A variational pansharpening method based on gradient sparse representation","volume":"27","author":"Tian","year":"2020","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1109\/TGRS.2018.2858288","article-title":"Pansharpening based on deconvolution for multiband filter estimation","volume":"57","author":"Vivone","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"036513","DOI":"10.1117\/1.JRS.13.036513","article-title":"Model-based variational pansharpening method with fast generalized intensity\u2013hue\u2013saturation","volume":"13","author":"Li","year":"2019","journal-title":"J. Appl. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1109\/TIP.2018.2866954","article-title":"High-quality Bayesian pansharpening","volume":"28","author":"Wang","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4820","DOI":"10.1109\/TGRS.2018.2839564","article-title":"A Bayesian procedure for full-resolution quality assessment of pansharpened products","volume":"56","author":"Vivone","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2448","DOI":"10.1109\/JSTARS.2018.2835573","article-title":"An efficient pan sharpening via texture based dictionary learning and sparse representation","volume":"11","author":"Ayas","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1595","DOI":"10.1109\/LGRS.2019.2904526","article-title":"Convolutional sparse representation of injected details for pansharpening","volume":"16","author":"Fei","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"4199","DOI":"10.1080\/01431161.2021.1875512","article-title":"Weighted manifold regularized sparse representation of featured injected details for pansharpening","volume":"42","author":"Fei","year":"2021","journal-title":"Int. J. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4938","DOI":"10.1109\/TGRS.2019.2894702","article-title":"PAN-Guided Cross-Resolution Projection for Local Adaptive Sparse Representation- Based Pansharpening","volume":"57","author":"Yin","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"9010","DOI":"10.1109\/TGRS.2019.2924096","article-title":"Spectral Super-Resolution for Multispectral Image Based on Spectral Improvement Strategy and Spatial Preservation Strategy","volume":"57","author":"Yi","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/j.isprsjprs.2018.09.018","article-title":"Super-resolution of Sentinel-2 images: Learning a globally applicable deep neural network","volume":"146","author":"Lanaras","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Gargiulo, M., Mazza, A., Gaetano, R., Ruello, G., and Scarpa, G. (2019). Fast Super-Resolution of 20 m Sentinel-2 Bands Using Convolutional Neural Networks. Remote Sens., 11.","DOI":"10.3390\/rs11222635"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"594","DOI":"10.3390\/rs8070594","article-title":"Pansharpening by Convolutional Neural Networks","volume":"8","author":"Giuseppe","year":"2016","journal-title":"Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1109\/LGRS.2017.2736020","article-title":"Boosting the Accuracy of Multispectral Image Pansharpening by Learning a Deep Residual Network","volume":"14","author":"Wei","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yang, J., Fu, X., Hu, Y., Huang, Y., Ding, X., and Paisley, J. (2017, January 22\u201329). PanNet: A Deep Network Architecture for Pan-Sharpening. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.193"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5443","DOI":"10.1109\/TGRS.2018.2817393","article-title":"Target-Adaptive CNN-Based Pansharpening","volume":"56","author":"Scarpa","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liu, X., Wang, Y., and Liu, Q. (2018, January 7\u201310). Psgan: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening. Proceedings of the IEEE Transactions on Geoscience and Remote Sensing, (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451049"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.inffus.2020.04.006","article-title":"Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion","volume":"62","author":"Ma","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Zhao, Z., Zhan, J., Xu, S., Sun, K., Huang, L., Liu, J., and Zhang, C. (2021, January 5\u20139). FGF-GAN: A Lightweight Generative Adversarial Network for Pansharpening via Fast Guided Filter. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), Shenzhen, China.","DOI":"10.1109\/ICME51207.2021.9428272"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"6995","DOI":"10.1109\/TGRS.2020.3031366","article-title":"Detail Injection-Based Deep Convolutional Neural Networks for Pansharpening","volume":"59","author":"Deng","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wu, Y., Huang, M., Li, Y., Feng, S., and Wu, D. (2021). A Distributed Fusion Framework of Multispectral and Panchromatic Images Based on Residual Network. Remote Sens., 13.","DOI":"10.3390\/rs13132556"},{"key":"ref_42","first-page":"691","article-title":"Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images","volume":"63","author":"Wald","year":"1997","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A universal image quality index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"6102","DOI":"10.1109\/JSTARS.2021.3086877","article-title":"A Benchmarking Protocol for Pansharpening: Dataset, Pre-processing, and Quality Assessment","volume":"14","author":"Vivone","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"193","DOI":"10.14358\/PERS.74.2.193","article-title":"Multispectral and Panchromatic Data Fusion Assessment Without Reference","volume":"74","author":"Alparone","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_47","unstructured":"Kingma, D., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 8\u201316). Identity mappings in deep residual networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2300","DOI":"10.1109\/TGRS.2002.803623","article-title":"Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis","volume":"40","author":"Aiazzi","year":"2002","journal-title":"IEEE Trans. Geosci. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/5\/1077\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:25:03Z","timestamp":1760135103000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/5\/1077"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,22]]},"references-count":49,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["rs14051077"],"URL":"https:\/\/doi.org\/10.3390\/rs14051077","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,2,22]]}}}