{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T02:51:21Z","timestamp":1772679081710,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2023,10,3]],"date-time":"2023-10-03T00:00:00Z","timestamp":1696291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China","award":["62331008"],"award-info":[{"award-number":["62331008"]}]},{"name":"National Natural Science Foundation of China","award":["61972060"],"award-info":[{"award-number":["61972060"]}]},{"name":"National Natural Science Foundation of China","award":["62027827"],"award-info":[{"award-number":["62027827"]}]},{"name":"National Natural Science Foundation of China","award":["2019YFE0110800"],"award-info":[{"award-number":["2019YFE0110800"]}]},{"name":"National Natural Science Foundation of China","award":["2022CQBSHTB3103"],"award-info":[{"award-number":["2022CQBSHTB3103"]}]},{"name":"National Key Research and Development Program of China","award":["62331008"],"award-info":[{"award-number":["62331008"]}]},{"name":"National Key Research and Development Program of China","award":["61972060"],"award-info":[{"award-number":["61972060"]}]},{"name":"National Key Research and Development Program of China","award":["62027827"],"award-info":[{"award-number":["62027827"]}]},{"name":"National Key Research and Development Program of China","award":["2019YFE0110800"],"award-info":[{"award-number":["2019YFE0110800"]}]},{"name":"National Key Research and Development Program of China","award":["2022CQBSHTB3103"],"award-info":[{"award-number":["2022CQBSHTB3103"]}]},{"name":"Special Funding for Postdoctoral Research Projects of Chongqing","award":["62331008"],"award-info":[{"award-number":["62331008"]}]},{"name":"Special Funding for Postdoctoral Research Projects of Chongqing","award":["61972060"],"award-info":[{"award-number":["61972060"]}]},{"name":"Special Funding for Postdoctoral Research Projects of Chongqing","award":["62027827"],"award-info":[{"award-number":["62027827"]}]},{"name":"Special Funding for Postdoctoral Research Projects of Chongqing","award":["2019YFE0110800"],"award-info":[{"award-number":["2019YFE0110800"]}]},{"name":"Special Funding for Postdoctoral Research Projects of Chongqing","award":["2022CQBSHTB3103"],"award-info":[{"award-number":["2022CQBSHTB3103"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Pansharpening is a technique used in remote sensing to combine high-resolution panchromatic (PAN) images with lower resolution multispectral (MS) images to generate high-resolution multispectral images while preserving spectral characteristics. Recently, convolutional neural networks (CNNs) have been the mainstream in pansharpening by extracting the deep features of PAN and MS images and fusing these abstract features to reconstruct high-resolution details. However, they are limited by the short-range contextual dependencies of convolution operations. Although transformer models can alleviate this problem, they still suffer from weak capability in reconstructing high-resolution detailed information from global representations. To this end, a novel Swin-transformer-based pansharpening model named SwinPAN is proposed. Specifically, a detail reconstruction network (DRNet) is developed in an image difference and residual learning framework to reconstruct the high-resolution detailed information from the original images. DRNet is developed based on the Swin Transformer with a dynamic high-pass preservation module with adaptive convolution kernels. The experimental results on three remote sensing datasets with different sensors demonstrate that the proposed approach performs better than state-of-the-art networks through qualitative and quantitative analysis. Specifically, the generated pansharpening results contain finer spatial details and richer spectral information than other methods.<\/jats:p>","DOI":"10.3390\/rs15194816","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T11:58:57Z","timestamp":1696420737000},"page":"4816","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["A Swin Transformer with Dynamic High-Pass Preservation for Remote Sensing Image Pansharpening"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9033-8245","authenticated-orcid":false,"given":"Weisheng","family":"Li","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]},{"given":"Yijian","family":"Hu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3779-0360","authenticated-orcid":false,"given":"Yidong","family":"Peng","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]},{"given":"Maolin","family":"He","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,3]]},"reference":[{"key":"ref_1","unstructured":"Chavez, P.S., and Kwarteng, A.Y. (1988, January 16\u201319). Extracting spectral contrast in Landsat Thematic Mapper image data using selective principal component analysis. Proceedings of the 6th Thematic Conference on Remote Sensing for Exploration Geology, Houston, TX, USA."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1323","DOI":"10.1109\/TGRS.2008.916211","article-title":"An Efficient Pan-Sharpening Method via a Combined Adaptive PCA Approach and Contourlets","volume":"46","author":"Shah","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","first-page":"561","article-title":"A generalized component substitution technique for spatial enhancement of multispectral images using a higher resolution data set","volume":"58","author":"Shettigara","year":"1992","journal-title":"Photogram. Eng. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/S1566-2535(01)00036-7","article-title":"A new look at IHS-like image fusion methods","volume":"2","author":"Tu","year":"2001","journal-title":"Inf. Fusion"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TGRS.2010.2051674","article-title":"A New Adaptive Component-Substitution-Based Satellite Image Fusion by Using Partial Replacement","volume":"49","author":"Choi","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","unstructured":"Burt, P.J. (1987). Readings in Computer Vision, Morgan Kaufmann."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1109\/34.192463","article-title":"A theory for multiresolution signal decomposition: The wavelet representation","volume":"11","author":"Mallat","year":"1989","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/978-1-4612-2544-7_17","article-title":"The Stationary Wavelet Transform and some Statistical Applications","volume":"Volume 103","author":"Antoniadis","year":"1995","journal-title":"Wavelets and Statistics"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2091","DOI":"10.1109\/TIP.2005.859376","article-title":"The contourlet transform: An efficient directional multiresolution image representation","volume":"14","author":"Do","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2822","DOI":"10.1109\/TIP.2013.2258355","article-title":"A Variational Approach for Pan-Sharpening","volume":"22","author":"Fang","year":"2013","journal-title":"IEEE Trans. Image Process. A Publ. IEEE Signal Process. Soc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5201\/ipol.2014.98","article-title":"Implementation of Nonlocal Pansharpening Image Fusion","volume":"4","author":"Buades","year":"2014","journal-title":"Image Process. Line"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.inffus.2018.11.014","article-title":"The fusion of panchromatic and multispectral remote sensing images via tensor-based sparse modeling and hyper-Laplacian prior","volume":"52","author":"Deng","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_13","first-page":"1606","article-title":"Ranking based classification in hyperspectral images","volume":"13","author":"Devi","year":"2018","journal-title":"J. Eng. Appl. Sci."},{"key":"ref_14","unstructured":"Nayak, S.C., Sanjeev Kumar Dash, C., Behera, A.K., and Dehuri, S. (2022). Biologically Inspired Techniques in Many Criteria Decision Making: Proceedings of BITMDM 2021, Springer."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1007\/s12524-020-01265-7","article-title":"Spatial\u2013spectral image classification with edge preserving method","volume":"49","author":"Merugu","year":"2021","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.isprsjprs.2023.01.018","article-title":"Cross-domain landslide mapping from large-scale remote sensing images using prototype-guided domain-aware progressive representation learning","volume":"197","author":"Zhang","year":"2023","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","first-page":"1","article-title":"Federated Deep Learning with Prototype Matching for Object Extraction From Very-High-Resolution Remote Sensing Images","volume":"61","author":"Zhang","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2297","DOI":"10.1007\/s13042-022-01524-8","article-title":"Water atom search algorithm-based deep recurrent neural network for the big data classification based on spark architecture","volume":"13","author":"Dabbu","year":"2022","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1495","DOI":"10.1007\/s11063-021-10679-4","article-title":"Multiview objects recognition using deep learning-based wrap-CNN with voting scheme","volume":"54","author":"Balamurugan","year":"2022","journal-title":"Neural Process. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Vitale, S. (August, January 28). A cnn-based pansharpening method with perceptual loss. Proceedings of the IGARSS 2019\u20132019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8900390"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Vitale, S., and Scarpa, G. (2020). A detail-preserving cross-scale learning strategy for CNN-based pansharpening. Remote Sens., 12.","DOI":"10.3390\/rs12030348"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3092","DOI":"10.1109\/JSTARS.2019.2917584","article-title":"HyperPNN: Hyperspectral pansharpening via spectrally predictive convolutional neural networks","volume":"12","author":"He","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5443","DOI":"10.1109\/TGRS.2018.2817393","article-title":"Target-adaptive CNN-based pansharpening","volume":"56","author":"Scarpa","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","unstructured":"Jin, Z.R., Zhang, T.J., Jiang, T.X., Vivone, G., and Deng, L.J. (March, January 22). LAGConv: Local-context adaptive convolution kernels with global harmonic bias for pansharpening. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"6995","DOI":"10.1109\/TGRS.2020.3031366","article-title":"Detail Injection-Based Deep Convolutional Neural Networks for Pansharpening","volume":"59","author":"Deng","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1109\/JSTARS.2018.2794888","article-title":"A Multiscale and Multidepth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpening","volume":"11","author":"Yuan","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_27","first-page":"1","article-title":"Dual-stream convolutional neural network with residual information enhancement for pansharpening","volume":"60","author":"Yang","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_28","unstructured":"Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 13). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"10227","DOI":"10.1109\/TGRS.2020.3042974","article-title":"PSGAN: A generative adversarial network for remote sensing image pan-sharpening","volume":"59","author":"Liu","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.inffus.2022.10.001","article-title":"UPanGAN: Unsupervised pansharpening based on the spectral and spatial loss constrained generative adversarial network","volume":"91","author":"Xu","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhao, Z., Zhan, J., Xu, S., Sun, K., Huang, L., Liu, J., and Zhang, C. (2021, January 5\u20139). FGF-GAN: A lightweight generative adversarial network for pansharpening via fast guided filter. Proceedings of the 2021 IEEE International Conference on Multimedia and Expo (ICME), Shenzhen, China.","DOI":"10.1109\/ICME51207.2021.9428272"},{"key":"ref_32","first-page":"1836","article-title":"PAN-GAN: A Generative Adversarial Network for Pansharpening","volume":"12","author":"Li","year":"2020","journal-title":"Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Xu, S., Zhang, J., Zhao, Z., Sun, K., Liu, J., and Zhang, C. (2021, January 20\u201325). Deep gradient projection networks for pan-sharpening. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00142"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Mifdal, J., Tom\u00e1s-Cruz, M., Sebastianelli, A., Coll, B., and Duran, J. (2023, January 17\u201324). Deep unfolding for hyper sharpening using a high-frequency injection module. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Vancouver, BC, Canada.","DOI":"10.1109\/CVPRW59228.2023.00204"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1007\/s11263-022-01699-1","article-title":"Memory-augmented deep unfolding network for guided image super-resolution","volume":"131","author":"Zhou","year":"2023","journal-title":"Int. J. Comput. Vis."},{"key":"ref_36","first-page":"1","article-title":"Multilevel deformable attention-aggregated networks for change detection in bitemporal remote sensing imagery","volume":"60","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","first-page":"1","article-title":"Vision Transformer for Pansharpening","volume":"60","author":"Meng","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Yin, J., Qu, J., Sun, L., Huang, W., and Chen, Q. (2022). A Local and Nonlocal Feature Interaction Network for Pansharpening. Remote Sens., 14.","DOI":"10.3390\/rs14153743"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Li, S., Guo, Q., and Li, A. (2022). Pan-Sharpening Based on CNN+ Pyramid Transformer by Using No-Reference Loss. Remote Sens., 14.","DOI":"10.3390\/rs14030624"},{"key":"ref_40","first-page":"1","article-title":"Pan-Sharpening Based on Transformer with Redundancy Reduction","volume":"19","author":"Zhang","year":"2022","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Masi, G., Cozzolino, D., Verdoliva, L., and Scarpa, G. (2016). Pansharpening by convolutional neural networks. Remote Sens., 8.","DOI":"10.3390\/rs8070594"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image Super-Resolution Using Deep Convolutional Networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"He, L., Rao, Y., Li, J., Plaza, A., and Zhu, J. (2018). Pansharpening via Detail Injection Based Convolutional Neural Networks. arXiv.","DOI":"10.1109\/JSTARS.2019.2898574"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Yang, J., Fu, X., Hu, Y., Huang, Y., and Paisley, J. (2017, January 22\u201329). PanNet: A Deep Network Architecture for Pan-Sharpening. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.193"},{"key":"ref_45","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 \u00d7 16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_46","first-page":"1","article-title":"Convolution-Embedded Vision Transformer with Elastic Positional Encoding for Pansharpening","volume":"60","author":"Wang","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhang, F., Zhang, K., and Sun, J. (2022). Multiscale Spatial-Spectral Interaction Transformer for Pan-Sharpening. Remote Sens., 14.","DOI":"10.3390\/rs14071736"},{"key":"ref_48","first-page":"1","article-title":"Mutiscale Hybrid Attention Transformer for Remote Sensing Image Pansharpening","volume":"61","author":"Zhu","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_50","unstructured":"Yuhas, R.H., Goetz, A.F., and Boardman, J.W. (1992, January 1\u20135). Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm. Proceedings of the JPL, Summaries of the Third Annual JPL Airborne Geoscience Workshop. Volume 1: AVIRIS Workshop, Pasadena, CA, USA."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.inffus.2019.07.010","article-title":"Remote sensing image fusion based on two-stream fusion network","volume":"55","author":"Liu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1109\/LGRS.2004.836784","article-title":"A global quality measurement of pan-sharpened multispectral imagery","volume":"1","author":"Alparone","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1109\/MGRS.2022.3170092","article-title":"Full-resolution quality assessment of pansharpening: Theoretical and hands-on approaches","volume":"10","author":"Arienzo","year":"2022","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"3230","DOI":"10.1109\/TGRS.2007.901007","article-title":"Improving Component Substitution Pansharpening Through Multivariate Regression of MS + Pan Data","volume":"45","author":"Aiazzi","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_55","unstructured":"Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., and Selva, M. (2003, January 22\u201323). An MTF-based spectral distortion minimizing model for pan-sharpening of very high resolution multispectral images of urban areas. Proceedings of the 2003 2nd GRSS\/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas, Berlin, Germany."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"3461","DOI":"10.1080\/014311600750037499","article-title":"Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details","volume":"21","author":"Liu","year":"2000","journal-title":"Int. J. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/19\/4816\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:04:47Z","timestamp":1760130287000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/19\/4816"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,3]]},"references-count":56,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["rs15194816"],"URL":"https:\/\/doi.org\/10.3390\/rs15194816","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,3]]}}}