{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T13:27:57Z","timestamp":1767706077865,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T00:00:00Z","timestamp":1631577600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>This paper presents a near real-time automatic sub-pixel registration method of high-resolution panchromatic (PAN) and multispectral (MS) images using a graphics processing unit (GPU). In the first step, the method uses differential geo-registration to enable accurate geographic registration of PAN and MS images. Differential geo-registration normalizes PAN and MS images to the same direction and scale. There are also some residual misalignments due to the geometrical configuration of the acquisition instruments. These residual misalignments mean the PAN and MS images still have deviations after differential geo-registration. The second step is to use differential rectification with tiny facet primitive to eliminate possible residual misalignments. Differential rectification corrects the relative internal geometric distortion between PAN and MS images. The computational burden of these two steps is large, and traditional central processing unit (CPU) processing takes a long time. Due to the natural parallelism of the differential methods, these two steps are very suitable for mapping to a GPU for processing, to achieve near real-time processing while ensuring processing accuracy. This paper used GaoFen-6, GaoFen-7, ZiYuan3-02 and SuperView-1 satellite data to conduct an experiment. The experiment showed that our method\u2019s processing accuracy is within 0.5 pixels. The automatic processing time of this method is about 2.5 s for 1 GB output data in the NVIDIA GeForce RTX 2080Ti, which can meet the near real-time processing requirements for most satellites. The method in this paper can quickly achieve high-precision registration of PAN and MS images. It is suitable for different scenes and different sensors. It is extremely robust to registration errors between PAN and MS.<\/jats:p>","DOI":"10.3390\/rs13183674","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T23:34:11Z","timestamp":1631662451000},"page":"3674","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Near Real-Time Automatic Sub-Pixel Registration of Panchromatic and Multispectral Images for Pan-Sharpening"],"prefix":"10.3390","volume":"13","author":[{"given":"Guangqi","family":"Xie","sequence":"first","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}]},{"given":"Mi","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1914-9430","authenticated-orcid":false,"given":"Zhiqi","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"},{"name":"School of Computer Science, Hubei University of Technology, Wuhan 430068, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2797-1937","authenticated-orcid":false,"given":"Shao","family":"Xiang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}]},{"given":"Luxiao","family":"He","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.isprsjprs.2020.11.001","article-title":"A Review of Image Fusion Techniques for Pan-Sharpening of High-Resolution Satellite Imagery","volume":"171","author":"Samadzadegan","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2286","DOI":"10.1016\/j.asr.2014.08.024","article-title":"An Object-Level Strategy for Pan-Sharpening Quality Assessment of High-Resolution Satellite Imagery","volume":"54","author":"DadrasJavan","year":"2014","journal-title":"Adv. Space Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1109\/MGRS.2015.2440094","article-title":"Hyperspectral Pansharpening: A Review","volume":"3","author":"Loncan","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/s12517-015-2015-0","article-title":"Quality Assessment of Pan-Sharpening Methods in High-Resolution Satellite Images Using Radiometric and Geometric Index","volume":"9","author":"Hasanlou","year":"2016","journal-title":"Arab. J. Geosci."},{"unstructured":"Haydn, R., Dalke, G.W., Henkel, J., and Bare, J. (1982, January 19\u201325). Application of the IHS Color Transform to the Processing of Multisensor Data and Image Enhancement. Proceedings of the International Symposium on Remote Sensing of Arid and Semi-Arid Lands, Cairo, Egypt.","key":"ref_5"},{"key":"ref_6","first-page":"339","article-title":"Extracting Spectral Contrast in Landsat Thematic Mapper Image Data Using Selective Principal Component Analysis","volume":"55","author":"Kwarteng","year":"1989","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_7","first-page":"1325","article-title":"Reconstruction of Multispatial, Multispectral Image Data Using Spatial Frequency Content","volume":"46","author":"Schowengerdt","year":"1980","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_8","first-page":"295","article-title":"Comparison of Three Different Methods to Merge Multiresolution and Multispectral Data: Landsat TM and SPOT Panchromatic","volume":"57","author":"Chavez","year":"1991","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3461","DOI":"10.1080\/014311600750037499","article-title":"Smoothing Filter-Based Intensity Modulation: A Spectral Preserve Image Fusion Technique for Improving Spatial Details","volume":"21","author":"Liu","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1080\/01431160110088772","article-title":"Liu\u2019Smoothing Filter-Based Intensity Modulation: A Spectral Preserve Image Fusion Technique for Improving Spatial Details\u2019","volume":"23","author":"Wald","year":"2002","journal-title":"Int. J. Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"Jiang, D., Zhuang, D., Huang, Y., and Fu, J. (2011). Survey of Multispectral Image Fusion Techniques in Remote Sensing Applications. Image Fusion Its Appl., 1\u201323.","key":"ref_11","DOI":"10.5772\/10548"},{"key":"ref_12","first-page":"2690","article-title":"Pixel-Level Image Fusion Using Brovey Transforme and Wavelet Transform","volume":"2","author":"Mandhare","year":"2013","journal-title":"Int. J. Adv. Res. Electr. Electron. Instrum. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/19479832.2020.1845244","article-title":"A Context-Driven Pansharpening Method Using Superpixel Based Texture Analysis","volume":"12","author":"Hallabia","year":"2021","journal-title":"Int. J. Image Data Fusion"},{"unstructured":"Klonus, S., and Ehlers, M. (2009, January 6\u20139). Performance of Evaluation Methods in Image Fusion. Proceedings of the 2009 12th International Conference on Information Fusion, Seattle, WA, USA.","key":"ref_14"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"6102","DOI":"10.1109\/JSTARS.2021.3086877","article-title":"A Benchmarking Protocol for Pansharpening: Dataset, Preprocessing, and Quality Assessment","volume":"14","author":"Vivone","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1109\/MGRS.2020.3019315","article-title":"A New Benchmark Based on Recent Advances in Multispectral Pansharpening","volume":"9","author":"Vivone","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4984","DOI":"10.1109\/TGRS.2020.3019835","article-title":"Two Stages Pan-Sharpening Details Injection Approach Based on Very Deep Residual Networks","volume":"59","author":"Benzenati","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5549","DOI":"10.1109\/TGRS.2019.2900419","article-title":"Pan-Sharpening Using an Efficient Bidirectional Pyramid Network","volume":"57","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"Dong, W., Yang, Y., Qu, J., Xie, W., and Li, Y. (2021). Fusion of Hyperspectral and Panchromatic Images Using Generative Adversarial Network and Image Segmentation. IEEE Trans. Geosci. Remote Sens., 1\u201313.","key":"ref_19","DOI":"10.1109\/TGRS.2021.3078711"},{"doi-asserted-by":"crossref","unstructured":"Lei, D., Chen, H., Zhang, L., and Li, W. (2021). NLRNet: An Efficient Nonlocal Attention ResNet for Pansharpening. IEEE Trans. Geosci. Remote Sens., 1\u201313.","key":"ref_20","DOI":"10.1109\/TGRS.2021.3067097"},{"doi-asserted-by":"crossref","unstructured":"Qu, J., Shi, Y., Xie, W., Li, Y., Wu, X., and Du, Q. (2021). MSSL: Hyperspectral and Panchromatic Images Fusion via Multiresolution Spatial-Spectral Feature Learning Networks. IEEE Trans. Geosci. Remote Sens., 1\u201313.","key":"ref_21","DOI":"10.1109\/TGRS.2021.3066374"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/978-3-031-02256-2","article-title":"Image Fusion in Remote Sensing: Conventional and Deep Learning Approaches","volume":"10","author":"Azarang","year":"2021","journal-title":"Synth. Lect. Image Video Multimed. Process."},{"unstructured":"Parkinson, C.L., Ward, A., and King, M.D. (2006). Earth Science Reference Handbook: A Guide to NASA\u2019s Earth Science Program and Earth Observing Satellite Missions. Natl. Aeronaut. Space Adm., 277.","key":"ref_23"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1186\/1687-6180-2011-79","article-title":"A Survey of Classical Methods and New Trends in Pansharpening of Multispectral Images","volume":"2011","author":"Amro","year":"2011","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12518-016-0179-2","article-title":"Evaluation of Pan-Sharpening Methods for Spatial and Spectral Quality","volume":"9","author":"Pushparaj","year":"2017","journal-title":"Appl. Geomat."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"062082","DOI":"10.1088\/1757-899X\/768\/6\/062082","article-title":"Sharpening the Multispectral GF-2 Imagery Using the Modified Intensity-Hue-Saturation Approach: The Different Spectral Settings in Comparison","volume":"768","author":"Liu","year":"2020","journal-title":"IOP Conf. Ser. Mater. Sci. Eng."},{"doi-asserted-by":"crossref","unstructured":"Liu, Q., Zhou, H., Xu, Q., Liu, X., and Wang, Y. (2020). PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening. IEEE Trans. Geosci. Remote Sens., 1\u201316.","key":"ref_27","DOI":"10.1109\/TGRS.2020.3035561"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2231","DOI":"10.1109\/TGRS.2020.3007884","article-title":"Pan-Sharpening via Multiscale Dynamic Convolutional Neural Network","volume":"59","author":"Hu","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1301","DOI":"10.1109\/TGRS.2007.912448","article-title":"Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics","volume":"46","author":"Thomas","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.isprsjprs.2019.03.002","article-title":"Robust Registration for Remote Sensing Images by Combining and Localizing Feature- and Area-Based Methods","volume":"151","author":"Feng","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"doi-asserted-by":"crossref","unstructured":"Hu, J., He, Z., and Wu, J. (2019). Deep Self-Learning Network for Adaptive Pansharpening. Remote Sens., 11.","key":"ref_31","DOI":"10.3390\/rs11202395"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1049\/el:20082477","article-title":"Multi-Spectral Remote Image Registration Based on SIFT","volume":"44","author":"Yi","year":"2008","journal-title":"Electron. Lett."},{"doi-asserted-by":"crossref","unstructured":"Vural, M.F., Yardimci, Y., and Temizel, A. (2009, January 12\u201317). Registration of Multispectral Satellite Images with Orientation-Restricted SIFT. Proceedings of the 2009 IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa.","key":"ref_33","DOI":"10.1109\/IGARSS.2009.5417801"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"838","DOI":"10.1016\/j.cageo.2007.10.005","article-title":"A Fast and Fully Automatic Registration Approach Based on Point Features for Multi-Source Remote-Sensing Images","volume":"34","author":"Yu","year":"2008","journal-title":"Comput. Geosci."},{"doi-asserted-by":"crossref","unstructured":"Teke, M., and Temizel, A. (2010, January 23\u201326). Multi-Spectral Satellite Image Registration Using Scale-Restricted SURF. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","key":"ref_35","DOI":"10.1109\/ICPR.2010.565"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1166\/sl.2014.3129","article-title":"Registration of High Resolution Satellite Images Base on Scale-Orientation Restricted KAZE","volume":"12","author":"Yuan","year":"2014","journal-title":"Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"045007","DOI":"10.1117\/1.JRS.10.045007","article-title":"Image Matching Using Structural Similarity and Geometric Constraint Approaches on Remote Sensing Images","volume":"10","author":"Guo","year":"2016","journal-title":"J. Appl. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1494","DOI":"10.1109\/TGRS.2007.892599","article-title":"Robust Multispectral Image Registration Using Mutual-Information Models","volume":"45","author":"Kern","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.isprsjprs.2016.05.012","article-title":"Correction of ZY-3 Image Distortion Caused by Satellite Jitter via Virtual Steady Reimaging Using Attitude Data","volume":"119","author":"Wang","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.isprsjprs.2017.05.004","article-title":"Image Jitter Detection and Compensation Using a High-Frequency Angular Displacement Method for Yaogan-26 Remote Sensing Satellite","volume":"130","author":"Wang","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.isprsjprs.2017.01.004","article-title":"On-Orbit Geometric Calibration and Geometric Quality Assessment for the High-Resolution Geostationary Optical Satellite GaoFen4","volume":"125","author":"Wang","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"4391","DOI":"10.3390\/rs6054391","article-title":"On-Orbit Geometric Calibration Model and Its Applications for High-Resolution Optical Satellite Imagery","volume":"6","author":"Wang","year":"2014","journal-title":"Remote Sens."},{"unstructured":"Xing, S., Tan, B., Li, J., Xu, Q., and Geng, Z. (2003). Approach of High Accurate Multisensor Remote Sensing Images Registration Based on Tiny Facet Primitive. J. Pla Inst. Surv. Mapp., 2.","key":"ref_43"},{"doi-asserted-by":"crossref","unstructured":"Alcaras, E., Parente, C., and Vallario, A. (2021). Automation of Pan-Sharpening Methods for Pl\u00e9iades Images Using GIS Basic Functions. Remote Sens., 13.","key":"ref_44","DOI":"10.3390\/rs13081550"},{"doi-asserted-by":"crossref","unstructured":"Wieland, M., and Martinis, S. (2019). A Modular Processing Chain for Automated Flood Monitoring from Multi-Spectral Satellite Data. Remote Sens., 11.","key":"ref_45","DOI":"10.3390\/rs11192330"},{"key":"ref_46","first-page":"1347","article-title":"A Comprehensive Study of the Rational Function Model for Photogrammetric Processing","volume":"67","author":"Tao","year":"2001","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"59","DOI":"10.14358\/PERS.69.1.59","article-title":"Block Adjustment of High-Resolution Satellite Images Described by Rational Polynomials","volume":"69","author":"Grodecki","year":"2003","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1016\/j.isprsjprs.2005.11.001","article-title":"Sensor Orientation via RPCs","volume":"60","author":"Fraser","year":"2006","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1177\/074171367802800202","article-title":"Perspective Transformation","volume":"28","author":"Mezirow","year":"1978","journal-title":"Adult Educ."},{"doi-asserted-by":"crossref","unstructured":"Benesty, J., Chen, J., Huang, Y., and Cohen, I. (2009). Pearson correlation coefficient. Noise Reduction in Speech Processing, Springer.","key":"ref_50","DOI":"10.1007\/978-3-642-00296-0_5"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"111756","DOI":"10.1016\/j.rse.2020.111756","article-title":"Comparison of Microwave Remote Sensing and Land Surface Modeling for Surface Soil Moisture Climatology Estimation","volume":"242","author":"Dong","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"193","DOI":"10.14358\/PERS.74.2.193","article-title":"Multispectral and Panchromatic Data Fusion Assessment without Reference","volume":"74","author":"Alparone","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1109\/JSTSP.2011.2104938","article-title":"A Theoretical Analysis of the Effects of Aliasing and Misregistration on Pansharpened Imagery","volume":"5","author":"Baronti","year":"2011","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A Universal Image Quality Index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/18\/3674\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:02:47Z","timestamp":1760166167000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/18\/3674"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,14]]},"references-count":54,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["rs13183674"],"URL":"https:\/\/doi.org\/10.3390\/rs13183674","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2021,9,14]]}}}