{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:44:04Z","timestamp":1760197444515,"version":"build-2065373602"},"reference-count":57,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2018,5,19]],"date-time":"2018-05-19T00:00:00Z","timestamp":1526688000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2017YFC1500902"],"award-info":[{"award-number":["2017YFC1500902"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Finance Science and Technology project of Hainan Province, China","award":["418MS113"],"award-info":[{"award-number":["418MS113"]}]},{"name":"Youth Foundation of Director of the Institution of Remote Sensing and Digital Earth, Chinese Academy of Sciences","award":["Y6SJ1100CX"],"award-info":[{"award-number":["Y6SJ1100CX"]}]},{"name":"Key Research Program of the Chinese Academy of Sciences","award":["ZDRW-ZS-2016-6-1-3"],"award-info":[{"award-number":["ZDRW-ZS-2016-6-1-3"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Fusion of high spatial resolution (HSR) multispectral (MS) and panchromatic (PAN) images has become a research focus with the development of HSR remote sensing technology. In order to reduce the spectral distortions of fused images, current image fusion methods focus on optimizing the approach used to extract spatial details from the PAN band, or on the optimization of the models employed during the injection of spatial details into the MS bands. Due to the resolution difference between the MS and PAN images, there is a large amount of mixed pixels (MPs) existing in the upsampled MS images. The fused versions of these MPs remain mixed, although they may correspond to pure PAN pixels. This is one of the reasons for spectral distortions of fusion products. However, few methods consider spectral distortions introduced by the mixed fused spectra of MPs. In this paper, an image fusion method based on image segmentation was proposed to improve the fused spectra of MPs. The MPs were identified and then fused to be as close as possible to the spectra of pure pixels, in order to reduce spectral distortions caused by fused MPs and improve the quality of fused products. A fusion experiment, using three HSR datasets recorded by WorldView-2, WorldView-3 and GeoEye-1, respectively, was implemented to compare the proposed method with several other state-of-the-art fusion methods, such as haze- and ratio-based (HR), adaptive Gram\u2013Schmidt (GSA) and smoothing filter-based intensity modulation (SFIM). Fused products generated at the original and degraded scales were assessed using several widely-used quantitative quality indexes. Visual inspection was also employed to compare the fused images produced using the original datasets. It was demonstrated that the proposed method offers the lowest spectral distortions and more sharpened boundaries between different image objects than other methods, especially for boundaries between vegetation and non-vegetation objects.<\/jats:p>","DOI":"10.3390\/rs10050790","type":"journal-article","created":{"date-parts":[[2018,5,21]],"date-time":"2018-05-21T04:07:30Z","timestamp":1526875650000},"page":"790","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["An Image Fusion Method Based on Image Segmentation for High-Resolution Remotely-Sensed Imagery"],"prefix":"10.3390","volume":"10","author":[{"given":"Hui","family":"Li","sequence":"first","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China"},{"name":"Hainan Key Laboratory Earth Observation, Sanya 572029, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Linhai","family":"Jing","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China"},{"name":"Hainan Key Laboratory Earth Observation, Sanya 572029, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2257-8749","authenticated-orcid":false,"given":"Yunwei","family":"Tang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7191-0082","authenticated-orcid":false,"given":"Liming","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, No. 9 Dengzhuang South Road, Haidian District, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,5,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3012","DOI":"10.1109\/TGRS.2007.904923","article-title":"Comparison of pansharpening algorithms: Outcome of the 2006 GRS-S data-fusion contest","volume":"45","author":"Alparone","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1882","DOI":"10.1109\/LSP.2016.2618776","article-title":"Image fusion with convolutional sparse representation","volume":"23","author":"Liu","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1109\/TGRS.2016.2606324","article-title":"Sensitivity of pansharpening methods to temporal and instrumental changes between multispectral and panchromatic data sets","volume":"55","author":"Aiazzi","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, H., Jing, L., Tang, Y., and Ding, H. (2018). An improved pansharpening method for misaligned panchromatic and multispectral data. Sensors, 18.","DOI":"10.3390\/s18020557"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"818002","DOI":"10.1117\/12.898770","article-title":"Multispectral pansharpening based on pixel modulation: State of the art and new results","volume":"Volume 8180","author":"Bruzzone","year":"2011","journal-title":"Proceedings of SPIE, Image and Signal Processing for Remote Sensing XVII"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2376","DOI":"10.1109\/TGRS.2005.856106","article-title":"Introduction of sensor spectral response into image fusion methods: Application to wavelet-based methods","volume":"43","author":"Otazu","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2464","DOI":"10.1109\/78.157290","article-title":"The discrete wavelet transform: Wedding the a trous and mallat algorithms","volume":"40","author":"Shensa","year":"1992","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1109\/TSMCB.2012.2198810","article-title":"Adjustable model-based fusion method for multispectral and panchromatic images","volume":"42","author":"Zhang","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. Part B Cybern."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"6828","DOI":"10.3390\/rs70606828","article-title":"A new look at image fusion methods from a bayesian perspective","volume":"7","author":"Zhang","year":"2015","journal-title":"Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4779","DOI":"10.1109\/TGRS.2012.2230332","article-title":"Remote sensing image fusion via sparse representations over learned dictionaries","volume":"51","author":"Li","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2827","DOI":"10.1109\/TGRS.2012.2213604","article-title":"A sparse image fusion algorithm with application to pan-sharpening","volume":"51","author":"Zhu","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1016\/j.neucom.2014.07.003","article-title":"Sparse representation with learned multiscale dictionary for image fusion","volume":"148","author":"Yin","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"738","DOI":"10.1109\/TGRS.2010.2067219","article-title":"A new pan-sharpening method using a compressed sensing technique","volume":"49","author":"Li","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1109\/LGRS.2014.2347955","article-title":"Remote sensing image fusion using ripplet transform and compressed sensing","volume":"12","author":"Ghahremani","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"179","DOI":"10.3724\/SP.J.1004.2013.00179","article-title":"A new variational model for panchromatic and multispectral image fusion","volume":"39","author":"Ma","year":"2013","journal-title":"Acta Autom. Sin."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1484","DOI":"10.1080\/01431161.2015.1014973","article-title":"Pan-sharpening of multi-spectral images using a new variational model","volume":"36","author":"Zhang","year":"2015","journal-title":"Int. J. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Pohl, C., and Van Genderen, J.L. (2017). Remote Sensing Image Fusion: A Practical Guide, CRC Press.","DOI":"10.1201\/9781315370101"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1109\/LGRS.2008.2012003","article-title":"A comparison between global and context-adaptive pansharpening of multispectral images","volume":"6","author":"Aiazzi","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_19","first-page":"604","article-title":"Generalized model for remotely sensed data pixel-level fusion and its implement technology","volume":"14","author":"Yang","year":"2009","journal-title":"J. Image Graph."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/S1566-2535(01)00036-7","article-title":"A new look at IHS-like image fusion methods","volume":"2","author":"Tu","year":"2001","journal-title":"Inf. Fusion"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2300","DOI":"10.1109\/TGRS.2002.803623","article-title":"Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis","volume":"40","author":"Aiazzi","year":"2002","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.isprsjprs.2013.09.007","article-title":"Bi-cubic interpolation for shift-free pan-sharpening","volume":"86","author":"Aiazzi","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_23","unstructured":"Schowengerdt, R.A. (1997). Remote Sensing, Models and Methods for Image Processing, Academic Press."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1212","DOI":"10.1109\/36.763276","article-title":"Unmixing-based multisensor multiresolution image fusion","volume":"37","author":"Zhukov","year":"1999","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.rse.2014.09.012","article-title":"A comparison of STARFM and an unmixing-based algorithm for Landsat and MODIS data fusion","volume":"156","author":"Gevaert","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_26","unstructured":"Zhukov, B., Oertel, D., and Lanzl, F. (1995, January 10\u201314). A multiresolution multisensor technique for satellite remote sensing. Proceedings of the International Geoscience and Remote Sensing Symposium (IGARSS), Firenze, Italy."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1695","DOI":"10.1080\/01431161003621601","article-title":"Spectral change directions of multispectral subpixels in image fusion","volume":"32","author":"Jing","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1080\/19479832.2016.1180326","article-title":"Model-based view at multi-resolution image fusion methods and quality assessment measures","volume":"7","author":"Palubinskas","year":"2016","journal-title":"Int. J. Image Data Fusion"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2434","DOI":"10.1080\/01431161.2011.611183","article-title":"An image fusion method based on object-oriented classification","volume":"33","author":"Jing","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, H., Jing, L., Wang, L., and Cheng, Q. (2016). Improved pansharpening with un-mixing of mixed ms sub-pixels near boundaries between vegetation and non-vegetation objects. Remote Sens., 8.","DOI":"10.3390\/rs8020083"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1080\/17538947.2015.1111950","article-title":"A novel image-fusion method based on the un-mixing of mixed ms sub-pixels regarding high-resolution dsm","volume":"9","author":"Li","year":"2016","journal-title":"Int. J. Digit. Earth"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Gaetano, R., Masi, G., Scarpa, G., and Poggi, G. (2012, January 22\u201327). A marker-controlled watershed segmentation: Edge, mark and fill. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Munich, Germany.","DOI":"10.1109\/IGARSS.2012.6351713"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2987","DOI":"10.1109\/TGRS.2014.2367129","article-title":"Marker-controlled watershed-based segmentation of multiresolution remote sensing images","volume":"53","author":"Gaetano","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A computational approach to edge detection","volume":"8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1016\/j.isprsjprs.2011.02.006","article-title":"Unsupervised image segmentation evaluation and refinement using a multi-scale approach","volume":"66","author":"Johnson","year":"2011","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"907","DOI":"10.1016\/S0031-3203(99)00154-5","article-title":"An efficient watershed algorithm based on connected components","volume":"33","author":"Bieniek","year":"2000","journal-title":"Pattern Recognit."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2119","DOI":"10.1080\/01431160802549260","article-title":"Two improvement schemes of pan modulation fusion methods for spectral distortion minimization","volume":"30","author":"Jing","year":"2009","journal-title":"Int. J. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1016\/0034-4257(88)90019-3","article-title":"An improved dark-object subtraction technique for atmospheric scattering correction of multispectral data","volume":"24","author":"Chavez","year":"1988","journal-title":"Remote Sens. Environ."},{"key":"ref_39","first-page":"1025","article-title":"Image-based atmospheric corrections revisited and improved","volume":"62","author":"Chavez","year":"1996","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/0034-4257(92)90076-V","article-title":"Evaluation of simplified procedures for retrieval of land surface reflectance factors from satellite sensor output","volume":"41","author":"Moran","year":"1992","journal-title":"Remote Sens. Environ."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"5039","DOI":"10.1109\/JSTARS.2017.2730221","article-title":"Improvement of a pansharpening method taking into account haze","volume":"10","author":"Li","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"4967","DOI":"10.1080\/01431161.2012.657361","article-title":"Image misalignment caused by decimation in image fusion evaluation","volume":"33","author":"Jing","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2565","DOI":"10.1109\/TGRS.2014.2361734","article-title":"A critical comparison among pansharpening algorithms","volume":"33","author":"Vivone","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"5734","DOI":"10.1109\/TGRS.2015.2429691","article-title":"Pansharpening with multiscale normalized nonlocal means filter: A two-step approach","volume":"53","author":"Yin","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1007\/s11045-016-0421-4","article-title":"High spectral quality pansharpening approach based on MTF-matched filter banks","volume":"27","author":"Hallabia","year":"2016","journal-title":"Multidimens. Syst. Signal Process."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"3230","DOI":"10.1109\/TGRS.2007.901007","article-title":"Improving component substitution pansharpening through multivariate regression of MS + PAN data","volume":"45","author":"Aiazzi","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"3461","DOI":"10.1080\/014311600750037499","article-title":"Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details","volume":"21","author":"Liu","year":"2000","journal-title":"Int. J. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1080\/01431160110088772","article-title":"Liu \u2018Smoothing filter-based intensity modulation: A spectral preserve image fusion technique for improving spatial details\u2019","volume":"23","author":"Wald","year":"2002","journal-title":"Int. J. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"591","DOI":"10.14358\/PERS.72.5.591","article-title":"MTF-tailored multiscale fusion of high-resolution MS and Pan imagery","volume":"72","author":"Aiazzi","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_50","first-page":"49","article-title":"Fusion of high spatial and spectral resolution images: The ARSIS concept and its implementation","volume":"66","author":"Ranchin","year":"2000","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_51","unstructured":"Wald, L. (2000, January 26\u201328). Quality of high resolution synthesised images: Is there a simple criterion?. Proceedings of the International Conference on Fusion Earth Data, Sophia Antipolis, France."},{"key":"ref_52","unstructured":"Yuhas, R., Goetz, A., and Boardman, J. (1992, January 15). Discrimination among semi-arid landscape endmembers using the spectral angle mapper (SAM) algorithm. Proceedings of the Summaries of the Third Annual JPL Airborne Geoscience Workshop, Pasadena, CA, USA."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1109\/97.995823","article-title":"A universal image quality index","volume":"9","author":"Wang","year":"2002","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1109\/LGRS.2004.836784","article-title":"A global quality measurement of pan-sharpened multispectral imagery","volume":"1","author":"Alparone","year":"2004","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"662","DOI":"10.1109\/LGRS.2009.2022650","article-title":"Hypercomplex quality assessment of multi\/hyperspectral images","volume":"6","author":"Garzelli","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"193","DOI":"10.14358\/PERS.74.2.193","article-title":"Multispectral and panchromatic data fusion assessment without reference","volume":"74","author":"Alparone","year":"2008","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_57","unstructured":"Updike, T., and Comp, C. (2010). Radiometric Use of Worldview-2 Imagery, Digital Globe."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/5\/790\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:05:04Z","timestamp":1760195104000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/5\/790"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,19]]},"references-count":57,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2018,5]]}},"alternative-id":["rs10050790"],"URL":"https:\/\/doi.org\/10.3390\/rs10050790","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2018,5,19]]}}}