{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T13:00:40Z","timestamp":1773838840709,"version":"3.50.1"},"reference-count":51,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2019,6,17]],"date-time":"2019-06-17T00:00:00Z","timestamp":1560729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Jianhua Liu","award":["200000"],"award-info":[{"award-number":["200000"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The efficient and accurate application of deep learning in the remote sensing field largely depends on the pre-processing technology of remote sensing images. Particularly, image fusion is the essential way to achieve the complementarity of the panchromatic band and multispectral bands in high spatial resolution remote sensing images. In this paper, we not only pay attention to the visual effect of fused images, but also focus on the subsequent application effectiveness of information extraction and feature recognition based on fused images. Based on the WorldView-3 images of Tongzhou District of Beijing, we apply the fusion results to conduct the experiments of object recognition of typical urban features based on deep learning. Furthermore, we perform a quantitative analysis for the existing pixel-based mainstream fusion methods of IHS (Intensity-Hue Saturation), PCS (Principal Component Substitution), GS (Gram Schmidt), ELS (Ehlers), HPF (High-Pass Filtering), and HCS (Hyper spherical Color Space) from the perspectives of spectrum, geometric features, and recognition accuracy. The results show that there are apparent differences in visual effect and quantitative index among different fusion methods, and the PCS fusion method has the most satisfying comprehensive effectiveness in the object recognition of land cover (features) based on deep learning.<\/jats:p>","DOI":"10.3390\/rs11121435","type":"journal-article","created":{"date-parts":[[2019,6,17]],"date-time":"2019-06-17T11:24:45Z","timestamp":1560770685000},"page":"1435","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["The Comparison of Fusion Methods for HSRRSI Considering the Effectiveness of Land Cover (Features) Object Recognition Based on Deep Learning"],"prefix":"10.3390","volume":"11","author":[{"given":"Shiran","family":"Song","sequence":"first","affiliation":[{"name":"School of Geomatics and Urban Spatial Information, Beijing University of Civil Engineering and Architecture, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0130-9520","authenticated-orcid":false,"given":"Jianhua","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Information, Beijing University of Civil Engineering and Architecture, Beijing 100044, China"},{"name":"Key Laboratory for Urban Geomatics of National Administration of Surveying, Mapping and Geoinformation, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Heng","family":"Pu","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Information, Beijing University of Civil Engineering and Architecture, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuan","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Information, Beijing University of Civil Engineering and Architecture, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingyan","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Geomatics and Urban Spatial Information, Beijing University of Civil Engineering and Architecture, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,6,17]]},"reference":[{"key":"ref_1","first-page":"1050","article-title":"Progress and future of remote sensing data fusion","volume":"20","author":"Zhang","year":"2016","journal-title":"J. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.isprsjprs.2018.04.003","article-title":"Multi-scale object detection in remote sensing imagery with convolutional neural networks","volume":"145","author":"Deng","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrelland, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for object detection and semantic segmentation. Proceedings of the Conference on Computer Vision and Pattern Recognition (IEEE 2014), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_4","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Adv. Neural Inf. Process. Syst., 25."},{"key":"ref_5","first-page":"640","article-title":"Fully Convolutional Networks for Semantic Segmentation","volume":"39","author":"Long","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.rse.2018.04.050","article-title":"Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery","volume":"214","author":"Bo","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhou, P., Han, J., Cheng, G., and Zhang, B. (2019). Learning Compact and Discriminative Stacked Autoencoder for Hyperspectral Image Classification. IEEE Trans. Geosci. Remote Sens.","DOI":"10.1109\/TGRS.2019.2893180"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"7405","DOI":"10.1109\/TGRS.2016.2601622","article-title":"Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images","volume":"54","author":"Cheng","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/j.isprsjprs.2018.02.014","article-title":"Multi-class geospatial object detection based on a position-sensitive balancing framework for high spatial resolution remote sensing imagery","volume":"138","author":"Zhong","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.isprsjprs.2014.10.002","article-title":"Multi-class geospatial object detection and geographic image classification based on collection of part detectors","volume":"98","author":"Cheng","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1579","DOI":"10.1109\/TGRS.2017.2765364","article-title":"Recent Advances on Spectral-Spatial Hyperspectral Image Classification: An Overview and New Guidelines","volume":"56","author":"He","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.isprsjprs.2017.10.006","article-title":"Spectral-spatial classification of hyperspectral imagery with cooperative game","volume":"135","author":"Zhao","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"7152","DOI":"10.1109\/TGRS.2017.2743110","article-title":"Robust Joint Sparse Representation Based on Maximum Correntropy Criterion for Hyperspectral Image Classification","volume":"55","author":"Peng","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2509","DOI":"10.1109\/TGRS.2016.2645703","article-title":"Dimensionality Reduction and Classification of Hyperspectral Images Using Ensemble Discriminative Local Metric Learning","volume":"55","author":"Dong","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"7351","DOI":"10.1109\/TGRS.2016.2600522","article-title":"Class-Specific Sparse Multiple Kernel Learning for Spectral\u2013Spatial Hyperspectral Image Classification","volume":"54","author":"Liu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3083","DOI":"10.1109\/TGRS.2015.2511197","article-title":"Multiple Morphological Component Analysis Based Decomposition for Remote Sensing Image Classification","volume":"54","author":"Xu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Xiaoyong, B., Chen, C., Yan, X., and Du, Q. (2016). Robust Hyperspectral Image Classification by Multi-Layer Spatial-Spectral Sparse Representations. Remote Sens., 8.","DOI":"10.3390\/rs8120985"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1592","DOI":"10.1109\/TGRS.2014.2345739","article-title":"Multiple Feature Learning for Hyperspectral Image Classification","volume":"53","author":"Li","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5795","DOI":"10.3390\/rs6065795","article-title":"Spectral-Spatial Classification of Hyperspectral Image Based on Kernel Extreme Learning Machine","volume":"6","author":"Chen","year":"2014","journal-title":"Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"6712","DOI":"10.1109\/TGRS.2018.2841823","article-title":"Ecploring Hierchical Convolutional Features for Hyperspectral Image Classification","volume":"56","author":"Cheng","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","first-page":"1325","article-title":"Reconstruction of multispatial, multispectral image data using spatial frequency content","volume":"46","author":"Schowengerdt","year":"1980","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_22","unstructured":"Hallada, W.A., and Cox, S. (1983, January 9\u201313). Image sharpening for mixed spatial and spectral resolution satellite systems. Proceedings of the International Symposium on Remote Sensing of the Environment, Ann Arbor, MI, USA."},{"key":"ref_23","first-page":"311","article-title":"Integration of the spot panchromatic channel into its multispectral mode for image sharpness enhancement","volume":"51","author":"Cliche","year":"1985","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1391","DOI":"10.1109\/TGRS.2005.846874","article-title":"A comparative analysis of image fusion methods","volume":"43","author":"Wang","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1301","DOI":"10.1109\/TGRS.2007.912448","article-title":"Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics","volume":"46","author":"Thomas","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","unstructured":"Aiazzi, B., Alparone, L., Baronti, S., Garzelli, A., and Selva, M. (2012). 25 years of pansharpening: A critical review and new developments. Signal and Image Processing for Remote Sensing, CRC Press. [2nd ed.]."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/0034-4257(87)90088-5","article-title":"Color enhancement of highly correlated images. II. Channel ratio and \u201cchromaticity\u201d transformation techniques","volume":"22","author":"Gillespie","year":"1987","journal-title":"Remote Sens. Environ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/S1566-2535(01)00036-7","article-title":"A new look at IHS-like image fusion methods","volume":"2","author":"Tu","year":"2001","journal-title":"Inf. Fusion"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2300","DOI":"10.1109\/TGRS.2002.803623","article-title":"Context-driven fusion of high spatial and spectral resolution images based on oversampled multiresolution analysis","volume":"40","author":"Aiazzi","year":"2002","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2376","DOI":"10.1109\/TGRS.2005.856106","article-title":"Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods","volume":"43","author":"Otazu","year":"2005","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1693","DOI":"10.1109\/TSMCB.2012.2198810","article-title":"Adjustable Model-Based Fusion Method for Multispectral and Panchromatic Images","volume":"42","author":"Zhang","year":"2012","journal-title":"IEEE Trans. Syst. Man Cybern. Part B Cybern."},{"key":"ref_32","first-page":"1332","article-title":"Maximum a posteriori fusion method based on gradient consistency constraint for multispectral\/panchromatic remote sensing images","volume":"34","author":"Meng","year":"2014","journal-title":"Spectrosc. Spectr. Anal."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"629","DOI":"10.1109\/LGRS.2011.2177063","article-title":"A Practical Compressed Sensing-Based Pan-Sharpening Method","volume":"9","author":"Jiang","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_35","unstructured":"Ehlers, M., Ehlers, M., Posa, F., Kaufmann, H.J., Michel, U., and De Carolis, G. (2004). Remote Sensing for Environmental Monitoring, GIS Applications, and Geology IV, Society of Photo Optical."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"93","DOI":"10.2747\/1548-1603.44.2.93","article-title":"Image Fusion Using the Ehlers Spectral Characteristics Preservation Algorithm","volume":"44","author":"Klonus","year":"2007","journal-title":"Gisci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1779","DOI":"10.1080\/01431160802639525","article-title":"Merging hyperspectral and panchromatic image data: Qualitative and quantitative analysis","volume":"30","author":"Cetin","year":"2009","journal-title":"Int. J. Remote Sens."},{"key":"ref_38","first-page":"265","article-title":"Comparison of Three Different Methods to Merge Multiresolution and Multispectral Data: Landsat TM and SPOT Panchromatic","volume":"57","author":"Chavez","year":"1991","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_39","first-page":"1075","article-title":"Multispectral Imagery Band Sharpening Study","volume":"62","author":"Vrabel","year":"1996","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_40","first-page":"1376","article-title":"Comparison of Two Methods of Fusing Remote Sensing Images with Fidelity of Spectral Information","volume":"9","author":"Jun","year":"2004","journal-title":"J. Image Graph."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1672","DOI":"10.1109\/TGRS.2006.869923","article-title":"A new intensity-hue-saturation fusion approach to image fusion with a tradeoff parameter","volume":"44","author":"Choi","year":"2006","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/0924-2716(93)90069-Y","article-title":"Extraction of spectral information from Landsat TM data and merger with SPOT panchromatic imagery\u2014A contribution to the study of geological structures","volume":"48","author":"Besnus","year":"1993","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ji, S., Wei, S., and Lu, M. (2018). A scale robust convolutional neural network for automatic building extraction from aerial and satellite imagery. Int. J. Remote Sens.","DOI":"10.1080\/01431161.2018.1528024"},{"key":"ref_44","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 8\u201310). Going Deeper with Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Las Condes, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2016). Region-Based Convolutional Networks for Accurate Object Detection and Segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 38.","DOI":"10.1109\/TPAMI.2015.2437384"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Trans. Pattern Anal. Mach. Intell, 39.","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Zou, Q., Ni, L., Zhang, T., and Wang, Q. (2015). Deep Learning Based Feature Selection for Remote Sensing Scene Classification. IEEE Geosci. Remote Sens. Lett., 12.","DOI":"10.1109\/LGRS.2015.2475299"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010, January 2\u20135). Bag-of-visual-words and spatial extensions for land-use classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, San Jose, CA, USA.","DOI":"10.1145\/1869790.1869829"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/12\/1435\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:59:08Z","timestamp":1760187548000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/12\/1435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,6,17]]},"references-count":51,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2019,6]]}},"alternative-id":["rs11121435"],"URL":"https:\/\/doi.org\/10.3390\/rs11121435","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,6,17]]}}}