{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T05:58:12Z","timestamp":1768975092865,"version":"3.49.0"},"reference-count":50,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2017,10,24]],"date-time":"2017-10-24T00:00:00Z","timestamp":1508803200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Major Program of High Resolution Earth Observation System","award":["30-Y20A37-9003-15\/17"],"award-info":[{"award-number":["30-Y20A37-9003-15\/17"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41501489"],"award-info":[{"award-number":["41501489"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Science and Technology Support Program of China","award":["2015BAB05B05-02"],"award-info":[{"award-number":["2015BAB05B05-02"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The segmentation of a high spatial resolution remote sensing image is a critical step in geographic object-based image analysis (GEOBIA). Evaluating the performance of segmentation without ground truth data, i.e., unsupervised evaluation, is important for the comparison of segmentation algorithms and the automatic selection of optimal parameters. This unsupervised strategy currently faces several challenges in practice, such as difficulties in designing effective indicators and limitations of the spectral values in the feature representation. This study proposes a novel unsupervised evaluation method to quantitatively measure the quality of segmentation results to overcome these problems. In this method, multiple spectral and spatial features of images are first extracted simultaneously and then integrated into a feature set to improve the quality of the feature representation of ground objects. The indicators designed for spatial stratified heterogeneity and spatial autocorrelation are included to estimate the properties of the segments in this integrated feature set. These two indicators are then combined into a global assessment metric as the final quality score. The trade-offs of the combined indicators are accounted for using a strategy based on the Mahalanobis distance, which can be exhibited geometrically. The method is tested on two segmentation algorithms and three testing images. The proposed method is compared with two existing unsupervised methods and a supervised method to confirm its capabilities. Through comparison and visual analysis, the results verified the effectiveness of the proposed method and demonstrated the reliability and improvements of this method with respect to other methods.<\/jats:p>","DOI":"10.3390\/s17102427","type":"journal-article","created":{"date-parts":[[2017,10,24]],"date-time":"2017-10-24T10:39:18Z","timestamp":1508841558000},"page":"2427","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["A Novel Unsupervised Segmentation Quality Evaluation Method for Remote Sensing Images"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1633-6652","authenticated-orcid":false,"given":"Han","family":"Gao","sequence":"first","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2257-8749","authenticated-orcid":false,"given":"Yunwei","family":"Tang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Linhai","family":"Jing","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3565-1773","authenticated-orcid":false,"given":"Hui","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haifeng","family":"Ding","sequence":"additional","affiliation":[{"name":"Key Laboratory of Digital Earth Science, Institute of Remote Sensing and Digital Earth, Chinese Academy of Sciences, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,10,24]]},"reference":[{"key":"ref_1","first-page":"12","article-title":"What\u2019s wrong with pixels? Some recent developments interfacing remote sensing and GIS","volume":"6","author":"Blaschke","year":"2001","journal-title":"GeoBIT\/GIS"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2825","DOI":"10.1080\/01431161003745608","article-title":"Multi-scale geobia with very high spatial resolution digital aerial imagery: Scale, texture and image objects","volume":"32","author":"Kim","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_3","unstructured":"Marpu, P.R. (2009). Geographic object-based image analysis. Univ. Freiberg."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"799","DOI":"10.14358\/PERS.72.7.799","article-title":"Object-based detailed vegetation classification with airborne high spatial resolution remote sensing imagery","volume":"72","author":"Yu","year":"2006","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.isprsjprs.2009.06.004","article-title":"Object based image analysis for remote sensing","volume":"65","author":"Blaschke","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.isprsjprs.2013.09.014","article-title":"Geographic object-based image analysis\u2014Towards a new paradigm","volume":"87","author":"Blaschke","year":"2014","journal-title":"ISPRS  J. Photogramm. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.isprsjprs.2003.10.002","article-title":"Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information","volume":"58","author":"Benz","year":"2004","journal-title":"ISPRS  J. Photogramm. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/S0304-3800(03)00139-X","article-title":"A multi-scale segmentation\/object relationship modelling methodology for landscape analysis","volume":"168","author":"Burnett","year":"2003","journal-title":"Ecol. Model."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1016\/j.isprsjprs.2011.02.006","article-title":"Unsupervised image segmentation evaluation and refinement using a multi-scale approach","volume":"66","author":"Johnson","year":"2011","journal-title":"ISPRS  J. Photogramm. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3747","DOI":"10.1080\/01431161003777189","article-title":"Optimal region growing segmentation and its effect on classification accuracy","volume":"32","author":"Gao","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Neubert, M., Herold, H., and Meinel, G. (2008). Assessing image segmentation quality\u2014Concepts, methods and application. Lect. Notes Geoinf. Cartogr., 769\u2013784.","DOI":"10.1007\/978-3-540-77058-9_42"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, H., Fritts, J.E., and Goldman, S.A. (2008). Image Segmentation Evaluation: A Survey of Unsupervised Methods, Elsevier Science Inc.","DOI":"10.1016\/j.cviu.2007.08.003"},{"key":"ref_13","unstructured":"Zhang, Y.J. (2001, January 13\u201316). A review of recent evaluation methods for image segmentation. Proceedings of the 2001 Sixth International Symposium on Signal Processing and ITS Applications, Kuala Lumpur, Malaysia."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"289","DOI":"10.14358\/PERS.76.3.289","article-title":"Accuracy assessment measures for object-based image segmentation goodness","volume":"76","author":"Clinton","year":"2010","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_15","unstructured":"Martin, D.R. (2003, January 6\u20139). An empirical approach to grouping and segmentation. Proceedings of the International Symposium on Physical Design, Monterey, CA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1773","DOI":"10.1109\/TIP.2005.854491","article-title":"Toward a generic evaluation of image segmentation","volume":"14","author":"Cardoso","year":"2005","journal-title":"IEEE Trans. Image Process. A Publ. IEEE Signal Process. Soc."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2953","DOI":"10.1080\/01431160500057764","article-title":"Quality assessment for geo-spatial objects derived from remotely sensed data","volume":"26","author":"Molenaar","year":"2005","journal-title":"Int. J. Remote Sens."},{"key":"ref_18","first-page":"311","article-title":"The comparison index: A tool for assessing the accuracy of image segmentation","volume":"9","author":"Lymburner","year":"2007","journal-title":"Int. J. Appl. Earth Observ. Geoinf."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1080\/14498596.2010.487850","article-title":"Enhanced evaluation of image segmentation results","volume":"55","author":"Marpu","year":"2010","journal-title":"J. Spat. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1232","DOI":"10.1109\/TGRS.2009.2029570","article-title":"A novel protocol for accuracy assessment in classification of very high resolution images","volume":"48","author":"Persello","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.isprsjprs.2012.01.007","article-title":"Discrepancy measures for selecting optimal combination of parameter values in object-based image analysis","volume":"68","author":"Liu","year":"2012","journal-title":"ISPRS  J. Photogramm. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.isprsjprs.2013.11.006","article-title":"Optimizing multi-resolution segmentation scale using empirical methods: Exploring the sensitivity of the supervised discrepancy measure Euclidean distance 2 (ED2)","volume":"87","author":"Witharana","year":"2014","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.isprsjprs.2015.01.009","article-title":"Segmentation quality evaluation using region-based precision and recall measures for remote sensing images","volume":"102","author":"Zhang","year":"2015","journal-title":"ISPRS  J. Photogramm. Remote Sens"},{"key":"ref_24","first-page":"217","article-title":"Unsupervised performance evaluation of image segmentation","volume":"2006","author":"Chabrier","year":"2006","journal-title":"Eur. J. Adv. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1016\/j.patrec.2005.12.012","article-title":"Image segmentation based on merging of sub-optimal segmentations","volume":"27","author":"Pichel","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/S0734-189X(85)90153-7","article-title":"Image segmentation techniques","volume":"29","author":"Haralick","year":"1985","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2937","DOI":"10.1080\/01431160500057749","article-title":"Complexity metrics to quantify semantic accuracy in segmented landsat images","volume":"26","author":"Beurs","year":"2005","journal-title":"Int. J. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3035","DOI":"10.1080\/01431160600617194","article-title":"Parameter selection for region-growing image segmentation algorithms using spatial autocorrelation","volume":"27","author":"Espindola","year":"2006","journal-title":"Int. J. Remote Sens."},{"key":"ref_29","unstructured":"Kim, M., Madden, M., and Warner, T. (2008). Estimation of Optimal Image Object Size for the Segmentation of Forest Stands with Multispectral Ikonos Imagery, Springer."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"819","DOI":"10.14358\/PERS.75.7.819","article-title":"Forest type mapping using object-specific texture measures from multispectral ikonos imagery: Segmentation quality and image classification issues","volume":"75","author":"Kim","year":"2009","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_31","unstructured":"Radoux, J., and Defourny, P. (2008). Quality Assessment of Segmentation Results Devoted to Object-Based Classification, Springer."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1109\/LGRS.2009.2026915","article-title":"Salient remote sensing image segmentation based on rate-distortion measure","volume":"6","author":"Faur","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1080\/01431160902894475","article-title":"Segmentation performance evaluation for object-based remotely sensed image analysis","volume":"31","author":"Corcoran","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1109\/LGRS.2011.2163056","article-title":"An unsupervised evaluation method for remotely sensed imagery segmentation","volume":"9","author":"Zhang","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1936","DOI":"10.1109\/JSTARS.2015.2424457","article-title":"Unsupervised quantification of under- and over-segmentation for object-based remote sensing image analysis","volume":"8","author":"Passat","year":"2015","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Shi, R., Ngan, K.N., and Li, S. (2017, January 16\u201319). Objectness based unsupervised object segmentation quality evaluation. Proceedings of the Seventh International Conference on Information Science and Technology, Da Nang, Vietnam.","DOI":"10.1109\/ICIST.2017.7926766"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"B\u00f6ck, S., Immitzer, M., and Atzberger, C. (2017). On the objectivity of the objective function\u2014Problems with unsupervised segmentation evaluation based on global score and a possible remedy. Remote Sens., 9.","DOI":"10.3390\/rs9080769"},{"key":"ref_38","unstructured":"Tomasi, C., and Manduchi, R. (1998, January 7). Bilateral filtering for gray and color images. Proceedings of the Sixth International Conference on Computer Vision, Bombay, India."},{"key":"ref_39","first-page":"959","article-title":"Image representation using 2D gabor wavelet","volume":"18","author":"Lee","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1080\/13658810802443457","article-title":"Geographical detectors-based health risk assessment and its application in the neural tube defects study of the Heshun Region, China","volume":"24","author":"Wang","year":"2010","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"250","DOI":"10.1016\/j.ecolind.2016.02.052","article-title":"A measure of spatial stratified heterogeneity","volume":"67","author":"Wang","year":"2016","journal-title":"Ecol. Indic."},{"key":"ref_42","unstructured":"Isaaks, E., and Srivastava, R.M. (2000). Quantitative Geography: Perspectives on Spatial Data Analysis, Sage Publications."},{"key":"ref_43","first-page":"49","article-title":"On the generalised distance in statistics","volume":"2","author":"Mahalanobis","year":"1936","journal-title":"Proc. Natl. Inst. Sci. USA"},{"key":"ref_44","first-page":"38","article-title":"Entropy-based objective evaluation method for image segmentation","volume":"5307","author":"Zhang","year":"2003","journal-title":"SPIE"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1016\/S0167-8655(98)00052-X","article-title":"Quantitative evaluation of color image segmentation results","volume":"19","author":"Borsotti","year":"1998","journal-title":"Pattern Recognit. Lett."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/BF01908075","article-title":"Comparing partitions","volume":"2","author":"Hubert","year":"1985","journal-title":"J. Classif."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1080\/01621459.1971.10482356","article-title":"Objective criteria for the evaluation of clustering methods","volume":"66","author":"Rand","year":"1971","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_48","unstructured":"Baatz, M., and Sch\u00e4pe, A. (, January January). An optimization approach for high quality multi-scale image segmentation. Proceedings of the Beitr\u00e4ge zum AGIT-Symposium, karlsruhe, Germany."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1109\/34.1000236","article-title":"A robust approach toward feature space analysis","volume":"24","author":"Comaniciu","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","unstructured":"Laben, C.A., and Brower, B.V. (2000). Process for Enhancing the Spatial Resolution of Multispectral Imagery Using Pan-Sharpening. (US6011875 A), U.S. Patent."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/10\/2427\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:48:18Z","timestamp":1760208498000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/10\/2427"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,24]]},"references-count":50,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2017,10]]}},"alternative-id":["s17102427"],"URL":"https:\/\/doi.org\/10.3390\/s17102427","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,24]]}}}