{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T02:55:48Z","timestamp":1790132148588,"version":"4.0.1"},"reference-count":60,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2017,3,30]],"date-time":"2017-03-30T00:00:00Z","timestamp":1490832000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41372322"],"award-info":[{"award-number":["41372322"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41172269"],"award-info":[{"award-number":["41172269"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41330643"],"award-info":[{"award-number":["41330643"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>In this paper, we propose a methodology for validating landslide susceptibility results in the Pinggu district (Beijing, China). A landslide inventory including 169 landslides was prepared, and eight factors correlated to landslides (lithology, tectonic faults, topographic elevation, slope gradient, aspect, slope curvature, land use, and road network) were processed, integrating two techniques, namely the frequency ratio (FR) and the certainty factor (CF), in a geographic information system (GIS) environment. The area under the curve (success rate curve and prediction curve) analysis was used to evaluate model compatibility and predictability. Validation results indicated that the values of the area under the curve for the FR model and the CF model were 0.769 and 0.768, respectively. Considering spatial correlation, an alternative complementary method for validating landslide susceptibility maps was introduced. The spatially approximate maps could be discriminated from their matrices which carry structural information, and the structural similarity index (SSI) was then proposed to quantify the similarity. As a specific example, the SSI value of the FR (74.15%) scored higher than that of the CF model (69.36%), demonstrating its promise in validating different landslide susceptibility maps. These results show that the FR model outperforms the CF model in producing a landslide susceptibility map in the study area.<\/jats:p>","DOI":"10.3390\/ijgi6040103","type":"journal-article","created":{"date-parts":[[2017,3,30]],"date-time":"2017-03-30T09:29:15Z","timestamp":1490866155000},"page":"103","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":54,"title":["Validation of Spatial Prediction Models for Landslide Susceptibility Mapping by Considering Structural Similarity"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2229-9221","authenticated-orcid":false,"given":"Xiaolong","family":"Deng","sequence":"first","affiliation":[{"name":"Institute of Geology and Geophysics, Chinese Academy of Sciences, Beijing 100029, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lihui","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Geology and Geophysics, Chinese Academy of Sciences, Beijing 100029, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yufang","family":"Tan","sequence":"additional","affiliation":[{"name":"Institute of Geology and Geophysics, Chinese Academy of Sciences, Beijing 100029, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,3,30]]},"reference":[{"key":"ref_1","first-page":"209","article-title":"Recommendations for the quantitative analysis of landslide risk","volume":"73","author":"Corominas","year":"2014","journal-title":"Bull. Eng. Geol. Environ."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ba, Q.Q., Chen, Y.M., Deng, S.S., Wu, Q.J., Yang, J.X., and Zhang, J.Y. (2017). An improved information value model based on gray clustering for landslide susceptibility mapping. ISPRS Int. J. Geo-Inf., 6.","DOI":"10.3390\/ijgi6010018"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.cageo.2014.08.001","article-title":"A GIS-based extended fuzzy multi-criteria evaluation for landslide susceptibility mapping","volume":"73","author":"Feizizadeh","year":"2014","journal-title":"Comput. Geosci."},{"key":"ref_4","first-page":"319","article-title":"Landslide susceptibility mapping for the Urmia Lake basin, Iran: A multi-criteria evaluation approach using GIS","volume":"7","author":"Feizizadeh","year":"2013","journal-title":"Int. J. Environ. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.rse.2014.05.013","article-title":"Optimization of landslide conditioning factors using very high-resolution airborne laser scanning (LiDAR) data at catchment scale","volume":"152","author":"Jebur","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s10346-015-0557-6","article-title":"Spatial prediction models for shallow landslide hazards: A comparative assessment of the efficacy of support vector machines, artificial neural networks, kernel logistic regression, and logistic modes tree","volume":"13","author":"Tuan","year":"2016","journal-title":"Landslides"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1007\/s10346-013-0392-6","article-title":"Regional landslide susceptibility zoning with considering the aggregation of landslide points and the weights of factors","volume":"11","author":"Wang","year":"2014","journal-title":"Landslides"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3","DOI":"10.5194\/nhess-2-3-2002","article-title":"Impact of mapping errors on the reliability of landslide hazard maps","volume":"2","author":"Ardizzone","year":"2002","journal-title":"Nat. Hazards Earth Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1080\/17445647.2013.852142","article-title":"Landslide inventory map of north-eastern Calabria (South Italy)","volume":"10","author":"Conforti","year":"2014","journal-title":"J. Maps"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1016\/j.enggeo.2005.08.004","article-title":"Landslides in Sado Island of Japan: Part II. GIS-based susceptibility mapping with comparisons of results from two methods and verification","volume":"81","author":"Ayalew","year":"2005","journal-title":"Eng. Geol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.geomorph.2006.09.023","article-title":"Comparing landslide inventory maps","volume":"94","author":"Galli","year":"2008","journal-title":"Geomorphology"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.rse.2013.05.002","article-title":"The effect of spatial variability on the sensitivity of passive microwave measurement to snow water equivalent","volume":"136","author":"Durand","year":"2013","journal-title":"Remote Sens. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"33","DOI":"10.5194\/isprs-archives-XLI-B8-33-2016","article-title":"Spatial resolution effects of digital terrain models on landslide susceptibility analysis","volume":"XLI-B8","author":"Chang","year":"2016","journal-title":"ISPRS-Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s40677-015-0016-7","article-title":"Effect of landslide factor combinations on the prediction accuracy of landslide susceptibility maps in the Blue Nile Gorge of Central Ethiopia","volume":"2","author":"Meten","year":"2015","journal-title":"Geoenviron. Disasters"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1117\/1.JRS.7.073561","article-title":"Landslide susceptibility analysis using light detection and ranging-derived digital elevation models and logistic regression models: A case study in Mizunami City, Japan","volume":"7","author":"Wang","year":"2013","journal-title":"J. Appl. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1016\/j.envsoft.2009.10.016","article-title":"Landslide susceptibility assessment and factor effect analysis: Backpropagation artificial neural networks and their comparison with frequency ratio and bivariate logistic regression modelling.","volume":"25","author":"Pradhan","year":"2010","journal-title":"Environ. Model. Softw."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.cageo.2011.04.012","article-title":"An easy-to-use MATLAB program (MamLand) for the assessment of landslide susceptibility using a Mamdani fuzzy algorithm","volume":"38","author":"Akgun","year":"2012","journal-title":"Comput. Geosci."},{"key":"ref_18","first-page":"1389","article-title":"Probabilistic prediction models for landslide hazard mapping","volume":"65","author":"Chung","year":"1999","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4075","DOI":"10.1080\/01431161.2010.484433","article-title":"Landslide hazard and risk analyses at a landslide prone catchment area using statistical based geospatial model","volume":"32","author":"Pradhan","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1007\/s10346-013-0437-x","article-title":"Slope stability analysis using a physically based model: A case study from a Luoi district in Thua Thien-Hue province, Vietnam","volume":"11","author":"Thanh","year":"2014","journal-title":"Landslide"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1023\/B:NHAZ.0000007172.62651.2b","article-title":"Validation of spatial prediction models for landslide hazard mapping","volume":"30","author":"Chung","year":"2003","journal-title":"Nat. Hazards"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1023\/B:NHAZ.0000007201.80743.fc","article-title":"Validation of landslide susceptibility maps: Example and applications from a case study in Northern Spain","volume":"30","author":"Remondo","year":"2004","journal-title":"Nat. Hazards"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1002\/(SICI)1096-9837(199906)24:6<537::AID-ESP965>3.0.CO;2-6","article-title":"Verification of landslide susceptibility mapping: A case study","volume":"24","author":"Femandez","year":"1999","journal-title":"Earth Surf. Landf."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1007\/s002679910020","article-title":"Comparing landslide maps: A case study in the upper Tiber river basin, Central Italy","volume":"25","author":"Guzzetti","year":"2000","journal-title":"Environ. Manag."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recogn. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.enggeo.2009.12.004","article-title":"Techniques for evaluating the performance of landslide susceptibility models","volume":"111","author":"Frattini","year":"2010","journal-title":"Eng. Geol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.jseaes.2012.10.005","article-title":"Landslide susceptibility mapping at Golestan Province, Iran: A comparison between frequency ratio, Dempster-Shafer, and weights-of-evidence models","volume":"61","author":"Mohammady","year":"2012","journal-title":"J. Asian Earth Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12665-015-5233-6","article-title":"Landslide susceptibility mapping using an ensemble statistical index (Wi) and adaptive neuro-fuzzy inference system (ANFIS) model at alborz mountains (Iran)","volume":"75","author":"Aghdam","year":"2016","journal-title":"Environ. Earth Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.jseaes.2012.12.014","article-title":"A comparative study of frequency ratio, weights of evidence and logistic regression methods for landslide susceptibility mapping: Sultan Mountains, SW Turkey","volume":"64","author":"Ozdemir","year":"2013","journal-title":"J. Asian Earth Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.catena.2012.04.001","article-title":"Spatial prediction of landslide hazards in Hoa Binh province (Vietnam): A comparative assessment of the efficacy of evidential belief functions and fuzzy logic models","volume":"96","author":"Pradhan","year":"2012","journal-title":"Catena"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1023\/B:NHAZ.0000007097.42735.9e","article-title":"Use of geomorphological information in indirect landslide susceptibility assessment","volume":"30","author":"Rengers","year":"2003","journal-title":"Nat. Hazards"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2727","DOI":"10.1007\/s12517-012-0569-7","article-title":"A compressive evaluation of heuristic and bivariate statistical modelling for landslide susceptibility mappings in Ghurmi-Dhad Khola, east Nepal","volume":"6","author":"Bijukchhen","year":"2013","journal-title":"Arab. J. Geosci."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Sassa, K., Canuti, P., and Yin, Y. (2014). Landslide Science for a Safer Geoenvironment, Springer.","DOI":"10.1007\/978-3-319-05050-8"},{"key":"ref_34","unstructured":"Beijing Geological and Mineral Bureau (1995). The Expedition Report of Regional Geology Survey (Dahuashan Sheet, Pinggu Sheet, 1:50 000)."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1007\/s10064-010-0332-9","article-title":"Landslide susceptibility mapping in a semi-arid mountain environment: An example from the southern slopes of Sierra Nevada (Granada, Spain)","volume":"70","author":"Irigaray","year":"2011","journal-title":"Bull. Eng. Geol. Environ."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1125","DOI":"10.1016\/j.cageo.2008.08.007","article-title":"Landslide susceptibility mapping using frequency ratio, logistic regression, artificial neural networks and their comparison: A case study from Kat landslides (Tokat-Turkey)","volume":"35","author":"Yilmaz","year":"2009","journal-title":"Comput. Geosci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1007\/BF02910278","article-title":"The effect of spatial resolution on the accuracy of landslide susceptibility mapping: A case study in Boun, Korea","volume":"8","author":"Lee","year":"2004","journal-title":"Geosci. J."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.geomorph.2009.12.015","article-title":"Rockfall susceptibility map for Athinios port, Santorini Island, Greece","volume":"118","author":"Andreas","year":"2010","journal-title":"Geomorphology"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1007\/s11069-011-9844-2","article-title":"Landslide susceptibility analysis in the Hoa Binh province of Vietnam using statistical index and logistic regression","volume":"59","author":"Lofman","year":"2011","journal-title":"Nat. Hazards"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1111\/j.1467-8306.1963.tb00429.x","article-title":"Generalization in statistical mapping","volume":"53","author":"Jenks","year":"1963","journal-title":"Ann. Assoc. Am. Geogr."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.1007\/s12665-016-5919-4","article-title":"GIS-based modeling of rainfall-induced landslides using data mining-based functional trees classifier with AdaBoost, Bagging, and MultiBoost ensemble frameworks","volume":"75","author":"Ho","year":"2016","journal-title":"Environ. Earth Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"431","DOI":"10.5194\/nhess-3-435-2003","article-title":"Rockfall hazard mapping along a mountainous road in Switzerland using a GIS-based parameter rating approach","volume":"3","author":"Baillifard","year":"2003","journal-title":"Nat. Hazards Earth Syst. Sci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.geomorph.2004.06.010","article-title":"The application of GIS-based logistic regression for landslide susceptibility mapping in the Kakuda-Yahiko Mountains, Central Japan","volume":"65","author":"Ayalew","year":"2005","journal-title":"Geomorphology"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2161","DOI":"10.1007\/s12665-011-1196-4","article-title":"GIS-based landslide susceptibility mapping using bivariate statistical analysis in Devrek (Zonguldak-Turkey)","volume":"65","author":"Yilmaz","year":"2012","journal-title":"Environ. Earth Sci."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12665-015-5194-9","article-title":"Application of analytic hierarchy process model for landslide susceptibility mapping in the Gangu County, Gansu Province, China","volume":"75","author":"Wu","year":"2016","journal-title":"Environ. Earth Sci."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1016\/j.geomorph.2006.12.036","article-title":"Predicting landslides for risk analysis-spatial models tested by a cross-validation technique","volume":"94","author":"Chung","year":"2008","journal-title":"Geomorphology"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s10346-006-0047-y","article-title":"Landslide hazard mapping at Selangor, Malaysia using frequency ratio and logistic regression models","volume":"4","author":"Lee","year":"2007","journal-title":"Landslides"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2351","DOI":"10.1007\/s12517-012-0532-7","article-title":"Application of weights-of-evidence and certainty factor models and their comparison in landslide susceptibility mapping at Haraz watershed, Iran","volume":"6","author":"Pourghasemi","year":"2013","journal-title":"Arab. J. Geosci."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1007\/s12040-012-0230-6","article-title":"Landslide susceptibility analysis using Probabilistic Certainty Factor Approach: A case study on Tevankarai stream watershed, India","volume":"121","author":"Sujatha","year":"2012","journal-title":"J. Earth Syst. Sci."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/s00267-003-0077-3","article-title":"Application of likelihood ratio and logistic regression model for landslide susceptibility mapping using GIS","volume":"34","author":"Lee","year":"2004","journal-title":"Environ. Manag."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1007\/s00254-005-1228-z","article-title":"Probabilistic landslide susceptibility and factor effect analysis","volume":"47","author":"Lee","year":"2005","journal-title":"Environ. Geol."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1007\/s12524-010-0020-z","article-title":"Landslide susceptibility mapping of a catchment area using frequency ratio, fuzzy logic and multiple logistic regression approaches","volume":"38","author":"Pradhan","year":"2010","journal-title":"J. Indian Soc. Remote Sens."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1016\/0025-5564(75)90047-4","article-title":"A model of inexact reasoning in medicine","volume":"23","author":"Shortliffe","year":"1975","journal-title":"Math. Biosci."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.catena.2012.05.005","article-title":"Landslide susceptibility mapping using index of entropy and conditional probability models in GIS: Safarood Basin, Iran","volume":"97","author":"Pourghasemi","year":"2012","journal-title":"Catena"},{"key":"ref_55","first-page":"122","article-title":"The representation of geosciences information for data integration","volume":"2","author":"Chung","year":"1993","journal-title":"Non-Renew. Resour."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1023\/A:1008001724538","article-title":"Slope instability zonation: A comparison between certainty factor and fuzzy Dempster\u2013Shafer approaches","volume":"17","author":"Binaghi","year":"1998","journal-title":"Nat. Hazards"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1126\/science.3287615","article-title":"Measuring the accuracy of diagnostic systems","volume":"240","author":"Swets","year":"1988","journal-title":"Science"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1095","DOI":"10.1007\/s002540100310","article-title":"Statistical analyses of landslide susceptibility at Yongin, Korea","volume":"40","author":"Lee","year":"2001","journal-title":"Environ. Geol."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"617","DOI":"10.14358\/PERS.70.5.617","article-title":"An integrated approach for landslide susceptibility mapping using remote sensing and GIS","volume":"70","author":"Sarkar","year":"2004","journal-title":"Photogramm. Eng. Remote Sens."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/6\/4\/103\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:31:35Z","timestamp":1760207495000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/6\/4\/103"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,3,30]]},"references-count":60,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2017,4]]}},"alternative-id":["ijgi6040103"],"URL":"https:\/\/doi.org\/10.3390\/ijgi6040103","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,3,30]]}}}