{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,20]],"date-time":"2026-09-20T10:16:36Z","timestamp":1789899396161,"version":"4.0.1"},"reference-count":55,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2013,6,26]],"date-time":"2013-06-26T00:00:00Z","timestamp":1372204800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>This paper applies different methods of map comparison to quantify the characteristics of three different land change models. The land change models used for simulation are termed as \u201cStochastic Markov (St_Markov)\u201d, \u201cCellular Automata Markov (CA_Markov)\u201d and \u201cMulti Layer Perceptron Markov (MLP_Markov)\u201d models. Various model validation techniques such as per category method, kappa statistics, components of agreement and disagreement, three map comparison and fuzzy methods have then been applied. A comparative analysis of the validation techniques has also been discussed. In all cases, it is found that \u201cMLP_Markov\u201d gives the best results among the three modeling techniques. Fuzzy set theory is the method that seems best able to distinguish areas of minor spatial errors from major spatial errors. Based on the outcome of this paper, it is recommended that scientists should try to use the Kappa, three map comparison and fuzzy methods for model validation. This paper facilitates communication among land change modelers, because it illustrates the range of results for a variety of model validation techniques and articulates priorities for future research.<\/jats:p>","DOI":"10.3390\/ijgi2030577","type":"journal-article","created":{"date-parts":[[2013,6,26]],"date-time":"2013-06-26T13:00:35Z","timestamp":1372251635000},"page":"577-597","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":81,"title":["Evaluation of Model Validation Techniques in Land Cover Dynamics"],"prefix":"10.3390","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5092-5528","authenticated-orcid":false,"given":"Bayes","family":"Ahmed","sequence":"first","affiliation":[{"name":"School of Geography & Environmental Science, Building 11, Clayton Campus, Monash University, Melbourne, Victoria 3800, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raquib","family":"Ahmed","sequence":"additional","affiliation":[{"name":"Department of Geography & Environmental Studies, University of Rajshahi, Rajshahi 6205, Bangladesh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuan","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Geography & Environmental Science, Building 11, Clayton Campus, Monash University, Melbourne, Victoria 3800, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2013,6,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/s00168-007-0138-2","article-title":"Comparing the input, output, and validation maps for several models of land change","volume":"42","author":"Pontius","year":"2008","journal-title":"Ann. Reg. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1319","DOI":"10.1007\/s10980-010-9519-5","article-title":"Diagnostic tools to evaluate a spatial land change projection along a gradient of an explanatory variable","volume":"25","author":"Chen","year":"2010","journal-title":"Landsc. Ecol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.envsoft.2004.11.013","article-title":"The map comparison kit","volume":"21","author":"Visser","year":"2006","journal-title":"Environ. Model. Softw."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1111\/j.1467-8306.2007.00577.x","article-title":"Accuracy assessment for a simulation model of Amazonian deforestation","volume":"97","author":"Pontius","year":"2007","journal-title":"Ann. Assn. Amer. Geogr."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1080\/13658810210157822","article-title":"Fuzzy set approach to assessing similarity of categorical maps","volume":"17","author":"Hagen","year":"2003","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/S0924-2716(99)00023-4","article-title":"Change detection assessment using fuzzy sets and remotely sensed data: An application of topographic map revision","volume":"54","author":"Metternicht","year":"1999","journal-title":"ISPRS J. Photogramm."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s10109-006-0018-9","article-title":"Categorical maps, comparisons, and confidence","volume":"8","author":"Boots","year":"2006","journal-title":"J. Geograph. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1080\/13658810802570317","article-title":"An improved Fuzzy Kappa statistic that accounts for spatial autocorrelation","volume":"23","year":"2009","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_9","unstructured":"Richter, O., and S\u00f6ndgerath, D. (1990). Parameter Estimation in Ecology: The Link between Data and Models, VCH Publishers."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Canham, C.D., Cole, J.J., and Lauenroth, W.K. (2004). Models in Ecosystem Science, Princeton University Press.","DOI":"10.1515\/9780691228846"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/j.envsoft.2009.09.005","article-title":"Assessing a predictive model of land change using uncertain data","volume":"25","author":"Pontius","year":"2010","journal-title":"Environ. Model. Softw."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1080\/13658810210148561","article-title":"Data quality and model complexity for regional scale soil erosion prediction","volume":"16","author":"Govers","year":"2002","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3275","DOI":"10.1080\/01431160902755346","article-title":"The impact of imperfect ground reference data on the accuracy of land cover change estimation","volume":"30","author":"Foody","year":"2009","journal-title":"Int. J. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/0304-3800(95)00152-2","article-title":"Testing ecological models: The meaning of validation","volume":"90","author":"Rykiel","year":"1996","journal-title":"Ecol. Model."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1367","DOI":"10.1016\/j.ecolmodel.2011.01.017","article-title":"Revisiting Kappa to account for change in the accuracy assessment of land-use change models","volume":"222","author":"Vliet","year":"2011","journal-title":"Ecol. Model."},{"key":"ref_16","unstructured":"Gervasi, O., Murgante, B., Lagana, A., Taniar, D., Mun, Y., and Gavrilova, M. (July, January 30). Map Comparison Methods for Comprehensive Assessment of Geosimulation Models. Proceedings of the International Conference on Computational Science and Its Applications, Perugia, Italy."},{"key":"ref_17","first-page":"521","article-title":"Inland wetland change detection using aircraft MSS data","volume":"53","author":"Jensen","year":"1987","journal-title":"Photogramm. Eng. Remote Sensing"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1080\/136588100750058715","article-title":"Hierarchical fuzzy pattern matching for the regional comparison of land use maps","volume":"15","author":"Power","year":"2001","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1068\/b240323","article-title":"The use of constrained cellular automata for high-resolution modelling of urban land use dynamics","volume":"24","author":"White","year":"1997","journal-title":"Environ. Plan."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1016\/j.landurbplan.2008.04.002","article-title":"Neutral models of landscape change as benchmarks in the assessment of model performance","volume":"86","author":"Lajoie","year":"2008","journal-title":"Landscape Urban Plan."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1111\/j.0006-341X.2001.00495.x","article-title":"Similarity indices for spatial ecological data","volume":"57","author":"Fewster","year":"2001","journal-title":"Biometrics"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/S0022-1694(00)00343-7","article-title":"Verification of precipitation in weather systems: Determination of systematic errors","volume":"239","author":"Ebert","year":"2000","journal-title":"J. Hydrol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1016\/S0198-9715(01)00015-1","article-title":"Using neural networks and GIS to forecast land use changes: A land transformation model","volume":"26","author":"Pijanowski","year":"2002","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1329","DOI":"10.1175\/1520-0493(1997)125<1329:WAFFV>2.0.CO;2","article-title":"Wavelets and field forecast verification","volume":"125","author":"Briggs","year":"1997","journal-title":"Mon. Weather Rev."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1016\/S0264-2751(03)00047-7","article-title":"Urban sustainability in developing countries\u2019 megacities: Modelling and predicting future urban growth in Lagos","volume":"20","author":"Barredo","year":"2003","journal-title":"Cities"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0304-3800(89)90057-4","article-title":"Methods to evaluate the performance of spatial simulation-models","volume":"48","author":"Turner","year":"1989","journal-title":"Ecol. Model"},{"key":"ref_27","unstructured":"(2002). Structure Plan, Master Plan and Detailed Area Plan (2001\u20132020) for Khulna City, Aqua-Sheltech Consortium, Khulna Development Authority."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3","DOI":"10.3390\/ijgi1010003","article-title":"Modeling urban land cover growth dynamics using multi-temporal satellite images: A case study of Dhaka, Bangladesh","volume":"1","author":"Ahmed","year":"2012","journal-title":"ISPRS Int. J. Geo-Inf."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1037","DOI":"10.1080\/0143116031000150004","article-title":"Accuracy analysis of remote sensing change detection by rule-based rationality evaluation with post-classification comparison","volume":"5","author":"Liu","year":"2004","journal-title":"Int. J. Remote Sens."},{"key":"ref_30","unstructured":"Eastman, J.R. (2009). IDRISI Taiga Guide to GIS and Image Processing, Manual Version 16.02 (Software), Clark Labs."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.laa.2003.12.041","article-title":"The life and work of A.A. Markov","volume":"386","author":"Basharin","year":"2004","journal-title":"Linear Algebr. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1006\/jema.2001.0509","article-title":"Land use change analysis in the Zhujiang Delta of China using satellite remote sensing, GIS and stochastic modelling","volume":"64","author":"Weng","year":"2002","journal-title":"J. Environ. Manage."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.physrep.2005.08.005","article-title":"Cellular automata models of road traffic","volume":"419","author":"Maerivoet","year":"2005","journal-title":"Phys. Rep."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.progress.2003.09.002","article-title":"GIS-based land-use suitability analysis: A critical overview","volume":"62","author":"Malczewski","year":"2004","journal-title":"Prog. Plan."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Recknagel, F. (2006). Ecological Informatics, Springer.","DOI":"10.1007\/3-540-28426-5"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1080\/014311697218700","article-title":"Introduction neural networks in remote sensing","volume":"18","author":"Atkinson","year":"1997","journal-title":"Int. J. Remote Sens."},{"key":"ref_37","unstructured":"Vliet, J.V. (2009). Map Comparison Kit 3 User Manual, Manual Version 3.2 (Software), Research Institute for Knowledge Systems BV."},{"key":"ref_38","first-page":"1011","article-title":"Quantification error versus location error in the comparison of categorical maps","volume":"66","author":"Pontius","year":"2000","journal-title":"Photogramm. Eng. Remote Sensing"},{"key":"ref_39","first-page":"1041","article-title":"Statistical methods to partition effects of quantity and location during comparison of categorical maps at multiple resolutions","volume":"68","author":"Pontius","year":"2002","journal-title":"Photogramm. Eng. Remote Sensing"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ. Psychol. Meas."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.3390\/rs4061544","article-title":"Land-use and land-cover mapping using a gradable classification method","volume":"4","author":"Kitada","year":"2012","journal-title":"Remote Sens."},{"key":"ref_42","first-page":"16","article-title":"Modelling spatio-temporal urban land cover growth dynamics using remote sensing and GIS techniques: A case study of Khulna City","volume":"4","author":"Ahmed","year":"2011","journal-title":"J. Bangladesh Instit. Plan."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2972","DOI":"10.3390\/s110302972","article-title":"Mapping the Philippines\u2019 mangrove forests using landsat imagery","volume":"11","author":"Long","year":"2011","journal-title":"Sensors"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"4407","DOI":"10.1080\/01431161.2011.552923","article-title":"Death to Kappa: Birth of quantity disagreement and allocation disagreement for accuracy assessment","volume":"32","author":"Pontius","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_45","unstructured":"Pontius, R.G., and Millones, M. (2008, January 1\u20136). Problems and Solutions for Kappa-Based Indices of Agreement. Proceedings of the Conference Studying, Modeling and Sense Making of Planet Earth, Mytilene, Greece."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1080\/00045608.2010.517742","article-title":"Comparison of three maps at multiple resolutions: A case study of land change simulation in Cho Don District, Vietnam","volume":"101","author":"Pontius","year":"2011","journal-title":"Ann. Assn. Amer. Geogr."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1080\/01431168908903939","article-title":"Digital change detection using remote-sensing data","volume":"10","author":"Singh","year":"1989","journal-title":"Int. J. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1080\/014311699213659","article-title":"Monitoring land-cover changes: A comparison of change detection techniques","volume":"20","author":"Mas","year":"1999","journal-title":"Int. J. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1559\/152304081784447318","article-title":"Urban change detection mapping using Landsat digital data","volume":"8","author":"Jensen","year":"1981","journal-title":"Amer. Cartographer"},{"key":"ref_50","first-page":"207","article-title":"A quantitative comparison of change detection algorithms for monitoring eelgrass from remotely sensed data","volume":"64","author":"Macleod","year":"1998","journal-title":"Photogramm. Eng. Remote Sensing"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/S0019-9958(65)90241-X","article-title":"Fuzzy sets","volume":"8","author":"Zadeh","year":"1965","journal-title":"Inf. Control"},{"key":"ref_52","unstructured":"Bandemer, H., and Gottwald, S. (1995). Fuzzy Sets, Fuzzy Logic, Fuzzy Methods with Applications, Wiley."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1080\/13658810010004689","article-title":"Formalizing fuzzy objects from uncertain classification results","volume":"15","author":"Cheng","year":"2001","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"3223","DOI":"10.1080\/01431160152558332","article-title":"A generalized confusion matrix for assessing area estimates from remotely sensed data","volume":"22","author":"Lewis","year":"2001","journal-title":"Int. J. Remote Sens."},{"key":"ref_55","unstructured":"Hagen-Zanker, A. (2006). Comparing Continuous Valued Raster Data: A Cross Disciplinary Literature Scan, Research Institute for Knowledge Systems BV."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/2\/3\/577\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:47:34Z","timestamp":1760219254000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/2\/3\/577"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,6,26]]},"references-count":55,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2013,9]]}},"alternative-id":["ijgi2030577"],"URL":"https:\/\/doi.org\/10.3390\/ijgi2030577","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,6,26]]}}}