{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T15:23:43Z","timestamp":1783178623089,"version":"3.54.6"},"reference-count":71,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2021,7,28]],"date-time":"2021-07-28T00:00:00Z","timestamp":1627430400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Thematic Excellence Programme","award":["TKP2020-NKA-04"],"award-info":[{"award-number":["TKP2020-NKA-04"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The availability of aerial and satellite imageries has greatly reduced the costs and time associated with gully mapping, especially in remote locations. Regardless, accurate identification of gullies from satellite images remains an open issue despite the amount of literature addressing this problem. The main objective of this work was to investigate the performance of support vector machines (SVM) and random forest (RF) algorithms in extracting gullies based on two resampling methods: bootstrapping and k-fold cross-validation (CV). In order to achieve this objective, we used PlanetScope data, acquired during the wet and dry seasons. Using the Normalized Difference Vegetation Index (NDVI) and multispectral bands, we also explored the potential of the PlanetScope image in discriminating gullies from the surrounding land cover. Results revealed that gullies had significantly different (p &lt; 0.001) spectral profiles from any other land cover class regarding all bands of the PlanetScope image, both in the wet and dry seasons. However, NDVI was not efficient in gully discrimination. Based on the overall accuracies, RF\u2019s performance was better with CV, particularly in the dry season, where its performance was up to 4% better than the SVM\u2019s. Nevertheless, class level metrics (omission error: 11.8%; commission error: 19%) showed that SVM combined with CV was more successful in gully extraction in the wet season. On the contrary, RF combined with bootstrapping had relatively low omission (16.4%) and commission errors (10.4%), making it the most efficient algorithm in the dry season. The estimated gully area was 88 \u00b1 14.4 ha in the dry season and 57.2 \u00b1 18.8 ha in the wet season. Based on the standard error (8.2 ha), the wet season was more appropriate in gully identification than the dry season, which had a slightly higher standard error (8.6 ha). For the first time, this study sheds light on the influence of these resampling techniques on the accuracy of satellite-based gully mapping. More importantly, this study provides the basis for further investigations into the accuracy of such resampling techniques, especially when using different satellite images other than the PlanetScope data.<\/jats:p>","DOI":"10.3390\/rs13152980","type":"journal-article","created":{"date-parts":[[2021,7,28]],"date-time":"2021-07-28T21:21:04Z","timestamp":1627507264000},"page":"2980","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":51,"title":["Classification Efficacy Using K-Fold Cross-Validation and Bootstrapping Resampling Techniques on the Example of Mapping Complex Gully Systems"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1865-7011","authenticated-orcid":false,"given":"Kwanele","family":"Phinzi","sequence":"first","affiliation":[{"name":"Department of Physical Geography and Geoinformatics, Faculty of Science and Technology, Doctoral School of Earth Sciences, University of Debrecen, Egyetem t\u00e9r 1, 4032 Debrecen, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1187-5892","authenticated-orcid":false,"given":"D\u00e1vid","family":"Abriha","sequence":"additional","affiliation":[{"name":"Department of Physical Geography and Geoinformatics, Faculty of Science and Technology, Doctoral School of Earth Sciences, University of Debrecen, Egyetem t\u00e9r 1, 4032 Debrecen, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2670-7384","authenticated-orcid":false,"given":"Szil\u00e1rd","family":"Szab\u00f3","sequence":"additional","affiliation":[{"name":"Department of Physical Geography and Geoinformatics, Faculty of Science and Technology, University of Debrecen, Egyetem t\u00e9r 1, 4032 Debrecen, Hungary"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"754","DOI":"10.13031\/2013.38945","article-title":"Mathematical simulation of the process of soil erosion by water","volume":"12","author":"Meyer","year":"1969","journal-title":"Trans. ASAE"},{"key":"ref_2","unstructured":"Morgan, R.P.C. (2009). Soil Erosion and Conservation, John Wiley & Sons."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-017-02142-7","article-title":"An assessment of the global impact of 21st century land use change on soil erosion","volume":"8","author":"Borrelli","year":"2017","journal-title":"Nat. Commun."},{"key":"ref_4","unstructured":"Omuto, C., Nachtergaele, F., and Rojas, R.V. (2013). State of the Art Report on Global and Regional Soil Information: Where Are We? Where To Go?, Food and Agriculture Organization of the United Nations."},{"key":"ref_5","first-page":"201","article-title":"Landscape degradation in the world and in Hungary","volume":"68","year":"2019","journal-title":"Hung. Geogr. Bull."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1080\/03736245.2020.1716838","article-title":"Soil erosion risk assessment in the Umzintlava catchment (T32E), Eastern Cape, South Africa, using RUSLE and random forest algorithm","volume":"103","author":"Phinzi","year":"2020","journal-title":"S. Afr. Geogr. J."},{"key":"ref_7","unstructured":"(2020, July 16). Strategic Plan for the Department of Agriculture, Pretoria, South Africa, Available online: https:\/\/www.gov.za\/sites\/default\/files\/gcis_document\/201409\/agricstratplan2007.pdf."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1111\/1475-4762.00100","article-title":"The nature, extent and causes of land degradation in South Africa: Legacy of the past, lessons for the future?","volume":"34","author":"Meadows","year":"2002","journal-title":"Area"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1080\/03736245.2000.9713709","article-title":"Accelerated erosion by piping in the Eastern Cape Province, South Africa","volume":"82","author":"Beckedahl","year":"2000","journal-title":"S. Afr. Geogr. J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1002\/ldr.509","article-title":"The relationship between land use and soil erosion in the communal lands near Peddie town, Eastern Cape, South Africa","volume":"14","author":"Kakembo","year":"2003","journal-title":"Land Degrad. Dev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2087","DOI":"10.1007\/s12665-011-1190-x","article-title":"Soil erosion risk assessment of the Keiskamma catchment, South Africa using GIS and remote sensing","volume":"65","author":"Mhangara","year":"2012","journal-title":"Environ. Earth Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1080\/0035919X.2019.1634652","article-title":"Land use\/land cover dynamics and soil erosion in the Umzintlava catchment (T32E), Eastern Cape, South Africa","volume":"74","author":"Phinzi","year":"2019","journal-title":"Trans. R. Soc. S. Afr."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.geomorph.2009.04.006","article-title":"Topographic thresholds in gully development on the hillslopes of communal areas in Ngqushwa Local Municipality, Eastern Cape, South Africa","volume":"110","author":"Kakembo","year":"2009","journal-title":"Geomorphology"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1002\/ldr.1083","article-title":"Factors controlling gully development: Comparing continuous and discontinuous gullies","volume":"23","author":"Sumner","year":"2012","journal-title":"Land Degrad. Dev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1080\/03736245.2012.742786","article-title":"Gully location mapping at a national scale for South Africa","volume":"94","author":"Mararakanye","year":"2012","journal-title":"S. Afr. Geogr. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/S0341-8162(02)00143-1","article-title":"Gully erosion and environmental change: Importance and research needs","volume":"50","author":"Poesen","year":"2003","journal-title":"Catena"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1080\/02723646.2016.1184079","article-title":"Spatial distribution and morphologic characteristics of gullies in the Black Soil Region of Northeast China: Hebei watershed","volume":"37","author":"Zhang","year":"2016","journal-title":"Phys. Geogr."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1007\/s12371-017-0252-1","article-title":"The potential of permanent gullies in Europe as geomorphosites","volume":"11","author":"Poesen","year":"2019","journal-title":"Geoheritage"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.catena.2005.06.001","article-title":"Gully erosion: Impacts, factors and control","volume":"63","author":"Valentin","year":"2005","journal-title":"Catena"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"11","DOI":"10.4314\/sajg.v6i1.2","article-title":"Mapping soil erosion in a quaternary catchment in Eastern Cape using geographic information system and remote sensing","volume":"6","author":"Phinzi","year":"2017","journal-title":"S. Afr. J. Geomat."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1016\/j.pce.2016.10.001","article-title":"Assessing and mapping the severity of soil erosion using the 30-m Landsat multispectral satellite data in the former South African homelands of Transkei","volume":"100","author":"Seutloali","year":"2017","journal-title":"Phys. Chem. Earth"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"405","DOI":"10.26471\/cjees\/2020\/015\/140","article-title":"Comparison of rusle and supervised classification algorithms for identifying erosion-prone areas in a mountainous rural landscape","volume":"15","author":"Phinzi","year":"2020","journal-title":"Carpathian J. Earth Environ. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/j.geomorph.2011.07.003","article-title":"Object-based gully feature extraction using high spatial resolution imagery","volume":"134","author":"Shruthi","year":"2011","journal-title":"Geomorphology"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1080\/10106049.2015.1047412","article-title":"An assessment of gully erosion along major armoured roads in south-eastern region of South Africa: A remote sensing and GIS approach","volume":"31","author":"Seutloali","year":"2016","journal-title":"Geocarto Int."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.iswcr.2018.12.002","article-title":"The assessment of water-borne erosion at catchment level using GIS-based RUSLE and remote sensing: A review","volume":"7","author":"Phinzi","year":"2019","journal-title":"Int. Soil Water Conserv. Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/S0341-8162(99)00013-2","article-title":"Ephemeral gully erosion in southern Navarra (Spain)","volume":"36","year":"1999","journal-title":"Catena"},{"key":"ref_27","first-page":"199","article-title":"Large-area, high-resolution remote sensing based mapping of alluvial gully erosion in Australia\u2019s tropical rivers","volume":"Volume 2","author":"Knight","year":"2007","journal-title":"Proceedings of the 5th Australian Stream Management Conference"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Karydas, C., and Panagos, P. (2020). Towards an assessment of the ephemeral gully erosion potential in Greece using google earth. Water, 12.","DOI":"10.3390\/w12020603"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1007\/s11769-017-0874-x","article-title":"An object-based approach for two-level gully feature mapping using high-resolution DEM and imagery: A case study on hilly loess plateau region, China","volume":"27","author":"Liu","year":"2017","journal-title":"Chin. Geogr. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.rse.2011.11.020","article-title":"A comparison of pixel-based and object-based image analysis with selected machine learning algorithms for the classification of agricultural landscapes using SPOT-5 HRG imagery","volume":"118","author":"Duro","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/MGRS.2016.2540798","article-title":"Deep learning for remote sensing data: A technical tutorial on the state of the art","volume":"4","author":"Zhang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1653","DOI":"10.1080\/19475705.2020.1810138","article-title":"Gully erosion susceptibility mapping (GESM) using machine learning methods optimized by the multi-collinearity analysis and K-fold cross-validation","volume":"11","author":"Ghorbanzadeh","year":"2020","journal-title":"Geomat. Nat. Hazards Risk"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Thanh Noi, P., and Kappas, M. (2017). Comparison of Random Forest, k-Nearest Neighbor, and Support Vector Machine Classifiers for Land Cover Classification Using Sentinel-2 Imagery. Sensors, 18.","DOI":"10.3390\/s18010018"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Phinzi, K., Abriha, D., Bertalan, L., Holb, I., and Szab\u00f3, S. (2020). Machine learning for gully feature extraction based on a pan-sharpened multispectral image: Multiclass vs. Binary approach. ISPRS Int. J. Geo Inf., 9.","DOI":"10.3390\/ijgi9040252"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.isprsjprs.2019.04.016","article-title":"Meta-analysis of deep neural networks in remote sensing: A comparative study of mono-temporal classification to support vector machines","volume":"152","author":"Heydari","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"6308","DOI":"10.1109\/JSTARS.2020.3026724","article-title":"Support Vector Machine Versus Random Forest for Remote Sensing Image Classification: A Meta-Analysis and Systematic Review","volume":"13","author":"Sheykhmousa","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Gafurov, A.M., and Yermolayev, O.P. (2020). Automatic gully detection: Neural networks and computer vision. Remote Sens., 12.","DOI":"10.3390\/rs12111743"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1109\/JSTARS.2019.2953234","article-title":"Very High Resolution Remote Sensing Imagery Classification Using a Fusion of Random Forest and Deep Learning Technique-Subtropical Area for Example","volume":"13","author":"Dong","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2018.2890023","article-title":"Multisource and multitemporal data fusion in remote sensing: A comprehensive review of the state of the art","volume":"7","author":"Ghamisi","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/19479830903561035","article-title":"Multi-source remote sensing data fusion: Status and trends","volume":"1","author":"Zhang","year":"2010","journal-title":"Int. J. Image Data Fusion"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Shahabi, H., Jarihani, B., Tavakkoli Piralilou, S., Chittleborough, D., Avand, M., and Ghorbanzadeh, O. (2019). A Semi-Automated Object-Based Gully Networks Detection Using Different Machine Learning Models: A Case Study of Bowen Catchment, Queensland, Australia. Sensors, 19.","DOI":"10.3390\/s19224893"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Phinzi, K., Holb, I., and Szab\u00f3, S. (2021). Mapping Permanent Gullies in an Agricultural Area Using Satellite Images: Efficacy of Machine Learning Algorithms. Agronomy, 11.","DOI":"10.3390\/agronomy11020333"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1007\/BF00204406","article-title":"The distribution of soil erosion as a function of slope aspect and parent material in Ciskei, Southern Africa","volume":"23","year":"1991","journal-title":"GeoJournal"},{"key":"ref_44","unstructured":"Kotkowski, W., Maltby, E., Miroslaw\u2013Swiatek, D., Okruszko, T., and Szatylowicz, J. (2007). A landscape-based model to characterize the evolution and recent dynamics of wetlands in the Umzimvubu headwaters, Eastern Cape, South Africa. Wetlands: Modelling, Monitoring, Management, Taylor & Francis."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"3440","DOI":"10.1080\/01431161.2014.903435","article-title":"Land-use\/cover classification in a heterogeneous coastal landscape using RapidEye imagery: Evaluating the performance of random forest and support vector machines classifiers","volume":"35","author":"Adam","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Sabat-Tomala, A., and Raczko, E. (2020). Comparison of Support Vector Machine and Random Forest Algorithms for Invasive and Expansive Species Classification Using Airborne Hyperspectral Data. Remote Sens., 12.","DOI":"10.3390\/rs12030516"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Papp, L., van Leeuwen, B., Szilassi, P., Tobak, Z., Szatm\u00e1ri, J., \u00c1rvai, M., M\u00e9sz\u00e1ros, J., and P\u00e1sztor, L. (2021). Monitoring invasive plant species using hyperspectral remote sensing data. Land, 10.","DOI":"10.3390\/land10010029"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Boehmke, B., and Greenwell, B.M. (2019). Hands-On Machine Learning with R, CRC Press.","DOI":"10.1201\/9780367816377"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Oshiro, T.M., Perez, P.S., and Baranauskas, J.A. (2012, January 13\u201320). How many trees in a random forest?. Proceedings of the 8th International Workshop on Machine Learning and Data Mining in Pattern Recognition, Berlin, Germany.","DOI":"10.1007\/978-3-642-31537-4_13"},{"key":"ref_51","unstructured":"Vapnik, V. (2013). The Nature of Statistical Learning Theory, Springer Science & Business Media."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"853","DOI":"10.5194\/nhess-5-853-2005","article-title":"Spatial prediction models for landslide hazards: Review, comparison and evaluation","volume":"5","author":"Brenning","year":"2005","journal-title":"Nat. Hazards Earth Syst. Sci."},{"key":"ref_53","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/0034-4257(91)90048-B","article-title":"A review of assessing the accuracy of classifications of remotely sensed data","volume":"37","author":"Congalton","year":"1991","journal-title":"Remote Sens. Environ."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1016\/j.rse.2017.09.035","article-title":"Effect of classifier selection, reference sample size, reference class distribution and scene heterogeneity in per-pixel classification accuracy using 26 Landsat sites","volume":"204","author":"Heydari","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"4407","DOI":"10.1080\/01431161.2011.552923","article-title":"Death to Kappa: Birth of quantity disagreement and allocation disagreement for accuracy assessment","volume":"32","author":"Pontius","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1002\/pst.1659","article-title":"The disagreeable behaviour of the kappa statistic","volume":"14","author":"Flight","year":"2015","journal-title":"Pharm. Stat."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Delgado, R., and Tibau, X.-A. (2019). Why Cohen\u2019s Kappa should be avoided as performance measure in classification. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0222916"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Kuhn, M., and Johnson, K. (2013). Applied Predictive Modeling, Springer.","DOI":"10.1007\/978-1-4614-6849-3"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.rse.2014.02.015","article-title":"Good practices for estimating area and assessing accuracy of land change","volume":"148","author":"Olofsson","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12864-019-6413-7","article-title":"The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation","volume":"21","author":"Chicco","year":"2020","journal-title":"BMC Genom."},{"key":"ref_62","unstructured":"Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics, Sage."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"353","DOI":"10.4097\/kja.d.18.00242","article-title":"What is the proper way to apply the multiple comparison test?","volume":"71","author":"Lee","year":"2018","journal-title":"Korean J. Anesth."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"203","DOI":"10.11613\/BM.2011.029","article-title":"Multiple comparison analysis testing in ANOVA","volume":"21","author":"McHugh","year":"2011","journal-title":"Biochem. Med."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"4699","DOI":"10.5194\/amt-8-4699-2015","article-title":"Known and unknown unknowns: Uncertainty estimation in satellite remote sensing","volume":"8","author":"Povey","year":"2015","journal-title":"Atmos. Meas. Tech."},{"key":"ref_66","unstructured":"Kohavi, R. (1995, January 20). A study of cross-validation and bootstrap for accuracy estimation and model selection. Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI), Montreal, QC, Canada."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"3735","DOI":"10.1016\/j.csda.2009.04.009","article-title":"Estimating classification error rate: Repeated cross-validation, repeated hold-out and bootstrap","volume":"53","author":"Kim","year":"2009","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"2723","DOI":"10.1080\/01431160600857469","article-title":"Automatic identification of erosion gullies with ASTER imagery in the Brazilian Cerrados","volume":"28","author":"Vrieling","year":"2007","journal-title":"Int. J. Remote Sens."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1080\/01431160600746456","article-title":"A survey of image classification methods and techniques for improving classification performance","volume":"28","author":"Lu","year":"2007","journal-title":"Int. J. Remote Sens."},{"key":"ref_70","first-page":"119","article-title":"Understanding the spatial distribution of eroded areas in the former rural homelands of South Africa: Comparative evidence from two new non-commercial multispectral sensors","volume":"69","author":"Sepuru","year":"2018","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1109\/JSTARS.2020.3040284","article-title":"Use of TanDEM-X and Sentinel products to derive gully activity maps in Kunene Region (Namibia) based on automatic iterative Random Forest approach","volume":"14","author":"Orti","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/15\/2980\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:36:28Z","timestamp":1760164588000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/15\/2980"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,28]]},"references-count":71,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["rs13152980"],"URL":"https:\/\/doi.org\/10.3390\/rs13152980","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,28]]}}}