{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T17:32:12Z","timestamp":1762018332336,"version":"build-2065373602"},"reference-count":89,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,1,20]],"date-time":"2021-01-20T00:00:00Z","timestamp":1611100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Hydrological signatures, i.e., statistical features of streamflow time series, are used to characterize the hydrology of a region. A relevant problem is the prediction of hydrological signatures in ungauged regions using the attributes obtained from remote sensing measurements at ungauged and gauged regions together with estimated hydrological signatures from gauged regions. The relevant framework is formulated as a regression problem, where the attributes are the predictor variables and the hydrological signatures are the dependent variables. Here we aim to provide probabilistic predictions of hydrological signatures using statistical boosting in a regression setting. We predict 12 hydrological signatures using 28 attributes in 667 basins in the contiguous US. We provide formal assessment of probabilistic predictions using quantile scores. We also exploit the statistical boosting properties with respect to the interpretability of derived models. It is shown that probabilistic predictions at quantile levels 2.5% and 97.5% using linear models as base learners exhibit better performance compared to more flexible boosting models that use both linear models and stumps (i.e., one-level decision trees). On the contrary, boosting models that use both linear models and stumps perform better than boosting with linear models when used for point predictions. Moreover, it is shown that climatic indices and topographic characteristics are the most important attributes for predicting hydrological signatures.<\/jats:p>","DOI":"10.3390\/rs13030333","type":"journal-article","created":{"date-parts":[[2021,1,20]],"date-time":"2021-01-20T12:16:18Z","timestamp":1611144978000},"page":"333","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Explanation and Probabilistic Prediction of Hydrological Signatures with Statistical Boosting Algorithms"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8932-4997","authenticated-orcid":false,"given":"Hristos","family":"Tyralis","sequence":"first","affiliation":[{"name":"Hellenic Air Force General Staff, Hellenic Air Force, Mesogion Avenue 227-231, 155 61 Cholargos, Greece"},{"name":"Department of Water Resources and Environmental Engineering, School of Civil Engineering, National Technical University of Athens, Iroon Polytechniou 5, 157 80 Zografou, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5446-954X","authenticated-orcid":false,"given":"Georgia","family":"Papacharalampous","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, School of Engineering, University of Patras, University Campus, Rio, 26 504 Patras, Greece"},{"name":"Department of Engineering, Roma Tre University, 00154 Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0643-2520","authenticated-orcid":false,"given":"Andreas","family":"Langousis","sequence":"additional","affiliation":[{"name":"Department of Civil Engineering, School of Engineering, University of Patras, University Campus, Rio, 26 504 Patras, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5633-0154","authenticated-orcid":false,"given":"Simon Michael","family":"Papalexiou","sequence":"additional","affiliation":[{"name":"Department of Civil, Geological and Environmental Engineering, University of Saskatchewan, Saskatoon, SK S7N 5A2, Canada"},{"name":"Global Institute for Water Security, Saskatoon, SK S7N 3H5, Canada"},{"name":"Faculty of Environmental Sciences, Czech University of Life Sciences, 165 00 Prague, Czech Republic"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1002\/hyp.13632","article-title":"Linking hydrologic signatures to hydrologic processes: A review","volume":"34","author":"McMillan","year":"2020","journal-title":"Hydrol. Process."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4757","DOI":"10.1002\/hyp.11300","article-title":"Five guidelines for selecting hydrological signatures","volume":"31","author":"McMillan","year":"2017","journal-title":"Hydrol. Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3802","DOI":"10.1002\/hyp.6989","article-title":"Reconciling theory with observations: Elements of a diagnostic approach to model evaluation","volume":"22","author":"Gupta","year":"2008","journal-title":"Hydrol. Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3796","DOI":"10.1002\/2014WR016520","article-title":"Optimizing hydrological consistency by incorporating hydrological signatures into model calibration objectives","volume":"51","author":"Shafii","year":"2015","journal-title":"Water Resour. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"144612","DOI":"10.1016\/j.scitotenv.2020.144612","article-title":"Global-scale massive feature extraction from monthly hydroclimatic time series: Statistical characterizations, spatial patterns and hydrological similarity","volume":"767","author":"Papacharalampous","year":"2021","journal-title":"Sci. Total Environ."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bl\u00f6schl, G., Sivapalan, M., Wagener, T., Viglione, A., and Savenije, H. (2013). Runoff Prediction in Ungauged Basins, Cambridge University Press.","DOI":"10.1017\/CBO9781139235761"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1198","DOI":"10.1080\/02626667.2013.803183","article-title":"A decade of Predictions in Ungauged Basins (PUB)\u2014A review","volume":"58","author":"Hrachowitz","year":"2013","journal-title":"Hydrol. Sci. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1016\/j.jhydrol.2014.06.030","article-title":"Identifying dominant controls on hydrologic parameter transfer from gauged to ungauged catchments\u2014A comparative hydrology approach","volume":"517","author":"Singh","year":"2014","journal-title":"J. Hydrol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2263","DOI":"10.5194\/hess-17-2263-2013","article-title":"Comparative assessment of predictions in ungauged basins\u2014Part 3: Runoff signatures in Austria","volume":"17","author":"Viglione","year":"2013","journal-title":"Hydrol. Earth Syst. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1080\/02626667.2019.1620507","article-title":"Twenty-three Unsolved Problems in Hydrology (UPH)\u2014A community perspective","volume":"64","author":"Bierkens","year":"2019","journal-title":"Hydrol. Sci. J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2535","DOI":"10.5194\/hess-19-2535-2015","article-title":"Transferring global uncertainty estimates from gauged to ungauged catchments","volume":"19","author":"Bourgin","year":"2015","journal-title":"Hydrol. Earth Syst. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"W06301","DOI":"10.1029\/2010WR009469","article-title":"Convergence of approaches toward reducing uncertainty in predictions in ungauged basins","volume":"47","author":"Wagener","year":"2011","journal-title":"Water Resour. Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3951","DOI":"10.5194\/hess-19-3951-2015","article-title":"Uncertainty in hydrological signatures","volume":"19","author":"Westerberg","year":"2015","journal-title":"Hydrol. Earth Syst. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1847","DOI":"10.1002\/2015WR017635","article-title":"Uncertainty in hydrological signatures for gauged and ungauged catchments","volume":"52","author":"Westerberg","year":"2016","journal-title":"Water Resour. Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1478","DOI":"10.1175\/JHM-D-14-0155.1","article-title":"Global maps of streamflow characteristics based on observations from several thousand catchments","volume":"16","author":"Beck","year":"2015","journal-title":"J. Hydrometeorol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"8792","DOI":"10.1029\/2018WR022606","article-title":"A ranking of hydrological signatures based on their predictability in space","volume":"54","author":"Addor","year":"2018","journal-title":"Water Resour. Res."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1016\/j.jhydrol.2019.04.070","article-title":"How to explain and predict the shape parameter of the generalized extreme value distribution of streamflow extremes using a big dataset","volume":"574","author":"Tyralis","year":"2019","journal-title":"J. Hydrol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"7859","DOI":"10.1029\/2018WR023325","article-title":"Predicting runoff signatures using regression and hydrological modeling approaches","volume":"54","author":"Zhang","year":"2018","journal-title":"Water Resour. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_20","first-page":"983","article-title":"Quantile regression forests","volume":"7","author":"Meinshausen","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Efron, B., and Hastie, T. (2016). Computer Age Statistical Inference, Cambridge University Press.","DOI":"10.1017\/CBO9781316576533"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning, Springer.","DOI":"10.1007\/978-0-387-84858-7"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"James, G., Witten, D., Hastie, T., and Tibshirani, R. (2013). An Introduction to Statistical Learning, Springer.","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"480","DOI":"10.1177\/0309133312444943","article-title":"Two decades of anarchy? Emerging themes and outstanding challenges for neural network river forecasting","volume":"36","author":"Abrahart","year":"2012","journal-title":"Prog. Phys. Geogr. Earth Environ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1177\/030913330102500104","article-title":"Hydrological modelling using artificial neural networks","volume":"25","author":"Dawson","year":"2001","journal-title":"Prog. Phys. Geogr. Earth Environ."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3","DOI":"10.2166\/hydro.2008.015","article-title":"Data-driven modelling: Some past experiences and new approaches","volume":"10","author":"Solomatine","year":"2008","journal-title":"J. Hydroinform."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1016\/j.envsoft.2010.02.003","article-title":"Methods used for the development of neural networks for the prediction of water resource variables in river systems: Current status and future directions","volume":"25","author":"Maier","year":"2010","journal-title":"Environ. Model. Softw."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Tyralis, H., Papacharalampous, G., and Langousis, A. (2019). A brief review of random forests for water scientists and practitioners and their recent history in water resources. Water, 11.","DOI":"10.3390\/w11050910"},{"key":"ref_29","first-page":"477","article-title":"Boosting algorithms: Regularization, prediction and model fitting","volume":"22","author":"Hothorn","year":"2007","journal-title":"Stat. Sci."},{"key":"ref_30","unstructured":"Tyralis, H., and Papacharalampous, G. (2020). Boosting algorithms in energy research: A systematic review. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"5293","DOI":"10.5194\/hess-21-5293-2017","article-title":"The CAMELS data set: Catchment attributes and meteorology for large-sample studies","volume":"21","author":"Addor","year":"2017","journal-title":"Hydrol. Earth Syst. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2215","DOI":"10.1175\/JHM-D-16-0284.1","article-title":"Benchmarking of a physically based hydrologic model","volume":"18","author":"Newman","year":"2017","journal-title":"J. Hydrometeorol."},{"key":"ref_33","unstructured":"Addor, N., Newman, A.J., Mizukami, N., and Clark, M.P. (2017). Catchment Attributes for Large-Sample Studies, UCAR\/NCAR."},{"key":"ref_34","unstructured":"Newman, A.J., Sampson, K., Clark, M.P., Bock, A., Viger, R.J., and Blodgett, D. (2014). A Large-Sample Watershed-Scale Hydrometeorological Dataset for the Contiguous USA, UCAR\/NCAR."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"209","DOI":"10.5194\/hess-19-209-2015","article-title":"Development of a large-sample watershed-scale hydrometeorological data set for the contiguous USA: Data set characteristics and assessment of regional variability in hydrologic model performance","volume":"19","author":"Newman","year":"2015","journal-title":"Hydrol. Earth Syst. Sci."},{"key":"ref_36","unstructured":"Thornton, P.E., Thornton, M.M., Mayer, B.W., Wilhelmi, N., Wei, Y., Devarakonda, R., and Cook, R.B. (2014). Daymet: Daily Surface Weather Data on a 1-km Grid for North America, Version 2, ORNL DAAC."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1175\/1087-3562(1998)002<0001:ACUSMS>2.3.CO;2","article-title":"A conterminous United States multilayer soil characteristics dataset for regional climate and hydrology modeling","volume":"2","author":"Miller","year":"1998","journal-title":"Earth Interact."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1002\/2015MS000526","article-title":"A gridded global data set of soil, intact regolith, and sedimentary deposit thicknesses for regional and global land surface modeling","volume":"8","author":"Pelletier","year":"2016","journal-title":"J. Adv. Modeling Earth Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3891","DOI":"10.1002\/2014GL059856","article-title":"A glimpse beneath earth\u2019s surface: GLobal HYdrogeology MaPS (GLHYMPS) of permeability and porosity","volume":"41","author":"Gleeson","year":"2014","journal-title":"Geophys. Res. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"Q12004","DOI":"10.1029\/2012GC004370","article-title":"The new global lithological map database GLiM: A representation of rock properties at the Earth surface","volume":"13","author":"Hartmann","year":"2012","journal-title":"Geochem. Geophys. Geosyst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1214\/aos\/1016218223","article-title":"Additive logistic regression: A statistical view of boosting","volume":"28","author":"Friedman","year":"2000","journal-title":"Ann. Stat."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: A gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann. Stat."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3389\/fnbot.2013.00021","article-title":"Gradient boosting machines, a tutorial","volume":"7","author":"Natekin","year":"2013","journal-title":"Front. Neurorobot."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1177\/1471082X17748086","article-title":"Boosting for statistical modelling: A non-technical introduction","volume":"18","author":"Mayr","year":"2018","journal-title":"Stat. Model."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1002\/wics.55","article-title":"Boosting","volume":"2","author":"Yu","year":"2010","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"419","DOI":"10.3414\/ME13-01-0122","article-title":"The evolution of boosting algorithms","volume":"53","author":"Mayr","year":"2014","journal-title":"Methods Inf. Med."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"428","DOI":"10.3414\/ME13-01-0123","article-title":"Extending statistical boosting","volume":"53","author":"Mayr","year":"2014","journal-title":"Methods Inf. Med."},{"key":"ref_48","unstructured":"B\u00fchlmann, P. (2003, January 20\u201322). Boosting methods: Why they can be useful for high-dimensional data. Proceedings of the 3rd International Workshop on Distributed Statistical Computing (DSC 2003), Vienna, Austria."},{"key":"ref_49","first-page":"559","article-title":"Boosting for high-dimensional linear models","volume":"34","year":"2006","journal-title":"Ann. Stat."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2828","DOI":"10.1093\/bioinformatics\/btl462","article-title":"Model-based boosting in high dimensions","volume":"22","author":"Hothorn","year":"2006","journal-title":"Bioinformatics"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1198\/016214503000125","article-title":"Boosting with the L2 loss","volume":"98","author":"Yu","year":"2003","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s00180-012-0382-5","article-title":"Model-based boosting in R: A hands-on tutorial using the R package mboost","volume":"29","author":"Hofner","year":"2014","journal-title":"Comput. Stat."},{"key":"ref_53","first-page":"2109","article-title":"Model-based boosting 2.0","volume":"11","author":"Hothorn","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/BF00116037","article-title":"The strength of weak learnability","volume":"5","author":"Schapire","year":"1990","journal-title":"Mach. Learn."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1296","DOI":"10.1080\/01621459.1999.10473882","article-title":"Goodness of fit and related inference processes for quantile regression","volume":"94","author":"Koenker","year":"1999","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1198\/016214506000001437","article-title":"Strictly proper scoring rules, prediction, and estimation","volume":"102","author":"Gneiting","year":"2007","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"33","DOI":"10.2307\/1913643","article-title":"Regression quantiles","volume":"46","author":"Koenker","year":"1978","journal-title":"Econometrica"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1146\/annurev-economics-063016-103651","article-title":"Quantile regression: 40 years on","volume":"9","author":"Koenker","year":"2017","journal-title":"Annu. Rev. Econ."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1111\/j.2517-6161.1968.tb00740.x","article-title":"A Bayesian approach to calibration","volume":"30","author":"Dunsmore","year":"1968","journal-title":"J. R. Stat. Society. Ser. B (Methodol.)"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1080\/01621459.1972.10481224","article-title":"A decision-theoretic approach to interval estimation","volume":"67","author":"Winkler","year":"1972","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_61","doi-asserted-by":"crossref","unstructured":"Papacharalampous, G., Tyralis, H., Langousis, A., Jayawardena, A.W., Sivakumar, B., Mamassis, N., Montanari, A., and Koutsoyiannis, D. (2019). Probabilistic hydrological post-processing at scale: Why and how to apply machine-learning quantile regression algorithms. Water, 11.","DOI":"10.3390\/w11102126"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1214\/ss\/1009213726","article-title":"Statistical modeling: The two cultures","volume":"16","author":"Breiman","year":"2001","journal-title":"Stat. Sci."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1214\/10-STS330","article-title":"To explain or to predict?","volume":"25","author":"Shmueli","year":"2010","journal-title":"Stat. Sci."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1162\/neco.1996.8.7.1341","article-title":"The lack of a priori distinctions between learning algorithms","volume":"8","author":"Wolpert","year":"1996","journal-title":"Neural Comput."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"125205","DOI":"10.1016\/j.jhydrol.2020.125205","article-title":"Hydrological time series forecasting using simple combinations: Big data testing and investigations on one-year ahead river flow predictability","volume":"590","author":"Papacharalampous","year":"2020","journal-title":"J. Hydrol."},{"key":"ref_66","doi-asserted-by":"crossref","unstructured":"Tyralis, H., Papacharalampous, G., and Langousis, A. (2020). Super ensemble learning for daily streamflow forecasting: Large-scale demonstration and comparison with multiple machine learning algorithms. Neural Comput. Appl.","DOI":"10.1007\/s00521-020-05172-3"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"123957","DOI":"10.1016\/j.jhydrol.2019.123957","article-title":"Hydrological post-processing using stacked generalization of quantile regression algorithms: Large-scale application over CONUS","volume":"577","author":"Tyralis","year":"2019","journal-title":"J. Hydrol."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"103470","DOI":"10.1016\/j.advwatres.2019.103470","article-title":"Quantification of predictive uncertainty in hydrological modelling by harnessing the wisdom of the crowd: A large-sample experiment at monthly timescale","volume":"136","author":"Papacharalampous","year":"2020","journal-title":"Adv. Water Resour."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1002\/bimj.201700129","article-title":"For the Simulation Panel of the STRATOS Initiative. On the necessity and design of studies comparing statistical methods","volume":"60","author":"Boulesteix","year":"2018","journal-title":"Biom. J."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"5207","DOI":"10.1007\/s11269-018-2155-6","article-title":"Univariate time series forecasting of temperature and precipitation with a focus on machine learning algorithms: A multiple-case study from Greece","volume":"32","author":"Papacharalampous","year":"2018","journal-title":"Water Resour. Manag."},{"key":"ref_71","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1007\/s00477-018-1638-6","article-title":"Comparison of stochastic and machine learning methods for multi-step ahead forecasting of hydrological processes","volume":"33","author":"Papacharalampous","year":"2019","journal-title":"Stoch. Environ. Res. Risk Assess."},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/s11749-016-0481-7","article-title":"A random forest guided tour","volume":"25","author":"Biau","year":"2016","journal-title":"Test"},{"key":"ref_73","unstructured":"R Core Team (2020). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing. Available online: https:\/\/www.R-project.org\/."},{"key":"ref_74","unstructured":"Dowle, M., and Srinivasan, A. (2020, December 13). Data.Table: Extension of \u2018Data.Frame\u2019. R Package Version 1.13. Available online: https:\/\/CRAN.R-project.org\/package=data.table."},{"key":"ref_75","unstructured":"Warnes, G.R., Bolker, B., Gorjanc, G., Grothendieck, G., Korosec, A., Lumley, T., MacQueen, D., Magnusson, A., and Rogers, J. (2020, December 13). Gdata: Various R Programming Tools for Data Manipulation. R Package Version 2.18.0. Available online: https:\/\/CRAN.R-project.org\/package=gdata."},{"key":"ref_76","unstructured":"Wickham, H. (2020, December 13). reshape2: Flexibly Reshape Data: A Reboot of the Reshape Package. R Package Version 1.4.4. Available online: https:\/\/CRAN.R-project.org\/package=reshape2."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v021.i12","article-title":"Reshaping data with the reshape package","volume":"21","author":"Wickham","year":"2007","journal-title":"J. Stat. Softw."},{"key":"ref_78","unstructured":"Wickham, H. (2020, December 13). stringr: Simple, Consistent Wrappers for Common String Operations. R Package Version 1.4.0. Available online: https:\/\/CRAN.R-project.org\/package=stringr."},{"key":"ref_79","unstructured":"Kuhn, M. (2020, December 13). caret: Classification and Regression Training. R Package Version 6.0-86. Available online: https:\/\/CRAN.R-project.org\/package=caret."},{"key":"ref_80","unstructured":"Hothorn, T., B\u00fchlmann, P., Kneib, T., Schmid, M., and Hofner, B. (2020, December 13). mboost: Model-Based Boosting. R Package Version 2.9-3. Available online: https:\/\/CRAN.R-project.org\/package=mboost."},{"key":"ref_81","doi-asserted-by":"crossref","unstructured":"Wickham, H. (2016). ggplot2, Springer.","DOI":"10.1007\/978-3-319-24277-4"},{"key":"ref_82","unstructured":"Wickham, H., Chang, W., Henry, L., Pedersen, T.L., Takahashi, K., Wilke, C., Woo, K., Yutani, H., and Dunnington, D. (2020, December 13). ggplot2: Create Elegant Data Visualisations Using the Grammar of Graphics. R package Version 3.3.2. Available online: https:\/\/CRAN.R-project.org\/package=ggplot2."},{"key":"ref_83","unstructured":"Ram, K., and Wickham, H. (2020, December 13). wesanderson: A Wes Anderson Palette Generator. R Package Version 0.3.6. Available online: https:\/\/CRAN.R-project.org\/package=wesanderson."},{"key":"ref_84","unstructured":"Wickham, H., Hester, J., and Chang, W. (2020, December 13). devtools: Tools to Make Developing R Packages Easier. R Package Version 2.3.1. Available online: https:\/\/CRAN.R-project.org\/package=devtools."},{"key":"ref_85","doi-asserted-by":"crossref","unstructured":"Stodden, V., Leisch, F., and Peng, R.D. (2014). knitr: A comprehensive tool for reproducible research in R. Implementing Reproducible Computational Research, Chapman and Hall\/CRC.","DOI":"10.1201\/b16868"},{"key":"ref_86","doi-asserted-by":"crossref","unstructured":"Xie, Y. (2015). Dynamic Documents with R and Knitr, Chapman and Hall\/CRC. [2nd ed.].","DOI":"10.1201\/b15166"},{"key":"ref_87","unstructured":"Xie, Y. (2020, December 13). knitr: A General-Purpose Package for Dynamic Report Generation in R. R Package Version 1.29. Available online: https:\/\/CRAN.R-project.org\/package=knitr."},{"key":"ref_88","unstructured":"Allaire, J.J., Xie, Y., McPherson, J., Luraschi, J., Ushey, K., Atkins, A., Wickham, H., Cheng, J., Chang, W., and Iannone, R. (2020, December 13). rmarkdown: Dynamic Documents for R. R Package Version 2.3. Available online: https:\/\/CRAN.R-project.org\/package=rmarkdown."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Xie, Y., Allaire, J.J., and Grolemund, G. (2018). R Markdown, Chapman and Hall\/CRC. [1st ed.].","DOI":"10.1201\/9781138359444"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/3\/333\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:13:10Z","timestamp":1760159590000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/3\/333"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,20]]},"references-count":89,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,2]]}},"alternative-id":["rs13030333"],"URL":"https:\/\/doi.org\/10.3390\/rs13030333","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2021,1,20]]}}}