{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T02:52:34Z","timestamp":1780455154096,"version":"3.54.1"},"reference-count":54,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2023,8,11]],"date-time":"2023-08-11T00:00:00Z","timestamp":1691712000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Higher Education Commission (HEC) of Pakistan","award":["7368"],"award-info":[{"award-number":["7368"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Hydrology"],"abstract":"<jats:p>To maximize crop production, reference evapotranspiration (ET0) measurement is crucial for managing water resources and planning crop water needs. The FAO-PM56 method is recommended globally for estimating ET0 and evaluating alternative methods due to its extensive theoretical foundation. Numerous meteorological parameters, needed for ET0 estimation, are difficult to obtain in developing countries. Therefore, alternative ways to estimate ET0 using fewer climatic data are of critical importance. To estimate ET0 with alternative methods, difference climatic parameters of temperatures, relative humidity (maximum and minimum), sunshine hours, and wind speed for a period of 20 years from 1996 to 2015 were used in the study. The data were recorded by 11 meteorological observatories situated in various climatic regions of Pakistan. The significance of the climatic parameters used was evaluated using sensitivity analysis. The machine learning techniques of single decision tree (SDT), tree boost (TB) and decision tree forest (DTF) were used to perform sensitivity analysis. The outcomes indicated that DTF-based models estimated ET0 with higher accuracy and fewer climatic variables as compared to other ML techniques used in the study. The DTF technique, with Model 15 as input, outperformed other techniques for the most part of the performance metrics (i.e., NSE = 0.93, R2 = 0.96 and RMSE = 0.48 mm\/month). The results indicated that the DTF with fewer climatic variables of mean relative humidity, wind speed and minimum temperature could estimate ET0 accurately and outperformed other ML techniques. Additionally, a non-linear ensemble (NLE) of ML techniques was further used to estimate ET0 using the best input combination (i.e., Model 15). It was seen that the applied non-linear ensemble (NLE) approach enhanced modelling accuracy as compared to a stand-alone application of ML techniques (R2 Multan = 0.97, R2 Skardu = 0.99, R2 ISB = 0.98, R2 Bahawalpur = 0.98 etc.). The study results affirmed the use of an ensemble model for ET0 estimation and suggest applying it in other parts of the world to validate model performance.<\/jats:p>","DOI":"10.3390\/hydrology10080169","type":"journal-article","created":{"date-parts":[[2023,8,11]],"date-time":"2023-08-11T10:20:16Z","timestamp":1691749216000},"page":"169","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Using Ensembles of Machine Learning Techniques to Predict Reference Evapotranspiration (ET0) Using Limited Meteorological Data"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3333-7406","authenticated-orcid":false,"given":"Hamza","family":"Salahudin","sequence":"first","affiliation":[{"name":"Department of Agricultural Engineering, Bahauddin Zakariya University, Multan 60000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4628-4796","authenticated-orcid":false,"given":"Muhammad","family":"Shoaib","sequence":"additional","affiliation":[{"name":"Department of Agricultural Engineering, Bahauddin Zakariya University, Multan 60000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7956-9149","authenticated-orcid":false,"given":"Raffaele","family":"Albano","sequence":"additional","affiliation":[{"name":"School of Engineering, University of Basilicata, 85100 Potenza, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muhammad Azhar","family":"Inam Baig","sequence":"additional","affiliation":[{"name":"Department of Agricultural Engineering, Bahauddin Zakariya University, Multan 60000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2185-190X","authenticated-orcid":false,"given":"Muhammad","family":"Hammad","sequence":"additional","affiliation":[{"name":"Department of Agricultural Engineering, Bahauddin Zakariya University, Multan 60000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9207-5779","authenticated-orcid":false,"given":"Ali","family":"Raza","sequence":"additional","affiliation":[{"name":"Department of Agricultural Engineering, Bahauddin Zakariya University, Multan 60000, Pakistan"},{"name":"Department of Agricultural Engineering, Jiangsu University, Zhenjiang 212013, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alamgir","family":"Akhtar","sequence":"additional","affiliation":[{"name":"School of Science and the Environment, Grenfell Campus, Memorial University, St. John\u2019s, NL A1C 5S7, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muhammad Usman","family":"Ali","sequence":"additional","affiliation":[{"name":"Department of Agricultural Engineering, Bahauddin Zakariya University, Multan 60000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lieth, H., and Whittaker, R.H. (1975). Primary Productivity of the Biosphere, Springer.","DOI":"10.1007\/978-3-642-80913-2"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.atmosres.2018.09.021","article-title":"Error Adjustment of TMPA Satellite Precipitation Estimates and Assessment of Their Hydrological Utility in the Middle and Upper Yangtze River Basin, China","volume":"216","author":"Zhang","year":"2019","journal-title":"Atmos. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"951","DOI":"10.1038\/nature09396","article-title":"Recent decline in the global land evapotranspiration trend due to limited moisture supply","volume":"467","author":"Jung","year":"2010","journal-title":"Nature"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Goyal, M.R., and Harmsen, E.W. (2013). Evapotranspiration: Principles and Applications for Water Management, CRC Press.","DOI":"10.1201\/b15779"},{"key":"ref_5","unstructured":"Allen, R.G., Pereira, L.S., Raes, D., and Smith, M. (1998). Crop Evapotranspiration\u2014Guidelines for Computing Crop Water Requirements, Food and Agriculture Organization."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"106447","DOI":"10.1016\/j.compag.2021.106447","article-title":"Introductory overview: Evapotranspiration (ET) models for controlled environment agriculture (CEA)","volume":"190","author":"Wang","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"138","DOI":"10.2136\/sssaj1961.03615995002500020021x","article-title":"Lysimetric measurements of evapotranspiration rates in the eastern United States","volume":"25","author":"Van","year":"1961","journal-title":"Soil Sci. Soc. Am. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.agwat.2010.08.001","article-title":"Evaluating eddy covariance method by large-scale weighing lysimeter in a maize field of northwest China","volume":"98","author":"Ding","year":"2010","journal-title":"Agric. Water Manag."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.agrformet.2004.03.005","article-title":"Dynamics of Reference Evapotranspiration in the Bolivian Highlands (Altiplano)","volume":"125","author":"Garcia","year":"2004","journal-title":"Agric. For. Meteorol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.agwat.2005.05.001","article-title":"Regional Calibration of Hargreaves Equation for Estimating Reference ET in a Semiarid Environment","volume":"81","author":"Lorite","year":"2006","journal-title":"Agric. Water Manag."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/0378-3774(95)01172-F","article-title":"Penman-Monteith, FAO-24 Reference Crop Evapotranspiration and Class\u2014A Pan Data in Australia","volume":"28","author":"McMahon","year":"1995","journal-title":"Agric. Water Manag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.compag.2010.01.003","article-title":"Software for estimating reference evapotranspiration using limited weather data","volume":"71","author":"Gocic","year":"2010","journal-title":"Comput. Electron. Agric."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1061\/(ASCE)HE.1943-5584.0000366","article-title":"Local calibration of the Hargreaves and Priestley\u2013Taylor equations for estimating reference evapotranspiration in arid and cold climates of Iran based on the Penman\u2013Monteith model","volume":"16","author":"Tabari","year":"2011","journal-title":"J. Hydrol. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ba\u015fa\u011fao\u011flu, H., Chakraborty, D., and Winterle, J. (2021). Reliable Evapotranspiration Predictions with a Probabilistic Machine Learning Framework. Water, 13.","DOI":"10.3390\/w13040557"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"114498","DOI":"10.1016\/j.eswa.2020.114498","article-title":"Interpretable vs. noninterpretable machine learning models for data-driven hydro-climatological process modeling","volume":"170","author":"Chakraborty","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.1007\/s40710-021-00543-x","article-title":"A Deep Neural Network Architecture to Model Reference Evapotranspiration Using a Single Input Meteorological Parameter","volume":"8","author":"Ravindran","year":"2021","journal-title":"Environ. Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1287","DOI":"10.1007\/s12517-020-06293-8","article-title":"Exploring the potential of deep factorization machine and various gradient boosting models in modeling daily reference evapotranspiration in China","volume":"13","author":"Zhou","year":"2020","journal-title":"Arab. J. Geosci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1016\/j.apenergy.2016.01.130","article-title":"A wavelet-coupled support vector machine model for forecasting global incident solar radiation using limited meteorological dataset","volume":"168","author":"Deo","year":"2016","journal-title":"Appl. Energy"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1016\/j.rser.2016.04.024","article-title":"Solar radiation prediction using different techniques: Model evaluation and comparison","volume":"61","author":"Wang","year":"2016","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1016\/j.rser.2015.11.068","article-title":"Modeling and comparison of hourly photosynthetically active radiation in different ecosystems","volume":"56","author":"Wang","year":"2015","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1007\/s00704-009-0204-z","article-title":"Estimation of Evapotranspiration Based on Only Air Temperature Data Using Artificial Neural Networks for a Subtropical Climate in Iran","volume":"101","author":"Rahimikhoob","year":"2010","journal-title":"Theor. Appl. Climatol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1061\/(ASCE)IR.1943-4774.0000094","article-title":"Estimating Reference Evapotranspiration Using Limited Weather Data","volume":"135","author":"Slavisa","year":"2009","journal-title":"J. Irrig. Drain. Eng."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.ejor.2015.05.030","article-title":"Benchmarking State-of-the-Art Classification Algorithms for Credit Scoring: An Update of Research","volume":"247","author":"Lessmann","year":"2015","journal-title":"Eur. J. Oper. Res."},{"key":"ref_24","first-page":"241","article-title":"An Evolutionary Approach to the Combination of Multiple Classifiers to Predict a Stock Price Index","volume":"31","author":"Kim","year":"2006","journal-title":"Earth Syst. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.dss.2010.08.028","article-title":"Combining Multiple Feature Selection Methods for Stock Prediction: Union, Intersection, and Multi-Intersection Approaches","volume":"50","author":"Tsai","year":"2010","journal-title":"Decis. Support Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1057\/jors.1976.30","article-title":"Operational Research Society Is Collaborating with JSTOR to Digitize, Preserve, and Extend Access to Operational Research Quarterly (1970\u20131977)","volume":"27","author":"Baker","year":"1977","journal-title":"Oper. Res. Q."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1002\/for.3980010202","article-title":"The accuracy of extrapolation (time series) methods: Results of a forecasting competition","volume":"1","author":"Makridakis","year":"1982","journal-title":"J. Forecast."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"123958","DOI":"10.1016\/j.jhydrol.2019.123958","article-title":"Multi-station artificial intelligence-based ensemble modeling of reference evapotranspiration using pan evaporation measurements","volume":"577","author":"Nourani","year":"2019","journal-title":"J. Hydrol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1029\/2007WR006451","article-title":"Toward Improving the Reliability of Hydrologic Prediction: Model Structure Uncertainty and Its Quantification Using Ensemble-Based Genetic Programming Framework","volume":"44","author":"Parasuraman","year":"2008","journal-title":"Water Resour. Res."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"576","DOI":"10.1016\/j.jss.2007.05.005","article-title":"Software reliability prediction by soft computing techniques","volume":"81","author":"Kiran","year":"2008","journal-title":"J. Syst. Softw."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.2166\/hydro.2018.151","article-title":"Earthfill Dam Seepage Analysis Using Ensemble Artificial Intelligence Based Modeling","volume":"20","author":"Sharghi","year":"2018","journal-title":"J. Hydroinform."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1016\/j.ejor.2010.09.029","article-title":"Multiple Classifier Architectures and Their Application to Credit Risk Assessment","volume":"210","author":"Finlay","year":"2011","journal-title":"Eur. J. Oper. Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"490","DOI":"10.1016\/j.ejor.2009.03.008","article-title":"Subagging for Credit Scoring Models","volume":"201","author":"Paleologo","year":"2010","journal-title":"Eur. J. Oper. Res."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"4013","DOI":"10.1007\/s00521-021-06661-9","article-title":"A hybrid deep neural network approach to estimate reference evapotranspiration using limited climate data","volume":"34","author":"Sharma","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"4479","DOI":"10.1007\/s00024-020-02473-5","article-title":"Comparative Assessment of Reference Evapotranspiration Estimation Using Conventional Method and Machine Learning Algorithms in Four Climatic Regions","volume":"177","author":"Raza","year":"2020","journal-title":"Pure Appl. Geophys."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2213","DOI":"10.1007\/s00477-021-02013-0","article-title":"Rainfall forecasting in upper Indus basin using various artificial intelligence techniques","volume":"35","author":"Hammad","year":"2021","journal-title":"Stoch. Environ. Res. Risk Assess."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1016\/j.jhydrol.2018.05.003","article-title":"Addressing the incorrect usage of wavelet-based hydrological and water resources forecasting models for real-world applications with best practices and a new forecasting framework","volume":"563","author":"Quilty","year":"2018","journal-title":"J. Hydrol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1111\/j.2517-6161.1974.tb00994.x","article-title":"Cross-Validatory Choice and Assessment of Statistical Predictions","volume":"36","author":"Stone","year":"1974","journal-title":"J. R. Stat. Soc."},{"key":"ref_39","first-page":"1","article-title":"An Implementation of IDE3 Decision Tree Learning Algorithm","volume":"9417","author":"Peng","year":"2009","journal-title":"Mach. Learn."},{"key":"ref_40","unstructured":"Sherrod, P., and DTREG Predictive Modeling Software (2023, April 11). DevDigital: Nashvilla Software Development. Available online: https:\/\/www.dtreg.com."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1459","DOI":"10.1007\/s00704-019-03007-3","article-title":"Application of Non-Conventional Soft Computing Approaches for Estimation of Reference Evapotranspiration in Various Climatic Regions","volume":"139","author":"Raza","year":"2020","journal-title":"Theor. Appl. Climatol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"119","DOI":"10.54648\/JOIA2018005","article-title":"Arbitration and new technologies: Mutual benefits","volume":"35","author":"Vannieuwenhuyse","year":"2018","journal-title":"J. Int. Arbitr."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Maimon, O., and Rokach, L. (2010). Data Mining and Knowledge Discovery Handbook, Springer.","DOI":"10.1007\/978-0-387-09823-4"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Richman, R., and W\u00fcthrich, M.V. (2020). Nagging Predictors. Risks, 8.","DOI":"10.3390\/risks8030083"},{"key":"ref_45","unstructured":"Perrone, M.P., and Copper, L.N. (1992). When Networks Disagree: Ensemble Methods for Technical Report Hybrid Neural Networks Unclassified, Brown University Providence Ri Institute for Brain and Neural Systems."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1109\/72.554191","article-title":"Parallel consensual neural networks","volume":"8","author":"Benediktsson","year":"1997","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_47","first-page":"7490","article-title":"Comparative Study of Powerful Predictive Modeling Techniques for Modeling Monthly Reference Evapotranspiration in Various Climatic Regions","volume":"30","author":"Raza","year":"2021","journal-title":"Fresenius Environ. Bull."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1824","DOI":"10.1080\/02626667.2019.1678750","article-title":"Estimation of monthly reference evapotranspiration using novel hybrid machine learning approaches","volume":"64","author":"Tikhamarine","year":"2019","journal-title":"Hydrol. Sci. J."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1016\/j.jhydrol.2019.03.028","article-title":"Estimation of reference evapotranspiration in Brazil with limited meteorological data using ANN and SVM\u2014A new approach","volume":"572","author":"Ferreira","year":"2019","journal-title":"J. Hydrol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.compag.2015.04.015","article-title":"Long-term monthly evapotranspiration modeling by several data-driven methods without climatic data","volume":"115","author":"Kisi","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Khan, M.T., Shoaib, M., Hammad, M., Salahudin, H., Ahmad, F., and Ahmad, S. (2021). Application of Machine Learning Techniques in Rainfall\u2014Runoff Modelling of the Soan River Basin, Pakistan. Water, 13.","DOI":"10.3390\/w13243528"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Khan, M.T., Shoaib, M., Albano, R., Inam, M.A., Salahudin, H., Hammad, M., Ahmad, S., Ali, M.U., Hashim, S., and Ullah, M.K. (2023). Intercomparison and Assessment of Stand-Alone and Wavelet-Coupled Machine Learning Models for Simulating Rainfall-Runoff Process in Four Basins of Pothohar. Atmosphere, 14.","DOI":"10.3390\/atmos14030452"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"3342","DOI":"10.1002\/hyp.7439","article-title":"Sensitivity Analysis of a Penman\u2013Monteith Type Equation to Estimate Reference Evapotranspiration in Southern Spain","volume":"23","author":"Pedro","year":"2009","journal-title":"Hydrol. Process."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1007\/s13369-012-0214-5","article-title":"Estimating Penman-Monteith Reference Evapotranspiration Using Artificial Neural Networks and Genetic Algorithm: A Case Study","volume":"37","author":"Eslamian","year":"2012","journal-title":"Arab. J. Sci. Eng."}],"container-title":["Hydrology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5338\/10\/8\/169\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:31:17Z","timestamp":1760128277000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5338\/10\/8\/169"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,11]]},"references-count":54,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["hydrology10080169"],"URL":"https:\/\/doi.org\/10.3390\/hydrology10080169","relation":{},"ISSN":["2306-5338"],"issn-type":[{"value":"2306-5338","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,11]]}}}