{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T02:36:47Z","timestamp":1775875007291,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,6,5]],"date-time":"2023-06-05T00:00:00Z","timestamp":1685923200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Deseret Cattle and Citrus"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Both the vastness of pasturelands and the value they contain\u2014e.g., food security, ecosystem services\u2014have resulted in increased scientific and industry efforts to remotely monitor them via satellite imagery and machine learning (ML). However, the transferability of these models is uncertain, as modelers commonly train and test on site-specific or homogenized\u2014i.e., randomly partitioned\u2014datasets and choose complex ML algorithms with increased potential to overfit a limited dataset. In this study, we evaluated the accuracy and transferability of remote sensing pasture models, using multiple ML algorithms and evaluation structures. Specifically, we predicted pasture above-ground biomass and nitrogen concentration from Sentinel-2 imagery. The implemented ML algorithms include principal components regression (PCR), partial least squares regression (PLSR), least absolute shrinkage and selection operator (LASSO), random forest (RF), support vector machine regression (SVR), and a gradient boosting model (GBM). The evaluation structures were determined using levels of spatial and temporal dissimilarity to partition the train and test datasets. Our results demonstrated a general decline in accuracy as evaluation structures increase in spatiotemporal dissimilarity. In addition, the more simplistic algorithms\u2014PCR, PLSR, and LASSO\u2014out-performed the more complex models RF, SVR, and GBM for the prediction of dissimilar evaluation structures. We conclude that multi-spectral satellite and pasture physiological variable datasets, such as the one presented in this study, contain spatiotemporal internal dependence, which makes the generalization of predictive models to new localities challenging, especially for complex ML algorithms. Further studies on this topic should include the assessment of model transferability by using dissimilar evaluation structures, and we expect generalization to improve for larger and denser datasets.<\/jats:p>","DOI":"10.3390\/rs15112940","type":"journal-article","created":{"date-parts":[[2023,6,5]],"date-time":"2023-06-05T04:34:51Z","timestamp":1685939691000},"page":"2940","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Assessing Transferability of Remote Sensing Pasture Estimates Using Multiple Machine Learning Algorithms and Evaluation Structures"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3676-8655","authenticated-orcid":false,"given":"Hunter D.","family":"Smith","sequence":"first","affiliation":[{"name":"Agronomy Department, University of Florida, Gainesville, FL 32611, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8269-9959","authenticated-orcid":false,"given":"Jose C. B.","family":"Dubeux","sequence":"additional","affiliation":[{"name":"North Florida Research and Education Center, University of Florida, Marianna, FL 32446, USA"}]},{"given":"Alina","family":"Zare","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL 32611, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7695-8299","authenticated-orcid":false,"given":"Chris H.","family":"Wilson","sequence":"additional","affiliation":[{"name":"Agronomy Department, University of Florida, Gainesville, FL 32611, USA"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,5]]},"reference":[{"key":"ref_1","unstructured":"Conant, R.T. (2010). Challenges and Opportunities for Carbon Sequestration in Grassland Systems, FAO. Integrated Crop Management."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.eja.2008.05.005","article-title":"Precision agriculture on grassland: Applications, perspectives and constraints","volume":"29","author":"Schellberg","year":"2008","journal-title":"Eur. J. Agron."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Reinermann, S., Asam, S., and Kuenzer, C. (2020). Remote sensing of grassland production and management\u2014A review. Remote Sens., 12.","DOI":"10.3390\/rs12121949"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1093\/jpe\/rtw005","article-title":"Satellite remote sensing of grasslands: From observation to management","volume":"9","author":"Ali","year":"2016","journal-title":"J. Plant Ecol."},{"key":"ref_5","unstructured":"Sollenberger, L.E., Aiken, G.E., and Wallau, M.O. (2020). Management Strategies for Sustainable Cattle Production in Southern Pastures, Academic Press."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1021\/ci0342472","article-title":"The problem of overfitting","volume":"44","author":"Hawkins","year":"2004","journal-title":"J. Chem. Inf. Comput. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/0034-4257(93)90040-5","article-title":"Evaluating Landsat Thematic Mapper derived vegetation indices for estimating above-ground biomass on semiarid rangelands","volume":"45","author":"Anderson","year":"1993","journal-title":"Remote Sens. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Cisneros, A., Fiorio, P., Menezes, P., Pasqualotto, N., Van Wittenberghe, S., Bayma, G., and Furlan Nogueira, S. (2020). Mapping productivity and essential biophysical parameters of cultivated tropical grasslands from sentinel-2 imagery. Agronomy, 10.","DOI":"10.3390\/agronomy10050711"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1109\/TGRS.1995.8746027","article-title":"A feedback based modification of the NDVI to minimize canopy background and atmospheric noise","volume":"33","author":"Liu","year":"1995","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/S0034-4257(02)00096-2","article-title":"Overview of the radiometric and biophysical performance of the MODIS vegetation indices","volume":"83","author":"Huete","year":"2002","journal-title":"Remote Sens. Environ."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Garroutte, E.L., Hansen, A.J., and Lawrence, R.L. (2016). Using NDVI and EVI to map spatiotemporal variation in the biomass and quality of forage for migratory elk in the Greater Yellowstone Ecosystem. Remote Sens., 8.","DOI":"10.3390\/rs8050404"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.isprsjprs.2015.10.005","article-title":"Examining the potential of Sentinel-2 MSI spectral resolution in quantifying above ground biomass across different fertilizer treatments","volume":"110","author":"Sibanda","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.rse.2003.12.004","article-title":"Integrating imaging spectroscopy and neural networks to map grass quality in the Kruger National Park, South Africa","volume":"90","author":"Mutanga","year":"2004","journal-title":"Remote Sens. Environ."},{"key":"ref_14","first-page":"43","article-title":"Monitoring grass nutrients and biomass as indicators of rangeland quality and quantity using random forest modelling and WorldView-2 data","volume":"43","author":"Ramoelo","year":"2015","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ramoelo, A., and Cho, M.A. (2018). Explaining leaf nitrogen distribution in a semi-arid environment predicted on Sentinel-2 imagery using a field spectroscopy derived model. Remote Sens., 10.","DOI":"10.3390\/rs10020269"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1111\/ecog.02881","article-title":"Cross-validation strategies for data with temporal, spatial, hierarchical, or phylogenetic structure","volume":"40","author":"Roberts","year":"2017","journal-title":"Ecography"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"111322","DOI":"10.1016\/j.rse.2019.111322","article-title":"Land-cover classification with high-resolution remote sensing images using transferable deep models","volume":"237","author":"Tong","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Qin, R., and Liu, T. (2022). A review of landcover classification with very-high resolution remotely sensed optical images\u2014Analysis unit, model scalability and transferability. Remote Sens., 14.","DOI":"10.3390\/rs14030646"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1016\/S0034-4257(03)00039-7","article-title":"Predictive relations of tropical forest biomass from Landsat TM data and their transferability between regions","volume":"85","author":"Foody","year":"2003","journal-title":"Remote Sens. Environ."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Jin, S., Su, Y., Gao, S., Hu, T., Liu, J., and Guo, Q. (2018). The transferability of Random Forest in canopy height estimation from multi-source remote sensing data. Remote Sens., 10.","DOI":"10.3390\/rs10081183"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.rse.2018.02.026","article-title":"A comparison of resampling methods for remote sensing classification and accuracy assessment","volume":"208","author":"Lyons","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1111\/j.2041-210X.2011.00170.x","article-title":"Assessing transferability of ecological models: An underappreciated aspect of statistical validation","volume":"3","author":"Wenger","year":"2012","journal-title":"Methods Ecol. Evol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"790","DOI":"10.1016\/j.tree.2018.08.001","article-title":"Outstanding challenges in the transferability of ecological models","volume":"33","author":"Yates","year":"2018","journal-title":"Trends Ecol. Evol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1111\/j.1600-0587.2011.06999.x","article-title":"Does the interpolation accuracy of species distribution models come at the expense of transferability?","volume":"35","author":"Heikkinen","year":"2012","journal-title":"Ecography"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"022022","DOI":"10.1088\/1742-6596\/1168\/2\/022022","article-title":"An Overview of Overfitting and Its Solutions","volume":"1168","author":"Ying","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_26","unstructured":"Paris, G., Robilliard, D., and Fonlupt, C. (2003). International Conference on Artificial Evolution (Evolution Artificielle), Springer."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3844","DOI":"10.1002\/csc2.20568","article-title":"Water footprint, herbage, and livestock responses for nitrogen-fertilized grass and grass\u2013legume grazing systems","volume":"61","author":"Jaramillo","year":"2021","journal-title":"Crop Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"108363","DOI":"10.1016\/j.ecolind.2021.108363","article-title":"Comparing vegetation indices from Sentinel-2 and Landsat 8 under different vegetation gradients based on a controlled grazing experiment","volume":"133","author":"Qin","year":"2021","journal-title":"Ecol. Indic."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1007\/BF00122022","article-title":"Observations of in situ fluorescence of chlorophyll-a in Saanich Inlet","volume":"18","author":"Gower","year":"1980","journal-title":"Bound. -Layer Meteorol."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dall\u2019Olmo, G., Gitelson, A.A., and Rundquist, D.C. (2003). Towards a unified approach for remote estimation of chlorophyll-a in both terrestrial vegetation and turbid productive waters. Geophys. Res. Lett., 30.","DOI":"10.1029\/2003GL018065"},{"key":"ref_31","unstructured":"Huete, A.R., Liu, H., and van Leeuwen, W.J. Proceedings of the IGARSS\u201997\u20141997 IEEE International Geoscience and Remote Sensing Symposium Proceedings. Remote Sensing\u2014A Scientific Vision for Sustainable Development."},{"key":"ref_32","first-page":"165","article-title":"Estimating chlorophyll content of crops from hyperspectral data using a normalized area over reflectance curve (NAOC)","volume":"12","author":"Delegido","year":"2010","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_33","first-page":"87","article-title":"Using thematic mapper data to identify contrasting soil plains and tillage practices","volume":"63","author":"Ward","year":"1997","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_34","first-page":"309","article-title":"Monitoring vegetation systems in the Great Plains with ERTS","volume":"351","author":"Rouse","year":"1974","journal-title":"NASA Spec. Publ."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/S0034-4257(96)00067-3","article-title":"NDWI\u2014A normalized difference water index for remote sensing of vegetation liquid water from space","volume":"58","author":"Gao","year":"1996","journal-title":"Remote Sens. Environ."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chen, T., and Guestrin, C. (2016, January 13\u201317). Xgboost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, New York, NY, USA.","DOI":"10.1145\/2939672.2939785"},{"key":"ref_37","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1111\/j.2517-6161.1974.tb00994.x","article-title":"Cross-validatory choice and assessment of statistical predictions","volume":"36","author":"Stone","year":"1974","journal-title":"J. R. Stat. Soc. Ser. B Methodol."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"108081","DOI":"10.1016\/j.ecolind.2021.108081","article-title":"The use of machine learning methods to estimate aboveground biomass of grasslands: A review","volume":"130","author":"Morais","year":"2021","journal-title":"Ecol. Indic."},{"key":"ref_40","first-page":"100298","article-title":"Making sense in the cloud: Farm advisory services in a smart farming future","volume":"90","author":"Eastwood","year":"2019","journal-title":"NJAS-Wagening J. Life Sci."},{"key":"ref_41","unstructured":"Sarle, W.S. (1995, January 21\u201324). Stopped training and other remedies for overfitting. Proceedings of the 27th Symposium on the Interface of Computing Science and Statistics, Fairfax, VA, USA."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.cageo.2013.10.008","article-title":"Geological mapping using remote sensing data: A comparison of five machine learning algorithms, their response to variations in the spatial distribution of training data and the use of explicit spatial information","volume":"63","author":"Cracknell","year":"2014","journal-title":"Comput. Geosci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"8830","DOI":"10.3390\/rs70708830","article-title":"The EnMAP spaceborne imaging spectroscopy mission for earth observation","volume":"7","author":"Guanter","year":"2015","journal-title":"Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/0034-4257(74)90003-0","article-title":"Vegetation canopy reflectance","volume":"3","author":"Colwell","year":"1974","journal-title":"Remote Sens. Environ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/gfs.12312","article-title":"Remote sensing as a tool to assess botanical composition, structure, quantity and quality of temperate grasslands","volume":"73","author":"Wachendorf","year":"2018","journal-title":"Grass Forage Sci."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/11\/2940\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:48:25Z","timestamp":1760125705000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/11\/2940"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,5]]},"references-count":45,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["rs15112940"],"URL":"https:\/\/doi.org\/10.3390\/rs15112940","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,5]]}}}