{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,4]],"date-time":"2025-12-04T14:38:49Z","timestamp":1764859129764,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2019,7,15]],"date-time":"2019-07-15T00:00:00Z","timestamp":1563148800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000104","name":"National Aeronautics and Space Administration","doi-asserted-by":"publisher","award":["NNX14AJ32G"],"award-info":[{"award-number":["NNX14AJ32G"]}],"id":[{"id":"10.13039\/100000104","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Due to a rapid increase in accessible Earth observation data coupled with high computing and storage capabilities, multiple efforts over the past few years have aimed to map land use\/land cover using image time series with promising outcomes. Here, we evaluate the comparative performance of alternative land cover classifications generated by using only (1) phenological metrics derived from either of two land surface phenology models, or (2) a suite of spectral band percentiles and normalized ratios (spectral variables), or (3) a combination of phenological metrics and spectral variables. First, several annual time series of remotely sensed data were assembled: Accumulated growing degree-days (AGDD) from the MODerate resolution Imaging Spectroradiometer (MODIS) 8-day land surface temperature products, 2-band Enhanced Vegetation Index (EVI2), and the spectral variables from the Harmonized Landsat Sentinel-2, as well as from the U.S. Landsat Analysis Ready Data surface reflectance products. Then, at each pixel, EVI2 time series were fitted using two different land surface phenology models: The Convex Quadratic model (CxQ), in which EVI2 = f(AGDD) and the Hybrid Piecewise Logistic Model (HPLM), in which EVI2 = f(day of year). Phenometrics and spectral variables were submitted separately and together to Random Forest Classifiers (RFC) to depict land use\/land cover in Roberts County, South Dakota. HPLM RFC models showed slightly better accuracy than CxQ RFC models (about 1% relative higher in overall accuracy). Compared to phenometrically-based RFC models, spectrally-based RFC models yielded more accurate land cover maps, especially for non-crop cover types. However, the RFC models built from spectral variables could not accurately classify the wheat class, which contained mostly spring wheat with some fields in durum or winter varieties. The most accurate RFC models were obtained when using both phenometrics and spectral variables as inputs. The combined-variable RFC models overcame weaknesses of both phenometrically-based classification (low accuracy for non-vegetated covers) and spectrally-based classification (low accuracy for wheat). The analysis of important variables indicated that land cover classification for this study area was strongly driven by variables related to the initial green-up phase of seasonal growth and maximum fitted EVI2. For a deeper evaluation of RFC performance, RFC classifications were also executed with several alternative sampling scenarios, including different spatiotemporal filters to improve accuracy of sample pools and different sample sizes. Results indicated that a sample pool with less filtering yielded the most accurate predicted land cover map and a stratified random sample dataset covering approximately 0.25% or more of the study area were required to achieve an accurate land cover map. In case of data scarcity, a smaller dataset might be acceptable, but should not smaller than 0.05% of the study area.<\/jats:p>","DOI":"10.3390\/rs11141677","type":"journal-article","created":{"date-parts":[[2019,7,16]],"date-time":"2019-07-16T02:23:16Z","timestamp":1563243796000},"page":"1677","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Characterizing Land Use\/Land Cover Using Multi-Sensor Time Series from the Perspective of Land Surface Phenology"],"prefix":"10.3390","volume":"11","author":[{"given":"Lan H.","family":"Nguyen","sequence":"first","affiliation":[{"name":"Geospatial Sciences Center of Excellence, South Dakota State University, Brookings, SD 57007, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8999-2709","authenticated-orcid":false,"given":"Geoffrey M.","family":"Henebry","sequence":"additional","affiliation":[{"name":"Department of Geography, Environment, and Spatial Sciences, Michigan State University, East Lansing, MI 48824, USA"},{"name":"Center for Global Change and Earth Observations, Michigan State University, East Lansing, MI 48823, USA"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,15]]},"reference":[{"key":"ref_1","unstructured":"Goebel, J.J. (1998). The National Resources Inventory and its Role in US Agriculture, International Statistical Institute."},{"key":"ref_2","unstructured":"Miller, D., McCarthy, J., and Zakzeski, A. (2009, January 1\u20136). A fresh approach to agricultural statistics: Data mining and remote sensing. Proceedings of the Joint Statistical Meetings, Washington, DC, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"829","DOI":"10.14358\/PERS.70.7.829","article-title":"Development of a 2001 national land-cover database for the United States","volume":"70","author":"Homer","year":"2004","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1133","DOI":"10.1016\/j.rse.2009.02.004","article-title":"Updating the 2001 National Land Cover Database land cover classification to 2006 by using Landsat imagery change detection methods","volume":"113","author":"Xian","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_5","first-page":"345","article-title":"Completion of the 2011 National Land Cover Database for the conterminous United States\u2013representing a decade of land cover change information","volume":"81","author":"Homer","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_6","unstructured":"Boryan, C. (2019, March 10). The USDA NASS Cropland Data Layer Program Transition from Research to Operations (2006\u20132009), Available online: https:\/\/www.nass.usda.gov\/Research_and_Science\/Cropland\/SARS1a.php."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.isprsjprs.2016.03.008","article-title":"Optical remotely sensed time series data for land cover classification: A review","volume":"116","author":"White","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/S0034-4257(00)00159-0","article-title":"A comparison of multispectral and multitemporal information in high spatial resolution imagery for classification of individual tree species in a temperate hardwood forest","volume":"75","author":"Key","year":"2001","journal-title":"Remote Sens. Environ."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4857","DOI":"10.3390\/rs5104857","article-title":"Single and multi-date Landsat classifications of basalt to support soil survey efforts","volume":"5","author":"Mitchell","year":"2013","journal-title":"Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1080\/07038992.2015.1089401","article-title":"Large area mapping of annual land cover dynamics using multi-temporal change detection and classification of Landsat time-series data","volume":"41","author":"Franklin","year":"2015","journal-title":"Can. J. Remote. Sens."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Schwartz, M.D. (2013). Remote sensing of land surface phenology: A prospectus. Phenology: An Integrative Environmental Science, 2e, Springer.","DOI":"10.1007\/978-94-007-6925-0"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7777","DOI":"10.1080\/01431161.2010.527397","article-title":"A phenology-based approach to map crop types in the San Joaquin Valley, California","volume":"32","author":"Zhong","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"11518","DOI":"10.3390\/rs61111518","article-title":"Land cover classification of Landsat data with phenological features extracted from time series MODIS NDVI data","volume":"6","author":"Jia","year":"2014","journal-title":"Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1142","DOI":"10.1109\/JSTARS.2013.2294956","article-title":"Phenology-driven land cover classification and trend analysis based on long-term remote sensing image series","volume":"7","author":"Xue","year":"2014","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1080\/01431161.2014.999167","article-title":"Phenology-based classification of vegetation cover types in Northeast China using MODIS NDVI and EVI time series","volume":"36","author":"Yan","year":"2015","journal-title":"Int. J. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kong, F., Li, X., Wang, H., Xie, D., Li, X., and Bai, Y. (2016). Land cover classification based on fused data from GF-1 and MODIS NDVI time series. Remote Sens., 8.","DOI":"10.3390\/rs8090741"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1109\/JSTARS.2015.2508639","article-title":"Classification of vegetation type in Iraq using satellite-based phenological parameters","volume":"9","author":"Qader","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Nguyen, L.H., Joshi, D.R., Clay, D.E., and Henebry, G.M. (2019). Characterizing land cover\/land use from multiple years of Landsat and MODIS time series: A novel approach using land surface phenology modeling and random forest classifiers. Remote Sens. Environ.","DOI":"10.1016\/j.rse.2018.12.016"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/0034-4257(79)90013-0","article-title":"Red and photographic infrared linear combinations for monitoring vegetation","volume":"8","author":"Tucker","year":"1979","journal-title":"Remote Sens. Environ."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"USGS (U.S. Geological Survey) (2019, March 10). Landsat collections: U.S. Geological Survey Fact Sheet 2018\u20133049, Available online: https:\/\/doi.org\/10.3133\/fs20183049.","DOI":"10.3133\/fs20183049"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1016\/j.rse.2003.11.006","article-title":"Land surface phenology, climatic variation, and institutional change: Analyzing agricultural land cover change in Kazakhstan","volume":"89","author":"Henebry","year":"2004","journal-title":"Remote Sens. Environ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1016\/j.rse.2014.10.012","article-title":"Reconstruction of a complete global time series of daily vegetation index trajectory from long-term AVHRR data","volume":"156","author":"Zhang","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3833","DOI":"10.1016\/j.rse.2008.06.006","article-title":"Development of a two-band enhanced vegetation index without a blue band","volume":"112","author":"Jiang","year":"2008","journal-title":"Remote Sens. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Congalton, R.G., and Green, K. (2008). Assessing the Accuracy of Remotely Sensed Data: Principles and Practices, CRC Press.","DOI":"10.1201\/9781420055139"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"4407","DOI":"10.1080\/01431161.2011.552923","article-title":"Death to Kappa: Birth of quantity disagreement and allocation disagreement for accuracy assessment","volume":"32","author":"Pontius","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"13","DOI":"10.20982\/tqmp.04.1.p013","article-title":"The Mann-Whitney U: A test for assessing whether two independent samples come from the same distribution","volume":"4","author":"Nachar","year":"2008","journal-title":"Tutor. Quant. Methods Psychol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1658","DOI":"10.1016\/j.rse.2009.03.014","article-title":"Classification accuracy comparison: Hypothesis tests and the use of confidence intervals in evaluations of difference, equivalence, and non-inferiority","volume":"113","author":"Foody","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1177\/1948550617697177","article-title":"Equivalence tests: A practical primer for t tests, correlations, and meta-analyses","volume":"8","author":"Lakens","year":"2017","journal-title":"Soc. Psychol. Personal. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1363","DOI":"10.3390\/rs10091363","article-title":"Analysis ready data: Enabling analysis of the Landsat archive","volume":"10","author":"Dwyer","year":"2018","journal-title":"Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.rse.2018.09.002","article-title":"The Harmonized Landsat and Sentinel-2 surface reflectance data set","volume":"219","author":"Claverie","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_31","unstructured":"Wan, Z., Hook, S., and Hulley, G. (2015). MYD11A2 MODIS\/Aqua Land Surface Temperature\/ Emissivity 8-Day L3 Global 1km SIN Grid V006 [Data Set], NASA EOSDIS LP DAAC."},{"key":"ref_32","unstructured":"Wan, Z., Hook, S., and Hulley, G. (2015). MOD11A2 MODIS\/Terra Land Surface Temperature\/ Emissivity 8-Day L3 Global 1km SIN Grid V006 [Data Set], NASA EOSDIS LP DAAC."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1080\/10106049.2011.562309","article-title":"Monitoring US agriculture: The US Department of Agriculture, National Agricultural Statistics Service, Cropland Data Layer program","volume":"26","author":"Boryan","year":"2011","journal-title":"Geocarto Int."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1016\/S0034-4257(02)00135-9","article-title":"Monitoring vegetation phenology using MODIS","volume":"84","author":"Zhang","year":"2003","journal-title":"Remote Sens. Environ."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.rse.2017.05.024","article-title":"Using the 500 m MODIS land cover product to derive a consistent continental scale 30 m Landsat land cover classification","volume":"197","author":"Zhang","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"9655","DOI":"10.3390\/rs70809655","article-title":"An evaluation of different training sample allocation schemes for discrete and continuous land cover classification using decision tree-based algorithms","volume":"7","author":"Colditz","year":"2015","journal-title":"Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"8489","DOI":"10.3390\/rs70708489","article-title":"On the importance of training data sample selection in random forest image classification: A case study in peatland ecosystem mapping","volume":"7","author":"Millard","year":"2015","journal-title":"Remote Sens."},{"key":"ref_39","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.patrec.2005.08.011","article-title":"Random forests for land cover classification","volume":"27","author":"Gislason","year":"2006","journal-title":"Pattern Recognit Lett."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.isprsjprs.2011.11.002","article-title":"An assessment of the effectiveness of a random forest classifier for land-cover classification","volume":"67","author":"Ghimire","year":"2012","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"5321","DOI":"10.1080\/01431161.2010.498841","article-title":"Impact of reference datasets and autocorrelation on classification accuracy","volume":"32","author":"Mannel","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.isprsjprs.2013.09.010","article-title":"The use of single-date MODIS imagery for estimating large-scale urban impervious surface fraction with spectral mixture analysis and machine learning techniques","volume":"86","author":"Deng","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.isprsjprs.2015.03.002","article-title":"Random forest and rotation forest for fully polarized SAR image classification using polarimetric and spatial features","volume":"105","author":"Du","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1037\/a0024338","article-title":"Effect size estimates: Current use, calculations, and interpretation","volume":"141","author":"Fritz","year":"2012","journal-title":"J. Exp. Psychol. Gen."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Krehbiel, C., Zhang, X., and Henebry, G.M. (2017). Impacts of thermal time on land surface phenology in urban areas. Remote Sens., 9.","DOI":"10.3390\/rs9050499"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2043","DOI":"10.1109\/JSTARS.2015.2496951","article-title":"Web-enabled Landsat data time series for monitoring urban heat island impacts on land surface phenology","volume":"9","author":"Krehbiel","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1016\/j.rse.2018.02.067","article-title":"A cubesat enabled spatio-temporal enhancement method (CESTEM) utilizing Planet, Landsat and MODIS data","volume":"209","author":"Houborg","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.rse.2017.01.001","article-title":"Exploration of scaling effects on coarse resolution land surface phenology","volume":"190","author":"Zhang","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.rse.2014.01.011","article-title":"Continuous change detection and classification of land cover using all available Landsat data","volume":"144","author":"Zhu","year":"2014","journal-title":"Remote Sens. Environ."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/14\/1677\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:05:44Z","timestamp":1760187944000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/14\/1677"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,15]]},"references-count":50,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2019,7]]}},"alternative-id":["rs11141677"],"URL":"https:\/\/doi.org\/10.3390\/rs11141677","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2019,7,15]]}}}