{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T19:35:46Z","timestamp":1776800146063,"version":"3.51.2"},"reference-count":43,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2020,5,23]],"date-time":"2020-05-23T00:00:00Z","timestamp":1590192000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100006959","name":"U.S. Forest Service","doi-asserted-by":"publisher","award":["None"],"award-info":[{"award-number":["None"]}],"id":[{"id":"10.13039\/100006959","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NASA","award":["as per Funding section in paper"],"award-info":[{"award-number":["as per Funding section in paper"]}]},{"DOI":"10.13039\/100000203","name":"USGS","doi-asserted-by":"publisher","award":["Landsat Science Team"],"award-info":[{"award-number":["Landsat Science Team"]}],"id":[{"id":"10.13039\/100000203","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Disturbance monitoring is an important application of the Landsat times series, both to monitor forest dynamics and to support wise forest management at a variety of spatial and temporal scales. In the last decade, there has been an acceleration in the development of approaches designed to put the Landsat archive to use towards these causes. Forest disturbance mapping has moved from using individual change-detection algorithms, which implement a single set of decision rules that may not apply well to a range of scenarios, to compiling ensembles of such algorithms. One approach that has greatly reduced disturbance detection error has been to combine individual algorithm outputs in Random Forest (RF) ensembles trained with disturbance reference data, a process called stacking (or secondary classification). Previous research has demonstrated more robust and sensitive detection of disturbance using stacking with both multialgorithm ensembles and multispectral ensembles (which make use of a single algorithm applied to multiple spectral bands). In this paper, we examined several additional dimensions of this problem, including: (1) type of algorithm (represented by processes using one image per year vs. all historical images); (2) spectral band choice (including both the basic Landsat reflectance bands and several popular indices based on those bands); (3) number of algorithm\/spectral-band combinations needed; and (4) the value of including both algorithm and spectral band diversity in the ensembles. We found that ensemble performance substantially improved per number of model inputs if those inputs were drawn from a diversity of both algorithms and spectral bands. The best models included inputs from both algorithms, using different variants of shortwave-infrared (SWIR) and near-infrared (NIR) reflectance. Further disturbance detection improvement may depend upon the development of algorithms which either interrogate SWIR and NIR in new ways or better highlight disturbance signals in the visible wavelengths.<\/jats:p>","DOI":"10.3390\/rs12101673","type":"journal-article","created":{"date-parts":[[2020,5,25]],"date-time":"2020-05-25T11:42:02Z","timestamp":1590406922000},"page":"1673","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Diversity of Algorithm and Spectral Band Inputs Improves Landsat Monitoring of Forest Disturbance"],"prefix":"10.3390","volume":"12","author":[{"given":"Warren B.","family":"Cohen","sequence":"first","affiliation":[{"name":"Department of Forest Ecosystems and Society, 321 Richardson Hall, Oregon State University, Corvallis, OR 97331, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sean P.","family":"Healey","sequence":"additional","affiliation":[{"name":"Rocky Mountain Research Station, USDA Forest Service, Ogden, UT 84401, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhiqiang","family":"Yang","sequence":"additional","affiliation":[{"name":"Rocky Mountain Research Station, USDA Forest Service, Ogden, UT 84401, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8283-6407","authenticated-orcid":false,"given":"Zhe","family":"Zhu","sequence":"additional","affiliation":[{"name":"Department of Natural Resources and the Environment, University of Connecticut, Storrs, CT 06269, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5548-2436","authenticated-orcid":false,"given":"Noel","family":"Gorelick","sequence":"additional","affiliation":[{"name":"Google Switzerland (GmbH) and Department of Geography, University of Zurich, CH 8002 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1038\/nclimate2869","article-title":"A role for tropical forests in stabilizing atmospheric CO2","volume":"5","author":"Houghton","year":"2015","journal-title":"Nat. Clim. Chang."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.foreco.2015.03.039","article-title":"Protective functions and ecosystem services of global forests in the past quarter-century","volume":"352","author":"Miura","year":"2015","journal-title":"For. Ecol. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1038\/s41559-018-0490-x","article-title":"The exceptional value of intact forest ecosystems","volume":"2","author":"Watson","year":"2018","journal-title":"Nat. Ecol. Evol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.ecolecon.2013.05.005","article-title":"Valuing forest ecosystem services: What we know and what we don\u2019t","volume":"93","author":"Ninan","year":"2013","journal-title":"Ecol. Economics"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1038\/nclimate2816","article-title":"Conservation policy and the measurement of forests","volume":"6","author":"Sexton","year":"2016","journal-title":"Nat. Clim. Chang."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"G00E02","DOI":"10.1029\/2008JG000911","article-title":"Forest disturbance and recovery: A general review in the context of spaceborne remote sensing of impacts on aboveground biomass and canopy structure","volume":"114","author":"Frolking","year":"2009","journal-title":"J. Geophys. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5633","DOI":"10.3390\/rs6065633","article-title":"Remote sensing assessment of forest disturbance across complex mountainous terrain: The pattern and severity of impacts of tropical cyclone Yasi on Australian rainforests","volume":"6","author":"Chambers","year":"2014","journal-title":"Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Birdsey, R.A., Dugan, A.J., Healey, S.P., Dante-Wood, K., Zhang, F., Mo, G., Chen, J.M., Hernandez, A.J., Raymond, C.L., and McCarter, J. (2020, April 10). Assessment of the Influence of Disturbance, Management Activities, and Environmental Factors on Carbon Stocks of US National Forests, Available online: https:\/\/www.fs.usda.gov\/treesearch\/pubs\/59157.","DOI":"10.2737\/RMRS-GTR-402"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"850","DOI":"10.1126\/science.1244693","article-title":"High-resolution global maps of 21st-century forest cover change","volume":"342","author":"Hansen","year":"2013","journal-title":"Science"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.rse.2014.02.001","article-title":"Landsat-8: Science and product vision for terrestrial global change research","volume":"145","author":"Roy","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.rse.2019.02.015","article-title":"Current status of Landsat pro-gram, science, and applications","volume":"225","author":"Wulder","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.1126\/science.320.5879.1011a","article-title":"Free access to Land-sat data, Letter","volume":"320","author":"Woodcock","year":"2008","journal-title":"Science"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1080\/07038992.2014.987376","article-title":"Forest monitoring using Landsat time series data: A review","volume":"40","author":"Banskota","year":"2014","journal-title":"Can. J. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1109\/LGRS.2005.857030","article-title":"A Landsat surface reflectance data set for North America, 1990\u20132000","volume":"3","author":"Masek","year":"2006","journal-title":"Geosci. Remote Sens. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.rse.2014.06.012","article-title":"Automated cloud, cloud shadow, and snow detection in multitemporal Landsat data: An algorithm designed specifically for monitoring land cover change","volume":"152","author":"Zhu","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.isprsjprs.2017.06.013","article-title":"Change detection using Landsat time series: A review of frequencies, preprocessing, algorithms, and applications","volume":"130","author":"Zhu","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2897","DOI":"10.1016\/j.rse.2010.07.008","article-title":"Detecting trends in forest disturbance and recovery using yearly Landsat time series: 1. LandTrendr\u2014Temporal segmentation algorithms","volume":"114","author":"Kennedy","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.rse.2014.01.011","article-title":"Continuous change detection and classification of land cover using all available Landsat data","volume":"144","author":"Zhu","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Cohen, W.B., Healey, S.P., Yang, Z., Stehman, S.V., Brewer, C.K., Brooks, E.B., Gorelick, N., Huang, C., Hughes, M.J., and Kennedy, R.E. (2017). How similar are forest disturbance maps derived from different Landsat time series algorithms?. Forests, 8.","DOI":"10.3390\/f8040098"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1016\/j.foreco.2015.10.042","article-title":"Forest disturbance in the conterminous US from 1985-2012: The emerging dominance of forest decline","volume":"360","author":"Cohen","year":"2016","journal-title":"For. Ecol. Manag."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1016\/j.rse.2017.09.029","article-title":"Mapping forest change using stacked generalization: An ensemble approach","volume":"204","author":"Healey","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","article-title":"Stacked generalization","volume":"5","author":"Wolpert","year":"1992","journal-title":"Neural Netw."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.rse.2017.11.015","article-title":"A LandTrendr multi-spectral ensemble for forest disturbance detection","volume":"205","author":"Cohen","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"111116","DOI":"10.1016\/j.rse.2019.03.009","article-title":"Continuous monitoring of land disturbance based on Landsat time series","volume":"238","author":"Zhu","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2911","DOI":"10.1016\/j.rse.2010.07.010","article-title":"Detecting trends in forest disturbance and recovery using yearly Landsat time series: 2. TimeSync\u2014Tools for calibration and validation","volume":"114","author":"Cohen","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_27","first-page":"345","article-title":"Completion of the 2011 National Land Cover Database for the conterminous United States\u2014Representing a decade of land cover change information","volume":"81","author":"Homer","year":"2015","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_28","unstructured":"Kauth, R.J., and Thomas, G.S. (July, January 29). The tasseled cap\u2014a graphic description of the spectral\u2013temporal development of agricultural crops as seen by Landsat. Proceedings of the Symposium on Machine Processing of Remotely Sensed Data, Purdue University, West Lafayette, IN, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1109\/TGRS.1984.350619","article-title":"A physically-based transformation of thematic mapper data\u2014The TM tasseled cap","volume":"22","author":"Crist","year":"1984","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.rse.2011.09.024","article-title":"Spatial and temporal patterns of forest disturbance and regrowth within the area of the Northwest Forest Plan","volume":"122","author":"Kennedy","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3520","DOI":"10.1080\/01431161.2014.907937","article-title":"Relationship between spatio-temporal characteristics of leaf-fall phenology and seasonal variations in near surface- and satellite-observed vegetation indices in a cool-temperate deciduous broad-leaved forest in Japan","volume":"35","author":"Nagai","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.rse.2016.02.018","article-title":"Imaging phenology; scaling from camera plots to landscapes","volume":"177","author":"Nijland","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.ecolmodel.2015.12.005","article-title":"Multi-criteria evaluation of the suitability of growth functions for modeling remotely sensed phenology","volume":"323","author":"Verma","year":"2016","journal-title":"Ecol. Model."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2575","DOI":"10.1109\/TGRS.2003.819190","article-title":"Forest fire scar detection in the boreal forest with multitemporal SPOT-VEGETATION data","volume":"41","author":"Gerard","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ozdogan, M. (2014). A practical and automated approach to large area forest disturbance mapping with remote sensing. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0078438"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"3297","DOI":"10.1016\/j.foreco.2008.02.010","article-title":"Remote sensing assessment of forest damage in relation to the 1996 strong typhoon Herb at Lienhuachi Experimental Forest, Taiwan","volume":"255","author":"Lee","year":"2008","journal-title":"For. Ecol. Manag."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3316","DOI":"10.1109\/TGRS.2013.2272545","article-title":"On-the-fly massively multitemporal change detection using statistical quality control charts and Landsat data","volume":"52","author":"Brooks","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_38","first-page":"72","article-title":"Seasonal changes in canopy leaf area index and MODIS vegetation products for a boreal forest site in central Finland","volume":"17","author":"Rautiainen","year":"2012","journal-title":"Boreal Environ. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1093","DOI":"10.5194\/bg-14-1093-2017","article-title":"Separating overstory and understory leaf area indices for global needleleaf and deciduous broadleaf forests by fusion of MODIS and MISR data","volume":"14","author":"Liu","year":"2017","journal-title":"Biogeosciences"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.rse.2017.11.009","article-title":"Remote sensing of mangrove forest phenology and its environmental drivers","volume":"205","author":"Dash","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Kuncheva, L.I., and Whitaker, C.J. (2001). Ten measures of diversity in classifier ensembles: Limits for two classifiers. IEE Colloquium, 73\u201382.","DOI":"10.1049\/ic:20010105"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1016\/j.isprsjprs.2017.04.017","article-title":"Exploring diversity in ensemble classification: Applications in large area land cover mapping","volume":"129","author":"Mellor","year":"2017","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1016\/j.isprsjprs.2018.01.017","article-title":"Understanding the temporal dimension of the red-edge spectral region for forest decline detection using high-resolution hyperspectral and Sentinel-2a imagery","volume":"137","author":"Beck","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/10\/1673\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:31:48Z","timestamp":1760175108000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/10\/1673"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,23]]},"references-count":43,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["rs12101673"],"URL":"https:\/\/doi.org\/10.3390\/rs12101673","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,5,23]]}}}