{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T21:34:13Z","timestamp":1773869653147,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2019,11,25]],"date-time":"2019-11-25T00:00:00Z","timestamp":1574640000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004895","name":"European Social Fund","doi-asserted-by":"publisher","award":["C80815"],"award-info":[{"award-number":["C80815"]}],"id":[{"id":"10.13039\/501100004895","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Access to temporally dense time series such as data from the Landsat and Sentinel-2 missions has lead to an increase in methods which aim to monitor land cover change on a per-acquisition rather than a yearly basis. Evaluating the accuracy and limitations of these methods can be difficult because validation data are limited and often rely on human interpretation. Simulated time series offer an objective method for evaluating and comparing between change detection algorithms. A set of simulated time series was used to evaluate four change detection methods: (1) Breaks for Additive and Seasonal Trend (BFAST); (2) BFAST Monitor; (3) Continuous Change Detection and Classification (CCDC); and (4) Exponentially Weighted Moving Average Change Detection (EWMACD). In total, 151,200 simulations were generated to represent a range of abrupt, gradual, and seasonal changes. EWMACD was found to give the best performance overall, correctly identifying the true date of change in 76.6% of cases. CCDC performed worst (51.8%). BFAST performed well overall but correctly identified less than 10% of seasonal changes (changes in amplitude, length of season, or number of seasons). All methods showed some decrease in performance with increased noise and missing data, apart from BFAST Monitor which improved when data were removed. The following recommendations are made as a starting point for future studies: EWMACD should be used for detection of lower magnitude changes and changes in seasonality; CCDC should be used for robust detection of complete land cover class changes; EWMACD and BFAST are suitable for noisy datasets, depending on the application; and CCDC should be used where there are high quantities of missing data. The simulated datasets have been made freely available online as a foundation for future work.<\/jats:p>","DOI":"10.3390\/rs11232779","type":"journal-article","created":{"date-parts":[[2019,11,25]],"date-time":"2019-11-25T11:12:21Z","timestamp":1574680341000},"page":"2779","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":46,"title":["An Evaluation and Comparison of Four Dense Time Series Change Detection Methods Using Simulated Data"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6310-4577","authenticated-orcid":false,"given":"Katie","family":"Awty-Carroll","sequence":"first","affiliation":[{"name":"Department of Geography and Earth Sciences, Aberystwyth University, Aberystwyth SY23 3DB, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7435-0148","authenticated-orcid":false,"given":"Pete","family":"Bunting","sequence":"additional","affiliation":[{"name":"Department of Geography and Earth Sciences, Aberystwyth University, Aberystwyth SY23 3DB, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7928-8873","authenticated-orcid":false,"given":"Andy","family":"Hardy","sequence":"additional","affiliation":[{"name":"Department of Geography and Earth Sciences, Aberystwyth University, Aberystwyth SY23 3DB, UK"}]},{"given":"Gemma","family":"Bell","sequence":"additional","affiliation":[{"name":"Environment Systems Ltd., 9 Cefn Llan Science Park, Aberystwyth SY23 3AH, UK"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2655","DOI":"10.1111\/gcb.12865","article-title":"The Contribution of Agriculture, Forestry and other Land Use activities to Global Warming, 1990\u20132012","volume":"21","author":"Tubiello","year":"2015","journal-title":"Glob. Chang. Biol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1038\/ngeo671","article-title":"CO2 emissions from forest loss","volume":"2","author":"Morton","year":"2009","journal-title":"Nat. Geosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.rse.2014.02.001","article-title":"Landsat-8: Science and product vision for terrestrial global change research","volume":"145","author":"Roy","year":"2014","journal-title":"Remote. Sens. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.rse.2012.01.010","article-title":"Opening the archive: How free data has enabled the science and monitoring promise of Landsat","volume":"122","author":"Wulder","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2897","DOI":"10.1016\/j.rse.2010.07.008","article-title":"Detecting trends in forest disturbance and recovery using yearly Landsat time series: 1. LandTrendr\u2014Temporal segmentation algorithms","volume":"114","author":"Kennedy","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1016\/j.rse.2014.11.005","article-title":"An integrated Landsat time series protocol for change detection and generation of annual gap-free surface reflectance composites","volume":"158","author":"Hermosilla","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1430","DOI":"10.1016\/j.rse.2008.06.016","article-title":"Dynamics of national forests assessed using the Landsat record: Case studies in eastern United States","volume":"113","author":"Huang","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3518","DOI":"10.1111\/gcb.13358","article-title":"Shape selection in Landsat time series: A tool for monitoring forest dynamics","volume":"22","author":"Moisen","year":"2016","journal-title":"Glob. Chang. Biol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.isprsjprs.2017.06.013","article-title":"Change detection using landsat time series: A review of frequencies, preprocessing, algorithms, and applications","volume":"130","author":"Zhu","year":"2017","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1911","DOI":"10.1080\/014311600209814","article-title":"Reconstructing cloudfree NDVI composites using Fourier analysis of time series","volume":"21","author":"Roerink","year":"2000","journal-title":"Int. J. Remote. Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.isprsjprs.2018.07.002","article-title":"Towards a polyalgorithm for land use change detection","volume":"144","author":"Saxena","year":"2018","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2911","DOI":"10.1016\/j.rse.2010.07.010","article-title":"Detecting trends in forest disturbance and recovery using yearly Landsat time series: 2. TimeSync\u2014Tools for calibration and validation","volume":"114","author":"Cohen","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.isprsjprs.2015.03.015","article-title":"Monitoring forest cover loss using multiple data streams, a case study of a tropical dry forest in Bolivia","volume":"107","author":"Dutrieux","year":"2015","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cohen, W.B., Healey, S.P., Yang, Z., Stehman, S.V., Brewer, C.K., Brooks, E.B., Gorelick, N., Huang, C., Hughes, M.J., and Kennedy, R.E. (2017). How Similar Are Forest Disturbance Maps Derived from Different Landsat Time Series Algorithms?. Forests, 8.","DOI":"10.3390\/f8040098"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2970","DOI":"10.1016\/j.rse.2010.08.003","article-title":"Phenological change detection while accounting for abrupt and gradual trends in satellite image time series","volume":"114","author":"Verbesselt","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2113","DOI":"10.3390\/rs5052113","article-title":"Trend Change detection in NDVI time series: Effects of inter-annual variability and methodology","volume":"5","author":"Forkel","year":"2013","journal-title":"Remote Sens."},{"key":"ref_17","unstructured":"Awty-Carroll, K. (2019, November 12). Scripts Used for Evaluating and Comparing a Range of Dense Time Series Change Detection Methods. Available online: https:\/\/github.com\/klh5\/season-trend-comparison."},{"key":"ref_18","unstructured":"Verbesselt, J., Zeileis, A., and Hyndman, R. (2019, April 29). Package \u2018Bfast\u2019. Available online: https:\/\/cran.r-project.org\/web\/packages\/bfast\/bfast.pdf."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.rse.2014.11.015","article-title":"Multi-resolution time series imagery for forest disturbance and regrowth monitoring in Queensland, Australia","volume":"158","author":"Schmidt","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Grogan, K., Pflugmacher, D., Hostert, P., Verbesselt, J., and Fensholt, R. (2016). Mapping clearances in tropical dry forests using breakpoints, trend, and seasonal components from modis time series: Does forest type matter?. Remote Sens., 8.","DOI":"10.3390\/rs8080657"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1016\/j.rse.2014.08.023","article-title":"Effectiveness of the BFAST algorithm for detecting vegetation response patterns in a semi-arid region","volume":"154","author":"Watts","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Che, X., Feng, M., Yang, Y., Xiao, T., Huang, S., Xiang, Y., and Chen, Z. (2017). Mapping extent dynamics of small lakes using downscaling MODIS surface reflectance. Remote Sens., 9.","DOI":"10.3390\/rs9010082"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1007\/s00267-017-0983-4","article-title":"Estimating the Creation and Removal Date of Fracking Ponds Using Trend Analysis of Landsat Imagery","volume":"61","author":"Platt","year":"2018","journal-title":"Environ. Manag."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1016\/j.rse.2012.02.022","article-title":"Near real-time disturbance detection using satellite image time series","volume":"123","author":"Verbesselt","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.rse.2015.02.012","article-title":"Robust monitoring of small-scale forest disturbances in a tropical montane forest using Landsat time series","volume":"161","author":"DeVries","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Schultz, M., Shapiro, A., Clevers, J., Beech, C., Herold, M., Schultz, M., Shapiro, A., Clevers, J.G.P.W., Beech, C., and Herold, M. (2018). Forest Cover and Vegetation Degradation Detection in the Kavango Zambezi Transfrontier Conservation Area Using BFAST Monitor. Remote Sens., 10.","DOI":"10.3390\/rs10111850"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Murillo-Sandoval, P.J., Hilker, T., Krawchuk, M.A., and Van Den Hoek, J. (2018). Detecting and attributing drivers of forest disturbance in the Colombian andes using landsat time-series. Forests, 9.","DOI":"10.3390\/f9050269"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.rse.2014.01.011","article-title":"Continuous change detection and classification of land cover using all available Landsat data","volume":"144","author":"Zhu","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.rse.2015.02.009","article-title":"Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time","volume":"162","author":"Zhu","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_30","unstructured":"Deng, C., and Zhu, Z. (2018). Continuous subpixel mapping of impervious surface area using Landsat time series. Remote Sens. Environ."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhu, Z., Zhang, J., Yang, Z., Aljaddani, A.H., Cohen, W.B., Qiu, S., and Zhou, C. (2019). Continuous monitoring of land disturbance based on Landsat time series. Remote Sens. Environ.","DOI":"10.1016\/j.rse.2019.03.009"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3316","DOI":"10.1109\/TGRS.2013.2272545","article-title":"On-the-fly massively multitemporal change detection using statistical quality control charts and landsat data","volume":"52","author":"Brooks","year":"2014","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_33","unstructured":"Brooks, E.B., Wynne, R.H., Thomas, V.A., Blinn, C.E., and Coulston, J. (2019, April 29). Exponentially Weighted Moving Average Change Detection\u2014Script and Sample Data. Available online: http:\/\/vtechworks.lib.vt.edu\/handle\/10919\/50544."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Brooks, E.B., Yang, Z., Thomas, V.A., and Wynne, R.H. (2017). Edyn: Dynamic signaling of changes to forests using exponentially weighted moving average charts. Forests, 8.","DOI":"10.3390\/f8090304"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1029\/97GB00330","article-title":"A continental phenology model for monitoring vegetation responses to interannual climatic variability","volume":"11","author":"White","year":"1997","journal-title":"Glob. Biogeochem. Cycles"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1111\/j.1365-2486.2011.02578.x","article-title":"Trend changes in global greening and browning: Contribution of short-term trends to longer-term change","volume":"18","author":"Verbesselt","year":"2012","journal-title":"Glob. Chang. Biol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1016\/j.rse.2009.08.014","article-title":"Detecting trend and seasonal changes in satellite image time series","volume":"114","author":"Verbesselt","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1016\/j.rse.2015.08.020","article-title":"Tracking disturbance-regrowth dynamics in tropical forests using structural change detection and Landsat time series","volume":"169","author":"DeVries","year":"2015","journal-title":"Remote Sens. Environ."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1080\/07474930500406053","article-title":"A unified approach to structural change tests based on ML scores, F statistics, and OLS residuals","volume":"24","author":"Zeileis","year":"2005","journal-title":"Econom. Rev."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1016\/j.rse.2019.02.003","article-title":"Near real-time monitoring of tropical forest disturbance: New algorithms and assessment framework","volume":"224","author":"Tang","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_41","unstructured":"Awty-Carroll, K. (2019, April 29). Simulated NDVI Time Series Repository. Available online: osf.io\/taf9y."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1824","DOI":"10.1109\/TGRS.2002.802519","article-title":"Seasonality extraction by function fitting to time-series of satellite sensor data","volume":"40","author":"Eklundh","year":"2002","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"833","DOI":"10.1016\/j.cageo.2004.05.006","article-title":"TIMESAT\u2014A program for analyzing time-series of satellite sensor data","volume":"30","author":"Eklundh","year":"2004","journal-title":"Comput. Geosci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.rse.2017.06.031","article-title":"Google Earth Engine: Planetary-scale geospatial analysis for everyone","volume":"202","author":"Gorelick","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1080\/17538947.2015.1111952","article-title":"Rapid, high-resolution detection of environmental change over continental scales from satellite data\u2014The Earth Observation Data Cube","volume":"9","author":"Lewis","year":"2016","journal-title":"Int. J. Digit. Earth"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/23\/2779\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:37:23Z","timestamp":1760189843000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/11\/23\/2779"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,25]]},"references-count":45,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["rs11232779"],"URL":"https:\/\/doi.org\/10.3390\/rs11232779","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,25]]}}}