{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T01:23:45Z","timestamp":1783646625021,"version":"3.55.0"},"reference-count":54,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2015,9,22]],"date-time":"2015-09-22T00:00:00Z","timestamp":1442880000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Crop area extent estimates and crop type maps provide crucial information for agricultural monitoring and management. Remote sensing imagery in general and, more specifically, high temporal and high spatial resolution data as the ones which will be available with upcoming systems, such as Sentinel-2, constitute a major asset for this kind of application. The goal of this paper is to assess to what extent state-of-the-art supervised classification methods can be applied to high resolution multi-temporal optical imagery to produce accurate crop type maps at the global scale. Five concurrent strategies for automatic crop type map production have been selected and benchmarked using SPOT4 (Take5) and Landsat 8 data over 12 test sites spread all over the globe (four in Europe, four in Africa, two in America and two in Asia). This variety of tests sites allows one to draw conclusions applicable to a wide variety of landscapes and crop systems. The results show that a random forest classifier operating on linearly temporally gap-filled images can achieve overall accuracies above 80% for most sites. Only two sites showed low performances: Madagascar due to the presence of fields smaller than the pixel size and Burkina Faso due to a mix of trees and crops in the fields. The approach is based on supervised machine learning techniques, which need in situ data collection for the training step, but the map production is fully automatic.<\/jats:p>","DOI":"10.3390\/rs70912356","type":"journal-article","created":{"date-parts":[[2015,9,22]],"date-time":"2015-09-22T15:36:54Z","timestamp":1442936214000},"page":"12356-12379","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":334,"title":["Assessment of an Operational System for Crop Type Map Production Using High Temporal and Spatial Resolution Satellite Optical Imagery"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6896-0049","authenticated-orcid":false,"given":"Jordi","family":"Inglada","sequence":"first","affiliation":[{"name":"CESBIO-UMR 5126, 18 avenue Edouard Belin, 31401 Toulouse CEDEX 9, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcela","family":"Arias","sequence":"additional","affiliation":[{"name":"CESBIO-UMR 5126, 18 avenue Edouard Belin, 31401 Toulouse CEDEX 9, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Tardy","sequence":"additional","affiliation":[{"name":"CESBIO-UMR 5126, 18 avenue Edouard Belin, 31401 Toulouse CEDEX 9, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olivier","family":"Hagolle","sequence":"additional","affiliation":[{"name":"CESBIO-UMR 5126, 18 avenue Edouard Belin, 31401 Toulouse CEDEX 9, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Silvia","family":"Valero","sequence":"additional","affiliation":[{"name":"CESBIO-UMR 5126, 18 avenue Edouard Belin, 31401 Toulouse CEDEX 9, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Morin","sequence":"additional","affiliation":[{"name":"CESBIO-UMR 5126, 18 avenue Edouard Belin, 31401 Toulouse CEDEX 9, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"G\u00e9rard","family":"Dedieu","sequence":"additional","affiliation":[{"name":"CESBIO-UMR 5126, 18 avenue Edouard Belin, 31401 Toulouse CEDEX 9, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guadalupe","family":"Sepulcre","sequence":"additional","affiliation":[{"name":"Earth and Life Institute, Universit\u00e9 Catholique de Louvain, 2 Croix du Sud bte L7.05.24, 1348 Louvain-la-Neuve, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0012-8410","authenticated-orcid":false,"given":"Sophie","family":"Bontemps","sequence":"additional","affiliation":[{"name":"Earth and Life Institute, Universit\u00e9 Catholique de Louvain, 2 Croix du Sud bte L7.05.24, 1348 Louvain-la-Neuve, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5355-4988","authenticated-orcid":false,"given":"Pierre","family":"Defourny","sequence":"additional","affiliation":[{"name":"Earth and Life Institute, Universit\u00e9 Catholique de Louvain, 2 Croix du Sud bte L7.05.24, 1348 Louvain-la-Neuve, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Koetz","sequence":"additional","affiliation":[{"name":"European Space Agency-ESRIN D\/EOP-SEP, Via Galileo Galilei, 00044 Frascati, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2015,9,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1038\/nature10452","article-title":"Solutions for a Cultivated Planet","volume":"478","author":"Foley","year":"2011","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"812","DOI":"10.1126\/science.1185383","article-title":"Food Security: The Challenge of Feeding 9 Billion People","volume":"327","author":"Godfray","year":"2010","journal-title":"Science"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.agee.2004.12.002","article-title":"Future Scenarios of European Agricultural Land Use","volume":"107","author":"Rounsevell","year":"2005","journal-title":"Agric. Ecosyst. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1238","DOI":"10.1126\/science.1151861","article-title":"Use of US Croplands for Biofuels Increases Greenhouse Gases through Emissions from Land-Use Change","volume":"319","author":"Searchinger","year":"2008","journal-title":"Science"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1126\/science.1106049","article-title":"Farming and the Fate of Wild Nature","volume":"307","author":"Green","year":"2005","journal-title":"Science"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1126\/science.1057544","article-title":"Forecasting Agriculturally Driven Global Environmental Change","volume":"292","author":"Tilman","year":"2001","journal-title":"Science"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"883","DOI":"10.1007\/s10021-012-9552-0","article-title":"Restoration of Biodiversity and Ecosystem Services on Agricultural Land","volume":"15","author":"Benayas","year":"2012","journal-title":"Ecosystems"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1002\/ldr.1040","article-title":"Experiences in Monitoring and Assessment of Sustainable Land Management","volume":"22","author":"Schwilch","year":"2010","journal-title":"Land Degrad. Dev."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.rse.2011.11.026","article-title":"Sentinel-2: Esa\u2019s Optical High-Resolution Mission for Gmes Operational Services","volume":"120","author":"Drusch","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_10","unstructured":"Sentinel-2 for Agriculture. Available online: http:\/\/www.esa-sen2agri.org\/."},{"key":"ref_11","unstructured":"Committee on Earth Observation Satellites CEOS Acquisition Strategy for GEOGLAM Phase 1. Available online: http:\/\/ceos.org\/document_management\/Ad_Hoc_Teams\/GEOGLAM\/GEOGLAM_CEOS-Acquisition-Strategy-for-GEOGLAM-Phase-1_Nov2013.pdf."},{"key":"ref_12","unstructured":"JECAM. Available online: http:\/\/www.jecam.org\/."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hagolle, O., Sylvander, S., Huc, M., Claverie, M., Clesse, D., Dechoz, C., Lonjou, V., and Poulain, V. (2015). SPOT4 (Take5): Simulation of Sentinel-2 Time Series on 45 Large sites. Remote Sens., Accept.","DOI":"10.3390\/rs70912242"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.rse.2014.02.001","article-title":"Landsat-8: Science and Product Vision for Terrestrial Global Change Research","volume":"145","author":"Roy","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_15","first-page":"321","article-title":"Global Rain-Fed, Irrigated, and Paddy Croplands: A New High Resolution Map Derived From Remote Sensing, Crop Inventories and Climate Data","volume":"38","author":"Salmon","year":"2015","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1980","DOI":"10.1111\/gcb.12838","article-title":"Mapping Global Cropland and Field Size","volume":"21","author":"Fritz","year":"2015","journal-title":"Glob. Chang. Biol."},{"key":"ref_17","unstructured":"Defourny, P., Vancutsem, C., Bicheron, P., Brockmann, C., Nino, F., Schouten, L., and Leroy, M. (2006, January 8\u201311). GlobCover: A 300 m global land cover product for 2005 using ENVISAT MERIS time series. Proceedings of the ISPRS Commission VII Symposium Remote Sensing: From Pixels to Processes, Enschede, The Netherlands."},{"key":"ref_18","unstructured":"Friedl, M.A., Sulla-Menashe, D., Tan, B., Schneider, A., Ramankutty, N., Sibley, A., and Huang, X. Boston University."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1080\/17538947.2012.713190","article-title":"Global Characterization and Monitoring of Forest Cover Using Landsat Data: Opportunities and Challenges","volume":"5","author":"Townshend","year":"2012","journal-title":"Int. J. Digit. Earth"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.3390\/rs70201461","article-title":"A Framework for Defining Spatially Explicit Earth Observation Requirements for a Global Agricultural Monitoring Initiative (GEOGLAM)","volume":"7","author":"Whitcraft","year":"2015","journal-title":"Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.3390\/rs70201482","article-title":"Meeting Earth Observation Requirements for Global Agricultural Monitoring: An Evaluation of the Revisit Capabilities of Current and Planned Moderate Resolution Optical Earth Observing Missions","volume":"7","author":"Whitcraft","year":"2015","journal-title":"Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1080\/07038992.2014.987376","article-title":"Forest Monitoring Using Landsat Time Series Data: A Review","volume":"40","author":"Banskota","year":"2014","journal-title":"Can. J. Remote Sens."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/0034-4257(84)90061-0","article-title":"Classification of Corn and Soybeans Using Multitemporal Thematic Mapper Data","volume":"16","author":"Badhwar","year":"1984","journal-title":"Remote Sens. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"4871","DOI":"10.1080\/0143116031000070490","article-title":"Classification of Wheat Crop with Multi-Temporal Images: Performance of Maximum Likelihood and Artificial Neural Networks","volume":"24","author":"Murthy","year":"2003","journal-title":"Int. J. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.rse.2012.11.009","article-title":"Classifying multiyear agricultural land use data from Mato Grosso using time-series MODIS vegetation index data","volume":"130","author":"Brown","year":"2013","journal-title":"Remote Sens. Environ."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1016\/j.rse.2007.07.019","article-title":"Large-area crop mapping using time-series MODIS 250 m NDVI data: An assessment for the U.S. Central Great Plains","volume":"112","author":"Wardlow","year":"2008","journal-title":"Remote Sens. Environ."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/j.rse.2004.08.002","article-title":"Cropland distributions from temporal unmixing of MODIS data","volume":"93","author":"Lobell","year":"2004","journal-title":"Remote Sens. Environ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.1016\/j.rse.2010.01.006","article-title":"The spatial distribution of crop types from MODIS data: Temporal unmixing using Independent Component Analysis","volume":"114","author":"Ozdogan","year":"2010","journal-title":"Remote Sens. Environ."},{"key":"ref_29","first-page":"486","article-title":"Sub-Pixel Classification of Spot-Vegetation Time Series for the Assessment of Regional Crop Areas in Belgium","volume":"10","author":"Verbeiren","year":"2008","journal-title":"Int. J. Appl. Earth Observ. Geoinf."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1080\/01431161.2010.519002","article-title":"Continuous Fields of Land Cover for the Conterminous United States Using Landsat Data: First Results From the Web-Enabled Landsat Data (weld) Project","volume":"2","author":"Hansen","year":"2011","journal-title":"Remote Sens. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rse.2013.08.023","article-title":"Efficient Corn and Soybean Mapping with Temporal Extendability: A Multi-Year Experiment Using Landsat Imagery","volume":"140","author":"Zhong","year":"2014","journal-title":"Remote Sens. Environ."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3907","DOI":"10.3390\/rs70403907","article-title":"Global Crop Monitoring: A Satellite-Based Hierarchical Approach","volume":"7","author":"Wu","year":"2015","journal-title":"Remote Sensing"},{"key":"ref_33","unstructured":"Theia Land Data Centre. Available online: https:\/\/www.theia-land.fr\/en\/products\/spot4-take5."},{"key":"ref_34","unstructured":"Centre d\u2019Etudes Spatiales de la BIOsphere. Available online: http:\/\/www.cesbio.ups-tlse.fr\/."},{"key":"ref_35","unstructured":"Geoglam crop monitor. Available online: http:\/\/www.geoglam-crop-monitor.org\/index.php."},{"key":"ref_36","unstructured":"AMIS. Available online: http:\/\/www.amis-outlook.org."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.rse.2011.11.020","article-title":"A Comparison of Pixel-Based and Object-Based Image Analysis with Selected Machine Learning Algorithms for the Classification of Agricultural Landscapes Using Spot-5 Hrg Imagery","volume":"118","author":"Duro","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.isprsjprs.2011.11.002","article-title":"An Assessment of the Effectiveness of a Random Forest Classifier for Land-Cover Classification","volume":"67","author":"Ghimire","year":"2012","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1023\/A:1009715923555","article-title":"A tutorial on support vector machines for pattern recognition","volume":"2","author":"Burges","year":"1998","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_40","unstructured":"Breiman, L., Friedman, J., Olshen, R., and Stone, C. Classification and Regression Trees, Taylor and Francis."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","article-title":"Greedy function approximation: A gradient boosting machine","volume":"29","author":"Friedman","year":"2001","journal-title":"Ann. Stat."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_43","unstructured":"Orfeo Toolbox. Available online: http:\/\/www.orfeo-toolbox.org\/."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/0034-4257(91)90048-B","article-title":"A review of assessing the accuracy of classifications of remotely sensed data","volume":"37","author":"Congalton","year":"1991","journal-title":"Remote Sens. Environ."},{"key":"ref_45","first-page":"37","article-title":"Evaluation: From Precision, Recall and F-Measure to ROC, Informedness, Markedness and Correlation","volume":"1","author":"Powers","year":"2011","journal-title":"J. Mach. Lear. Technol."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1109\/34.1000236","article-title":"Mean Shift: A Robust Approach toward Feature Space Analysis","volume":"24","author":"Commaniciu","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/S0034-4257(96)00067-3","article-title":"NDWI. A normalized difference water index for remote sensing of vegetation liquid water from space","volume":"58","author":"Gao","year":"1996","journal-title":"Remote Sens. Environ."},{"key":"ref_48","unstructured":"Smets, P. (1994). Advances in the Dempster-Shafer Theory of Evidence, John Wiley & Sons, Inc."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1109\/21.155943","article-title":"Methods of Combining Multiple Classifiers and Their Applications To Handwriting Recognition","volume":"22","author":"Xu","year":"1992","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1016\/j.ipm.2009.03.002","article-title":"A Systematic Analysis of Performance Measures for Classification Tasks","volume":"45","author":"Sokolova","year":"2009","journal-title":"Inf. Process. Manag."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Klemens, B. (2008). Modeling with Data: Tools and Techniques for Scientific Computing, Princeton University Press.","DOI":"10.1515\/9781400828746"},{"key":"ref_52","unstructured":"Jackson, S. (2015). Research Methods and Statistics: A Critical Thinking Approach, Cengage Learning."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1658","DOI":"10.1016\/j.rse.2009.03.014","article-title":"Classification Accuracy Comparison: Hypothesis Tests and the Use of Confidence Intervals in Evaluations of Difference, Equivalence and Non-Inferiority","volume":"113","author":"Foody","year":"2009","journal-title":"Remote Sens. Environ."},{"key":"ref_54","unstructured":"Processing Chain for Crop type Map Production. Available online: http:\/\/tully.ups-tlse.fr\/ariasm\/croptype_bench\/."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/7\/9\/12356\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:49:01Z","timestamp":1760215741000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/7\/9\/12356"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,9,22]]},"references-count":54,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2015,9]]}},"alternative-id":["rs70912356"],"URL":"https:\/\/doi.org\/10.3390\/rs70912356","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,9,22]]}}}