{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T14:46:10Z","timestamp":1775486770748,"version":"3.50.1"},"reference-count":60,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2021,12,9]],"date-time":"2021-12-09T00:00:00Z","timestamp":1639008000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Austrian Research Promotion Agency (FFG)","award":["873721"],"award-info":[{"award-number":["873721"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>To ensure future food security, improved agricultural management approaches are required. For many of those applications, precise knowledge of the distribution of crop types is essential. Various machine and deep learning models have been used for automated crop classification using microwave remote sensing time series. However, the application of these approaches on a large spatial and temporal scale is barely investigated. In this study, the performance of two frequently used algorithms, Long Short-Term Memory (LSTM) networks and Random Forest (RF), for crop classification based on Sentinel-1 time series and meteorological data on a large spatial and temporal scale is assessed. For data from Austria, the Netherlands, and France and the years 2015\u20132019, scenarios with different spatial and temporal scales were defined. To quantify the complexity of these scenarios, the Fisher Discriminant measurement F1 (FDR1) was used. The results demonstrate that both classifiers achieve similar results for simple classification tasks with low FDR1 values. With increasing FDR1 values, however, LSTM networks outperform RF. This suggests that the ability of LSTM networks to learn long-term dependencies and identify the relation between radar time series and meteorological data becomes increasingly important for more complex applications. Thus, the study underlines the importance of deep learning models, including LSTM networks, for large-scale applications.<\/jats:p>","DOI":"10.3390\/rs13245000","type":"journal-article","created":{"date-parts":[[2021,12,9]],"date-time":"2021-12-09T21:46:58Z","timestamp":1639086418000},"page":"5000","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Comparison of Long Short-Term Memory Networks and Random Forest for Sentinel-1 Time Series Based Large Scale Crop Classification"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3867-7397","authenticated-orcid":false,"given":"Felix","family":"Reu\u00df","sequence":"first","affiliation":[{"name":"Department of Geodesy and Geoinformation, Vienna University of Technology, 1040 Vienna, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7893-8141","authenticated-orcid":false,"given":"Isabella","family":"Greimeister-Pfeil","sequence":"additional","affiliation":[{"name":"Department of Geodesy and Geoinformation, Vienna University of Technology, 1040 Vienna, Austria"},{"name":"Centre for Water Resource Systems, Vienna University of Technology, 1040 Vienna, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4913-0255","authenticated-orcid":false,"given":"Mariette","family":"Vreugdenhil","sequence":"additional","affiliation":[{"name":"Department of Geodesy and Geoinformation, Vienna University of Technology, 1040 Vienna, Austria"},{"name":"Centre for Water Resource Systems, Vienna University of Technology, 1040 Vienna, Austria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7704-6857","authenticated-orcid":false,"given":"Wolfgang","family":"Wagner","sequence":"additional","affiliation":[{"name":"Department of Geodesy and Geoinformation, Vienna University of Technology, 1040 Vienna, Austria"},{"name":"Centre for Water Resource Systems, Vienna University of Technology, 1040 Vienna, Austria"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,9]]},"reference":[{"key":"ref_1","unstructured":"FAO, IFAD, UNICEF, WFP, and WHO (2020). The State of Food Security and Nutrition in the World 2020, WHO."},{"key":"ref_2","unstructured":"United Nations, Department of Economic and Social Affairs (2019). Population Division World Population Prospects 2019: Highlights 2019, United Nations, Department of Economic and Social Affairs."},{"key":"ref_3","unstructured":"(2019). World Meteorological Organization (WMO) State of the Climate in Africa 2019, World Meteorological Organization (WMO)."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1038\/s43017-020-00122-y","article-title":"Uniting Remote Sensing, Crop Modelling and Economics for Agricultural Risk Management","volume":"2","author":"Benami","year":"2021","journal-title":"Nat. Rev. Earth Environ."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Navarro, A., Rolim, J., Miguel, I., Catal\u00e3o, J., Silva, J., Painho, M., and Vekerdy, Z. (2016). Crop Monitoring Based on SPOT-5 Take-5 and Sentinel-1A Data for the Estimation of Crop Water Requirements. Remote Sens., 8.","DOI":"10.3390\/rs8060525"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Setiyono, T., Quicho, E., Gatti, L., Campos-Taberner, M., Busetto, L., Collivignarelli, F., Garc\u00eda-Haro, F., Boschetti, M., Khan, N., and Holecz, F. (2018). Spatial Rice Yield Estimation Based on MODIS and Sentinel-1 SAR Data and ORYZA Crop Growth Model. Remote Sens., 10.","DOI":"10.3390\/rs10020293"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Vreugdenhil, M., Wagner, W., Bauer-Marschallinger, B., Pfeil, I., Teubner, I., R\u00fcdiger, C., and Strauss, P. (2018). Sensitivity of Sentinel-1 Backscatter to Vegetation Dynamics: An Austrian Case Study. Remote Sens., 10.","DOI":"10.3390\/rs10091396"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Khabbazan, S., Vermunt, P., Steele-Dunne, S., Ratering Arntz, L., Marinetti, C., van der Valk, D., Iannini, L., Molijn, R., Westerdijk, K., and van der Sande, C. (2019). Crop Monitoring Using Sentinel-1 Data: A Case Study from The Netherlands. Remote Sens., 11.","DOI":"10.3390\/rs11161887"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1016\/j.rse.2017.07.015","article-title":"Understanding the Temporal Behavior of Crops Using Sentinel-1 and Sentinel-2-like Data for Agricultural Applications","volume":"199","author":"Veloso","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chakhar, A., Hern\u00e1ndez-L\u00f3pez, D., Ballesteros, R., and Moreno, M.A. (2021). Improving the Accuracy of Multiple Algorithms for Crop Classification by Integrating Sentinel-1 Observations with Sentinel-2 Data. Remote Sens., 13.","DOI":"10.3390\/rs13020243"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Xu, L., Zhang, H., Wang, C., Zhang, B., and Liu, M. (2019). Crop Classification Based on Temporal Information Using Sentinel-1 SAR Time-Series Data. Remote Sens., 11.","DOI":"10.3390\/rs11010053"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7057","DOI":"10.1080\/01431161.2011.613414","article-title":"Agricultural Crop-Type Classification of Multi-Polarization SAR Images Using a Hybrid Entropy Decomposition and Support Vector Machine Technique","volume":"32","author":"Tan","year":"2011","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"6383","DOI":"10.1080\/01431161.2018.1460503","article-title":"Crop-Type Mapping from a Sequence of Sentinel 1 Images","volume":"39","author":"Kenduiywo","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ustuner, M., Sanli, F.B., Abdikan, S., Bilgin, G., and Goksel, C. (2019, January 16\u201319). A booster analysis of extreme gradient boosting for crop classification using PolSAR imagery. Proceedings of the 2019 8th International Conference on Agro-Geoinformatics (Agro-Geoinformatics), Istanbul, Turkey.","DOI":"10.1109\/Agro-Geoinformatics.2019.8820698"},{"key":"ref_15","unstructured":"Nitze, I., Schulthess, U., and Asche, H. (2012, January 7\u20139). Comparison of Machine Learning Algorithms Random Forest, Artificial Neural Network and Support Vector Machine to Maximum Likelihood for Supervised Crop Type Classification. Proceedings of the 4th GEOBIA, Rio de Janeiro, Brazil."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"6553","DOI":"10.1080\/01431161.2019.1569791","article-title":"Crop Type Classification Using a Combination of Optical and Radar Remote Sensing Data: A Review","volume":"40","author":"Orynbaikyzy","year":"2019","journal-title":"Int. J. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Torbick, N., Chowdhury, D., Salas, W., and Qi, J. (2017). Monitoring Rice Agriculture across Myanmar Using Time Series Sentinel-1 Assisted by Landsat-8 and PALSAR-2. Remote Sens., 9.","DOI":"10.3390\/rs9020119"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1109\/TBDATA.2019.2940237","article-title":"Cloud Approach to Automated Crop Classification Using Sentinel-1 Imagery","volume":"6","author":"Shelestov","year":"2020","journal-title":"IEEE Trans. Big Data"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"D\u2019Andrimont, R., Verhegghen, A., Lemoine, G., Kempeneers, P., Meroni, M., and van der Velde, M. (2021). From Parcel to Continental Scale\u2014A First European Crop Type Map Based on Sentinel-1 and LUCAS Copernicus in-Situ Observations. arXiv.","DOI":"10.1016\/j.rse.2021.112708"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1016\/j.rse.2018.11.032","article-title":"Deep Learning Based Multi-Temporal Crop Classification","volume":"221","author":"Zhong","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"90202","DOI":"10.1109\/ACCESS.2020.2993538","article-title":"Quantitative and Qualitative Analysis of Time-Series Classification Using Deep Learning","volume":"8","author":"Ebrahim","year":"2020","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1038\/nmeth.3707","article-title":"Deep Learning","volume":"13","author":"Rusk","year":"2016","journal-title":"Nat. Methods"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"107886","DOI":"10.1016\/j.agrformet.2019.107886","article-title":"Satellite-Based Soybean Yield Forecast: Integrating Machine Learning and Weather Data for Improving Crop Yield Prediction in Southern Brazil","volume":"284","author":"Schwalbert","year":"2020","journal-title":"Agric. For. Meteorol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1754","DOI":"10.1111\/gcb.14885","article-title":"A Deep Learning Approach to Conflating Heterogeneous Geospatial Data for Corn Yield Estimation: A Case Study of the US Corn Belt at the County Level","volume":"26","author":"Jiang","year":"2020","journal-title":"Glob. Chang. Biol."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Cris\u00f3stomo de Castro Filho, H., Ab\u00edlio de Carvalho J\u00fanior, O., Ferreira de Carvalho, O.L., Pozzobon de Bem, P., dos Santos de Moura, R., Olino de Albuquerque, A., Rosa Silva, C., Guimar\u00e3es Ferreira, P.H., Fontes Guimar\u00e3es, R., and Trancoso Gomes, R.A. (2020). Rice Crop Detection Using LSTM, Bi-LSTM, and Machine Learning Models from Sentinel-1 Time Series. Remote Sens., 12.","DOI":"10.3390\/rs12162655"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ndikumana, E., Ho Tong Minh, D., Baghdadi, N., Courault, D., and Hossard, L. (2018). Deep Recurrent Neural Network for Agricultural Classification Using Multitemporal SAR Sentinel-1 for Camargue, France. Remote Sens., 10.","DOI":"10.1117\/12.2325160"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhao, H., Chen, Z., Jiang, H., Jing, W., Sun, L., and Feng, M. (2019). Evaluation of Three Deep Learning Models for Early Crop Classification Using Sentinel-1A Imagery Time Series\u2014A Case Study in Zhanjiang, China. Remote Sens., 11.","DOI":"10.3390\/rs11222673"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Pelletier, C., Webb, G.I., and Petitjean, F. (August, January 28). Deep learning for the classification of sentinel-2 image time series. Proceedings of the IGARSS 2019\u20142019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8900123"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"He, T., Xie, C., Liu, Q., Guan, S., and Liu, G. (2019). Evaluation and Comparison of Random Forest and A-LSTM Networks for Large-Scale Winter Wheat Identification. Remote Sens., 11.","DOI":"10.3390\/rs11141665"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.rse.2011.05.028","article-title":"GMES Sentinel-1 Mission","volume":"120","author":"Torres","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.cageo.2014.07.005","article-title":"Optimisation of Global Grids for High-Resolution Remote Sensing Data","volume":"72","author":"Sabel","year":"2014","journal-title":"Comput. Geosci."},{"key":"ref_32","unstructured":"SkyWatch, German Aerospace Center (DLR), Brockmann Consult, and OceanDataLab (2021, January 29). Sentinel-1 Toolbox. Available online: https:\/\/step.esa.int\/main\/toolboxes\/sentinel-1-toolbox\/."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1029\/RS013i002p00357","article-title":"Vegetation Modeled as a Water Cloud","volume":"13","author":"Attema","year":"1978","journal-title":"Radio Sci."},{"key":"ref_34","unstructured":"Woodhouse, I.H. (2006). Introduction to Microwave Remote Sensing, Taylor & Francis."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1109\/LGRS.2013.2263034","article-title":"C-Band SAR Data for Mapping Crops Dominated by Surface or Volume Scattering","volume":"11","author":"Satalino","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Holtgrave, A.-K., R\u00f6der, N., Ackermann, A., Erasmi, S., and Kleinschmit, B. (2020). Comparing Sentinel-1 and -2 Data and Indices for Agricultural Land Use Monitoring. Remote Sens., 12.","DOI":"10.3390\/rs12182919"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Vreugdenhil, M., Navacchi, C., Bauer-Marschallinger, B., Hahn, S., Steele-Dunne, S., Pfeil, I., Dorigo, W., and Wagner, W. (2020). Sentinel-1 Cross Ratio and Vegetation Optical Depth: A Comparison over Europe. Remote Sens., 12.","DOI":"10.3390\/rs12203404"},{"key":"ref_38","unstructured":"(2021, May 24). Copernicus Climate Change Service ERA5-Land Hourly Data from 2001 to Present 2019. Available online: https:\/\/cds.climate.copernicus.eu\/doi\/10.24381\/cds.e2161bac."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/S0168-1923(97)00027-0","article-title":"Growing Degree-Days: One Equation, Two Interpretations","volume":"87","author":"McMaster","year":"1997","journal-title":"Agric. For. Meteorol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2060","DOI":"10.1175\/JAMC-D-11-0146.1","article-title":"Long-Term Trends in Air Temperature Distribution and Extremes, Growing Degree-Days, and Spring and Fall Frosts for Climate Impact Assessments on Agricultural Practices in Nebraska","volume":"51","author":"Skaggs","year":"2012","journal-title":"J. Appl. Meteorol. Climatol."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"244","DOI":"10.1016\/j.rse.2017.04.026","article-title":"Early Season Large-Area Winter Crop Mapping Using MODIS NDVI Data, Growing Degree Days Information and a Gaussian Mixture Model","volume":"195","author":"Skakun","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/s00484-016-1190-3","article-title":"Variability of Growing Degree Days in Poland in Response to Ongoing Climate Changes in Europe","volume":"61","author":"Wypych","year":"2017","journal-title":"Int. J. Biometeorol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1038\/s41597-021-01059-7","article-title":"The Normalised Sentinel-1 Global Backscatter Model, Mapping Earth\u2019s Land Surface with C-Band Microwaves","volume":"8","author":"Cao","year":"2021","journal-title":"Sci. Data"},{"key":"ref_44","unstructured":"TU Wien GEO Department (2021, April 03). yeoda\u2013GitHub. Available online: https:\/\/github.com\/TUW-GEO\/yeoda."},{"key":"ref_45","unstructured":"Rumelhart, D.E., Smolensky, P., McClelland, J.L., and Hinton, G.E. (1986). Schemata and sequential thought processes in PDP models. Parallel Distributed Processing: Explorations in the Microstructure, Vol. 2: Psychological and Biological Models, MIT Press."},{"key":"ref_46","unstructured":"Hochreiter, S., and Schmidhuber, J. (1996, January 3\u20135). LSTM can solve hard long time lag problems. Proceedings of the 9th International Conference on Neural Information Processing Systems, Denver, CO, USA."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_48","first-page":"3133","article-title":"Do We Need Hundreds of Classifiers to Solve Real World Classification Problems?","volume":"15","author":"Cernadas","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging Predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_51","unstructured":"Chollet, F. (2021, February 02). Keras\u2014GitHub. Available online: https:\/\/github.com\/keras-team\/keras."},{"key":"ref_52","first-page":"2825","article-title":"Scikit-Learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Sammut, C., and Webb, G.I. (2011). Precision and recall. Encyclopedia of Machine Learning, Springer US.","DOI":"10.1007\/978-0-387-30164-8"},{"key":"ref_54","first-page":"1","article-title":"How Complex Is Your Classification Problem? A Survey on Measuring Classification Complexity","volume":"52","author":"Lorena","year":"2019","journal-title":"ACM Comput. Surv. CSUR"},{"key":"ref_55","unstructured":"Fisher, A., Rudin, C., and Dominici, F. (2019). All Models Are Wrong, but Many Are Useful: Learning a Variable\u2019s Importance by Studying an Entire Class of Prediction Models Simultaneously. arXiv."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"(1908). Student The Probable Error of a Mean. Biometrika, 6, 1.","DOI":"10.2307\/2331554"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.isprsjprs.2020.08.014","article-title":"Response of Winter Wheat to Spring Frost from a Remote Sensing Perspective: Damage Estimation and Influential Factors","volume":"168","author":"Wang","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_58","unstructured":"Amt der Nieder\u00f6sterr, Landesregierung, Abt, Raumordnung und Regionalpolitik, Sachgebiet Statistik (2017). Statistisches Handbuch des Landes Nieder\u00f6sterreich. 41.2017, Amt der Nieder\u00f6sterr, Landesregierung, Abt, Raumordnung und Regionalpolitik, Sachgebiet Statistik. N\u00d6 Schriften."},{"key":"ref_59","unstructured":"CBS, PBL, RIVM, and WUR (2021, September 12). Meteorologische Gegevens, 1990\u20132020. Available online: https:\/\/www.clo.nl\/indicatoren\/nl000423."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/4235.585893","article-title":"No Free Lunch Theorems for Optimization","volume":"1","author":"Wolpert","year":"1997","journal-title":"IEEE Trans. Evol. Comput."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/24\/5000\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:44:01Z","timestamp":1760168641000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/24\/5000"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,9]]},"references-count":60,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["rs13245000"],"URL":"https:\/\/doi.org\/10.3390\/rs13245000","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,9]]}}}