{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,6]],"date-time":"2026-04-06T14:43:25Z","timestamp":1775486605875,"version":"3.50.1"},"reference-count":48,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T00:00:00Z","timestamp":1628640000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100007751","name":"Akademia G\u00f3rniczo-Hutnicza im. Stanislawa Staszica","doi-asserted-by":"publisher","award":["IDUB dzia\u0142anie 4 wniosek 51"],"award-info":[{"award-number":["IDUB dzia\u0142anie 4 wniosek 51"]}],"id":[{"id":"10.13039\/501100007751","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The study presents the analysis of the possible use of limited number of the Sentinel-2 and Sentinel-1 to check if crop declarations that the EU farmers submit to receive subsidies are true. The declarations used in the research were randomly divided into two independent sets (training and test). Based on the training set, supervised classification of both single images and their combinations was performed using random forest algorithm in SNAP (ESA) and our own Python scripts. A comparative accuracy analysis was performed on the basis of two forms of confusion matrix (full confusion matrix commonly used in remote sensing and binary confusion matrix used in machine learning) and various accuracy metrics (overall accuracy, accuracy, specificity, sensitivity, etc.). The highest overall accuracy (81%) was obtained in the simultaneous classification of multitemporal images (three Sentinel-2 and one Sentinel-1). An unexpectedly high accuracy (79%) was achieved in the classification of one Sentinel-2 image at the end of May 2018. Noteworthy is the fact that the accuracy of the random forest method trained on the entire training set is equal 80% while using the sampling method ca. 50%. Based on the analysis of various accuracy metrics, it can be concluded that the metrics used in machine learning, for example: specificity and accuracy, are always higher then the overall accuracy. These metrics should be used with caution, because unlike the overall accuracy, to calculate these metrics, not only true positives but also false positives are used as positive results, giving the impression of higher accuracy. Correct calculation of overall accuracy values is essential for comparative analyzes. Reporting the mean accuracy value for the classes as overall accuracy gives a false impression of high accuracy. In our case, the difference was 10\u201316% for the validation data, and 25\u201345% for the test data.<\/jats:p>","DOI":"10.3390\/rs13163176","type":"journal-article","created":{"date-parts":[[2021,8,11]],"date-time":"2021-08-11T21:48:12Z","timestamp":1628718492000},"page":"3176","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Reliable Crops Classification Using Limited Number of Sentinel-2 and Sentinel-1 Images"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0230-8386","authenticated-orcid":false,"given":"Beata","family":"Hejmanowska","sequence":"first","affiliation":[{"name":"Faculty of Mining Surveying and Environmental Engineering, Department of Photogrammetry Remote Sensing of Environment and Spatial Engineering, AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Krakow, Poland"}]},{"given":"Piotr","family":"Kramarczyk","sequence":"additional","affiliation":[{"name":"Faculty of Mining Surveying and Environmental Engineering, Department of Photogrammetry Remote Sensing of Environment and Spatial Engineering, AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Krakow, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7326-1592","authenticated-orcid":false,"given":"Ewa","family":"G\u0142owienka","sequence":"additional","affiliation":[{"name":"Faculty of Mining Surveying and Environmental Engineering, Department of Photogrammetry Remote Sensing of Environment and Spatial Engineering, AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Krakow, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4389-7562","authenticated-orcid":false,"given":"S\u0142awomir","family":"Mikrut","sequence":"additional","affiliation":[{"name":"Faculty of Mining Surveying and Environmental Engineering, Department of Photogrammetry Remote Sensing of Environment and Spatial Engineering, AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Krakow, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,11]]},"reference":[{"key":"ref_1","unstructured":"Devos, W., Fasbender, D., Lemoine, G., Loudjani, P., Milenov, P., and Wirnhardt, C. (2017). Discussion Document on the Introduction of Monitoring to Substitute OTSC\u2014Supporting Non-Paper DS\/CDP\/2017\/03 Revising R2017\/809, Publications Office of the European Union."},{"key":"ref_2","unstructured":"Devos, W., Lemoine, G., Milenov, P., and Fasbender, D. (2018). Technical Guidance on the Decision to Go for Substitution of OTSC by Monitoring, Publications Office of the European Union."},{"key":"ref_3","unstructured":"Devos, W., Lemoine, G., Milenov, P., Fasbender, D., Loudjani, P., Wirnhardt, C., Sima, A., and Griffiths, P. (2018). Second Discussion Document on the Introduction of Monitoring to Substitute OTSC: Rules for Processing Application in 2018\u20132019, Publications Office of the European Union."},{"key":"ref_4","unstructured":"Rouse, J., Haas, R., Schell, J., Deering, D., and Harlan, J. (2021, July 14). Monitoring the Vernal Advancement and Retrogradation (Green Wave Effect) of Natural Vegetation. NASA\/GSFC Type III Final Report, Available online: https:\/\/ntrs.nasa.gov\/api\/citations\/19750020419\/downloads\/19750020419.pdf."},{"key":"ref_5","unstructured":"Laur, H., Bally, P., Meadows, P., Sanchez, J., Sch\u00e4ttler, B., Lopinto, E., and Esteban, D. (2021, July 14). Derivation of the backscattering coefficient sigma nought in ESA ERS SAR PRI products. Technical Report ES-TN-RS-PM-HL09, ESA, September 1998. Available online: https:\/\/earth.esa.int\/documents\/10174\/13019\/ers_sar_calibration_issue2_5f.pdf."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"683","DOI":"10.5194\/isprs-archives-XLII-5-683-2018","article-title":"Crop classification on single date sentinel-2 imagery using random forest and support vector machine","volume":"42","author":"Saini","year":"2018","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Brinkhoff, J., Vardanega, J., and Robson, A. (2020). Land cover classification of nine perennial crops using sentinel-1 and -2 data. Remote Sens., 12.","DOI":"10.3390\/rs12010096"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Maponya, M., van Niekerk, A., and Mashimbye, Z. (2020). Pre-harvest classification of crop types using a Sentinel-2 time-series and machine learning. Comput. Electron. Agric., 169.","DOI":"10.1016\/j.compag.2019.105164"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Carranza-Garc\u00eda, M., Garc\u00eda-Guti\u00e9rrez, J., and Riquelme, J.C. (2019). A Framework for Evaluating Land Use and Land Cover Classification Using Convolutional Neural Networks. Remote Sens., 11.","DOI":"10.3390\/rs11030274"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"778","DOI":"10.1109\/LGRS.2017.2681128","article-title":"Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data","volume":"14","author":"Kussul","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"105618","DOI":"10.1016\/j.compag.2020.105618","article-title":"Accessing the temporal and spectral features in crop type mapping using multi-temporal Sentinel-2 imagery: A case study of Yi\u2019an County, Heilongjiang province, China","volume":"176","author":"Hongyan","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"573","DOI":"10.5194\/isprs-archives-XLII-3-W6-573-2019","article-title":"Exploring machine learning classification algorithms for crop classification using sentinel 2 data","volume":"42","author":"Neetu","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Shi, Y., Li, J., Ma, D., Zhang, T., and Li, Q. (2019, January 21\u201323). Method for crop classification based on multi-source remote sensing data. Proceedings of the IOP Conference Series, Materials Science and Engineering, Kazimierz Dolny, Poland.","DOI":"10.1088\/1757-899X\/592\/1\/012192"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Qadir, A., and Mondal, P. (2020). Synergistic use of radar and optical satellite data for improved monsoon cropland mapping in India. Remote Sens., 12.","DOI":"10.3390\/rs12030522"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"H\u00fctt, C., Waldhoff, G., and Bareth, G. (2020). Fusion of sentinel-1 with official topographic and cadastral geodata for crop-type enriched LULC mapping using FOSS and open data. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9020120"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Van Tricht, K., Gobin, A., Gilliams, S., and Piccard, I. (2018). Synergistic use of radar sentinel-1 and optical sentinel-2 imagery for crop mapping: A case study for Belgium. Remote Sens., 10.","DOI":"10.20944\/preprints201808.0066.v1"},{"key":"ref_17","unstructured":"Hejmanowska, B., Mikrut, S., G\u0142owienka, E., Micha\u0142owska, K., Kramarczyk, P., and Pirowski, T. (2021, July 14). Expertise on the Use of Sentinel 1 and 2 Images to Monitor the Agricultural Activity of ARIMR Beneficiaries. Available online: http:\/\/home.agh.edu.pl\/~galia\/img\/Raport_ARIMR_AGH_2018_EN_haslo.pdf."},{"key":"ref_18","unstructured":"Hejmanowska, B., Mikrut, S., G\u0142owienka, E., Kramarczyk, P., and Pirowski, T. (2021, July 14). The Use of Hyperspectral Data to Monitor the Agricultural Activity of the ARMA Beneficiaries and Support its Business Processes. Available online: http:\/\/home.agh.edu.pl\/~galia\/img\/Raport_ARIMR_AGH_2019_EN_haslo.pdf."},{"key":"ref_19","unstructured":"Musia\u0142, J., and Bojanowski, J. (2019, January 26\u201328). Assessing potential of the Sentinel-2 imagery for monitoring of agricultural fields in Poland. Proceedings of the 25th MARS Conference, Prague, Czech Republic."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"563","DOI":"10.5194\/isprs-archives-XLII-3-W6-563-2019","article-title":"Evaluation of the performance of SAR and SAR-optical fused dataset for crop discrimination","volume":"42","author":"Mustak","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.isprsjprs.2020.06.022","article-title":"ISPRS Journal of Photogrammetry and Remote Sensing Mapping croplands of Europe, Middle East, Russia, and Central Asia using Landsat, Random Forest, and Google Earth Engine","volume":"167","author":"Phalke","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sun, C., Bian, Y., Zhou, T., and Pan, J. (2019). Using of multi-source and multi-temporal remote sensing data improves crop-type mapping in the subtropical agriculture region. Sensors, 19.","DOI":"10.3390\/s19102401"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sun, L., Chen, J., Guo, S., Deng, X., and Han, Y. (2020). Integration of time series sentinel-1 and sentinel-2 imagery for crop type mapping over oasis agricultural areas. Remote Sens., 12.","DOI":"10.3390\/rs12010158"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hu, X., Yang, W., Wen, H., Liu, Y., and Peng, Y. (2021). A Lightweight 1-D Convolution Augmented Transformer with Metric Learning for Hyperspectral Image Classification. Sensors, 21.","DOI":"10.3390\/s21051751"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"111199","DOI":"10.1016\/j.rse.2019.05.018","article-title":"Key issues in rigorous accuracy assessment of land cover products","volume":"231","author":"Stehman","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Morales-Barquero, L., Lyons, M.B., Phinn, S.R., and Roelfsema, C.M. (2019). Trends in Remote Sensing Accuracy Assessment Approaches in the Context of Natural Resources. Remote Sens., 11.","DOI":"10.3390\/rs11192305"},{"key":"ref_27","first-page":"671","article-title":"Land-Use Map Accuracy Criteria","volume":"42","author":"Hord","year":"1976","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_28","first-page":"1135","article-title":"Testing Land Use Map Accuracy","volume":"43","author":"Lock","year":"1977","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_29","first-page":"1371","article-title":"Testing Land-Use Map Accuracy: Another Look","volume":"45","author":"Gineva","year":"1979","journal-title":"Photogramm. Eng. Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/0034-4257(91)90048-B","article-title":"A review of assessing the accuracy of classifications of remotely sensed data","volume":"37","author":"Russell","year":"1991","journal-title":"Remote Sens. Environ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"606","DOI":"10.1016\/j.rse.2006.10.010","article-title":"Comparative assessment of the measures of thematic classification accuracy","volume":"107","author":"Canran","year":"2007","journal-title":"Remote Sens. Environ."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.rse.2012.10.031","article-title":"Making better use of accuracy data in land change studies: Estimating accuracy and area and quantifying uncertainty using stratified estimation","volume":"129","author":"Pontus","year":"2013","journal-title":"Remote Sens. Environ."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Foody, G.M. (2017). Impacts of Sample Design for Validation Data on the Accuracy of Feedforward Neural Network Classification. Appl. Sci., 7.","DOI":"10.3390\/app7090888"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Luo, D., Goodin, D.G., and Caldas, M.M. (2019). Spatial\u2013Temporal Analysis of Land Cover Change at the Bento Rodrigues Dam Disaster Area Using Machine Learning Techniques. Remote Sens., 11.","DOI":"10.3390\/rs11212548"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gbodjo, Y.J.E., Ienco, D., Leroux, L., Interdonato, R., Gaetano, R., and Ndao, B. (2020). Object-Based Multi-Temporal and Multi-Source Land Cover Mapping Leveraging Hierarchical Class Relationships. Remote Sens., 12.","DOI":"10.3390\/rs12172814"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"112308","DOI":"10.1016\/j.rse.2021.112308","article-title":"Change detection using deep learning approach with object-based image analysis","volume":"256","author":"Tao","year":"2021","journal-title":"Remote Sens. Environ."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"112367","DOI":"10.1016\/j.rse.2021.112367","article-title":"Impacts of ignorance on the accuracy of image classification and thematic mapping","volume":"259","author":"Foody","year":"2021","journal-title":"Remote Sens. Environ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Shetty, S., Gupta, P.K., Belgiu, M., and Srivastav, S.K. (2021). Assessing the Effect of Training Sampling Design on the Performance of Machine Learning Classifiers for Land Cover Mapping Using Multi-Temporal Remote Sensing Data and Google Earth Engine. Remote Sens., 13.","DOI":"10.3390\/rs13081433"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Csillik, O., Belgiu, M., Asner, G.P., and Kelly, M. (2019). Object-Based Time-Constrained Dynamic Time Warping Classification of Crops Using Sentinel-2. Remote Sens., 11.","DOI":"10.3390\/rs11101257"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1016\/j.isprsjprs.2020.03.009","article-title":"Evaluation of Sentinel-1 and 2 time series for predicting wheat and rapeseed phenological stages","volume":"163","author":"Mercier","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Demarez, V., Helen, F., Marais-Sicre, C., and Baup, F. (2019). In-season mapping of irrigated crops using Landsat 8 and Sentinel-1 time series. Remote Sens., 11.","DOI":"10.3390\/rs11020118"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1109\/JSTARS.2019.2963539","article-title":"Large-Scale Crop Mapping from Multisource Remote Sensing Images in Google Earth Engine","volume":"13","author":"Liu","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.isprsjprs.2020.01.001","article-title":"Examining earliest identifiable timing of crops using all available Sentinel 1\/2 imagery and Google Earth Engine","volume":"161","author":"Nanshan","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"123","DOI":"10.5194\/isprs-archives-XLII-3-W6-123-2019","article-title":"Wheat area mapping and phenology detection using synthetic aperture radar and multi-spectral remote sensing observations","volume":"XLII-3\/W6","author":"Mohite","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"3295","DOI":"10.1109\/JSTARS.2019.2922469","article-title":"Crop Type Identification and Mapping Using Machine Learning Algorithms and Sentinel-2 Time Series Data","volume":"12","author":"Feng","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Xie, Q., Lai, K., Wang, J., Lopez-Sanchez, J.M., Shang, J., Liao, C., Zhu, J., Fu, H., and Peng, X. (2021). Crop Monitoring and Classification Using Polarimetric RADARSAT-2 Time-Series Data Across Growing Season: A Case Study in Southwestern Ontario, Canada. Remote Sens., 13.","DOI":"10.3390\/rs13071394"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Valcarce-Di\u00f1eiro, R., Arias-P\u00e9rez, B., Lopez-Sanchez, J.M., and S\u00e1nchez, N. (2019). Multi-Temporal Dual- and Quad-Polarimetric Synthetic Aperture Radar Data for Crop-Type Mapping. Remote Sens., 11.","DOI":"10.3390\/rs11131518"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3176\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:44:19Z","timestamp":1760165059000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3176"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,11]]},"references-count":48,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["rs13163176"],"URL":"https:\/\/doi.org\/10.3390\/rs13163176","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,11]]}}}