{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T16:01:04Z","timestamp":1781712064221,"version":"3.54.5"},"reference-count":60,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,4,28]],"date-time":"2020-04-28T00:00:00Z","timestamp":1588032000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union's Horizon 2020 research and innovation programme","award":["No 820852"],"award-info":[{"award-number":["No 820852"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Earth observation (EO) has an immense potential as being an enabling tool for mapping spatial characteristics of the topsoil layer. Recently, deep learning based algorithms and cloud computing infrastructure have become available with a great potential to revolutionize the processing of EO data. This paper aims to present a novel EO-based soil monitoring approach leveraging open-access Copernicus Sentinel data and Google Earth Engine platform. Building on key results from existing data mining approaches to extract bare soil reflectance values the current study delivers valuable insights on the synergistic use of open access optical and radar images. The proposed framework is driven by the need to eliminate the influence of ambient factors and evaluate the efficiency of a convolutional neural network (CNN) to effectively combine the complimentary information contained in the pool of both optical and radar spectral information and those form auxiliary geographical coordinates mainly for soil. We developed and calibrated our multi-input CNN model based on soil samples (calibration = 80% and validation 20%) of the LUCAS database and then applied this approach to predict soil clay content. A promising prediction performance (R2 = 0.60, ratio of performance to the interquartile range (RPIQ) = 2.02, n = 6136) was achieved by the inclusion of both types (synthetic aperture radar (SAR) and laboratory visible near infrared\u2013short wave infrared (VNIR-SWIR) multispectral) of observations using the CNN model, demonstrating an improvement of more than 5.5% in RMSE using the multi-year median optical composite and current state-of-the-art non linear machine learning methods such as random forest (RF; R2 = 0.55, RPIQ = 1.91, n = 6136) and artificial neural network (ANN; R2 = 0.44, RPIQ = 1.71, n = 6136). Moreover, we examined post-hoc techniques to interpret the CNN model and thus acquire an understanding of the relationships between spectral information and the soil target identified by the model. Looking to the future, the proposed approach can be adopted on the forthcoming hyperspectral orbital sensors to expand the current capabilities of the EO component by estimating more soil attributes with higher predictive performance.<\/jats:p>","DOI":"10.3390\/rs12091389","type":"journal-article","created":{"date-parts":[[2020,4,28]],"date-time":"2020-04-28T10:30:58Z","timestamp":1588069858000},"page":"1389","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":59,"title":["Employing a Multi-Input Deep Convolutional Neural Network to Derive Soil Clay Content from a Synergy of Multi-Temporal Optical and Radar Imagery Data"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1502-3219","authenticated-orcid":false,"given":"Nikolaos","family":"Tziolas","sequence":"first","affiliation":[{"name":"School of Agriculture, Faculty of Agriculture, Forestry, and Natural Environment, Aristotle University of Thessaloniki, 54123 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1904-9029","authenticated-orcid":false,"given":"Nikolaos","family":"Tsakiridis","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Faculty of Engineering, Aristotle University of Thessaloniki, 54123 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eyal","family":"Ben-Dor","sequence":"additional","affiliation":[{"name":"The Remote Sensing and GIS Laboratory Department of Geography, School of Earth Science, Tel-Aviv University, Tel Aviv-Yafo P.O. Box 39040, Israel"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Theocharis","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, Faculty of Engineering, Aristotle University of Thessaloniki, 54123 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"George","family":"Zalidis","sequence":"additional","affiliation":[{"name":"School of Agriculture, Faculty of Agriculture, Forestry, and Natural Environment, Aristotle University of Thessaloniki, 54123 Thessaloniki, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Montanarella, L., Pennock, D.J., McKenzie, N., Badraoui, M., Chude, V., Baptista, I., Mamo, T., Yemefack, M., Aulakh, M.S., and Yagi, K. (2016). World\u2019s soils are under threat. SOIL.","DOI":"10.5194\/soild-2-1263-2015"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"137","DOI":"10.5194\/soil-5-137-2019","article-title":"A review of the global soil property maps for Earth system models","volume":"5","author":"Dai","year":"2019","journal-title":"SOIL"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.rse.2012.01.010","article-title":"Opening the archive: How free data has enabled the science and monitoring promise of Landsat","volume":"122","author":"Wulder","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hengl, T., De Jesus, J.M., Heuvelink, G.B.M., Gonzalez, M.R., Kilibarda, M., Blagoti\u0107, A., Shangguan, W., Wright, M.N., Geng, X., and Bauer-Marschallinger, B. (2017). SoilGrids250m: Global gridded soil information based on machine learning. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0169748"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Behrens, T., Schmidt, K., MacMillan, R.A., and Viscarra Rossel, R.A. (2018). Multi-scale digital soil mapping with deep learning. Sci. Rep., 8.","DOI":"10.1038\/s41598-018-33516-6"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"79","DOI":"10.5194\/soil-5-79-2019","article-title":"Using deep learning for digital soil mapping","volume":"5","author":"Padarian","year":"2019","journal-title":"SOIL"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"107","DOI":"10.5194\/soil-5-107-2019","article-title":"Multi-source data integration for soil mapping using deep learning","volume":"5","author":"Wadoux","year":"2019","journal-title":"SOIL"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.geoderma.2017.09.015","article-title":"Multiscale contextual spatial modelling with the Gaussian scale space","volume":"310","author":"Behrens","year":"2018","journal-title":"Geoderma"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"114208","DOI":"10.1016\/j.geoderma.2020.114208","article-title":"Simultaneous prediction of soil properties from VNIR-SWIR spectra using a localized multi-channel 1-D convolutional neural network","volume":"367","author":"Tsakiridis","year":"2020","journal-title":"Geoderma"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Angelopoulou, T., Tziolas, N., Balafoutis, A., Zalidis, G., and Bochtis, D. (2019). Remote Sensing Techniques for Soil Organic Carbon Estimation: A Review. Remote Sens., 11.","DOI":"10.3390\/rs11060676"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1016\/j.isprsjprs.2018.11.026","article-title":"Evaluating the capability of the Sentinel 2 data for soil organic carbon prediction in croplands","volume":"147","author":"Castaldi","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.rse.2019.01.006","article-title":"Sentinel-2 image capacities to predict common topsoil properties of temperate and Mediterranean agroecosystems","volume":"223","author":"Vaudour","year":"2019","journal-title":"Remote Sens. Environ."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tziolas, N., Tsakiridis, N.L., Ogen, Y., Kalopesa, E., Ben-Dor, E., Theocharis, J.B., and Zalidis, G.C. (2020). An integrated methodology using open soil spectral libraries and Earth Observation data for soil organic carbon estimations in support of soil-related SDGs. Remote Sens. Environ., 245.","DOI":"10.1016\/j.rse.2020.111793"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.rse.2018.09.015","article-title":"Soil organic carbon and texture retrieving and mapping using proximal, airborne and Sentinel-2 spectral imaging","volume":"218","author":"Gholizadeh","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Bousbih, S., Zribi, M., Pelletier, C., Gorrab, A., Lili-Chabaane, Z., Baghdadi, N., Ben Aissa, N., and Mougenot, B. (2019). Soil Texture Estimation Using Radar and Optical Data from Sentinel-1 and Sentinel-2. Remote Sens., 11.","DOI":"10.3390\/rs11131520"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Baghdadi, N., El Hajj, M., Choker, M., Zribi, M., Bazzi, H., Vaudour, E., Gilliot, J.-M., and Ebengo, M.D. (2018). Potential of Sentinel-1 Images for Estimating the Soil Roughness over Bare Agricultural Soils. Water, 10.","DOI":"10.3390\/w10020131"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Diek, S., Schaepman, E.M., and de Jong, R. (2016). Creating Multi-Temporal Composites of Airborne Imaging Spectroscopy Data in Support of Digital Soil Mapping. Remote Sens., 8.","DOI":"10.3390\/rs8110906"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rse.2017.11.004","article-title":"Building an exposed soil composite processor (SCMaP) for mapping spatial and temporal characteristics of soils with Landsat imagery (1984\u20132014)","volume":"205","author":"Rogge","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.rse.2018.04.047","article-title":"Geospatial Soil Sensing System (GEOS3): A powerful data mining procedure to retrieve soil spectral reflectance from satellite images","volume":"212","author":"Fongaro","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1276","DOI":"10.1080\/01431161.2016.1148291","article-title":"Normalizing reflectance from different spectrometers and protocols with an internal soil standard","volume":"37","year":"2016","journal-title":"Int. J. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1111\/ejss.12499","article-title":"LUCAS Soil, the largest expandable soil dataset for Europe: A review","volume":"69","author":"Orgiazzi","year":"2018","journal-title":"Eur. J. Soil Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"7409","DOI":"10.1007\/s10661-013-3109-3","article-title":"The LUCAS topsoil database and derived information on the regional variability of cropland topsoil properties in the European Union","volume":"185","author":"Jones","year":"2013","journal-title":"Environ. Monit. Assess."},{"key":"ref_23","unstructured":"Fischer, G., Nachtergaele, F.O., Prieler, S., Teixeira, E., T\u00f3th, G., Van Velthuizen, H., Verelst, L., and Wiberg, D. (2012). Global Agro-ecological Zones (GAEZ v3.0)-Model Documentation, IIASA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"464","DOI":"10.2134\/agronj1962.00021962005400050028x","article-title":"Hydrometer Method Improved for Making Particle Size Analyses of Soils1","volume":"54","author":"Bouyoucos","year":"1962","journal-title":"Agron. J."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Castaldi, F., Chabrillat, S., Don, A., and van Wesemael, B. (2019). Soil organic carbon mapping using LUCAS topsoil database and Sentinel-2 data: An approach to reduce soil moisture and crop residue effects. Remote Sens., 11.","DOI":"10.3390\/rs11182121"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Viscarra Rossel, R.A. (2011). Fine-resolution multiscale mapping of clay minerals in Australian soils measured with near infrared spectra. J. Geophys. Res. Earth Surf., 116.","DOI":"10.1029\/2011JF001977"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1126\/science.1127647","article-title":"Reducing the dimensionality of data with neural networks","volume":"313","author":"Hinton","year":"2006","journal-title":"Science"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e00198","DOI":"10.1016\/j.geodrs.2018.e00198","article-title":"Using deep learning to predict soil properties from regional spectral data","volume":"16","author":"Padarian","year":"2019","journal-title":"Geoderma Reg."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"e2977","DOI":"10.1002\/cem.2977","article-title":"One-dimensional convolutional neural networks for spectroscopic signal regression","volume":"32","author":"Malek","year":"2018","journal-title":"J. Chemom."},{"key":"ref_30","unstructured":"Kingma, D.P., and Ba, J.L. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015-Conference Track Proceedings, San Diego, CA, USA."},{"key":"ref_31","unstructured":"Yosinski, J., Clune, J., Nguyen, A., Fuchs, T., and Lipson, H. (2015). Understanding Neural Networks Through Deep Visualization. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1631\/FITEE.1700808","article-title":"Visual Interpretability for Deep Learning: A Survey","volume":"19","author":"Zhang","year":"2018","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1016\/j.eswa.2017.04.026","article-title":"DECO3RUM: A Differential Evolution learning approach for generating compact Mamdani fuzzy rule-based models","volume":"83","author":"Tsakiridis","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","article-title":"Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI","volume":"58","author":"Bennetot","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Gallo, C.B., Dematt\u00ea, A.M.J., Rizzo, R., Safanelli, L.J., Mendes, D.S.W., Lepsch, F.I., Sato, V.M., Romero, J.D., and Lacerda, P.C.M. (2018). Multi-Temporal Satellite Images on Topsoil Attribute Quantification and the Relationship with Soil Classes and Geology. Remote Sens., 10.","DOI":"10.3390\/rs10101571"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"114018","DOI":"10.1016\/j.geoderma.2019.114018","article-title":"Multi-temporal bare surface image associated with transfer functions to support soil classification and mapping in southeastern Brazil","volume":"361","author":"Rizzo","year":"2020","journal-title":"Geoderma"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1080\/00401706.1969.10490666","article-title":"Computer Aided Design of Experiments","volume":"11","author":"Kennard","year":"1969","journal-title":"Technometrics"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.rse.2017.06.031","article-title":"Google Earth Engine: Planetary-scale geospatial analysis for everyone","volume":"202","author":"Gorelick","year":"2017","journal-title":"Remote Sens. Environ."},{"key":"ref_40","unstructured":"R Development Core Team R: A Language and Environment for statIstical Computing, and R Found (2013). Stat. Comput., Team RC."},{"key":"ref_41","unstructured":"Chollet, F. Keras. Available online: https:\/\/keras.io."},{"key":"ref_42","first-page":"1","article-title":"Building Predictive Models in R Using the caret Package","volume":"28","author":"Kuhn","year":"2008","journal-title":"J. Stat. Software, Artic."},{"key":"ref_43","unstructured":"Working Group WRB (2015). World Reference Base for Soil Resources 2014, Update 2015, FAO. International World Soil Resources Reports No. 106."},{"key":"ref_44","first-page":"101905","article-title":"Satellite data integration for soil clay content modelling at a national scale","volume":"82","author":"Loiseau","year":"2019","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Liu, L., Ji, M., and Buchroithner, M. (2018). Transfer Learning for Soil Spectroscopy Based on Convolutional Neural Networks and Its Application in Soil Clay Content Mapping Using Hyperspectral Imagery. Sensors, 18.","DOI":"10.3390\/s18093169"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1038\/s41586-019-0912-1","article-title":"Deep learning and process understanding for data-driven Earth system science","volume":"566","author":"Reichstein","year":"2019","journal-title":"Nature"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Stevens, A., Nocita, M., T\u00f3th, G., Montanarella, L., and van Wesemael, B. (2013). Prediction of Soil Organic Carbon at the European Scale by Visible and Near InfraRed Reflectance Spectroscopy. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0066409"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/B978-0-08-100355-8.00005-9","article-title":"Chapter 5\u2014IR Spectra of Clay Minerals","volume":"Volume 8","author":"Gates","year":"2017","journal-title":"Infrared and Raman Spectroscopies of Clay Minerals"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Poppiel, R.R., Lacerda, P.C.M., Safanelli, L.J., Rizzo, R., Oliveira, P.M., Novais, J.J., and Dematt\u00ea, A.M.J. (2019). Mapping at 30 m Resolution of Soil Attributes at Multiple Depths in Midwest Brazil. Remote Sens., 11.","DOI":"10.3390\/rs11242905"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Castaldi, F., Chabrillat, S., and van Wesemael, B. (2019). Sampling strategies for soil property mapping using multispectral Sentinel-2 and hyperspectral EnMAP satellite data. Remote Sens., 11.","DOI":"10.3390\/rs11030309"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s10712-019-09524-0","article-title":"Imaging Spectroscopy for Soil Mapping and Monitoring","volume":"40","author":"Chabrillat","year":"2019","journal-title":"Surv. Geophys."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Notesco, G., Weksler, S., and Ben-Dor, E. (2019). Mineral Classification of Soils Using Hyperspectral Longwave Infrared (LWIR) Ground-Based Data. Remote Sens., 11.","DOI":"10.3390\/rs11121429"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1109\/TGRS.2018.2858004","article-title":"Toward Global Soil Moisture Monitoring With Sentinel-1: Harnessing Assets and Overcoming Obstacles","volume":"57","author":"Freeman","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.rse.2018.04.042","article-title":"STAIR: A generic and fully-automated method to fuse multiple sources of optical satellite data to generate a high-resolution, daily and cloud-\/gap-free surface reflectance product","volume":"214","author":"Luo","year":"2018","journal-title":"Remote Sens. Environ."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Tsakiridis, N.L., Chadoulos, C.G., Theocharis, J.B., Ben-Dor, E.C., and Zalidis, G. (2020). A three-level Multiple-Kernel Learning approach for soil spectral analysis. Neurocomputing.","DOI":"10.1016\/j.neucom.2020.01.008"},{"key":"ref_56","first-page":"2672","article-title":"Generative adversarial nets","volume":"3","author":"Goodfellow","year":"2014","journal-title":"Adv. Neural Inf. Proces. Syst."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.earscirev.2016.01.012","article-title":"A global spectral library to characterize the world\u2019s soil","volume":"155","author":"Behrens","year":"2016","journal-title":"Earth-Sci. Rev."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Tziolas, N., Tsakiridis, N., Ben-Dor, E., Theocharis, J., and Zalidis, G. (2019). A memory-based learning approach utilizing combined spectral sources and geographical proximity for improved VIS-NIR-SWIR soil properties estimation. Geoderma, 340.","DOI":"10.1016\/j.geoderma.2018.12.044"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Galeazzi, C., Sacchetti, A., Cisbani, A., and Babini, G. (2008). The PRISMA Program. IGARSS 2008\u20142008 IEEE Int. Geosci. Remote Sens. Symp., 4.","DOI":"10.1109\/IGARSS.2008.4779667"},{"key":"ref_60","first-page":"8629","article-title":"Overview of the open data cube initiative","volume":"2018","author":"Killough","year":"2018","journal-title":"Int. Geosci. Remote Sens. Symp. (IGARSS)"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/9\/1389\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:51:30Z","timestamp":1760363490000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/9\/1389"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,28]]},"references-count":60,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,5]]}},"alternative-id":["rs12091389"],"URL":"https:\/\/doi.org\/10.3390\/rs12091389","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,28]]}}}