{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:28:03Z","timestamp":1760232483292,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2022,11,7]],"date-time":"2022-11-07T00:00:00Z","timestamp":1667779200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"],"award-info":[{"award-number":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Key Research and Development Program of China","award":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"],"award-info":[{"award-number":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"]}]},{"name":"Open Fund of the State Key Laboratory of Remote Sensing Science","award":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"],"award-info":[{"award-number":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"]}]},{"name":"Hainan Provincial Key R&amp;D Program of China","award":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"],"award-info":[{"award-number":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"]}]},{"name":"Youth Innovation Promotion Association CAS","award":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"],"award-info":[{"award-number":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"]}]},{"name":"Future Star Talent Program of the Aerospace Information Research Institute, Chinese Academy of Sciences","award":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"],"award-info":[{"award-number":["41871339","2021YFB3900501","OFSLRSS202222","ZDYF2021GXJS038","2021119","2020KTYWLZX08"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Accurate estimation of the maize leaf area index (LAI) and biomass is of great importance in guiding field management and early yield estimation. Physical models and traditional machine learning methods are commonly used for LAI and biomass estimation. However, these models and methods mostly rely on handcrafted features and theoretical formulas under idealized assumptions, which limits their accuracy. Deep neural networks have demonstrated great superiority in automatic feature extraction and complicated nonlinear approximation, but their application to LAI and biomass estimation has been hindered by the shortage of in situ data. Therefore, bridging the gap of data shortage and making it possible to leverage deep neural networks to estimate maize LAI and biomass is of great significance. Optical data cannot provide information in the lower canopy due to the limited penetrability, but synthetic aperture radar (SAR) data can do this, so the integration of optical and SAR data is necessary. In this paper, 158 samples from the jointing, trumpet, flowering, and filling stages of maize were collected for investigation. First, we propose an improved version of the mixup training method, which is termed mixup+, to augment the sample amount. We then constructed a novel gated Siamese deep neural network (GSDNN) based on a gating mechanism and a Siamese architecture to integrate optical and SAR data for the estimation of the LAI and biomass. We compared the accuracy of the GSDNN with those of other machine learning methods, i.e., multiple linear regression (MLR), support vector regression (SVR), random forest regression (RFR), and a multilayer perceptron (MLP). The experimental results show that without the use of mixup+, the GSDNN achieved a similar accuracy to that of the simple neural network MLP in terms of R2 and RMSE, and this was slightly lower than those of MLR, SVR, and RFR. However, with the help of mixup+, the GSDNN achieved state-of-the-art performance (R2 = 0.71, 0.78, and 0.86 and RMSE = 0.58, 871.83, and 150.76 g\/m2, for LAI, Biomass_wet, and Biomass_dry, respectively), exceeding the accuracies of MLR, SVR, RFR, and MLP. In addition, through the integration of optical and SAR data, the GSDNN achieved better accuracy in LAI and biomass estimation than when optical or SAR data alone were used. We found that the most appropriate amount of synthetic data from mixup+ was five times the amount of original data. Overall, this study demonstrates that the GSDNN + mixup+ has great potential for the integration of optical and SAR data with the aim of improving the estimation accuracy of the maize LAI and biomass with limited in situ data.<\/jats:p>","DOI":"10.3390\/rs14215624","type":"journal-article","created":{"date-parts":[[2022,11,8]],"date-time":"2022-11-08T08:17:12Z","timestamp":1667895432000},"page":"5624","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Enabling Deep-Neural-Network-Integrated Optical and SAR Data to Estimate the Maize Leaf Area Index and Biomass with Limited In Situ Data"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1460-3366","authenticated-orcid":false,"given":"Peilei","family":"Luo","sequence":"first","affiliation":[{"name":"State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}]},{"given":"Huichun","family":"Ye","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Key Laboratory of Earth Observation of Hainan, Aerospace Information Research Institute, Chinese Academy of Sciences, Sanya 572029, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1710-8301","authenticated-orcid":false,"given":"Wenjiang","family":"Huang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"Key Laboratory of Earth Observation of Hainan, Aerospace Information Research Institute, Chinese Academy of Sciences, Sanya 572029, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5915-2661","authenticated-orcid":false,"given":"Jingjuan","family":"Liao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0129-9513","authenticated-orcid":false,"given":"Quanjun","family":"Jiao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}]},{"given":"Anting","family":"Guo","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"}]},{"given":"Binxiang","family":"Qian","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Remote Sensing Science, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1111\/nyas.12396","article-title":"Global maize production, utilization, and consumption","volume":"1312","author":"Ranum","year":"2014","journal-title":"Ann. N. Y. Acad. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1007\/s12571-011-0140-5","article-title":"Crops that feed the world 6. Past successes and future challenges to the role played by maize in global food security","volume":"3","author":"Shiferaw","year":"2011","journal-title":"Food Secur."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1111\/j.1541-4337.2010.00117.x","article-title":"Maize: A paramount staple crop in the context of global nutrition","volume":"9","author":"Nuss","year":"2010","journal-title":"Compr. Rev. Food Sci. Food Saf."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Xia, T., Miao, Y., Wu, D., Shao, H., Khosla, R., and Mi, G. (2016). Active optical sensing of spring maize for in-season diagnosis of nitrogen status based on nitrogen nutrition index. Remote Sens., 8.","DOI":"10.3390\/rs8070605"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"104943","DOI":"10.1016\/j.compag.2019.104943","article-title":"Monitoring plant diseases and pests through remote sensing technology: A review","volume":"165","author":"Zhang","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bi, W., Wang, M., Weng, B., Yan, D., Yang, Y., and Wang, J. (2019). Effects of drought\u2013flood abrupt alternation on the growth of summer maize. Atmosphere, 11.","DOI":"10.3390\/atmos11010021"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"875","DOI":"10.1038\/nclimate1908","article-title":"The role of satellite remote sensing in climate change studies","volume":"3","author":"Yang","year":"2013","journal-title":"Nat. Clim. Chang."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Che, Y., Wang, Q., Zhou, L., Wang, X., Li, B., and Ma, Y. (2022). The effect of growth stage and plant counting accuracy of maize inbred lines on LAI and biomass prediction. Precis. Agric., 1\u201327.","DOI":"10.1007\/s11119-022-09915-1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"739","DOI":"10.1029\/2018RG000608","article-title":"An overview of global leaf area index (LAI): Methods, products, validation, and applications","volume":"57","author":"Fang","year":"2019","journal-title":"Rev. Geophys."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Jinsong, C., Yu, H., and Xinping, D. (2017, January 7\u201310). Monitoring rice growth in Southern China using TerraSAR-X dual polarization data. Proceedings of the 2017 6th International Conference on Agro-Geoinformatics, Fairfax, VA, USA.","DOI":"10.1109\/Agro-Geoinformatics.2017.8047073"},{"key":"ref_11","first-page":"512","article-title":"New index for crop canopy fresh biomass estimation","volume":"30","author":"Chen","year":"2010","journal-title":"Spectrosc. Spectr. Anal."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gitelson, A.A., Vi\u00f1a, A., Arkebauer, T.J., Rundquist, D.C., Keydan, G., and Leavitt, B. (2003). Remote estimation of leaf area index and green leaf biomass in maize canopies. Geophys. Res. Lett., 30.","DOI":"10.1029\/2002GL016450"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1109\/36.225538","article-title":"Estimating leaf area index from satellite data","volume":"31","author":"Price","year":"1993","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","first-page":"462","article-title":"Comparison of different methods for corn LAI estimation over northeastern China","volume":"18","author":"Fei","year":"2012","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_15","first-page":"101893","article-title":"An investigation of inversion methodologies to retrieve the leaf area index of corn from C-band SAR data","volume":"82","author":"Mandal","year":"2019","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1016\/j.isprsjprs.2011.09.013","article-title":"Mapping grassland leaf area index with airborne hyperspectral imagery: A comparison study of statistical approaches and inversion of radiative transfer models","volume":"66","author":"Darvishzadeh","year":"2011","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"53614","DOI":"10.1109\/ACCESS.2020.2981492","article-title":"Combining spectral and texture features for estimating leaf area index and biomass of maize using Sentinel-1\/2, and Landsat-8 data","volume":"8","author":"Luo","year":"2020","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.isprsjprs.2019.06.007","article-title":"Estimating leaf area index and aboveground biomass of grazing pastures using Sentinel-1, Sentinel-2 and Landsat images","volume":"154","author":"Wang","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Shafique, A., Cao, G., Khan, Z., Asad, M., and Aslam, M. (2022). Deep learning-based change detection in remote sensing images: A review. Remote Sens., 14.","DOI":"10.3390\/rs14040871"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.isprsjprs.2019.04.015","article-title":"Deep learning in remote sensing applications: A meta-analysis and review","volume":"152","author":"Ma","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1016\/j.rse.2018.11.032","article-title":"Deep learning based multi-temporal crop classification","volume":"221","author":"Zhong","year":"2019","journal-title":"Rem. Sens. Environ."},{"key":"ref_22","first-page":"102456","article-title":"A review on deep learning in UAV remote sensing","volume":"102","author":"Osco","year":"2021","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, D., Cao, W., Zhang, F., Li, Z., Xu, S., and Wu, X. (2022). A review of deep learning in multiscale agricultural sensing. Remote Sens., 14.","DOI":"10.3390\/rs14030559"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"111716","DOI":"10.1016\/j.rse.2020.111716","article-title":"Deep learning in environmental remote sensing: Achievements and challenges","volume":"241","author":"Yuan","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1080\/22797254.2020.1790995","article-title":"A novel approach for scene classification from remote sensing images using deep learning methods","volume":"54","author":"Xu","year":"2021","journal-title":"Eur. J. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zheng, L., and Xu, W. (2021). An improved adaptive spatial preprocessing method for remote sensing images. Sensors, 21.","DOI":"10.3390\/s21175684"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.isprsjprs.2020.12.015","article-title":"PBNet: Part-based convolutional neural network for complex composite object detection in remote sensing imagery","volume":"173","author":"Sun","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_28","first-page":"840","article-title":"An improved YOLO algorithm for rotated object detection in remote sensing images","volume":"Volume 4","author":"Zhang","year":"2021","journal-title":"Proceedings of the 2021 IEEE 4th Advanced Information Management, Communications, Electronic and Automation Control Conference (IMCEC)"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Potnis, A.V., Durbha, S.S., and Shinde, R.C. (2021). Semantics-driven remote sensing scene understanding framework for grounded spatio-contextual scene descriptions. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10010032"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"89644","DOI":"10.1109\/ACCESS.2021.3090981","article-title":"Floodnet: A high resolution aerial imagery dataset for post flood scene understanding","volume":"9","author":"Rahnemoonfar","year":"2021","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wong, S.C., Gatt, A., Stamatescu, V., and McDonnell, M.D. (December, January 30). Understanding data augmentation for classification: When to warp?. Proceedings of the 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), Gold Coast, Australia.","DOI":"10.1109\/DICTA.2016.7797091"},{"key":"ref_32","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, H., Cisse, M., Dauphin, Y.N., and Lopez-Paz, D. (2017). mixup: Beyond empirical risk minimization. arXiv.","DOI":"10.1007\/978-1-4899-7687-1_79"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3468","DOI":"10.1016\/j.rse.2011.08.010","article-title":"Comparison of different vegetation indices for the remote assessment of green leaf area index of crops","volume":"115","author":"Gitelson","year":"2011","journal-title":"Remote Sens. Environ."},{"key":"ref_35","first-page":"235","article-title":"Assessment of RapidEye vegetation indices for estimation of leaf area index and biomass in corn and soybean crops","volume":"34","author":"Kross","year":"2015","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"13251","DOI":"10.3390\/rs71013251","article-title":"Combined multi-temporal optical and radar parameters for estimating LAI and biomass in winter wheat using HJ and RADARSAR-2 data","volume":"7","author":"Jin","year":"2015","journal-title":"Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/j.compag.2017.12.007","article-title":"Generalizability of gene expression programming and random forest methodologies in estimating cropland and grassland leaf area index","volume":"144","author":"Karimi","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Dey, R., and Salem, F.M. (2017, January 6\u20139). Gate-variants of gated recurrent unit (GRU) neural networks. Proceedings of the 2017 IEEE 60th International Midwest Symposium on Circuits and Systems (MWSCAS), Boston, MA, USA.","DOI":"10.1109\/MWSCAS.2017.8053243"},{"key":"ref_39","unstructured":"Koch, G., Zemel, R., and Salakhutdinov, R. (2015, January 6\u201311). Siamese neural networks for one-shot image recognition. Proceedings of the ICML Deep Learning Workshop, Lille, France."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Xu, L., Zhang, H., Wang, C., Zhang, B., and Liu, M. (2018). Crop classification based on temporal information using Sentinel-1 SAR time-series data. Remote Sens., 11.","DOI":"10.3390\/rs11010053"},{"key":"ref_42","unstructured":"Chapelle, O., Weston, J., Bottou, L., and Vapnik, V. (2000). Vicinal risk minimization. Advances in Neural Information Processing Systems 13, MIT Press."},{"key":"ref_43","unstructured":"Ruder, S. (2017). An overview of multi-task learning in deep neural networks. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"5586","DOI":"10.1109\/TKDE.2021.3070203","article-title":"A survey on multi-task learning","volume":"34","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Knowledge Data Eng."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7\u201313). Delving deep into rectifiers: Surpassing human-level performance on ImageNet classification. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.123"},{"key":"ref_46","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Bahrami, H., Homayouni, S., Safari, A., Mirzaei, S., Mahdianpari, M., and Reisi-Gahrouei, O. (2021). Deep learning-based estimation of crop biophysical parameters using multi-source and multi-temporal remote sensing observations. Agronomy, 11.","DOI":"10.3390\/agronomy11071363"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1080\/07038992.2021.2011180","article-title":"Regional crop characterization using multi-temporal optical and synthetic aperture radar earth observations data","volume":"48","author":"Bahrami","year":"2022","journal-title":"Can. J. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/21\/5624\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:12:09Z","timestamp":1760145129000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/21\/5624"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,7]]},"references-count":48,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["rs14215624"],"URL":"https:\/\/doi.org\/10.3390\/rs14215624","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,11,7]]}}}