{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T03:37:19Z","timestamp":1768448239064,"version":"3.49.0"},"reference-count":56,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,16]],"date-time":"2021-11-16T00:00:00Z","timestamp":1637020800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Advanced machine learning techniques have been used in remote sensing (RS) applications such as crop mapping and yield prediction, but remain under-utilized for tracking crop progress. In this study, we demonstrate the use of agronomic knowledge of crop growth drivers in a Long Short-Term Memory-based, domain-guided neural network (DgNN) for in-season crop progress estimation. The DgNN uses a branched structure and attention to separate independent crop growth drivers and captures their varying importance throughout the growing season. The DgNN is implemented for corn, using RS data in Iowa, U.S., for the period 2003\u20132019, with United States Department of Agriculture (USDA) crop progress reports used as ground truth. State-wide DgNN performance shows significant improvement over sequential and dense-only NN structures, and a widely-used Hidden Markov Model method. The DgNN had a 4.0% higher Nash-Sutcliffe efficiency over all growth stages and 39% more weeks with highest cosine similarity than the next best NN during test years. The DgNN and Sequential NN were more robust during periods of abnormal crop progress, though estimating the Silking\u2013Grainfill transition was difficult for all methods. Finally, Uniform Manifold Approximation and Projection visualizations of layer activations showed how LSTM-based NNs separate crop growth time-series differently from a dense-only structure. Results from this study exhibit both the viability of NNs in crop growth stage estimation (CGSE) and the benefits of using domain knowledge. The DgNN methodology presented here can be extended to provide near-real time CGSE of other crops.<\/jats:p>","DOI":"10.3390\/rs13224605","type":"journal-article","created":{"date-parts":[[2021,11,17]],"date-time":"2021-11-17T02:42:28Z","timestamp":1637116948000},"page":"4605","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Domain-Guided Machine Learning for Remotely Sensed In-Season Crop Growth Estimation"],"prefix":"10.3390","volume":"13","author":[{"given":"George","family":"Worrall","sequence":"first","affiliation":[{"name":"Center for Remote Sensing, Department of Agricultural and Biological Engineering, University of Florida, Gainesville, FL 32611, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8695-8436","authenticated-orcid":false,"given":"Anand","family":"Rangarajan","sequence":"additional","affiliation":[{"name":"Department of Computer & Information Science & Engineering, University of Florida, Gainesville, FL 32611, USA"}]},{"given":"Jasmeet","family":"Judge","sequence":"additional","affiliation":[{"name":"Center for Remote Sensing, Department of Agricultural and Biological Engineering, University of Florida, Gainesville, FL 32611, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"5989","DOI":"10.1038\/ncomms6989","article-title":"Climate variation explains a third of global crop yield variability","volume":"6","author":"Ray","year":"2015","journal-title":"Nat. Commun."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"034003","DOI":"10.1088\/1748-9326\/11\/3\/034003","article-title":"Changes in yield variability of major crops for 1981\u20132010 explained by climate change","volume":"11","author":"Iizumi","year":"2016","journal-title":"Environ. Res. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1038\/s41559-019-0862-x","article-title":"Synchronized failure of global crop production","volume":"3","author":"Mehrabi","year":"2019","journal-title":"Nat. Ecol. Evol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1734","DOI":"10.3390\/rs5041734","article-title":"Hidden Markov Models for Real-Time Estimation of Corn Progress Stages Using MODIS and Meteorological Data","volume":"5","author":"Shen","year":"2013","journal-title":"Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/j.rse.2016.03.039","article-title":"A hybrid approach for detecting corn and soybean phenology with time-series MODIS data","volume":"181","author":"Zeng","year":"2016","journal-title":"Remote Sens. Environ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.fcr.2019.03.015","article-title":"Improving remotely-sensed crop monitoring by NDVI-based crop phenology estimators for corn and soybeans in Iowa and Illinois, USA","volume":"238","author":"Seo","year":"2019","journal-title":"Field Crops Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"111960","DOI":"10.1016\/j.rse.2020.111960","article-title":"Remote sensing phenological monitoring framework to characterize corn and soybean physiological growing stages","volume":"248","author":"Diao","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"107829","DOI":"10.1016\/j.agrformet.2019.107829","article-title":"A parametric empirical Bayes (PEB) approach for estimating maize progress percentage at field scale","volume":"281","author":"Ghamghami","year":"2020","journal-title":"Agric. For. Meteorol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"6553","DOI":"10.1080\/01431161.2019.1569791","article-title":"Crop type classification using a combination of optical and radar remote sensing data: A review","volume":"40","author":"Orynbaikyzy","year":"2019","journal-title":"Int. J. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1111\/agec.12531","article-title":"Bringing automated, remote-sensed, machine learning methods to monitoring crop landscapes at scale","volume":"50","author":"Jia","year":"2019","journal-title":"Agric. Econ."},{"key":"ref_11","unstructured":"Kerner, H., Sahajpal, R., Skakun, S., Becker-Reshef, I., Barker, B., Hosseini, M., Puricelli, E., and Gray, P. (2020). Resilient In-Season Crop Type Classification in Multispectral Satellite Observations using Growth Stage Normalization. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Teimouri, N., Dyrmann, M., and J\u00f8rgensen, R.N. (2019). A Novel Spatio-Temporal FCN-LSTM Network for Recognizing Various Crop Types Using Multi-Temporal Radar Images. Remote Sens., 11.","DOI":"10.3390\/rs11080990"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"111402","DOI":"10.1016\/j.rse.2019.111402","article-title":"Remote sensing for agricultural applications: A meta-review","volume":"236","author":"Weiss","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_14","unstructured":"USDA National Agricultural Statistics Service Cropland Data Layer (2020, November 05). 2008\u20132019. Type: Dataset. Available online: http:\/\/nassgeodata.gmu.edu\/CropScape\/."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2318","DOI":"10.1109\/TKDE.2017.2720168","article-title":"Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data","volume":"29","author":"Karpatne","year":"2017","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_16","unstructured":"Khandelwal, A., Xu, S., Li, X., Jia, X., Stienbach, M., Duffy, C., Nieber, J., and Kumar, V. (2020). Physics Guided Machine Learning Methods for Hydrology. arXiv."},{"key":"ref_17","unstructured":"Willard, J., Jia, X., Xu, S., Steinbach, M., and Kumar, V. (2020). Integrating Physics-Based Modeling with Machine Learning: A Survey. arXiv."},{"key":"ref_18","unstructured":"Karpatne, A., Watkins, W., Read, J., and Kumar, V. (2018). Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2082","DOI":"10.1109\/TPWRS.2020.3029557","article-title":"Physics-Guided Deep Neural Networks for Power Flow Analysis","volume":"36","author":"Hu","year":"2020","journal-title":"IEEE Trans. Power Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1606","DOI":"10.1038\/s41598-020-80820-1","article-title":"Coupling machine learning and crop modeling improves crop yield prediction in the US Corn Belt","volume":"11","author":"Shahhosseini","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1643","DOI":"10.3389\/fgene.2020.599510","article-title":"Predicting rice heading date using an integrated approach combining a machine learning method and a crop growth model","volume":"11","author":"Chen","year":"2020","journal-title":"Front. Genet."},{"key":"ref_22","unstructured":"Rong, M., Zhang, D., and Wang, N. (2020). A Lagrangian Dual-based Theory-guided Deep Neural Network. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"124700","DOI":"10.1016\/j.jhydrol.2020.124700","article-title":"Deep learning of subsurface flow via theory-guided neural network","volume":"584","author":"Wang","year":"2020","journal-title":"J. Hydrol."},{"key":"ref_24","unstructured":"USDA National Agricultural Statistics Service (2021). World Agricultural Production, USDA Foreign Agricultural Service. Technical Report WAP 4-21."},{"key":"ref_25","unstructured":"USDA National Agricultural Statistics Service (2021, March 15). NASS\u2014Quick Stats. 2017: Corn\u2014Acres Planted. Type: Dataset, Available online: https:\/\/data.nal.usda.gov\/dataset\/nass-quick-stats."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1038\/s41597-020-00646-4","article-title":"Mapping twenty years of corn and soybean across the US Midwest using the Landsat archive","volume":"7","author":"Wang","year":"2020","journal-title":"Sci. Data"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"766","DOI":"10.2134\/agronj2010.0423","article-title":"CSM-IXIM: A New Maize Simulation Model for DSSAT Version 4.5","volume":"103","author":"Lizaso","year":"2011","journal-title":"Agron. J."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hanks, J., and Ritchie, J.T. (2015). Maize Phasic Development. Agronomy Monographs, American Society of Agronomy, Crop Science Society of America, Soil Science Society of America.","DOI":"10.2134\/agronmonogr31.c3"},{"key":"ref_29","unstructured":"Thornton, M., Shrestha, R., Wei, Y., Thornton, P., Kao, S., and Wilson, B. (2020). Daymet: Daily Surface Weather Data on a 1-km Grid for North America, Version 4, ORNL Distributed Active Archive Center."},{"key":"ref_30","unstructured":"Myneni, Y.R., and Knyazikhin, T.P. (2020, November 05). MCD15A3H MODIS\/Terra+Aqua Leaf Area Index\/FPAR 4-day L4 Global 500m SIN Grid V006. NASA EOSDIS Land Processes DAAC, Available online: https:\/\/lpdaac.usgs.gov\/products\/mcd15a3hv006\/."},{"key":"ref_31","unstructured":"Staff, S.S. (2020). Gridded Soil Survey Geographic (gSSURGO) Database for the United States of America and the Territories, Commonwealths, and Island Nations served by the USDA-NRCS, USDA National Resource Conversvation Service. Technical Report."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"332","DOI":"10.1016\/j.rse.2004.03.014","article-title":"A simple method for reconstructing a high-quality NDVI time-series data set based on the Savitzky\u2013Golay filter","volume":"91","author":"Chen","year":"2004","journal-title":"Remote Sens. Environ."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1162\/neco_a_01199","article-title":"A Review of Recurrent Neural Networks: LSTM Cells and Network Architectures","volume":"31","author":"Yu","year":"2019","journal-title":"Neural Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1750","DOI":"10.3389\/fpls.2019.01750","article-title":"A CNN-RNN Framework for Crop Yield Prediction","volume":"10","author":"Khaki","year":"2020","journal-title":"Front. Plant Sci."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Graves, A. (2012). Long short-term memory. Supervised Sequence Labelling with Recurrent Neural Networks, Springer.","DOI":"10.1007\/978-3-642-24797-2"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"749","DOI":"10.2134\/agronj1983.00021962007500050008x","article-title":"Corn Growth Response to Temperature and Photoperiod I. Seedling Emergence, Tassel Initiation, and Anthesis","volume":"75","author":"Warrington","year":"1983","journal-title":"Agron. J."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"755","DOI":"10.2134\/agronj1983.00021962007500050009x","article-title":"Corn Growth Response to Temperature and Photoperiod II. Leaf-Initiation and Leaf-Appearance Rates","volume":"75","author":"Warrington","year":"1983","journal-title":"Agron. J."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"107","DOI":"10.2134\/agronj1992.00021962008400010021x","article-title":"Short- and Long-Term Responses of Corn to a Pre-Anthesis Soil Water Deficit","volume":"84","author":"NeSmith","year":"1992","journal-title":"Agron. J."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.fcr.2004.01.005","article-title":"Effect of water stress at different development stages on vegetative and reproductive growth of corn","volume":"89","year":"2004","journal-title":"Field Crops Res."},{"key":"ref_41","unstructured":"Jones, C., Ritchie, J., Kiniry, J., Godwin, D., and Otter, S. (1983, January 21\u201326). The CERES wheat and maize models. Proceedings of the International Symposium on Minimum Data Sets for Agrotechnology Transfer, ICRISAT Center, Patancheru, India."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1016\/j.envsoft.2014.07.009","article-title":"APSIM\u2013Evolution towards a new generation of agricultural systems simulation","volume":"62","author":"Holzworth","year":"2014","journal-title":"Environ. Model. Softw."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/MCI.2018.2840738","article-title":"Recent Trends in Deep Learning Based Natural Language Processing","volume":"13","author":"Young","year":"2018","journal-title":"IEEE Comput. Intell. Mag."},{"key":"ref_44","unstructured":"Liu, Y., Sun, C., Lin, L., and Wang, X. (2016). Learning Natural Language Inference using Bidirectional LSTM model and Inner-Attention. arXiv."},{"key":"ref_45","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv."},{"key":"ref_46","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th {USENIX} symposium on operating systems design and implementation ({OSDI} 16), Savannah, GA, USA."},{"key":"ref_47","unstructured":"McInnes, L., Healy, J., and Melville, J. (2020). UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1038\/nbt.4314","article-title":"Dimensionality reduction for visualizing single-cell data using UMAP","volume":"37","author":"Becht","year":"2019","journal-title":"Nat. Biotechnol."},{"key":"ref_49","unstructured":"USDA-National Agricultural Statistics Service Upper Midwest Region, Iowa Field Office (2010). 2010 Iowa Agricultural Statistics, USDA. Technical Report."},{"key":"ref_50","unstructured":"USDA-National Agricultural Statistics Service Upper Midwest Region, Iowa Field Office (2013). 2013 Iowa Agricultural Statistics, USDA. Technical Report."},{"key":"ref_51","unstructured":"USDA-National Agricultural Statistics Service Upper Midwest Region, Iowa Field Office (2015). 2015 Iowa Agricultural Statistics, USDA. Technical Report."},{"key":"ref_52","unstructured":"USDA-National Agricultural Statistics Service Upper Midwest Region, Iowa Field Office (2020). 2020 Iowa Agricultural Statistics, USDA. Technical Report."},{"key":"ref_53","unstructured":"USDA National Agricultural Statistics Service (2021, March 15). NASS\u2014Quick Stats. 2017: Corn\u2014Crop Condition. Type: Dataset, Available online: https:\/\/data.nal.usda.gov\/dataset\/nass-quick-stats."},{"key":"ref_54","unstructured":"Meyes, R., Lu, M., de Puiseau, C.W., and Meisen, T. (2019). Ablation Studies in Artificial Neural Networks. arXiv."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Peerlinck, A., Sheppard, J., and Senecal, J. (2019, January 14\u201319). AdaBoost with Neural Networks for Yield and Protein Prediction in Precision Agriculture. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8851976"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Kussul, N., Lavreniuk, M., Shelestov, A., and Yailymov, B. (2016, January 10\u201315). Along the season crop classification in Ukraine based on time series of optical and SAR images using ensemble of neural network classifiers. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.","DOI":"10.1109\/IGARSS.2016.7730864"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/22\/4605\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:31:02Z","timestamp":1760167862000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/22\/4605"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,16]]},"references-count":56,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["rs13224605"],"URL":"https:\/\/doi.org\/10.3390\/rs13224605","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,16]]}}}