{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:43:33Z","timestamp":1760240613734,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2019,8,10]],"date-time":"2019-08-10T00:00:00Z","timestamp":1565395200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012774","name":"Innovationsfonden","doi-asserted-by":"publisher","award":["7038-00170B"],"award-info":[{"award-number":["7038-00170B"]}],"id":[{"id":"10.13039\/100012774","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Efficient and robust evaluation of kernel processing from corn silage is an important indicator to a farmer to determine the quality of their harvested crop. Current methods are cumbersome to conduct and take between hours to days. We present the adoption of two deep learning-based methods for kernel processing prediction without the cumbersome step of separating kernels and stover before capturing images. The methods show that kernels can be detected both with bounding boxes and at pixel-level instance segmentation. Networks were trained on up to 1393 images containing just over 6907 manually annotated kernel instances. Both methods showed promising results despite the challenging setting, with an average precision at an intersection-over-union of 0.5 of 34.0% and 36.1% on the test set consisting of images from three different harvest seasons for the bounding-box and instance segmentation networks respectively. Additionally, analysis of the correlation between the Kernel Processing Score (KPS) of annotations against the KPS of model predictions showed a strong correlation, with the best performing at r(15) = 0.88, p = 0.00003. The adoption of deep learning-based object recognition approaches for kernel processing measurement has the potential to lower the quality assessment process to minutes, greatly aiding a farmer in the strenuous harvesting season.<\/jats:p>","DOI":"10.3390\/s19163506","type":"journal-article","created":{"date-parts":[[2019,8,12]],"date-time":"2019-08-12T06:38:02Z","timestamp":1565591882000},"page":"3506","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Maize Silage Kernel Fragment Estimation Using Deep Learning-Based Object Recognition in Non-Separated Kernel\/Stover RGB Images"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8786-0737","authenticated-orcid":false,"given":"Christoffer B\u00f8gelund","family":"Rasmussen","sequence":"first","affiliation":[{"name":"Department of Architecture, Design &amp; Media Technology, Aalborg University, Rendsburggade 14, 9000 Aalborg, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas B.","family":"Moeslund","sequence":"additional","affiliation":[{"name":"Department of Architecture, Design &amp; Media Technology, Aalborg University, Rendsburggade 14, 9000 Aalborg, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"208","DOI":"10.3168\/jds.S0022-0302(03)73601-7","article-title":"Corn Silage Mangement: Effects of Hybrid, Chop Length, and Mechanical Processing on Digestion and Energy Content","volume":"86","author":"Johnson","year":"2003","journal-title":"J. Dairy Sci."},{"key":"ref_2","first-page":"649","article-title":"Comparison of Fuel Usage and Harvest Capacity in Self-propelled Forage Harvesters","volume":"7","author":"Marsh","year":"2013","journal-title":"World Acad. Sci. Eng. Technol."},{"key":"ref_3","unstructured":"Mertens, D.R. (2005, January 15). Particle size, fragmentation index, and effective fiber: Tools for evaluating the physical attributes of corn silages. Proceedings of the Four-State Dairy Nutrition and Management Conference, Dubuque, IA, USA."},{"key":"ref_4","unstructured":"Heinrichs, J. (2018, July 24). The Penn State Particle Separator. Penn State Extension. Available online: https:\/\/extension.psu.edu\/penn-state-particle-separator."},{"key":"ref_5","first-page":"1","article-title":"Making Sure Your Kernel Processor Is Doing Its Job","volume":"15","author":"Shinners","year":"2014","journal-title":"Focus Forage"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.compag.2019.03.020","article-title":"Predicting kernel processing score of harvested and processed corn silage via image processing techniques","volume":"160","author":"Drewry","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_7","first-page":"1","article-title":"Classification and grading rice using multi-class SVM","volume":"3","author":"Kaur","year":"2013","journal-title":"Int. J. Sci. Res."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Aggarwal, A.K., and Mohan, R. (2010). Aspect ratio analysis using image processing for rice grain quality. Int. J. Food Eng., 5.","DOI":"10.2202\/1556-3758.1788"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1257","DOI":"10.1007\/s11947-017-1895-2","article-title":"An Open Source Conveyor Belt Prototype for Image Analysis-Based Rice Yield Determination","volume":"10","author":"Antonucci","year":"2017","journal-title":"Food Bioprocess Technol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.foodres.2003.09.001","article-title":"Determination of the size distribution and percentage of broken kernels of rice using flatbed scanning and image analysis","volume":"37","year":"2004","journal-title":"Food Res. Int."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1117\/1.JEI.24.6.061116","article-title":"Automatic visual grading of grain products by machine vision","volume":"24","author":"Dubosclard","year":"2015","journal-title":"J. Electron. Imaging"},{"key":"ref_12","first-page":"11","article-title":"Image analysis of bulk grain samples using neural networks","volume":"46","author":"Visen","year":"2004","journal-title":"Can. Biosyst. Eng."},{"key":"ref_13","first-page":"77","article-title":"Effect of foreign bodies on recognition and classification of bulk food grains image samples","volume":"6","author":"Anami","year":"2009","journal-title":"J. Appl. Comput. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lee, C.Y., Yan, L., Wang, T., Lee, S.R., and Park, C.W. (2011). Intelligent classification methods of grain kernels using computer vision analysis. Meas. Sci. Technol., 22.","DOI":"10.1088\/0957-0233\/22\/6\/064006"},{"key":"ref_15","first-page":"672","article-title":"A machine vision system for classification of wheat and barley grain kernels","volume":"9","year":"2011","journal-title":"Spanish. J. Agr. Res."},{"key":"ref_16","first-page":"3669","article-title":"Color and texture based identification and classification of food grains using different color models and haralick features","volume":"3","author":"Patil","year":"2011","journal-title":"Int. J. Comput. Sci. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Miao, A., Zhuang, J., Tang, Y., He, Y., Chu, X., and Luo, S. (2018). Hyperspectral Image-Based Variety Classification of Waxy Maize Seeds by the t-SNE Model and Procrustes Analysis. Sensors, 18.","DOI":"10.3390\/s18124391"},{"key":"ref_18","unstructured":"Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems 25, Curran Associates, Inc."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Skovsen, S., Dyrmann, M., Mortensen, A.K., Steen, K.A., Green, O., Eriksen, J., Gislum, R., and J\u00f8rgensen, R.N. (2017). Estimation of the Botanical Composition of Clover-Grass Leys from RGB Images Using Data Simulation and Fully Convolutional Neural Networks. Sensors, 17.","DOI":"10.3390\/s17122930"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Fuentes, A., Yoon, S., Kim, S.C., and Park, D.S. (2017). A Robust Deep-Learning-Based Detector for Real-Time Tomato Plant Diseases and Pests Recognition. Sensors, 17.","DOI":"10.3390\/s17092022"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hall, D., McCool, C., Dayoub, F., Sunderhauf, N., and Upcroft, B. (2015, January 5\u20139). Evaluation of Features for Leaf Classification in Challenging Conditions. Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Waikola, HI, USA.","DOI":"10.1109\/WACV.2015.111"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.3389\/fpls.2016.01419","article-title":"Using Deep Learning for Image-based Plant Disease Detection","volume":"7","author":"Mohanty","year":"2016","journal-title":"Front. Plant Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"41","DOI":"10.5194\/isprs-annals-IV-2-W3-41-2017","article-title":"Real-time Blob-wise Sugar Beets vs Weeds Classification for Monitoring Fields using Convolutional Neural Networks","volume":"V-2\/W3","author":"Milioto","year":"2017","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_24","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_25","unstructured":"Dai, J., He, K., and Sun, J. (2016, January 4\u20139). R-FCN: Object Detection via Region-based Fully Convolutional Networks. Proceedings of the Conference on Neural Information Processing (NIPS), Barcelona, Spain."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Dai, J., He, K., and Sun, J. (2016, January 26). Instance-Aware Semantic Segmentation via Multi-task Network Cascades. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.343"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The PASCAL Visual Object Classes (VOC) Challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lin, T., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014). Microsoft COCO: Common Objects in Context. Computer Vision\u2014ECCV 2014, Springer International Publishing.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_29","unstructured":"Ren, S., He, K., Girschick, R., and Sun, J. (2015, January 7\u201312). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Proceedings of the NIPS\u201915 Proceedings of the 28th International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_30","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 26). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet Large Scale Visual Recognition Challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Jia, Y., Shelhamer, E., Donahue, J., Karayev, S., Long, J., Girschick, R., Guadarrama, S., and Darrel, T. (2014). Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv.","DOI":"10.1145\/2647868.2654889"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Cohen, J. (2013). Statistical Power Analysis for the Behavioral Sciences, Lawrence Erlbaum. [2nd ed.].","DOI":"10.4324\/9780203771587"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/16\/3506\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:10:13Z","timestamp":1760188213000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/16\/3506"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,10]]},"references-count":34,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["s19163506"],"URL":"https:\/\/doi.org\/10.3390\/s19163506","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,8,10]]}}}