{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T13:40:32Z","timestamp":1777729232391,"version":"3.51.4"},"reference-count":25,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2020,12,29]],"date-time":"2020-12-29T00:00:00Z","timestamp":1609200000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012774","name":"Innovationsfonden","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100012774","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Green Development and Demonstration Programme (GUDP)"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Crop mixtures are often beneficial in crop rotations to enhance resource utilization and yield stability. While targeted management, dependent on the local species composition, has the potential to increase the crop value, it comes at a higher expense in terms of field surveys. As fine-grained species distribution mapping of within-field variation is typically unfeasible, the potential of targeted management remains an open research area. In this work, we propose a new method for determining the biomass species composition from high resolution color images using a DeepLabv3+ based convolutional neural network. Data collection has been performed at four separate experimental plot trial sites over three growing seasons. The method is thoroughly evaluated by predicting the biomass composition of different grass clover mixtures using only an image of the canopy. With a relative biomass clover content prediction of R2 = 0.91, we present new state-of-the-art results across the largely varying sites. Combining the algorithm with an all terrain vehicle (ATV)-mounted image acquisition system, we demonstrate a feasible method for robust coverage and species distribution mapping of 225 ha of mixed crops at a median capacity of 17 ha per hour at 173 images per hectare.<\/jats:p>","DOI":"10.3390\/s21010175","type":"journal-article","created":{"date-parts":[[2020,12,29]],"date-time":"2020-12-29T19:55:25Z","timestamp":1609271725000},"page":"175","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Robust Species Distribution Mapping of Crop Mixtures Using Color Images and Convolutional Neural Networks"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6222-3005","authenticated-orcid":false,"given":"S\u00f8ren Kelstrup","family":"Skovsen","sequence":"first","affiliation":[{"name":"Department of Engineering, Aarhus University, Finlandsgade 22, 8200 Aarhus N, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4532-4810","authenticated-orcid":false,"given":"Morten Stigaard","family":"Laursen","sequence":"additional","affiliation":[{"name":"Department of Engineering, Aarhus University, Finlandsgade 22, 8200 Aarhus N, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebekka Kjeldgaard","family":"Kristensen","sequence":"additional","affiliation":[{"name":"Department of Agroecology, Aarhus University, Blichers All\u00e9 20, 8830 Tjele, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jim","family":"Rasmussen","sequence":"additional","affiliation":[{"name":"Department of Agroecology, Aarhus University, Blichers All\u00e9 20, 8830 Tjele, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6510-1609","authenticated-orcid":false,"given":"Mads","family":"Dyrmann","sequence":"additional","affiliation":[{"name":"School of Engineering, Aarhus University, Finlandsgade 22, 8200 Aarhus N, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4622-7660","authenticated-orcid":false,"given":"J\u00f8rgen","family":"Eriksen","sequence":"additional","affiliation":[{"name":"Department of Agroecology, Aarhus University, Blichers All\u00e9 20, 8830 Tjele, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1432-4781","authenticated-orcid":false,"given":"Ren\u00e9","family":"Gislum","sequence":"additional","affiliation":[{"name":"Department of Agroecology, Aarhus University, Blichers All\u00e9 20, 8830 Tjele, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1329-1674","authenticated-orcid":false,"given":"Rasmus Nyholm","family":"J\u00f8rgensen","sequence":"additional","affiliation":[{"name":"Department of Engineering, Aarhus University, Finlandsgade 22, 8200 Aarhus N, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Henrik","family":"Karstoft","sequence":"additional","affiliation":[{"name":"Department of Engineering, Aarhus University, Finlandsgade 22, 8200 Aarhus N, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,29]]},"reference":[{"key":"ref_1","unstructured":"Eriksen, J., Frandsen, T., Knudsen, L., Skovsen, S., Nyholm J\u00f8rgensen, R., Steen, K., Green, O., and Rasmussen, J. (2019, January 24\u201327). Nitrogen fertilization of grass-clover leys. Improving Sown Grasslands Through Breeding and Management. Proceedings of the Grassland Science in Europe, Z\u00fcrich, Switzerland."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fpls.2020.00159","article-title":"Assessment of Mixed Sward Using Context Sensitive Convolutional Neural Networks","volume":"11","author":"Bateman","year":"2020","journal-title":"Front. Plant Sci."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Skovsen, S., Dyrmann, M., Mortensen, A.K., Steen, K.A., Green, O., Eriksen, J., Gislum, R., J\u00f8rgensen, R.N., and Karstoft, H. (2017). Estimation of the Botanical Composition of Clover-Grass Leys from RGB Images Using Data Simulation and Fully Convolutional Neural Networks. Sensors, 17.","DOI":"10.3390\/s17122930"},{"key":"ref_4","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the 25th International Conference on Neural Information Processing Systems\u2014Volume 1, Curran Associates Inc.. NIPS\u201912."},{"key":"ref_5","first-page":"76","article-title":"Evaluating an image analysis system for mapping white clover pastures","volume":"54","author":"Bonesmo","year":"2004","journal-title":"Acta Agric. Scand. Sect. Soil Plant Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1910","DOI":"10.2135\/cropsci2008.11.0636","article-title":"Determining the Contribution of Legumes in Legume\u2013Grass Mixtures Using Digital Image Analysis","volume":"49","author":"Himstedt","year":"2009","journal-title":"Crop Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2186","DOI":"10.2135\/cropsci2009.10.0592","article-title":"The Relationship between Coverage and Dry Matter Contribution of Forage Legumes in Binary Legume\u2014Grass Mixtures","volume":"50","author":"Himstedt","year":"2010","journal-title":"Crop Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"943","DOI":"10.2135\/cropsci2011.04.0189","article-title":"The Benefit of Color Information in Digital Image Analysis for the Estimation of Legume Contribution in Legume\u2013Grass Mixtures","volume":"52","author":"Himstedt","year":"2012","journal-title":"Crop Sci."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mortensen, A., Karstoft, H., S\u00f8egaard, K., Gislum, R., and J\u00f8rgensen, R. (2017). Preliminary Results of Clover and Grass Coverage and Total Dry Matter Estimation in Clover-Grass Crops Using Image Analysis. J. Imaging, 3.","DOI":"10.3390\/jimaging3040059"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2134\/FG-2011-0176-DG","article-title":"Measuring Legume Content in Pastures Using Digital Photographs","volume":"12","author":"Rayburn","year":"2014","journal-title":"Forage Grazinglands"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_12","unstructured":"Skovsen, S., Dyrmann, M., Eriksen, J., Gislum, R., Karstoft, H., and J\u00f8rgensen, R.N. (2018, January 24\u201327). Predicting Dry Matter Composition of Grass Clover Leys Using Data Simulation and Camera-Based Segmentation of Field Canopies into White Clover, Red Clover, Grass and Weeds. Proceedings of the 14th International Conference on Precision Agriculture, Montreal, QC, Canada."},{"key":"ref_13","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bakken, A.K., Bonesmo, H., and Pedersen, B. (2015). Spatial and temporal abundance of interacting populations of white clover and grass species as assessed by image analyses. Dataset Pap. Sci., 2015.","DOI":"10.1155\/2015\/620164"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Skovsen, S., Laursen, M., Gislum, R., Eriksen, J., Dyrmann, M., Mortensen, A., Farkhani, S., Karstoft, H., Jensen, N., and J\u00f8rgensen, R. (2019). Species distribution mapping of grass clover leys using images for targeted nitrogen fertilization. Precision Agriculture \u201919, Wageningen Academic Publishers. Chapter 79.","DOI":"10.3920\/978-90-8686-888-9_79"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Skovsen, S., Dyrmann, M., Mortensen, A.K., Laursen, M.S., Gislum, R., Eriksen, J., Farkhani, S., Karstoft, H., and Jorgensen, R.N. (2019, January 5\u201320). The GrassClover Image Dataset for Semantic and Hierarchical Species Understanding in Agriculture. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00325"},{"key":"ref_17","unstructured":"Quigley, M., Conley, K., Gerkey, B.P., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2009, January 12\u201317). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan."},{"key":"ref_18","unstructured":"International Conference of Acoustic, Speech and Signal Processing (2004). High-Quality Linear Interpolation for Demosaicing of Bayer-Patterned Color Images. International Conference of Acoustic, Speech and Signal Processing, Institute of Electrical and Electronics Engineers, Inc."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.compag.2016.02.015","article-title":"Application of local binary patterns in digital images to estimate botanical composition in mixed alfalfa\u2014Grass fields","volume":"123","author":"McRoberts","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_20","unstructured":"Ferrari, V., Hebert, M., Sminchisescu, C., and Weiss, Y. (2018). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Computer Vision\u2014ECCV 2018, Springer International Publishing."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_22","unstructured":"(2020, July 31). Google Deeplab Github Repository. Available online: https:\/\/github.com\/tensorflow\/models\/tree\/master\/research\/deeplab."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet Large Scale Visual Recognition Challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis. (IJCV)"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Fleet, D., Pajdla, T., Schiele, B., and Tuytelaars, T. (2014). Microsoft COCO: Common Objects in Context. Computer Vision\u2014ECCV 2014, Springer International Publishing.","DOI":"10.1007\/978-3-319-10578-9"},{"key":"ref_25","unstructured":"Wang, Z., Zhao, L., Xing, W., and Lu, D. (2018). GLStyleNet: Higher Quality Style Transfer Combining Global and Local Pyramid Features. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/175\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:47:35Z","timestamp":1760179655000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/1\/175"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,29]]},"references-count":25,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["s21010175"],"URL":"https:\/\/doi.org\/10.3390\/s21010175","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,29]]}}}