{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T04:29:27Z","timestamp":1780633767234,"version":"3.54.1"},"reference-count":30,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2023,8,20]],"date-time":"2023-08-20T00:00:00Z","timestamp":1692489600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100012774","name":"Innovation Fund Denmark","doi-asserted-by":"publisher","award":["9065-00036B"],"award-info":[{"award-number":["9065-00036B"]}],"id":[{"id":"10.13039\/100012774","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Vision-based object detection is essential for safe and efficient field operation for autonomous agricultural vehicles. However, one of the challenges in transferring state-of-the-art object detectors to the agricultural domain is the limited availability of labeled datasets. This paper seeks to address this challenge by utilizing two object detection models based on YOLOv5, one pre-trained on a large-scale dataset for detecting general classes of objects and one trained to detect a smaller number of agriculture-specific classes. To combine the detections of the models at inference, we propose an ensemble module based on a hierarchical structure of classes. Results show that applying the proposed ensemble module increases mAP@.5 from 0.575 to 0.65 on the test dataset and reduces the misclassification of similar classes detected by different models. Furthermore, by translating detections from base classes to a higher level in the class hierarchy, we can increase the overall mAP@.5 to 0.701 at the cost of reducing class granularity.<\/jats:p>","DOI":"10.3390\/s23167285","type":"journal-article","created":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T01:49:34Z","timestamp":1692582574000},"page":"7285","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Object Detection for Agricultural Vehicles: Ensemble Method Based on Hierarchy of Classes"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1584-0857","authenticated-orcid":false,"given":"Esma","family":"Mujkic","sequence":"first","affiliation":[{"name":"Automation and Control Group, Department of Electrical and Photonics Engineering, Technical University of Denmark, 2800 Kongens Lyngby, Denmark"},{"name":"AGCO A\/S, 8930 Randers, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6214-9818","authenticated-orcid":false,"given":"Martin P.","family":"Christiansen","sequence":"additional","affiliation":[{"name":"AGCO A\/S, 8930 Randers, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2265-0031","authenticated-orcid":false,"given":"Ole","family":"Ravn","sequence":"additional","affiliation":[{"name":"Automation and Control Group, Department of Electrical and Photonics Engineering, Technical University of Denmark, 2800 Kongens Lyngby, Denmark"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,20]]},"reference":[{"key":"ref_1","first-page":"100307","article-title":"Farming Reimagined: A case study of autonomous farm equipment and creating an innovation opportunity space for broadacre smart farming","volume":"90\u201391","author":"Ballantyne","year":"2019","journal-title":"NJAS-Wagening. J. Life Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.compag.2018.02.016","article-title":"Deep learning in agriculture: A survey","volume":"147","author":"Kamilaris","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"128837","DOI":"10.1109\/ACCESS.2019.2939201","article-title":"A Survey of Deep Learning-Based Object Detection","volume":"7","author":"Jiao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bargoti, S., and Underwood, J. (June, January 29). Deep fruit detection in orchards. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989417"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., and McCool, C. (2016). Deepfruits: A fruit detection system using deep neural networks. Sensors, 16.","DOI":"10.3390\/s16081222"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"105108","DOI":"10.1016\/j.compag.2019.105108","article-title":"Fast implementation of real-time fruit detection in apple orchards using deep learning","volume":"168","author":"Kang","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"106508","DOI":"10.1016\/j.compag.2021.106508","article-title":"An improved obstacle separation method using deep learning for object detection and tracking in a hybrid visual control loop for fruit picking in clusters","volume":"191","author":"Xiong","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhao, W., Yamada, W., Li, T., Digman, M., and Runge, T. (2021). Augmenting Crop Detection for Precision Agriculture with Deep Visual Transfer Learning\u2014A Case Study of Bale Detection. Remote Sens., 13.","DOI":"10.3390\/rs13010023"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Veeranampalayam Sivakumar, A.N., Li, J., Scott, S., Psota, E., J Jhala, A., Luck, J.D., and Shi, Y. (2020). Comparison of object detection and patch-based classification deep learning models on mid-to late-season weed detection in UAV imagery. Remote Sens., 12.","DOI":"10.3390\/rs12132136"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"105523","DOI":"10.1016\/j.compag.2020.105523","article-title":"UAV environmental perception and autonomous obstacle avoidance: A deep learning and depth camera combined solution","volume":"175","author":"Wang","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1186\/s13007-020-00570-z","article-title":"Deep convolutional neural networks for image-based Convolvulus sepium detection in sugar beet fields","volume":"16","author":"Gao","year":"2020","journal-title":"Plant Methods"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1016\/j.compag.2018.12.048","article-title":"Development and evaluation of a low-cost and smart technology for precision weed management utilizing artificial intelligence","volume":"157","author":"Partel","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"9548","DOI":"10.1038\/s41598-020-66505-9","article-title":"Goosegrass detection in strawberry and tomato using a convolutional neural network","volume":"10","author":"Sharpe","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Doll\u00e1r, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft COCO: Common objects in context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The pascal visual object classes (voc) challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_16","unstructured":"Kragh, M., Christiansen, P., Korthals, T., Jungeblut, T., Karstoft, H., and J\u00f8rgensen, R.N. (2016, January 26\u201329). Multi-Modal Obstacle Detection and Evaluation of Occupancy Grid Mapping in Agriculture. Proceedings of the International Conference on Agricultural Engineering, Aarhus, Denmark."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Steen, K.A., Christiansen, P., Karstoft, H., and J\u00f8rgensen, R.N. (2016). Using deep learning to challenge safety standard for highly autonomous machines in agriculture. J. Imaging, 2.","DOI":"10.3390\/jimaging2010006"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"105932","DOI":"10.1016\/j.compag.2020.105932","article-title":"Detection of typical obstacles in orchards based on deep convolutional neural network","volume":"181","author":"Li","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_19","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Jung, T.H., Cates, B., Choi, I.K., Lee, S.H., and Choi, J.M. (2020). Multi-Camera-Based Person Recognition System for Autonomous Tractors. Designs, 4.","DOI":"10.3390\/designs4040054"},{"key":"ref_21","unstructured":"(2021, November 24). YOLOv5 by Ultralytics. Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Neubeck, A., and Van Gool, L. (2006, January 20\u201324). Efficient non-maximum suppression. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China.","DOI":"10.1109\/ICPR.2006.479"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bodla, N., Singh, B., Chellappa, R., and Davis, L.S. (2017, January 22\u201329). Soft-NMS\u2013improving object detection with one line of code. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.593"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"104117","DOI":"10.1016\/j.imavis.2021.104117","article-title":"Weighted boxes fusion: Ensembling boxes from different object detection models","volume":"107","author":"Solovyev","year":"2021","journal-title":"Image Vis. Comput."},{"key":"ref_25","unstructured":"Casado-Garc\u00eda, \u00c1., and Heras, J. (2020). ECAI 2020, IOS Press."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liu, Z., Jiang, Z., Feng, W., and Feng, H. (2020, January 6\u201310). OD-GCN: Object Detection Boosted by Knowledge GCN. Proceedings of the 2020 IEEE International Conference on Multimedia & Expo Workshops (ICMEW), London, UK.","DOI":"10.1109\/ICMEW46912.2020.9105952"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, K., Wang, N.Y., Yang, Y., and Wang, G. (2021, January 26). SGNet: A Super-class Guided Network for Image Classification and Object Detection. Proceedings of the 2021 18th Conference on Robots and Vision (CRV), Los Alamitos, CA, USA.","DOI":"10.1109\/CRV52889.2021.00025"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zwemer, M.H., Wijnhoven, R.G.J., and de With, P.H.N. (2020, January 27\u201329). SSD-ML: Hierarchical Object Classification for Traffic Surveillance. Proceedings of the VISIGRAPP, Valetta, Malta.","DOI":"10.5220\/0008902402500259"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Salakhutdinov, R., Torralba, A., and Tenenbaum, J. (2011, January 20\u201325). Learning to share visual appearance for multiclass object detection. Proceedings of the CVPR 2011, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995720"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"982581","DOI":"10.3389\/frobt.2022.982581","article-title":"Framework for environment perception: Ensemble method for vision-based scene understanding algorithms in agriculture","volume":"9","author":"Mujkic","year":"2023","journal-title":"Front. Robot. AI"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7285\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:38:02Z","timestamp":1760128682000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7285"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,20]]},"references-count":30,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["s23167285"],"URL":"https:\/\/doi.org\/10.3390\/s23167285","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,20]]}}}