{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T12:20:56Z","timestamp":1774700456270,"version":"3.50.1"},"reference-count":35,"publisher":"Emerald","issue":"4","license":[{"start":{"date-parts":[[2024,4,8]],"date-time":"2024-04-08T00:00:00Z","timestamp":1712534400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IR"],"published-print":{"date-parts":[[2024,7,2]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>Time of flight (ToF) imaging is a promising emerging technology for the purposes of crop identification. This paper aim to presents localization system for identifying and localizing asparagus in the field based on point clouds from ToF imaging. Since the semantics are not included in the point cloud, it contains the geometric information of other objects such as stones and weeds other than asparagus spears. An approach is required for extracting the spear information so that a robotic system can be used for harvesting.<\/jats:p>\n<\/jats:sec>\n<jats:sec><jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>A real-time convolutional neural network (CNN)-based method is used for filtering the point cloud generated by a ToF camera, allowing subsequent processing methods to operate over smaller and more information-dense data sets, resulting in reduced processing time. The segmented point cloud can then be split into clusters of points representing each individual spear. Geometric filters are developed to eliminate the non-asparagus points in each cluster so that each spear can be modelled and localized. The spear information can then be used for harvesting decisions.<\/jats:p>\n<\/jats:sec>\n<jats:sec><jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>The localization system is integrated into a robotic harvesting prototype system. Several field trials have been conducted with satisfactory performance. The identification of a spear from the point cloud is the key to successful localization. Segmentation and clustering points into individual spears are two major failures for future improvements.<\/jats:p>\n<\/jats:sec>\n<jats:sec><jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>Most crop localizations in agricultural robotic applications using ToF imaging technology are implemented in a very controlled environment, such as a greenhouse. The target crop and the robotic system are stationary during the localization process. The novel proposed method for asparagus localization has been tested in outdoor farms and integrated with a robotic harvesting platform. Asparagus detection and localization are achieved in real time on a continuously moving robotic platform in a cluttered and unstructured environment.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/ir-01-2024-0009","type":"journal-article","created":{"date-parts":[[2024,4,5]],"date-time":"2024-04-05T07:54:07Z","timestamp":1712303647000},"page":"595-606","source":"Crossref","is-referenced-by-count":4,"title":["Localization of asparagus spears using time-of-flight imaging for robotic harvesting"],"prefix":"10.1108","volume":"51","author":[{"given":"Matthew","family":"Peebles","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shen Hin","family":"Lim","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mike","family":"Duke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin","family":"Mcguinness","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chi Kit","family":"Au","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"140","published-online":{"date-parts":[[2024,4,8]]},"reference":[{"issue":"6","key":"key2024070211044483900_ref001","doi-asserted-by":"publisher","first-page":"1390","DOI":"10.3390\/s19061390","article-title":"Controlled lighting and illumination-independent target detection for real-time cost-efficient applications. The case study of sweet pepper robotic harvesting","volume":"19","year":"2019","journal-title":"Sensors"},{"issue":"6","key":"key2024070211044483900_ref002","doi-asserted-by":"publisher","first-page":"1027","DOI":"10.1002\/rob.21937","article-title":"Development of a sweet pepper harvesting robot","volume":"37","year":"2020","journal-title":"Journal of Field Robotics"},{"issue":"6","key":"key2024070211044483900_ref003","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1002\/rob.21709","article-title":"Performance evaluation of a harvesting robot for sweet pepper","volume":"34","year":"2017","journal-title":"Journal of Field Robotics"},{"key":"key2024070211044483900_ref004","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989417","article-title":"Deep fruit detection in orchards","volume-title":"2017 IEEE International Conference on Robotics and Automation (ICRA)","year":"2017"},{"issue":"4","key":"key2024070211044483900_ref005","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/0031-3203(84)90067-0","article-title":"Detection and three-dimensional localization by stereoscopic visual sensor and its application to a robot for picking asparagus","volume":"17","year":"1984","journal-title":"Pattern Recognition"},{"issue":"9","key":"key2024070211044483900_ref006","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1145\/361002.361007","article-title":"Multidimensional binary search trees used for associative searching","volume":"18","year":"1975","journal-title":"Communications of the ACM"},{"key":"key2024070211044483900_ref007","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1016\/j.patrec.2021.04.022","article-title":"Deep learning-based apple detection using a suppression mask R-CNN","volume":"147","year":"2021","journal-title":"Pattern Recognition Letters"},{"key":"key2024070211044483900_ref008","doi-asserted-by":"publisher","DOI":"10.1117\/12.2064003","article-title":"Automatic detection and segmentation of stems of potted tomato plant using Kinect","volume-title":"Proceedings of SPIE - The International Society for Optical Engineering","year":"2014"},{"key":"key2024070211044483900_ref009","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.biosystemseng.2020.07.007","article-title":"Faster R\u2013CNN\u2013based apple detection in dense-foliage fruiting-wall trees using RGB and depth features for robotic harvesting","volume":"197","year":"2020","journal-title":"Biosystems Engineering"},{"key":"key2024070211044483900_ref010","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2020.105687","article-title":"Application of consumer RGB-D cameras for fruit detection and localization in field: a critical review","volume":"177","year":"2020","journal-title":"Computers and Electronics in Agriculture"},{"issue":"17","key":"key2024070211044483900_ref011","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.ifacol.2018.08.059","article-title":"Kiwifruit detection in field images using faster R-CNN with ZFNet","volume":"51","year":"2018","journal-title":"IFAC-PapersOnLine"},{"issue":"30","key":"key2024070211044483900_ref012","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.ifacol.2019.12.499","article-title":"Deep orange: mask R-CNN based orange detection and segmentation","volume":"52","year":"2019","journal-title":"IFAC-PapersOnLine"},{"key":"key2024070211044483900_ref013","doi-asserted-by":"publisher","first-page":"105634","DOI":"10.1016\/j.compag.2020.105634","article-title":"Multi-class fruit-on-plant detection for apple in SNAP system using faster R-CNN","volume":"176","year":"2020","journal-title":"Computers and Electronics in Agriculture"},{"key":"key2024070211044483900_ref014","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.compag.2015.05.021","article-title":"Sensors and systems for fruit detection and localization: a review","volume":"116","year":"2015","journal-title":"Computers and Electronics in Agriculture"},{"issue":"2","key":"key2024070211044483900_ref015","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/0167-8655(90)90119-M","article-title":"Contour coding for image description","volume":"11","year":"1990","journal-title":"Pattern Recognition Letters"},{"key":"key2024070211044483900_ref016","doi-asserted-by":"publisher","article-title":"Automatic harvesting of asparagus: an application of robot vision to agriculture","year":"1994","DOI":"10.1117\/12.167496"},{"key":"key2024070211044483900_ref017","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.322","article-title":"Mask R-CNN","volume-title":"2017 IEEE International Conference on Computer Vision (ICCV)","year":"2017"},{"key":"key2024070211044483900_ref018","first-page":"90","volume-title":"A Machine Vision Algorithm for Identification of Harvestable Spears of Asparagus","year":"1990"},{"key":"key2024070211044483900_ref019","doi-asserted-by":"publisher","article-title":"Field performance of machine vision for the selective harvest of asparagus","year":"1991","DOI":"10.4271\/911751"},{"issue":"2","key":"key2024070211044483900_ref020","doi-asserted-by":"publisher","first-page":"267","DOI":"10.20965\/jrm.2014.p0267","article-title":"Asparagus harvesting robot","volume":"26","year":"2014","journal-title":"Journal of Robotics and Mechatronics"},{"key":"key2024070211044483900_ref021","doi-asserted-by":"publisher","DOI":"10.1109\/ICIT.2009.4939556","article-title":"Asparagus harvesting robot coordinated with 3-D vision sensor","volume-title":"2009 IEEE International Conference on Industrial Technology","year":"2009"},{"issue":"30","key":"key2024070211044483900_ref022","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1016\/j.ifacol.2019.12.536","article-title":"A perception pipeline for robotic harvesting of green asparagus","volume":"52","year":"2019","journal-title":"IFAC-PapersOnLine"},{"issue":"6","key":"key2024070211044483900_ref023","doi-asserted-by":"publisher","first-page":"1107","DOI":"10.1007\/s11119-019-09642-0","article-title":"Deep learning for real-time fruit detection and orchard fruit load estimation: benchmarking of \u2018MangoYOLO","volume":"20","year":"2019","journal-title":"Precision Agriculture"},{"key":"key2024070211044483900_ref024","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2016.7487394","article-title":"Sweet pepper pose detection and grasping for automated crop harvesting","volume-title":"2016 IEEE International Conference on Robotics and Automation (ICRA)","year":"2016"},{"key":"key2024070211044483900_ref026","doi-asserted-by":"publisher","DOI":"10.1109\/IVCNZ.2018.8634650","article-title":"Ground plane segmentation of time-of-flight images for asparagus harvesting","volume-title":"2018 International Conference on Image and Vision Computing New Zealand (IVCNZ)","year":"2018"},{"issue":"6","key":"key2024070211044483900_ref027","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: towards real-time object detection with region proposal networks","volume":"39","year":"2015","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"4","key":"key2024070211044483900_ref028","first-page":"66","article-title":"Apple identification in field environment with over the row machine vision system","volume":"16","year":"2014","journal-title":"Agricultural Engineering International: CIGR Journal"},{"issue":"6","key":"key2024070211044483900_ref029","doi-asserted-by":"publisher","first-page":"1140","DOI":"10.1002\/rob.21715","article-title":"Design, integration, and field evaluation of a robotic apple harvester","volume":"34","year":"2017","journal-title":"Journal of Field Robotics"},{"issue":"5","key":"key2024070211044483900_ref030","doi-asserted-by":"publisher","first-page":"1072","DOI":"10.1007\/s11119-020-09709-3","article-title":"Passion fruit detection and counting based on multiple scale faster R-CNN using RGB-D images","volume":"21","year":"2020","journal-title":"Precision Agriculture"},{"key":"key2024070211044483900_ref031","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2020.105348","article-title":"Comparison of convolutional neural networks in fruit detection and counting: a comprehensive evaluation","volume":"173","year":"2020","journal-title":"Computers and Electronics in Agriculture"},{"issue":"1","key":"key2024070211044483900_ref032","first-page":"1","article-title":"Review of research advances in fruit and vegetable harvesting robots","volume":"19","year":"2023","journal-title":"Journal of Electrical Engineering & Technology"},{"issue":"2","key":"key2024070211044483900_ref033","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1049\/tje2.12097","article-title":"Fast recognition method for citrus under complex environments based on improved YOLOv3","volume":"2022","year":"2022","journal-title":"The Journal of Engineering"},{"key":"key2024070211044483900_ref034","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2019.06.001","article-title":"Fruit detection for strawberry harvesting robot in non-structural environment based on Mask-RCNN","volume":"163","year":"2019","journal-title":"Computers and Electronics in Agriculture"},{"key":"key2024070211044483900_ref035","unstructured":"Asparagus Market (2017), \u201cTechnical report\u201d, Future Market Insights."},{"key":"key2024070211044483900_ref025","unstructured":"New Zealand Asparagus Council (2022), available at: http:\/\/asparagus.org.nz\/(accessed 10 June 2022)."}],"container-title":["Industrial Robot: the international journal of robotics research and application"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IR-01-2024-0009\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IR-01-2024-0009\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T21:38:18Z","timestamp":1753393098000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ir\/article\/51\/4\/595-606\/1216894"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,8]]},"references-count":35,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,4,8]]},"published-print":{"date-parts":[[2024,7,2]]}},"alternative-id":["10.1108\/IR-01-2024-0009"],"URL":"https:\/\/doi.org\/10.1108\/ir-01-2024-0009","relation":{},"ISSN":["0143-991X","0143-991X"],"issn-type":[{"value":"0143-991X","type":"print"},{"value":"0143-991X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,8]]}}}