{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T16:03:14Z","timestamp":1783180994907,"version":"3.54.6"},"reference-count":24,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T00:00:00Z","timestamp":1724284800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Corn, as one of the three major grain crops in China, plays a crucial role in ensuring national food security through its yield and quality. With the advancement of agricultural intelligence, agricultural robot technology has gained significant attention. High-precision navigation is the basis for realizing various operations of agricultural robots in corn fields and is closely related to the quality of operations. Corn leaf and stalk recognition and ranging are the prerequisites for achieving high-precision navigation and have attracted much attention. This paper proposes a corn leaf and stalk recognition and ranging algorithm based on multi-sensor fusion. First, YOLOv8 is used to identify corn leaves and stalks. Considering the large differences in leaf morphology and the large changes in field illumination that lead to discontinuous identification, an equidistant expansion polygon algorithm is proposed to post-process the leaves, thereby increasing the average recognition completeness of the leaves to 86.4%. Secondly, after eliminating redundant point clouds, the IMU data are used to calculate the confidence of the LiDAR and depth camera ranging point clouds, and point cloud fusion is performed based on this to achieve high-precision ranging of corn leaves. The average ranging error is 2.9 cm, which is lower than the measurement error of a single sensor. Finally, the stalk point cloud is processed and clustered using the FILL-DBSCAN algorithm to identify and measure the distance of the same corn stalk. The algorithm combines recognition accuracy and ranging accuracy to meet the needs of robot navigation or phenotypic measurement in corn fields, ensuring the stable and efficient operation of the robot in the corn field.<\/jats:p>","DOI":"10.3390\/s24165422","type":"journal-article","created":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T12:58:07Z","timestamp":1724417887000},"page":"5422","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Research on Corn Leaf and Stalk Recognition and Ranging Technology Based on LiDAR and Camera Fusion"],"prefix":"10.3390","volume":"24","author":[{"given":"Xueting","family":"Hu","sequence":"first","affiliation":[{"name":"Mechanical Engineering Training Centre, College of Engineering, China Agricultural University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Mechanical Engineering Training Centre, College of Engineering, China Agricultural University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xi","family":"Chen","sequence":"additional","affiliation":[{"name":"Mechanical Engineering Training Centre, College of Engineering, China Agricultural University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lu","family":"Zheng","sequence":"additional","affiliation":[{"name":"Mechanical Engineering Training Centre, College of Engineering, China Agricultural University, Beijing 100083, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,22]]},"reference":[{"key":"ref_1","first-page":"113212Y.f.","article-title":"Summary on Sensors in Agricultural Robots","volume":"Volume 11321","author":"Su","year":"2019","journal-title":"Proceedings of the 2019 International Conference on Image and Video Processing, and Artificial Intelligence"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Xu, B., and Chen, Z. (2018, January 18\u201323). Multi-Level Fusion Based 3D Object Detection from Monocular Images. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00249"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Choi, J.D., and Kim, M.Y. (2021, January 17\u201320). A Sensor Fusion System with Thermal Infrared Camera and LiDAR for Autonomous Vehicles: Its Calibration and Application. Proceedings of the 2021 Twelfth International Conference on Ubiquitous and Future Networks (ICUFN), Jeju Island, Republic of Korea.","DOI":"10.1109\/ICUFN49451.2021.9528609"},{"key":"ref_4","unstructured":"Cheng, J. (2014). Real-Time Object Detection Based on 3D LiDAR. [Master\u2019s Thesis, Zhejiang University]."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3434","DOI":"10.1109\/LRA.2018.2852843","article-title":"RT3D: Real-Time 3-D Vehicle Detection in LiDAR Point Cloud for Autonomous Driving","volume":"3","author":"Zeng","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_6","first-page":"139","article-title":"Fast detection and tracking of point cloud objects in intelligent driving","volume":"44","author":"Ye","year":"2019","journal-title":"J. Wuhan Univ. (Inf. Sci. Ed.)"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"103805","DOI":"10.1016\/j.jvcir.2023.103805","article-title":"LiDAR-Only 3D Object Detection Based on Spatial Context","volume":"93","author":"Wang","year":"2023","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Huang, T., Liu, Z., Chen, X., and Bai, X. (2020). EPNet: Enhancing Point Features with Image Semantics for 3D Object Detection. arXiv.","DOI":"10.1007\/978-3-030-58555-6_3"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bai, X., Hu, Z., Zhu, X., Huang, Q., Chen, Y., Fu, H., and Tai, C.-L. (2022, January 18\u201324). TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers. Proceedings of the 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00116"},{"key":"ref_10","first-page":"945","article-title":"Object detection, tracking, and prediction by fusing camera and LiDAR","volume":"49","author":"Huang","year":"2024","journal-title":"J. Wuhan Univ. (Inf. Sci. Ed.)"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2512412","DOI":"10.1109\/TIM.2021.3102739","article-title":"Object Detection Based on Fusion of Sparse Point Cloud and Image Information","volume":"70","author":"Xu","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_12","first-page":"152","article-title":"Citrus recognition in complex environments based on improved YOLOv8n","volume":"40","author":"Yue","year":"2024","journal-title":"Trans. Chin. Soc. Agric. Eng."},{"key":"ref_13","first-page":"119","article-title":"Apple Detection Method Based on Improved YOLOv8","volume":"20","author":"Du","year":"2023","journal-title":"Wirel. Internet Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"722","DOI":"10.1109\/TITS.2020.3023541","article-title":"Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Review","volume":"23","author":"Cui","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_15","first-page":"169","article-title":"Object detection and size measurement by fusing camera and LiDAR","volume":"37","author":"Wu","year":"2023","journal-title":"J. Electron. Meas. Instrum."},{"key":"ref_16","first-page":"69","article-title":"Object detection method based on camera-LiDAR fusion","volume":"2","author":"Zhou","year":"2024","journal-title":"Spec. Purp. Veh."},{"key":"ref_17","first-page":"91","article-title":"Object detection and tracking based on fusion of LiDAR and camera information","volume":"46","author":"Chang","year":"2019","journal-title":"Optoelectron. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Charles, R.Q., Su, H., Kaichun, M., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.16"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hussain, M. (2023). YOLO-v1 to YOLO-v8, the Rise of YOLO and Its Complementary Nature toward Digital Manufacturing and Industrial Defect Detection. Machines, 11.","DOI":"10.3390\/machines11070677"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"201105","DOI":"10.3788\/LOP57.201105","article-title":"Improved LiDAR obstacle detection method based on Euclidean clustering","volume":"57","author":"Liu","year":"2020","journal-title":"Laser Optoelectron. Prog."},{"key":"ref_21","first-page":"49","article-title":"Ground point cloud extraction from vehicle-mounted LiDAR based on improved RANSAC algorithm","volume":"34","author":"Li","year":"2022","journal-title":"J. Henan Univ. Eng. (Nat. Sci. Ed.)"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"47468","DOI":"10.1109\/ACCESS.2020.2972034","article-title":"An Improved DBSCAN Algorithm Based on the Neighbor Similarity and Fast Nearest Neighbor Query","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"key":"ref_23","first-page":"692","article-title":"Algorithms study of building boundary extraction and normalization based on LiDAR data. J","volume":"5","author":"Shen","year":"2008","journal-title":"Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"9919003","DOI":"10.1155\/2021\/9919003","article-title":"Grid Partition Variable Step Alpha Shapes Algorithm","volume":"2021","author":"Liao","year":"2021","journal-title":"Math. Probl. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/16\/5422\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:40:52Z","timestamp":1760110852000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/16\/5422"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,22]]},"references-count":24,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["s24165422"],"URL":"https:\/\/doi.org\/10.3390\/s24165422","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,22]]}}}