{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T16:16:30Z","timestamp":1762272990420,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2022,8,25]],"date-time":"2022-08-25T00:00:00Z","timestamp":1661385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Jiangsu Province Modern Agricultural Machinery Equipment and Technology Demonstration and Promotion","award":["NJ2022-08","BK20210040","MAET202106","21KJB470018"],"award-info":[{"award-number":["NJ2022-08","BK20210040","MAET202106","21KJB470018"]}]},{"name":"Youth Fund Project of Jiangsu Natural Science Foundation","award":["NJ2022-08","BK20210040","MAET202106","21KJB470018"],"award-info":[{"award-number":["NJ2022-08","BK20210040","MAET202106","21KJB470018"]}]},{"name":"Key Laboratory of Modern Agricultural Equipment and Technology (Jiangsu University)","award":["NJ2022-08","BK20210040","MAET202106","21KJB470018"],"award-info":[{"award-number":["NJ2022-08","BK20210040","MAET202106","21KJB470018"]}]},{"name":"Natural Science Research of Jiangsu Higher Education Institutions of China","award":["NJ2022-08","BK20210040","MAET202106","21KJB470018"],"award-info":[{"award-number":["NJ2022-08","BK20210040","MAET202106","21KJB470018"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Ego-motion estimation is a foundational capability for autonomous combine harvesters, supporting high-level functions such as navigation and harvesting. This paper presents a novel approach for estimating the motion of a combine harvester from a sequence of stereo images. The proposed method starts with tracking a set of 3D landmarks which are triangulated from stereo-matched features. Six Degree of Freedom (DoF) ego motion is obtained by minimizing the reprojection error of those landmarks on the current frame. Then, local bundle adjustment is performed to refine structure (i.e., landmark positions) and motion (i.e., keyframe poses) jointly in a sliding window. Both processes are encapsulated into a two-threaded architecture to achieve real-time performance. Our method utilizes a stereo camera, which enables estimation at true scale and easy startup of the system. Quantitative tests were performed on real agricultural scene data, comprising several different working paths, in terms of estimating accuracy and real-time performance. The experimental results demonstrated that our proposed perception system achieved favorable accuracy, outputting the pose at 10 Hz, which is sufficient for online ego-motion estimation for combine harvesters.<\/jats:p>","DOI":"10.3390\/s22176394","type":"journal-article","created":{"date-parts":[[2022,8,26]],"date-time":"2022-08-26T02:04:32Z","timestamp":1661479472000},"page":"6394","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Stereovision-Based Ego-Motion Estimation for Combine Harvesters"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6470-3464","authenticated-orcid":false,"given":"Haiwen","family":"Chen","sequence":"first","affiliation":[{"name":"Mechanical Engineering School, Jiangsu University, Zhenjiang 212013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jin","family":"Chen","sequence":"additional","affiliation":[{"name":"Mechanical Engineering School, Jiangsu University, Zhenjiang 212013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhuohuai","family":"Guan","sequence":"additional","affiliation":[{"name":"Nanjing Research Institute for Agricultural Mechanization, Ministry of Agriculture, Nanjing 210014, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaoming","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory of Modern Agricultural Equipment and Technology, Jiangsu University, Zhenjiang 212013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kai","family":"Cheng","sequence":"additional","affiliation":[{"name":"Mechanical Engineering School, Jiangsu University, Zhenjiang 212013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhihong","family":"Cui","sequence":"additional","affiliation":[{"name":"Key Laboratory of Modern Agricultural Equipment and Technology, Jiangsu University, Zhenjiang 212013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.compag.2015.04.003","article-title":"Reducing fuel consumption in weed and pest control using robotic tractors","volume":"114","author":"Emmi","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.biosystemseng.2016.01.008","article-title":"Reducing air pollution with hybrid-powered robotic tractors for precision agriculture","volume":"143","author":"Emmi","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.compag.2014.12.017","article-title":"The role of GNSS in the navigation strategies of cost-effective agricultural robots","volume":"112","author":"Chatterjee","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.biosystemseng.2007.01.010","article-title":"Dynamic performance of global positioning system velocity sensor for extremely accurate positioning","volume":"97","author":"Chosa","year":"2007","journal-title":"Biosyst. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.compag.2007.05.008","article-title":"Autonomous robotic weed control systems: A review","volume":"61","author":"Slaughter","year":"2008","journal-title":"Comput. Electron. Agric."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Piyathulaka, L., and Munasinghe, R. (2011, January 16\u201319). Vision-only outdoor localization of two-wheel tractor for autonomous operation in agricultural fields. Proceedings of the 2011 6th International Conference on Industrial and Information Systems, Kandy, Sri Lanka.","DOI":"10.1109\/ICIINFS.2011.6038094"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.biosystemseng.2011.04.006","article-title":"Stereovision-based lateral offset measurement for vehicle navigation in cultivated stubble fields","volume":"109","author":"Wang","year":"2011","journal-title":"Biosyst. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lowe, D.G. (1999, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790410"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006). Surf: Speeded up robust features. Computer Vision\u2014ECCV 2006, Proceedings of the 9th European Conference on Compute Vision, Graz, Austria, 7 May 2006, Springer.","DOI":"10.1007\/11744023_32"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 22\u201324). ORB: An efficient alternative to Sift or Surf. Proceedings of the 2011 International Conference on Computer Vision, Crete, Greece.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Mair, E., Hager, G.D., Burschka, D., Suppa, M., and Hirzinger, G. (2010). Adaptive and generic corner detection based on the accelerated segment test. Computer Vision\u2014ECCV 2010, Proceedings of the 11th European Conference on Compute Vision, Heraklion, Crete, Greece, 5\u201311 September 2010, Springer.","DOI":"10.1007\/978-3-642-15552-9_14"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). Brisk: Binary robust invariant scalable keypoints. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Alahi, A., Ortiz, R., and Vandergheynst, P. (2012, January 16\u201321). FREAK: Fast Retina Keypoint. Proceedings of the 2012 IEEE Conference on Computer Visio and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247715"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.biosystemseng.2017.11.009","article-title":"Analysis of two visual odometry systems for use in an agricultural field environment","volume":"166","author":"Ericson","year":"2018","journal-title":"Biosyst. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.compag.2019.03.037","article-title":"Cost-effective visual odometry system for vehicle motion control in agricultural environments","volume":"162","author":"Zamana","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.biosystemseng.2014.02.016","article-title":"Development of a 3D ego-motion estimation system for an autonomous agricultural vehicle","volume":"121","author":"Jiang","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/j.compag.2011.07.007","article-title":"Optimized EIF-SLAM algorithm for precision agriculture mapping based on stems detection","volume":"78","author":"Steiner","year":"2011","journal-title":"Comput. Electron. Agric."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.biosystemseng.2014.02.010","article-title":"Image-based particle filtering for navigation in a semi-structured agricultural environment","volume":"121","author":"Hiremath","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.imavis.2012.02.009","article-title":"Visual SLAM: Why filter?","volume":"30","author":"Strasdat","year":"2012","journal-title":"Image Vis. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Strasdat, H., Davison, A.J., Montiel, J.M.M., and Konolige, K. (2011, January 6\u201313). Double window optimisation for constant time visual SLAM. Proceedings of the 2011 IEEE International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126517"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.robot.2019.03.015","article-title":"Efficient on-board Stereo SLAM through constrained-covisibility strategies","volume":"116","author":"Castro","year":"2019","journal-title":"Robot. Auton. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Mouragnon, E., Lhuillier, M., Dhome, M., Dekeyser, F., and Sayd, P. (2006, January 17\u201319). Real-time localization and 3D reconstruction. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA.","DOI":"10.1109\/CVPR.2006.236"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Klein, G., and Murray, D. (2007, January 13\u201316). Parallel tracking and mapping for small AR workspaces. Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan.","DOI":"10.1109\/ISMAR.2007.4538852"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Pire, T., Fischer, T., Civera, J., Crist\u00f3foris, P.D., and Berlles, J.J. (October, January 28). Stereo parallel tracking and mapping for robot localization. Proceedings of the 2015 IEEE\/RSJ International Workshop on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353546"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rosten, E., and Drummond, T. (2006, January 7). Machine learning for high-speed corner detection. Proceedings of the 9th European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_34"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5\u201311). BRIEF: Binary robust independent elementary features. Proceedings of the 11th European Conference on Computer Vision, Heraklion, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_29","first-page":"726","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1987","journal-title":"Read. Comput. Vis."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"EPnP: An Accurate O(n) Solution to the PnP Problem","volume":"81","author":"Lepetit","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","unstructured":"K\u00fcmmerle, R., Grisetti, G., Strasdat, H., Konolige, K., and Burgard, W. (2011, January 9\u201313). G2o: A general framework for graph optimization. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China."},{"key":"ref_32","unstructured":"Quigley, M., Gerkey, B., Conley, K., Faust, J., Foote, T., Leibs, J., Berger, E., Wheeler, R., and Ng, A. (2009). ROS: An open-source Robot Operating System. ICRA Workshop on Open Source Software, IEEE."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","unstructured":"Endres, J., Engelhard, N., Endres, F., Burgard, W., and Cremers, D. (2012, January 7\u201312). A benchmark for the evaluation of RGB-D SLAM systems. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1016\/j.robot.2009.06.010","article-title":"A comparison of loop closing techniques in monocular slam","volume":"57","author":"Williams","year":"2009","journal-title":"Robot. Auton. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/17\/6394\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:14:59Z","timestamp":1760141699000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/17\/6394"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,25]]},"references-count":35,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22176394"],"URL":"https:\/\/doi.org\/10.3390\/s22176394","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,8,25]]}}}