{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:18:59Z","timestamp":1760231939605,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2022,10,9]],"date-time":"2022-10-09T00:00:00Z","timestamp":1665273600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science, Technology, and Innovation Commission of Shenzhen Municipality","award":["JSGG20200102162401765","K2021390006","K2021390007","30121603","pdjh2022b0456","2022S20"],"award-info":[{"award-number":["JSGG20200102162401765","K2021390006","K2021390007","30121603","pdjh2022b0456","2022S20"]}]},{"name":"Special field pre-research foundation","award":["JSGG20200102162401765","K2021390006","K2021390007","30121603","pdjh2022b0456","2022S20"],"award-info":[{"award-number":["JSGG20200102162401765","K2021390006","K2021390007","30121603","pdjh2022b0456","2022S20"]}]},{"name":"Guangdong College Students\u2019 Scientific and Technological Innovation","award":["JSGG20200102162401765","K2021390006","K2021390007","30121603","pdjh2022b0456","2022S20"],"award-info":[{"award-number":["JSGG20200102162401765","K2021390006","K2021390007","30121603","pdjh2022b0456","2022S20"]}]},{"name":"College Students\u2019 Innovative Entrepreneurial Training Plan Program","award":["JSGG20200102162401765","K2021390006","K2021390007","30121603","pdjh2022b0456","2022S20"],"award-info":[{"award-number":["JSGG20200102162401765","K2021390006","K2021390007","30121603","pdjh2022b0456","2022S20"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>With the wide application of autonomous mobile robots (AMRs), the visual inertial odometer (VIO) system that realizes the positioning function through the integration of a camera and inertial measurement unit (IMU) has developed rapidly, but it is still limited by the high complexity of the algorithm, the long development cycle of the dedicated accelerator, and the low power supply capacity of AMRs. This work designs a reconfigurable accelerated core that supports different VIO algorithms and has high area and energy efficiency, precision, and speed processing characteristics. Experimental results show that the loss of accuracy of the proposed accelerator is negligible on the most authoritative dataset. The on-chip memory usage of 70 KB is at least 10\u00d7 smaller than the state-of-the-art works. Thus, the FPGA implementation\u2019s hardware-resource consumption, power dissipation, and synthesis in the 28 nm CMOS outperform the previous works with the same platform.<\/jats:p>","DOI":"10.3390\/s22197669","type":"journal-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T05:12:21Z","timestamp":1665378741000},"page":"7669","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Reconfigurable Visual\u2013Inertial Odometry Accelerated Core with High Area and Energy Efficiency for Autonomous Mobile Robots"],"prefix":"10.3390","volume":"22","author":[{"given":"Yonghao","family":"Tan","sequence":"first","affiliation":[{"name":"School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China"}]},{"given":"Mengying","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China"}]},{"given":"Huanshihong","family":"Deng","sequence":"additional","affiliation":[{"name":"School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China"}]},{"given":"Haihan","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China"}]},{"given":"Minghao","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China"}]},{"given":"Yifei","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China"}]},{"given":"Zhuo","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China"}]},{"given":"Qinghan","family":"Zeng","sequence":"additional","affiliation":[{"name":"Scientific and Technical Center for Innovation, Beijing 100080, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1503-0240","authenticated-orcid":false,"given":"Ping","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Computing and School of Design, The Hong Kong Polytechnic University, Hong Kong, China"}]},{"given":"Lei","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7554-7938","authenticated-orcid":false,"given":"Fengwei","family":"An","sequence":"additional","affiliation":[{"name":"School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1109\/TRO.2008.2004829","article-title":"An Efficient Direct Approach to Visual SLAM","volume":"24","author":"Silveira","year":"2008","journal-title":"IEEE Trans. Robot."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Newcombe, R.A., Lovegrove, S.J., and Davison, A.J. (2011, January 6\u201313). DTAM: Dense tracking and mapping in real-time. Proceedings of the IEEE International Conference on Computer Vision, ICCV 2011, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126513"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Engel, J., Stuckler, J., and Cremers, D. (October, January 28). Large-scale direct SLAM with stereo cameras. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353631"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1109\/TPAMI.2017.2658577","article-title":"Direct Sparse Odometry","volume":"40","author":"Engel","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Herbert","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1109\/TPAMI.2008.275","article-title":"Faster and better: A machine learning approach to corner detection","volume":"32","author":"Rosten","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"948","DOI":"10.1109\/70.795798","article-title":"The SPmap: A probabilistic framework for simultaneous localization and map building","volume":"15","author":"Castellanos","year":"1999","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Huang, G.P., Mourikis, A.I., and Roumeliotis, S.I. (2008, January 19\u201323). Analysis and improvement of the consistency of extended Kalman filter based SLAM. Proceedings of the 2008 IEEE International Conference on Robotics and Automation, Pasadena, CA, USA.","DOI":"10.1109\/ROBOT.2008.4543252"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1100","DOI":"10.1109\/TRO.2006.886264","article-title":"Exactly Sparse Delayed-State Filters for View-Based SLAM","volume":"22","author":"Eustice","year":"2007","journal-title":"IEEE Trans. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1177\/0278364904045479","article-title":"Simultaneous Localization and Mapping With Sparse Extended Information Filters","volume":"23","author":"Thrun","year":"2004","journal-title":"Int. J. Robot. Res."},{"key":"ref_12","unstructured":"Montemarlo, M. (August, January 28). FastSLAM: A Factored Solution to the Simultaneous Localization and Mapping Problem. Proceedings of the Theaaai National Conference on Artificial Intelligence, Edmonton, AB, Canada."},{"key":"ref_13","unstructured":"H\u00e4hnel, D., Burgard, W., Fox, D., and Thrun, S. (2003, January 27\u201331). An Efficient {FastSLAM} Algorithm for Generating Maps of Large-Scale Cyclic Environments from Raw Laser Range Measurements. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, IROS 2003, Las Vegas, NV, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/TRO.2006.889486","article-title":"Improved Techniques for Grid Mapping with Rao-Blackwellized Particle Filters","volume":"23","author":"Grisetti","year":"2007","journal-title":"IEEE Trans. Robot."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Di, K., Zhao, Q., Wan, W., Wang, Y., and Gao, Y. (2016). RGB-D SLAM Based on Extended Bundle Adjustment with 2D and 3D Information. Sensors, 16.","DOI":"10.3390\/s16081285"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Alismail, H., Browning, B., and Lucey, S. (2016, January 20\u201324). Photometric Bundle Adjustment for Vision-Based SLAM. Proceedings of the Asian Conference on Computer Vision, Taipei, Taiwan.","DOI":"10.1007\/978-3-319-54190-7_20"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, H., Chen, M., Zhang, G., Bao, H., and Bao, Y. (2018, January 18\u201323). ICE-BA: Incremental, Consistent and Efficient Bundle Adjustment for Visual-Inertial SLAM. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00211"},{"key":"ref_18","unstructured":"Chao, J., Geng, Z.X., Wei, X.F., and Shen, C. (2013, January 25\u201327). SIFT implementation based on GPU. Proceedings of the ISPDI 2013\u2014Fifth International Symposium on Photoelectronic Detection and Imaging, Beijing, China."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Cornelis, N., and Gool, L.V. (2009, January 9\u201310). Fast scale invariant feature detection and matching on programmable graphics hardware. Proceedings of the IEEE International Conference on Technologies for Practical Robot Applications, Woburn, MA, USA.","DOI":"10.1109\/CVPRW.2008.4563087"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TCSVT.2015.2489458","article-title":"A Novel Hardware Architecture with Reduced Internal Memory for Real-Time Extraction of SIFT in an HD Video","volume":"26","author":"Yum","year":"2016","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wilson, C., Zicari, P., Craciun, S., Gauvin, P., and Lam, H. (2015, January 7\u20139). A power-efficient real-time architecture for SURF feature extraction. Proceedings of the International Conference on ReConFigurable mputing and FPGAs (ReConFig14), Riviera Maya, Mexico.","DOI":"10.1109\/ReConFig.2014.7032492"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ulusel, O., Picardo, C., Harris, C.B., Reda, S., and Bahar, R.I. (September, January 29). Hardware acceleration of feature detection and description algorithms on low-power embedded platforms. Proceedings of the International Conference on Field Programmable Logic & Applications, FPL 2016, Lausanne, Switzerland.","DOI":"10.1109\/FPL.2016.7577310"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.compeleceng.2016.05.003","article-title":"FPGA design of EKF block accelerator for 3D visual SLAM","volume":"55","author":"Tertei","year":"2016","journal-title":"Comput. Electr. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, J., Zhan, Y., Wang, Z., Peng, Z., Xu, J., Liu, B., Yu, G., An, F., Wang, C., and Zou, X. (2021, January 7\u201310). A Reconfigurable Matrix Multiplication Coprocessor with High Area and Energy Efficiency for Visual Intelligent and Autonomous Mobile Robots. Proceedings of the 2021 IEEE Asian Solid-State Circuits Conference, A-SSCC 2021, Busan, Korea.","DOI":"10.1109\/A-SSCC53895.2021.9634793"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, R., Yang, J., Chen, Y., and Zhao, W. (2019, January 2\u20136). eSLAM: An Energy-Efficient Accelerator for Real-Time ORB-SLAM on FPGA Platform. Proceedings of the 56th Annual Design Automation Conference, Las Vegas, NV, USA.","DOI":"10.1145\/3316781.3317820"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, Z., Chen, Y., Gong, L., Liu, L., and Kim, H.S. (2019, January 17\u201321). An 879GOPS 243mW 80fps VGA Fully Visual CNN-SLAM Processor for Wide-Range Autonomous Exploration. Proceedings of the 2019 IEEE International Solid-State Circuits Conference\u2014(ISSCC), San Francisco, CA, USA.","DOI":"10.1109\/ISSCC.2019.8662397"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1106","DOI":"10.1109\/JSSC.2018.2886342","article-title":"Navion: A 2-mW Fully Integrated Real-Time Visual-Inertial Odometry Accelerator for Autonomous Navigation of Nano Drones","volume":"54","author":"Suleiman","year":"2019","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Suleiman, A.Z., Carlone, L., Sze, V., and Karaman, S. (2017, January 12\u201316). Visual-Inertial Odometry on Chip: An Algorithm-and-Hardware Co-design Approach. Proceedings of the Robotics: Science and Systems, Cambridge, MA, USA.","DOI":"10.15607\/RSS.2017.XIII.028"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, C., Liu, Y., Zuo, K., Tong, J., Ding, Y., and Ren, P. (2021, January 6\u201310). ac2SLAM: FPGA Accelerated High-Accuracy SLAM with Heapsort and Parallel Keypoint Extractor. Proceedings of the 2021 International Conference on Field-Programmable Technology (ICFPT), Auckland, New Zealand.","DOI":"10.1109\/ICFPT52863.2021.9609808"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1109\/TRO.2011.2170332","article-title":"Visual-Inertial-Aided Navigation for High-Dynamic Motion in Built Environments Without Initial Conditions","volume":"28","author":"Lupton","year":"2012","journal-title":"IEEE Trans. Robot."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Forster, C., Carlone, L., Dellaert, F., and Scaramuzza, D. (2015, January 13\u201317). IMU Preintegration on Manifold for Efficient Visual-Inertial Maximum-a-Posteriori Estimation. Proceedings of the Robotics: Science and Systems XI, Rome, Italy.","DOI":"10.15607\/RSS.2015.XI.006"},{"key":"ref_32","first-page":"1","article-title":"VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimator","volume":"34","author":"Tong","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bloesch, M., Omari, S., Hutter, M., and Siegwart, R. (October, January 28). Robust visual inertial odometry using a direct EKF-based approach. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353389"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Tan, Y., Deng, H., Sun, M., Zhou, M., Chen, Y., Chen, L., Wang, C., and An, F. (IEEE Trans. Circuits Syst. II Express Briefs, 2022). A Reconfigurable Coprocessor for Simultaneous Localization and Mapping Algorithms in FPGA, IEEE Trans. Circuits Syst. II Express Briefs, in press.","DOI":"10.1109\/TCSII.2022.3198759"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7669\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:48:58Z","timestamp":1760143738000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/19\/7669"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,9]]},"references-count":34,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22197669"],"URL":"https:\/\/doi.org\/10.3390\/s22197669","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,10,9]]}}}