{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T19:42:49Z","timestamp":1770752569169,"version":"3.50.0"},"reference-count":31,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2022,10,11]],"date-time":"2022-10-11T00:00:00Z","timestamp":1665446400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003052","name":"International Cooperative R&amp;D program","doi-asserted-by":"publisher","award":["P0004631"],"award-info":[{"award-number":["P0004631"]}],"id":[{"id":"10.13039\/501100003052","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Extended Kalman filter (EKF) is one of the most widely used Bayesian estimation methods in the optimal control area. Recent works on mobile robot control and transportation systems have applied various EKF methods, especially for localization. However, it is difficult to obtain adequate and reliable process-noise and measurement-noise models due to the complex and dynamic surrounding environments and sensor uncertainty. Generally, the default noise values of the sensors are provided by the manufacturer, but the values may frequently change depending on the environment. Thus, this paper mainly focuses on designing a highly accurate trainable EKF-based localization framework using inertial measurement units (IMUs) for the autonomous ground vehicle (AGV) with dead reckoning, with the goal of fusing it with a laser imaging, detection, and ranging (LiDAR) sensor-based simultaneous localization and mapping (SLAM) estimation for enhancing the performance. Convolution neural networks (CNNs), backward propagation algorithms, and gradient descent methods are implemented in the system to optimize the parameters in our framework. Furthermore, we develop a unique cost function for training the models to improve EKF accuracy. The proposed work is general and applicable to diverse IMU-aided robot localization models.<\/jats:p>","DOI":"10.3390\/s22207701","type":"journal-article","created":{"date-parts":[[2022,10,11]],"date-time":"2022-10-11T06:13:27Z","timestamp":1665468807000},"page":"7701","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Trainable Quaternion Extended Kalman Filter with Multi-Head Attention for Dead Reckoning in Autonomous Ground Vehicles"],"prefix":"10.3390","volume":"22","author":[{"given":"Gary","family":"Milam","sequence":"first","affiliation":[{"name":"Department of Biomedical Engineering, George Washington University, Washington, DC 20052, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5080-198X","authenticated-orcid":false,"given":"Baijun","family":"Xie","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, George Washington University, Washington, DC 20052, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Runnan","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, George Washington University, Washington, DC 20052, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoheng","family":"Zhu","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, George Washington University, Washington, DC 20052, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juyoun","family":"Park","sequence":"additional","affiliation":[{"name":"Korea Institute of Science and Technology, Seoul 02792, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4797-0464","authenticated-orcid":false,"given":"Gonwoo","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Control and Robot Engineering, ChunBuk National University, Chungbuk 28644, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0742-6541","authenticated-orcid":false,"given":"Chung Hyuk","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, George Washington University, Washington, DC 20052, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"39830","DOI":"10.1109\/ACCESS.2020.2975643","article-title":"A Review on Challenges of Autonomous Mobile Robot and Sensor Fusion Methods","volume":"8","author":"Alatise","year":"2020","journal-title":"IEEE Access"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ott, F., Feigl, T., Loffler, C., and Mutschler, C. (2020, January 14\u201319). ViPR: Visual-Odometry-aided Pose Regression for 6DoF Camera Localization. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00029"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2615","DOI":"10.1109\/TITS.2020.2972409","article-title":"Increasing GPS Localization Accuracy With Reinforcement Learning","volume":"22","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lidow, A., De Rooij, M., Strydom, J., Reusch, D., and Glaser, J. (2019). GaN Transistors for Efficient Power Conversion, John Wiley & Sons.","DOI":"10.1002\/9781119594406"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1088\/1742-6596\/1087\/4\/042003","article-title":"A Review of Wearable IMU (Inertial-Measurement-Unit)-based Pose Estimation and Drift Reduction Technologies","volume":"1087","author":"Zhao","year":"2018","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_6","unstructured":"Thrun, S., Burgard, W., and Fox, D. (2005). Probability Robotics, MIT Press."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A New Approach to Linear Filtering and Prediction Problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Malyavej, V., Kumkeaw, W., and Aorpimai, M. (2013, January 15\u201317). Indoor robot localization by RSSI\/IMU sensor fusion. Proceedings of the 2013 10th International Conference on Electrical Engineering\/Electronics, Computer, Telecommunications and Information Technology, Krabi, Thailand.","DOI":"10.1109\/ECTICon.2013.6559517"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Brossard, M., and Bonnabel, S. (2019, January 20\u201324). Learning wheel odometry and IMU errors for localization. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794237"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Yan, Y., Zhang, B., Zhou, J., Zhang, Y., and Liu, X. (2022). Real-Time Localization and Mapping Utilizing Multi-Sensor Fusion and Visual\u2013IMU\u2013Wheel Odometry for Agricultural Robots in Unstructured, Dynamic and GPS-Denied Greenhouse Environments. Agronomy, 12.","DOI":"10.3390\/agronomy12081740"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1002\/navi.278","article-title":"A regression-based methodology to improve estimation of inertial sensor errors using Allan variance data","volume":"66","author":"Jurado","year":"2019","journal-title":"Navig. J. Inst. Navig."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"585","DOI":"10.1109\/TIV.2020.2980758","article-title":"AI-IMU dead-reckoning","volume":"5","author":"Brossard","year":"2020","journal-title":"IEEE Trans. Intell. Veh."},{"key":"ref_13","first-page":"5998","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_14","unstructured":"Tsai, Y.H.H., Bai, S., Liang, P.P., Kolter, J.Z., Morency, L.P., and Salakhutdinov, R. (August, January 28). Multimodal transformer for unaligned multimodal language sequences. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Akhlaghi, S., Zhou, N., and Huang, Z. (2017, January 16\u201320). Adaptive adjustment of noise covariance in Kalman filter for dynamic state estimation. Proceedings of the 2017 IEEE Power & Energy Society General Meeting, Chicago, IL, USA.","DOI":"10.1109\/PESGM.2017.8273755"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1016\/j.inffus.2020.08.005","article-title":"Unscented kalman filter with process noise covariance estimation for vehicular ins\/gps integration system","volume":"64","author":"Hu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","article-title":"Multilayer feedforward networks are universal approximators","volume":"2","author":"Hornik","year":"1989","journal-title":"Neural Netw."},{"key":"ref_18","first-page":"4376","article-title":"Backprop kf: Learning discriminative deterministic state estimators","volume":"29","author":"Haarnoja","year":"2016","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"8280428","DOI":"10.1155\/2022\/8280428","article-title":"An Improved Kalman Filter Based on Long Short-Memory Recurrent Neural Network for Nonlinear Radar Target Tracking","volume":"2022","author":"Song","year":"2022","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Gao, X., Luo, H., Ning, B., Zhao, F., Bao, L., Gong, Y., Xiao, Y., and Jiang, J. (2020). RL-AKF: An adaptive kalman filter navigation algorithm based on reinforcement learning for ground vehicles. Remote Sens., 12.","DOI":"10.3390\/rs12111704"},{"key":"ref_21","first-page":"1","article-title":"Predicting the noise covariance with a multitask learning model for Kalman filter-based GNSS\/INS integrated navigation","volume":"70","author":"Wu","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Feng, K., Li, J., Zhang, X., Shen, C., Bi, Y., Zheng, T., and Liu, J. (2017). A new quaternion-based Kalman filter for real-time attitude estimation using the two-step geometrically-intuitive correction algorithm. Sensors, 17.","DOI":"10.3390\/s17092146"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Kok, M., Hol, J.D., and Sch\u00f6n, T.B. (2017). Using inertial sensors for position and orientation estimation. arXiv.","DOI":"10.1561\/9781680833577"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Mochnac, J., Marchevsky, S., and Kocan, P. (2009, January 22\u201323). Bayesian filtering techniques: Kalman and extended Kalman filter basics. Proceedings of the 2009 19th International Conference Radioelektronika, Bratislava, Slovakia.","DOI":"10.1109\/RADIOELEK.2009.5158765"},{"key":"ref_25","unstructured":"NGOC, T.T., KHENCHAF, A., and COMBLET, F. (April, January 31). Evaluating Process and Measurement Noise in Extended Kalman Filter for GNSS Position Accuracy. Proceedings of the 2019 13th European Conference on Antennas and Propagation (EuCAP), Krakow, Poland."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Khairuddin, A.R., Talib, M.S., and Haron, H. (2015, January 27\u201329). Review on simultaneous localization and mapping (SLAM). Proceedings of the 2015 IEEE International Conference on Control System, Computing and Engineering (ICCSCE), Penang, Malaysia.","DOI":"10.1109\/ICCSCE.2015.7482163"},{"key":"ref_27","unstructured":"LeCun, Y., Touresky, D., Hinton, G., and Sejnowski, T. (1988, January 17\u201326). A theoretical framework for back-propagation. Proceedings of the 1988 Connectionist Models Summer School, San Mateo, CA, USA."},{"key":"ref_28","first-page":"8026","article-title":"Pytorch: An imperative style, high-performance deep learning library","volume":"32","author":"Paszke","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_29","unstructured":"Stanford Artificial Intelligence Laboratory (2020, September 01). Robotic Operating System. Available online: https:\/\/www.ros.org."},{"key":"ref_30","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_31","unstructured":"Nam, D.V. (2022). Robust Multi-Sensor Fusion-based SLAM using State Estimation by Learning Observation Model. [Ph.D. Thesis, Chungbuk National University]."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7701\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:49:43Z","timestamp":1760143783000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7701"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,11]]},"references-count":31,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22207701"],"URL":"https:\/\/doi.org\/10.3390\/s22207701","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,11]]}}}