{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,27]],"date-time":"2026-06-27T12:04:34Z","timestamp":1782561874287,"version":"3.54.5"},"reference-count":46,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T00:00:00Z","timestamp":1658188800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["11572036"],"award-info":[{"award-number":["11572036"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Although there have been numerous studies on maneuvering target tracking, few studies have focused on the distinction between unknown maneuvers and inaccurate measurements, leading to low accuracy, poor robustness, or even divergence. To this end, a noise-adaption extended Kalman filter is proposed to track maneuvering targets with multiple synchronous sensors. This filter avoids the simultaneous adjustment of the process model and measurement model without distinction. Instead, the maneuver detection based on the Dempster-Shafer evidence theory is constructed to achieve the reliable distinction between unknown maneuvers and inaccurate measurements by fusing multi-sensor information, which effectively improves the robustness of the filter. Moreover, the adaptive estimation of the process noise covariance is modeled by a Markovian decision process with a proper reward function. Deep deterministic policy gradient is designed to obtain the optimal process noise covariance by taking the innovation as the state and the compensation factor as the action. Furthermore, the recursive estimation of the measurement noise covariance is applied to modify a priori measurement noise covariance of the corresponding sensor. Finally, the fusion algorithm is developed for the global estimation. Simulation experiments are carried out in two scenarios, and simulation results illustrate the feasibility and superiority of the proposed algorithm.<\/jats:p>","DOI":"10.3390\/s22145389","type":"journal-article","created":{"date-parts":[[2022,7,19]],"date-time":"2022-07-19T23:10:22Z","timestamp":1658272222000},"page":"5389","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Noise-Adaption Extended Kalman Filter Based on Deep Deterministic Policy Gradient for Maneuvering Targets"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9161-3686","authenticated-orcid":false,"given":"Jiali","family":"Li","sequence":"first","affiliation":[{"name":"School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4224-9579","authenticated-orcid":false,"given":"Shengjing","family":"Tang","sequence":"additional","affiliation":[{"name":"School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0951-5126","authenticated-orcid":false,"given":"Jie","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Yin, J., Yang, Z., and Luo, Y. (2021). Adaptive tracking method for non-cooperative continuously thrusting spacecraft. Aerospace, 8.","DOI":"10.3390\/aerospace8090244"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1695","DOI":"10.1016\/j.cja.2018.11.013","article-title":"Radar maneuvering target tracking algorithm based on human cognition mechanism","volume":"32","author":"Wang","year":"2019","journal-title":"Chin. J. Aeronaut."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1002\/rnc.4785","article-title":"Minimax particle filtering for tracking a highly maneuvering target","volume":"30","author":"Lim","year":"2020","journal-title":"Int. J. Robust Nonlinear Control"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"106529","DOI":"10.1016\/j.ast.2021.106529","article-title":"An adaptive non-zero mean damping model for trajectory tracking of hypersonic glide vehicles","volume":"111","author":"Cheng","year":"2021","journal-title":"Aerosp. Sci. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1016\/j.inffus.2019.06.012","article-title":"DeepMTT: A deep learning maneuvering target-tracking algorithm based on bidirectional LSTM network","volume":"53","author":"Liu","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhu, W., Xu, Z., Li, B., and Wu, Z. (2012, January 8\u201310). Research on the observability of bearings-only target tracking based on multiple sonar sensors. Proceedings of the 2012 Second International Conference on Instrumentation, Measurement, Computer, Communication and Control (IMCCC), Harbin, China.","DOI":"10.1109\/IMCCC.2012.154"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"841","DOI":"10.21629\/JSEE.2017.05.03","article-title":"Highly maneuvering target tracking using multi-parameter fusion Singer model","volume":"28","author":"Jia","year":"2017","journal-title":"J. Syst. Eng. Electron."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.sigpro.2016.08.010","article-title":"Range tracking method based on adaptive \u201ccurrent\u201d statistical model with velocity prediction","volume":"131","author":"Jiang","year":"2017","journal-title":"Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"780","DOI":"10.1109\/9.1299","article-title":"The interacting multiple model algorithm for systems with Markovian switching coefficients","volume":"33","author":"Blom","year":"1988","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/LSP.2019.2954000","article-title":"Interactive-multiple-model algorithm based on minimax particle filtering","volume":"27","author":"Lim","year":"2020","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_11","unstructured":"Wang, M., and Bai, Y. (2015, January 28\u201330). Multi-platform maneuvering target tracking based on BLUE-AIMM-CI algorithm. Proceedings of the 34th Chinese Control Conference, Hangzhou, China."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Ding, Z., Liu, Y., Liu, J., Yu, K., You, Y., Jing, P., and He, Y. (2018). Adaptive interacting multiple model algorithm based on information-weighted consensus for maneuvering target tracking. Sensors, 18.","DOI":"10.3390\/s18072012"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.ast.2017.03.028","article-title":"State dependent multiple model-based particle filtering for ballistic missile tracking in a low-observable environment","volume":"67","author":"Yu","year":"2017","journal-title":"Aerosp. Sci. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1109\/TAES.2005.1541435","article-title":"Multiple-model estimation with variable structure part VI: Expected-mode augmentation","volume":"41","author":"Li","year":"2005","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1016\/j.sigpro.2019.04.026","article-title":"Consensus variable structure multiple model filtering for distributed maneuvering tracking","volume":"162","author":"Wang","year":"2019","journal-title":"Signal Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.ast.2016.02.016","article-title":"An improved multiple model particle filtering approach for maneuvering target tracking using airborne GMTI with geographic information","volume":"52","author":"Yu","year":"2016","journal-title":"Aerosp. Sci. Technol."},{"key":"ref_17","unstructured":"Gelb, A. (1974). Applied Optimal Estimation, MIT Press."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Kim, J., and Lee, K. (2021). Unscented Kalman filter-aided long short-term memory approach for wind nowcasting. Aerospace, 8.","DOI":"10.3390\/aerospace8090236"},{"key":"ref_19","unstructured":"Wan, E.A., and van der Merwe, R. (2000, January 1\u20134). The unscented Kalman filter for nonlinear estimation. Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373), Lake Louise, AB, Canada."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3052","DOI":"10.1177\/0142331220940228","article-title":"A consensus-based square-root cubature Kalman filter for maneuvering target tracking in sensor networks","volume":"42","author":"Zhong","year":"2020","journal-title":"Trans. Inst. Meas. Control"},{"key":"ref_21","first-page":"1","article-title":"Suboptimal fading extended Kalman filtering for nonlinear systems","volume":"5","author":"Zhou","year":"1990","journal-title":"Control Decis."},{"key":"ref_22","first-page":"689","article-title":"A suboptimal multiple fading extended Kalman filter","volume":"17","author":"Zhou","year":"1991","journal-title":"Acta Autom. Sin."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1550147717741576","article-title":"Distributed consensus strong tracking filter for wireless sensor networks with model mismatches","volume":"13","author":"Liu","year":"2017","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1561","DOI":"10.1002\/acs.2572","article-title":"Modified strong tracking unscented Kalman filter for nonlinear state estimation with process model uncertainty","volume":"29","author":"Hu","year":"2015","journal-title":"Int. J. Adapt. Control Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"13458","DOI":"10.3390\/en81212378","article-title":"A new method for state of charge estimation of lithium-ion battery based on strong tracking cubature Kalman filter","volume":"8","author":"Xia","year":"2015","journal-title":"Energies"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1049\/iet-smt.2016.0044","article-title":"Target tracking algorithm based on adaptive strong tracking particle filter","volume":"10","author":"Li","year":"2016","journal-title":"IET Sci. Meas. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2489","DOI":"10.1016\/j.cja.2019.07.025","article-title":"A novel strong tracking cubature Kalman filter and its application in maneuvering target tracking","volume":"32","author":"Zhang","year":"2019","journal-title":"Chin. J. Aeronaut."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Liu, H., and Wu, W. (2017). Strong tracking spherical simplex-radial cubature Kalman filter for maneuvering target tracking. Sensors, 17.","DOI":"10.20944\/preprints201704.0106.v1"},{"key":"ref_29","first-page":"5918456","article-title":"A novel fifth-degree strong tracking cubature Kalman filter for two-dimensional maneuvering target tracking","volume":"2018","author":"Li","year":"2018","journal-title":"Math. Probl. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"52544","DOI":"10.1109\/ACCESS.2018.2869020","article-title":"A variational Bayesian based strong tracking interpolatory cubature Kalman filter for maneuvering target tracking","volume":"6","author":"Wang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1049\/iet-rsn.2017.0467","article-title":"Strong tracking SCKF based on adaptive CS model for maneuvering aircraft tracking","volume":"12","author":"Zhang","year":"2018","journal-title":"IET Radar Sonar Navig."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"143095","DOI":"10.1109\/ACCESS.2020.3013561","article-title":"Combination of IMM algorithm and ASTRWCKF for maneuvering target tracking","volume":"8","author":"Ma","year":"2020","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2304","DOI":"10.2514\/1.G004347","article-title":"Residual-normalized strong tracking filter for tracking a noncooperative maneuvering spacecraft","volume":"42","author":"Jiang","year":"2019","journal-title":"J. Guid. Control Dyn."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1017\/S0373463314000484","article-title":"Adaptive Kalman filtering with recursive noise estimator for integrated SINS\/DVL systems","volume":"68","author":"Gao","year":"2015","journal-title":"J. Navig."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1109\/TAC.2017.2730480","article-title":"A novel adaptive Kalman filter with inaccurate process and measurement noise covariance matrices","volume":"63","author":"Huang","year":"2018","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ge, B., Zhang, H., Jiang, L., Li, Z., and Butt, M. (2019). Adaptive unscented Kalman filter for target tracking with unknown time-varying noise covariance. Sensors, 19.","DOI":"10.3390\/s19061371"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1795","DOI":"10.1049\/iet-rsn.2020.0165","article-title":"Noise-aware maneuvering target tracking algorithm in wireless sensor networks by a novel adaptive cubature Kalman filter","volume":"14","author":"Fang","year":"2020","journal-title":"IET Radar Sonar Navig."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Fang, W., Jiang, J., Lu, S., Gong, Y., Tao, Y., Tang, Y., Yan, P., Luo, H., and Liu, J. (2020). A LSTM algorithm estimating pseudo measurements for aiding INS during GNSS signal outages. Remote Sens., 12.","DOI":"10.3390\/rs12020256"},{"key":"ref_39","first-page":"8500613","article-title":"Predicting the noise covariance with a multitask learning model for Kalman filter-based GNSS\/INS integrated navigation","volume":"70","author":"Wu","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Hu, L., Tang, Y., Zhou, Z., and Pan, W. (June, January 30). Reinforcement learning for orientation estimation using inertial sensors with performance guarantee. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561440"},{"key":"ref_41","unstructured":"Tang, Y., Hu, L., Zhang, Q., and Pan, W. (October, January 27). Reinforcement learning compensated extended Kalman filter for attitude estimation. Proceedings of the International Conference on Intelligent Robots and Systems (IROS), New York, NY, USA."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Gao, X., Luo, H., Ning, B., Zhao, F., Bao, L., Gong, Y., Xiao, Y., and Jiang, J. (2020). RL-AKF: An adaptive Kalman filter navigation algorithm based on reinforcement learning for ground vehicles. Remote Sens., 12.","DOI":"10.3390\/rs12111704"},{"key":"ref_43","first-page":"1","article-title":"Network anomaly detection system with optimized DS Evidence Theory","volume":"753659","author":"Liu","year":"2014","journal-title":"Sci. World J."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1109\/TAES.2012.6129634","article-title":"Distributed estimation fusion with unavailable cross-correlation","volume":"48","author":"Wang","year":"2012","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Henderson, P., Islam, R., Bachman, P., Pineau, J., Precup, D., and Meger, D. (2018, January 2\u20137). Deep reinforcement learning that matters. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11694"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Li, B., Gan, Z., Chen, D., and Sergey Aleksandrovich, D. (2020). UAV maneuvering target tracking in uncertain environments based on deep reinforcement learning and meta-learning. Remote Sens., 12.","DOI":"10.3390\/rs12223789"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5389\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:53:59Z","timestamp":1760140439000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5389"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,19]]},"references-count":46,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22145389"],"URL":"https:\/\/doi.org\/10.3390\/s22145389","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,19]]}}}