{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:58:48Z","timestamp":1760151528993,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T00:00:00Z","timestamp":1648598400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Foreign Scholars in University Research and Teaching Programs (the 111 Project)","award":["B18039"],"award-info":[{"award-number":["B18039"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>For the problem of joint beam selection and power allocation (JBSPA) for multiple target tracking (MTT), existing works tend to allocate resources only considering the MTT performance at the current tracking time instant. However, in this way, it cannot guarantee the long-term MTT performance in the future. If the JBSPA not only considers the tracking performance at the current tracking time instant but also at the future tracking time instant, the allocation results are theoretically able to enhance the long-term tracking performance and the robustness of tracking. Motivated by this, the JBSPA is formulated as a model-free Markov decision process (MDP) problem, and solved with a data-driven method in this article, i.e., deep reinforcement learning (DRL). With DRL, the optimal policy is given by learning from the massive interacting data of the DRL agent and environment. In addition, in order to ensure the information prediction performance of target state in maneuvering target scenarios, a data-driven method is developed based on Long-short term memory (LSTM) incorporating the Gaussian mixture model (GMM), which is called LSTM-GMM for short. This method can realize the state prediction by learning the regularity of nonlinear state transitions of maneuvering targets, where the GMM is used to describe the target motion uncertainty in LSTM. Simulation results have shown the effectiveness of the proposed method.<\/jats:p>","DOI":"10.3390\/rs14071674","type":"journal-article","created":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T21:28:39Z","timestamp":1648675719000},"page":"1674","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Data-Driven Joint Beam Selection and Power Allocation for Multiple Target Tracking"],"prefix":"10.3390","volume":"14","author":[{"given":"Yuchun","family":"Shi","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Zhoukou Normal University, Zhoukou 466001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hao","family":"Zheng","sequence":"additional","affiliation":[{"name":"National Laboratory of Radar Signal Processing, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kang","family":"Li\u00a0","sequence":"additional","affiliation":[{"name":"National Laboratory of Radar Signal Processing, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,30]]},"reference":[{"key":"ref_1","unstructured":"Blackman, S. (1986). Multiple-Target Tracking with Radar Applications, Artech House."},{"key":"ref_2","unstructured":"Stone, L.D., Barlow, C.A., and Corwin, T. (1999). Bayesian Multiple Target Tracking, Artech House."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1109\/78.978386","article-title":"Sequential Monte Carlo methods for multiple target tracking and data fusion","volume":"50","author":"Hue","year":"2002","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1109\/MSP.2007.904812","article-title":"MIMO radar with colocated antennas","volume":"24","author":"Stoica","year":"2007","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2498","DOI":"10.1109\/TAES.2012.6237605","article-title":"Multiple unresolved target localization and tracking using collocated MIMO radars","volume":"48","author":"Gorji","year":"2012","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_6","unstructured":"Rabideau, D.J., and Parker, P. (2003). Ubiquitous MIMO Multifunction Digital Array Radar and the Role of Time-Energy Management in Radar, MIT Lincoln Lab.. Project Rep. DAR-4."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3226","DOI":"10.1109\/TSP.2011.2144976","article-title":"Power allocation strategies for target localization in distributed multiple-radar architecture","volume":"59","author":"Godrich","year":"2011","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1109\/TSP.2011.2174989","article-title":"Scheduling and power allocation in a cognitive radar network for multiple-target tracking","volume":"50","author":"Chavali","year":"2012","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1109\/JSYST.2020.2990409","article-title":"Quality of service constrained-resource allocation scheme for multiple target tracking in radar sensor network","volume":"15","author":"Yan","year":"2021","journal-title":"IEEE Syst. J."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Haykin, S., Zia, A., Arasaratnam, I., and Yanbo, X. (2010, January 10\u201314). Cognitive tracking radar. In Proceedings of the 2010 IEEE Radar Conference, Washington, DC, USA.","DOI":"10.1109\/RADAR.2010.5494383"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1386","DOI":"10.1109\/78.668800","article-title":"Posterior Cram\u00e9r-Rao bounds for discrete-time nonlinear filtering","volume":"46","author":"Tichavsky","year":"1998","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1109\/TAES.2004.1309993","article-title":"Multisensor resource deployment using posterior Cram\u00e9r-Rao bounds","volume":"40","author":"Hernandez","year":"2004","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"680","DOI":"10.1109\/TAES.2006.1642582","article-title":"PCRLB for tracking in cluttered environments: Measurement sequence conditioning approach","volume":"42","author":"Hernandez","year":"2006","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3110","DOI":"10.1109\/TSP.2015.2417504","article-title":"Simultaneous multibeam resource allocation scheme for multiple target tracking","volume":"63","author":"Yan","year":"2015","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1264","DOI":"10.1109\/JSYST.2020.2984774","article-title":"Data-driven simultaneous multibeam power allocation: When multiple targets tracking meets deep reinforcement learning","volume":"15","author":"Shi","year":"2021","journal-title":"IEEE Syst. J."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cormode, G., and Thottan, M. (2010). Algorithms for Next Generation Networks, Springer.","DOI":"10.1007\/978-1-84882-765-3"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_19","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press. [2nd ed.]."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"19296","DOI":"10.1109\/JSEN.2021.3087747","article-title":"Data-Driven radar selection and power allocation method for target tracking in multiple radar system","volume":"21","author":"Shi","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_21","unstructured":"Lillicrap, T.P., Hunt, J.J., Pritzel, A., Heess, N., Erez, T., Tassa, Y., Silver, D., and Wierstra, D. (2016, January 2\u20134). Continuous control with deep reinforcement learning. Proceedings of the 4th International Conference on Learning Representations, San Juan, Puerto Rico."},{"key":"ref_22","unstructured":"Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., and Riedmiller, M. (2014, January 21\u201326). Deterministic policy gradient algorithms. Proceedings of the 31st International Conference on Machine Learning, Beijing, China."},{"key":"ref_23","unstructured":"Sutton, R.S., McAllester, D.A., Singhand, S.P., and Mansour, Y. (2000, January 27\u201330). Policy gradient methods for reinforcement learning with function approximation. Proceedings of the 12th IInternational Conference on Neural Information Processing Systems, Denver, CO, USA."},{"key":"ref_24","unstructured":"Van Trees, H.L. (1971). Detection, Estimation, and Modulation Theory, Part III, Wiley."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Van Trees, H.L. (2002). Optimum Array Processing: Detection, Estimation, and Modulation Theory, Part IV, Wiley.","DOI":"10.1002\/0471221104"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1325","DOI":"10.1109\/78.928687","article-title":"Matrix CRLB scaling due to measurements of uncertain origin","volume":"49","author":"Niu","year":"2001","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.1109\/TAES.2005.1561880","article-title":"Dynamic Cramer-Rao bound for target tracking in clutter","volume":"41","author":"Zhang","year":"2005","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1109\/MSP.2004.1267055","article-title":"Cyclic minimizer, majorization techniques, and expectation-maximization algorithm: A refresher","volume":"21","author":"Stocia","year":"2004","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_29","unstructured":"Kingma, D., and Ba, J. (2015, January 28\u201330). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference for Design. Proceedings of the 3rd International Conference for Design, Santiago de Chile, Chile."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Ristic, B., Arulampalam, S., and Gordon, N. (2004). Beyond the Kalman Filter Particle Filters for Tracking Applications, Artech House.","DOI":"10.1155\/S1110865704405095"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3946","DOI":"10.1109\/TSP.2018.2841865","article-title":"Robust chance constrained power allocation scheme for multiple target localization in colocated MIMO system","volume":"21","author":"Yan","year":"2018","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.inffus.2019.08.010","article-title":"Collaborative detection and power allocation framework for target tracking in multiple radar system","volume":"55","author":"Yan","year":"2020","journal-title":"Inf. Fusion"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4055","DOI":"10.1109\/TSP.2020.3007313","article-title":"Optimal Resource Allocation for Asynchronous Multiple Targets Tracking in Heterogeneous Radar Network","volume":"68","author":"Yan","year":"2020","journal-title":"IEEE Trans. Signal Process."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/7\/1674\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:47:05Z","timestamp":1760136425000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/7\/1674"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,30]]},"references-count":33,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["rs14071674"],"URL":"https:\/\/doi.org\/10.3390\/rs14071674","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,3,30]]}}}