{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T02:47:33Z","timestamp":1772160453454,"version":"3.50.1"},"reference-count":43,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2024,6,12]],"date-time":"2024-06-12T00:00:00Z","timestamp":1718150400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Funds of China","award":["62201580"],"award-info":[{"award-number":["62201580"]}]},{"name":"National Natural Science Funds of China","award":["2023-JC-YB-533"],"award-info":[{"award-number":["2023-JC-YB-533"]}]},{"name":"Natural Science Foundation of Shaanxi Province","award":["62201580"],"award-info":[{"award-number":["62201580"]}]},{"name":"Natural Science Foundation of Shaanxi Province","award":["2023-JC-YB-533"],"award-info":[{"award-number":["2023-JC-YB-533"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>With the development of electronic warfare technology, the intelligent jammer dramatically reduces the performance of traditional radar anti-jamming methods. A key issue is how to actively adapt radar to complex electromagnetic environments and design anti-jamming strategies to deal with intelligent jammers. The space of the electromagnetic environment is dynamically changing, and the transmitting power of the jammer and frequency diversity array (FDA) radar in each frequency band is continuously adjustable. Both can learn the optimal strategy by interacting with the electromagnetic environment. Considering that the competition between the FDA radar and the jammer is a confrontation process of two agents, we find the optimal power allocation strategy for both sides by using the multi-agent deep deterministic policy gradient (MADDPG) algorithm based on multi-agent reinforcement learning (MARL). Finally, the simulation results show that the power allocation strategy of the FDA radar and the jammer can converge and effectively improve the performance of the FDA radar and the jammer in the intelligent countermeasure environment.<\/jats:p>","DOI":"10.3390\/rs16122127","type":"journal-article","created":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T04:30:12Z","timestamp":1718253012000},"page":"2127","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Frequency Diversity Array Radar and Jammer Intelligent Frequency Domain Power Countermeasures Based on Multi-Agent Reinforcement Learning"],"prefix":"10.3390","volume":"16","author":[{"given":"Changlin","family":"Zhou","sequence":"first","affiliation":[{"name":"Air and Missile Defense College, Air Force Engineering University, Xi\u2019an 710051, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunyang","family":"Wang","sequence":"additional","affiliation":[{"name":"Air and Missile Defense College, Air Force Engineering University, Xi\u2019an 710051, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lei","family":"Bao","sequence":"additional","affiliation":[{"name":"Test Center, National University of Defense Technology, Xi\u2019an 710106, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xianzhong","family":"Gao","sequence":"additional","affiliation":[{"name":"Test Center, National University of Defense Technology, Xi\u2019an 710106, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Gong","sequence":"additional","affiliation":[{"name":"Air and Missile Defense College, Air Force Engineering University, Xi\u2019an 710051, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ming","family":"Tan","sequence":"additional","affiliation":[{"name":"College of Information and Communication, National University of Defense Technology, Wuhan 430035, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"102806","DOI":"10.1016\/j.dsp.2020.102806","article-title":"Mainlobe jamming suppression with polarimetric multi-channel radar via independent component analysis","volume":"106","author":"Ge","year":"2020","journal-title":"Digit. Signal Process."},{"key":"ref_2","first-page":"1327","article-title":"Enhanced and generalized coprime array for direction of arrival estimation","volume":"59","author":"Shi","year":"2023","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Li, K., Jiu, B., Liu, H., and Pu, W. (2021). Robust Antijamming Strategy Design for Frequency-Agile Radar against Main Lobe Jamming. Remote Sens., 13.","DOI":"10.3390\/rs13153043"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1660","DOI":"10.1109\/TAES.2021.3126370","article-title":"On Parameter Identifiability of Diversity-Smoothing-Based MIMO Radar","volume":"58","author":"Shi","year":"2022","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_5","unstructured":"Antonik, P., Wicks, M.C., Griffiths, H.D., and Baker, C.J. (2006, January 24\u201327). Frequency diverse array radars. Proceedings of the 2006 IEEE Conference on Radar, Verona, NY, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4145","DOI":"10.1109\/TGRS.2019.2961324","article-title":"Transceive Beamforming with Accurate Nulling in FDA-MIMO Radar for Imaging","volume":"58","author":"Lan","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1109\/TAES.2020.3028485","article-title":"GLRT-Based Adaptive Target Detection in FDA-MIMO Radar","volume":"57","author":"Lan","year":"2020","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"108810","DOI":"10.1016\/j.sigpro.2022.108810","article-title":"Ambiguity Function Evaluation and Optimization of the Transmitting Beamspace-Based FDA Radar","volume":"203","author":"Zhou","year":"2023","journal-title":"Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"4470","DOI":"10.1109\/TAP.2023.3247916","article-title":"Beampattern Synthesis Based on Novel Receive Delay Array for Mainlobe Interference Mitigation","volume":"71","author":"Lan","year":"2023","journal-title":"IEEE Trans. Antennas Propag."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2909","DOI":"10.1109\/TAES.2022.3221027","article-title":"A Joint Array Parameters Design Method Based on FDA-MIMO Radar","volume":"59","author":"Ding","year":"2023","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1576","DOI":"10.1109\/TSP.2024.3366438","article-title":"FDA-MIMO Transmitter and Receiver Optimization","volume":"72","author":"Lan","year":"2024","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1109\/TVT.2021.3126781","article-title":"Adaptive Moving Target Detection without Training Data for FDA-MIMO Radar","volume":"71","author":"Huang","year":"2022","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2083","DOI":"10.1049\/iet-rsn.2018.5653","article-title":"Adaptive transmit beamspace design for cognitive FDA radar tracking","volume":"13","author":"Basit","year":"2019","journal-title":"IET Radar Sonar Navig."},{"key":"ref_14","first-page":"4006705","article-title":"2-D Moving Target Deception against Multichannel SAR-GMTI Using Frequency Diverse Array","volume":"19","author":"Huang","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2031","DOI":"10.1049\/rsn2.12314","article-title":"Joint optimisation of transmit beamspace and receive filter in frequency diversity array-multi-input multi-output radar","volume":"16","author":"Zhou","year":"2022","journal-title":"IET Radar Sonar Navig."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1574","DOI":"10.1049\/iet-rsn.2016.0551","article-title":"Cognitive FDA-MIMO radar for LPI transmit beamforming","volume":"11","author":"Xiong","year":"2017","journal-title":"IET Radar Sonar Navig."},{"key":"ref_17","first-page":"133","article-title":"Improved transmit beamforming design based on ADMM for low probability of intercept of FDA-MIMO radar","volume":"43","author":"Pengcheng","year":"2022","journal-title":"J. Commun."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1938","DOI":"10.1109\/LSP.2022.3205206","article-title":"Joint Design of Transmit Waveform and Receive Beamforming for LPI FDA-MIMO Radar","volume":"29","author":"Gong","year":"2022","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1076","DOI":"10.1109\/LWC.2023.3261419","article-title":"Optimization of LPI-FDA-MIMO Radar and MIMO Communication for Spectrum Coexistence","volume":"12","author":"Gong","year":"2023","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"11584","DOI":"10.1109\/TVT.2020.3014689","article-title":"Suppression of Mainbeam Deceptive Jammer with FDA-MIMO Radar","volume":"69","author":"Lan","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"107773","DOI":"10.1016\/j.sigpro.2020.107773","article-title":"FDA Radar with Doppler-Spreading Consideration: Mainlobe Clutter Suppression for Blind-Doppler Target Detection","volume":"179","author":"Gui","year":"2020","journal-title":"Signal Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/LAWP.2023.3331573","article-title":"Range Dimensional Monopulse Approach with FDA-MIMO Radar for Mainlobe Deceptive Jamming Suppression","volume":"23","author":"Tan","year":"2023","journal-title":"IEEE Antennas Wirel. Propag. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"108006","DOI":"10.1016\/j.sigpro.2021.108006","article-title":"Cognitive FDA radar transmit power allocation for target tracking in spectrally dense scenario","volume":"183","author":"Gui","year":"2021","journal-title":"Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3386","DOI":"10.1109\/TSP.2022.3184780","article-title":"Covariance Matrix Estimation for FDA-MIMO Adaptive Transmit Power Allocation","volume":"70","author":"Wang","year":"2022","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jakabosky, J., Ravenscroft, B., Blunt, S.D., and Martone, A. (2016, January 2\u20136). Gapped spectrum shaping for tandem-hopped radar\/communications cognitive sensing. Proceedings of the 2016 IEEE Radar Conference (RadarConf), Philadelphia, PA, USA.","DOI":"10.1109\/RADAR.2016.7485067"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ravenscroft, B., Blunt, S., Allen, C., Martone, A., and Sherbondy, K. (2017, January 23\u201326). Analysis of spectral notching in fm noise radar using measured interference. Proceedings of the International Conference on Radar Systems, Belfast, UK.","DOI":"10.1049\/cp.2017.0388"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/MAES.2016.150216","article-title":"Optimization theory-based radar waveform design for spectrally dense environments","volume":"31","author":"Aubry","year":"2016","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/MAES.2016.150193","article-title":"Cognitive radars in spectrally dense environments","volume":"31","author":"Stinco","year":"2016","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhou, C., Wang, C., Gong, J., Tan, M., Bao, L., and Liu, M. (2023). Phase Characteristics and Angle Deception of Frequency-Diversity-Array Transmitted Signals Based on Time Index within Pulse. Remote Sens., 15.","DOI":"10.3390\/rs15215171"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3904","DOI":"10.1109\/TAES.2020.2987443","article-title":"Reinforcement Learning for Adaptable Bandwidth Tracking Radars","volume":"56","author":"Selvi","year":"2020","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1335","DOI":"10.1109\/TCCN.2020.3019605","article-title":"Deep Reinforcement Learning Control for Radar Detection and Tracking in Congested Spectral Environments","volume":"6","author":"Thornton","year":"2020","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"ref_32","first-page":"550","article-title":"Transmit Power Allocation Method of Frequency Diverse Array-Multi Input and Multi Output Radar Based on Reinforcement Learning","volume":"45","author":"Ding","year":"2023","journal-title":"J. Electron. Inf. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wang, L., Peng, J., Xie, Z., and Zhang, Y. (2019, January 28\u201330). Optimal jamming frequency selection for cognitive jammer based on reinforcement learning. Proceedings of the 2019 IEEE 2nd International Conference on Information Communication and Signal Processing (ICICSP), Weihai, China.","DOI":"10.1109\/ICICSP48821.2019.8958575"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Liu, H., Zhang, H., He, Y., and Sun, Y. (2021). Jamming Strategy Optimization through Dual Q-Learning Model against Adaptive Radar. Sensors, 22.","DOI":"10.3390\/s22010145"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1109\/TAES.2011.5751244","article-title":"Game Theoretic Analysis of Adaptive Radar Jamming","volume":"47","author":"Bachmann","year":"2011","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1049\/iet-rsn.2012.0049","article-title":"Scheduling the usage of radar and jammer during peace and war time","volume":"6","author":"Norouzi","year":"2012","journal-title":"IET Radar Sonar Navig."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"5533","DOI":"10.1109\/TAES.2022.3175186","article-title":"Neural Fictitious Self-Play for Radar Antijamming Dynamic Game with Imperfect Information","volume":"58","author":"Li","year":"2022","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Geng, J., Jiu, B., Li, K., Zhao, Y., Liu, H., and Li, H. (2023). Radar and Jammer Intelligent Game under Jamming Power Dynamic Allocation. Remote Sens., 15.","DOI":"10.3390\/rs15030581"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"11111","DOI":"10.1109\/TVT.2023.3270394","article-title":"Adaptive FDA Radar Transmit Power Allocation for Target Detection Enhancement in Clutter Environment","volume":"72","author":"Huang","year":"2023","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"123957","DOI":"10.1016\/j.eswa.2024.123957","article-title":"Expert systems with applications reinforcement learning for FDA-MIMO radar power allocation in congested spectral environments","volume":"251","author":"Zhou","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_41","first-page":"5027","article-title":"Cognitive Conformal Subaperturing FDA-MIMO Radar for Power Allocation Strategy","volume":"59","author":"Ding","year":"2023","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_42","unstructured":"Silver, D., Lever, G., Heess, N., Degris, T., Wierstra, D., and Riedmiller, M. (2014, January 21\u201326). Deterministic policy gradient algorithms. Proceedings of the International Conference on Machine Learning, PMLR, Beijing, China."},{"key":"ref_43","first-page":"6379","article-title":"Multi-agent actor-critic for mixed cooperative-competitive environments","volume":"30","author":"Lowe","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/12\/2127\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:57:27Z","timestamp":1760108247000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/12\/2127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,12]]},"references-count":43,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["rs16122127"],"URL":"https:\/\/doi.org\/10.3390\/rs16122127","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,12]]}}}