{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,24]],"date-time":"2026-01-24T16:12:20Z","timestamp":1769271140308,"version":"3.49.0"},"reference-count":47,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2023,8,16]],"date-time":"2023-08-16T00:00:00Z","timestamp":1692144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U20B2041"],"award-info":[{"award-number":["U20B2041"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In the face of smart and varied jamming, intelligent radar anti-jamming technologies are urgently needed. Due to the variety of radar electronic counter-countermeasures (ECCMs), it is necessary to efficiently optimize ECCMs in the high-dimensional knowledge base to ensure that the radar achieves the optimal anti-jamming effect. Therefore, an intelligent radar anti-jamming decision-making method based on the deep deterministic policy gradient (DDPG) and the multi-agent deep deterministic policy gradient (MADDPG) (DDPG-MADDPG) algorithm is proposed. Firstly, by establishing a typical working scenario of radar and jamming, we designed the intelligent radar anti-jamming decision-making model, and the anti-jamming decision-making process was formulated. Then, aiming at different jamming modes, we designed the anti-jamming improvement factor and the correlation matrix of jamming and ECCM. They were used to evaluate the jamming suppression performance of ECCMs and to provide feedback for the decision-making algorithm. The decision-making constraints and four different decision-making objectives were designed to verify the performance of the decision-making algorithm. Finally, we designed a DDPG-MADDPG algorithm to generate the anti-jamming strategy. The simulation results showed that the proposed method has excellent robustness and generalization performance. At the same time, it has a shorter convergence time and higher anti-jamming decision making accuracy.<\/jats:p>","DOI":"10.3390\/rs15164046","type":"journal-article","created":{"date-parts":[[2023,8,16]],"date-time":"2023-08-16T10:08:09Z","timestamp":1692180489000},"page":"4046","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Radar Anti-Jamming Decision-Making Method Based on DDPG-MADDPG Algorithm"],"prefix":"10.3390","volume":"15","author":[{"given":"Jingjing","family":"Wei","sequence":"first","affiliation":[{"name":"School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin 150006, China"},{"name":"Key Laboratory of Marine Environmental Monitoring and Information Processing, Ministry of Industry and Information Technology, Harbin 150006, China"}]},{"given":"Yinsheng","family":"Wei","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin 150006, China"},{"name":"Key Laboratory of Marine Environmental Monitoring and Information Processing, Ministry of Industry and Information Technology, Harbin 150006, China"}]},{"given":"Lei","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin 150006, China"},{"name":"Key Laboratory of Marine Environmental Monitoring and Information Processing, Ministry of Industry and Information Technology, Harbin 150006, China"}]},{"given":"Rongqing","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Engineering, Harbin Institute of Technology, Harbin 150006, China"},{"name":"Key Laboratory of Marine Environmental Monitoring and Information Processing, Ministry of Industry and Information Technology, Harbin 150006, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Geng, J., Jiu, B., Li, K., Zhao, Y., Liu, H., and Li, H. (2023). Radar and Jammer Intelligent Game under Jamming Power Dynamic Allocation. Remote Sens., 15.","DOI":"10.3390\/rs15030581"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5533","DOI":"10.1109\/TAES.2022.3175186","article-title":"Neural Fictitious Self-Play for Radar Antijamming Dynamic Game with Imperfect Information","volume":"58","author":"Li","year":"2022","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"72257","DOI":"10.1109\/ACCESS.2019.2920398","article-title":"Game Theoretic Strategies Design for Monostatic Radar and Jammer Based on Mutual Information","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Feng, X., Zhao, Z., Li, F., Cui, W., and Zhao, Y. (2022). Radar Phase-Coded Waveform Design with Local Low Range Sidelobes Based on Particle Swarm-Assisted Projection Optimization. Remote Sens., 14.","DOI":"10.3390\/rs14174186"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"45","DOI":"10.11003\/JPNT.2014.3.2.045","article-title":"Jammer Identification Technique based on a Template Matching Method","volume":"3","author":"Jin","year":"2014","journal-title":"J. Position. Navig. Timing"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Yu, W., Sun, Y., Wang, X., Li, K., and Luo, J. (2017, January 21\u201323). Modeling and Analyzing of Fire-Control Radar Anti-Jamming Performance in the Complex Electromagnetic Circumstances. Proceedings of the International Conference on Man-Machine-Environment System Engineering, Jinggangshan, China.","DOI":"10.1007\/978-981-10-6232-2_71"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Guo, W., Zhang, S., and Wang, Z. (2008, January 2\u20134). A method to evaluate radar effectiveness based on fuzzy analytic hierarchy process. Proceedings of the 2008 Chinese Control and Decision Conference, Yantai, China.","DOI":"10.1109\/CCDC.2008.4597660"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Xia, X., Hao, D., and Wu, X. (2017, January 28\u201330). Optimal Waveform Design for Smart Noise Jamming. Proceedings of the 7th International Conference on Education, Management, Information and Mechanical Engineering, Shenyang, China.","DOI":"10.2991\/emim-17.2017.381"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, Z., Zhang, Q., and Li, K. (2022). A Smart Noise Jamming Suppression Method Based on Atomic Dictionary Parameter Optimization Decomposition. Remote Sens., 14.","DOI":"10.3390\/rs14081921"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Liu, Y.-X., Zhang, Q., Xiong, S.-C., Ni, J.-C., Wang, D., and Wang, H.-B. (2023). An ISAR Shape Deception Jamming Method Based on Template Multiplication and Time Delay. Remote Sens., 15.","DOI":"10.3390\/rs15112762"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Dai, H., Zhao, Y., Su, H., Wang, Z., Bao, Q., and Pan, J. (2023). Research on an Intra-Pulse Orthogonal Waveform and Methods Resisting Interrupted-Sampling Repeater Jamming within the Same Frequency Band. Remote Sens., 15.","DOI":"10.20944\/preprints202307.0099.v1"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhan, H., Wang, T., Guo, T., and Su, X. (2023). An Anti-Intermittent Sampling Jamming Technique Utilizing the OTSU Algorithm of Random Orthogonal Sub-Pulses. Remote Sens., 15.","DOI":"10.3390\/rs15123080"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Han, B., Qu, X., Yang, X., Li, W., and Zhang, Z. (2023). DRFM-Based Repeater Jamming Reconstruction and Cancellation Method with Accurate Edge Detection. Remote Sens., 15.","DOI":"10.3390\/rs15071759"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1109\/TAES.2018.2886614","article-title":"Avoidance of Time-Varying Radio Frequency Interference with Software-Defined Cognitive Radar","volume":"55","author":"Kirk","year":"2019","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, X., Wang, S., Liang, X., Zhao, D., Huang, J., Xu, X., Dai, B., and Miao, Q. (2022). Deep Reinforcement Learning: A Survey. IEEE Trans. Neural Networks Learn. Syst., 1\u201315.","DOI":"10.1109\/TNNLS.2022.3207346"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"9920","DOI":"10.1109\/TVT.2019.2935999","article-title":"Cognitive Risk Control for Anti-Jamming V2V Communications in Autonomous Vehicle Networks","volume":"68","author":"Feng","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"11812","DOI":"10.1109\/TVT.2021.3115474","article-title":"Protecting Multi-Function Wireless Systems from Jammers with Backscatter Assistance: An Intelligent Strategy","volume":"70","author":"Lotfi","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3682","DOI":"10.1109\/TCOMM.2021.3062854","article-title":"Reinforcement Learning for Deceiving Reactive Jammers in Wireless Networks","volume":"69","author":"Pourranjbar","year":"2021","journal-title":"IEEE Trans. Commun."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"9499","DOI":"10.1109\/TVT.2018.2856854","article-title":"Two-dimensional anti-jamming mobile communication based on reinforcement learning","volume":"67","author":"Xiao","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"12434","DOI":"10.1109\/TVT.2022.3197425","article-title":"Adaptation of Frequency Hopping Interval for Radar Anti-Jamming Based on Reinforcement Learning","volume":"71","author":"Ailiya","year":"2022","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1335","DOI":"10.1109\/TCCN.2020.3019605","article-title":"Deep Reinforcement Learning Control for Radar Detection and Tracking in Congested Spectral Environments","volume":"6","author":"Thornton","year":"2020","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1109\/TAES.2020.3011869","article-title":"Decentralized Automotive Radar Spectrum Allocation to Avoid Mutual Interference Using Reinforcement Learning","volume":"57","author":"Liu","year":"2020","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3904","DOI":"10.1109\/TAES.2020.2987443","article-title":"Reinforcement Learning for Adaptable Bandwidth Tracking Radars","volume":"56","author":"Selvi","year":"2020","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Feng, C., Fu, X., Wang, Z., Dong, J., Zhao, Z., and Pan, T. (2023). An Optimization Method for Collaborative Radar Antijamming Based on Multi-Agent Reinforcement Learning. Remote Sens., 15.","DOI":"10.3390\/rs15112893"},{"key":"ref_25","unstructured":"Li, K., Jiu, B., Liu, H., and Liang, S. (2018, January 14\u201316). Reinforcement learning based anti-jamming frequency hopping strategies design for cognitive radar. Proceedings of the 2018 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), Qingdao, China."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, K., Jiu, B., and Liu, H. (2019, January 23\u201327). Deep Q-Network based anti-Jamming strategy design for frequency agile radar. Proceedings of the International Radar Conference (RADAR), Toulon, France.","DOI":"10.1109\/RADAR41533.2019.171227"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ak, S., and Br\u00fcggenwirth, S. (2020, January 28\u201330). Avoiding Jammers: A Reinforcement Learning Approach. Proceedings of the 2020 IEEE International Radar Conference (RADAR), Washington, DC, USA.","DOI":"10.1109\/RADAR42522.2020.9114797"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"108130","DOI":"10.1016\/j.sigpro.2021.108130","article-title":"Radar active antagonism through deep reinforcement learning: A Way to address the challenge of mainlobe jamming","volume":"186","author":"Li","year":"2021","journal-title":"Signal Process."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, K., Jiu, B., Liu, H., and Pu, W. (2021). Robust Antijamming Strategy Design for Frequency-Agile Radar against Main Lobe Jamming. Remote Sens., 13.","DOI":"10.3390\/rs13153043"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Geng, J., Jiu, B., Li, K., Zhao, Y., and Liu, H. (2022, January 25\u201327). Reinforcement Learning Based Radar Anti-Jamming Strategy Design against a Non-Stationary Jammer. Proceedings of the 2022 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), Xi\u2019an, China.","DOI":"10.1109\/ICSPCC55723.2022.9984459"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"He, X., Liao, K., Peng, S., Tian, Z., and Huang, J. (2022). Interrupted-Sampling Repeater Jamming-Suppression Method Based on a Multi-Stages Multi-Domains Joint Anti-Jamming Depth Network. Remote Sens., 14.","DOI":"10.3390\/rs14143445"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1109\/TVT.2022.3212966","article-title":"Mitigating Jamming Attack in 5G Heterogeneous Networks: A Federated Deep Reinforcement Learning Approach","volume":"72","author":"Sharma","year":"2023","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"116117","DOI":"10.1016\/j.apenergy.2020.116117","article-title":"Intelligent multi-zone residential HVAC control strategy based on deep reinforcement learning","volume":"281","author":"Du","year":"2021","journal-title":"Appl. Energy"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1109\/TCI.2022.3197939","article-title":"An Adversarial Learning Based Approach for 2D Unknown View Tomography","volume":"8","author":"Zehni","year":"2022","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1109\/JSAC.2020.3036962","article-title":"Multi-Agent Reinforcement Learning Based Resource Management in MEC- and UAV-Assisted Vehicular Networks","volume":"39","author":"Peng","year":"2021","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_36","unstructured":"Johnston, S.L. (1986, January 4\u20137). The ECCM improvement factor (EIF)\u2013Illustrative examples, applications, and considerations in its utilization in radar ECCM performance assessment. Proceedings of the International Conference on Radar, Nanjing, China."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"674","DOI":"10.1007\/s42452-020-2510-0","article-title":"Radar seeker performance evaluation based on information fusion method","volume":"2","author":"Liu","year":"2020","journal-title":"SN Appl. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"110386","DOI":"10.1016\/j.measurement.2021.110386","article-title":"Research on anti-Narrowband AM jamming of Ultra-wideband impulse radio detection radar based on improved singular spectrum analysis","volume":"188","author":"Wang","year":"2022","journal-title":"Measurement"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"214504","DOI":"10.1109\/ACCESS.2020.3040514","article-title":"Evaluating Effect of Blanket Jamming on Radar Via Robust Time-Frequency Analysis and Peak to Average Power Ratio","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Xing, H., Xing, Q., and Wang, K. (2023). Radar Anti-Jamming Countermeasures Intelligent Decision-Making: A Partially Observable Markov Decision Process Approach. Aerospace, 10.","DOI":"10.3390\/aerospace10030236"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wang, F., Liu, D., Liu, P., and Li, B. (2015, January 30\u201331). A Research on the Radar Anti-jamming Evaluation Index System. Proceedings of the 2015 International Conference on Applied Science and Engineering Innovation, Jinan, China.","DOI":"10.2991\/asei-15.2015.49"},{"key":"ref_42","unstructured":"Lillicrap, T., Hunt, J., and Pritzel, A. (2015). Continuous control with deep reinforcement learning. arXiv."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_45","unstructured":"Lowe, R., Wu, Y., Tamar, A., Harb, J., Abbeel, P., and Mordatch, I. (2017, January 4\u20139). Multi-agent actor-critic for mixed cooperative-competitive environments. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_46","unstructured":"Jang, E., Gu, S., and Poole, B. (2016). Categorical reparameterization with gumbel-softmax. arXiv."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/j.future.2020.03.065","article-title":"Deep reinforcement learning for traffic signal control under disturbances: A case study on Sunway city, Malaysia","volume":"109","author":"Rasheed","year":"2020","journal-title":"Futur. Gener. Comput. Syst."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/16\/4046\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:34:50Z","timestamp":1760128490000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/16\/4046"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,16]]},"references-count":47,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["rs15164046"],"URL":"https:\/\/doi.org\/10.3390\/rs15164046","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,16]]}}}