{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T05:02:48Z","timestamp":1789621368465,"version":"build-2803163510"},"reference-count":38,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T00:00:00Z","timestamp":1789084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100008083","name":"Xihua University","doi-asserted-by":"publisher","award":["ZX20250131"],"award-info":[{"award-number":["ZX20250131"]}],"id":[{"id":"10.13039\/501100008083","id-type":"DOI","asserted-by":"publisher"}]},{"award":["ZX20250131"],"award-info":[{"award-number":["ZX20250131"]}],"id":[{"id":"https:\/\/ror.org\/04gwtvf26","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The integration of semantic communication with unmanned aerial vehicles (UAVs) and intelligent reflecting surfaces (IRSs) offers a promising approach for next-generation wireless systems. However, jointly optimizing semantic reliability, physical-layer security, and energy efficiency remains challenging. This paper investigates an IRS-assisted UAV semantic secure communication system in the presence of a potential eavesdropper, with the objective of maximizing semantic secure energy efficiency (SSEE). We first introduce a semantic similarity-based secure energy efficiency metric to capture the trade-off among transmission reliability, physical-layer security, and UAV energy consumption. The semantic symbol number, UAV trajectory, transmit power, and IRS phase shifts are jointly considered under mobility, secrecy, and energy constraints. To efficiently solve the resulting mixed discrete-continuous optimization problem, we develop a hierarchical optimization framework: the outer layer exhaustively searches over a finite set of candidate semantic symbol numbers, while the inner layer solves the continuous resource allocation problem using a heuristic-guided soft actor\u2013critic (HG-SAC) algorithm. Simulation results show that the proposed framework achieves noticeable SSEE gains over several benchmark schemes.<\/jats:p>","DOI":"10.3390\/s26185779","type":"journal-article","created":{"date-parts":[[2026,9,11]],"date-time":"2026-09-11T13:29:29Z","timestamp":1789133369000},"page":"5779","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Deep Reinforcement Learning for Semantic Secure Energy Efficiency Optimization in IRS-Assisted UAV Communications"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-7474-4613","authenticated-orcid":false,"given":"Xiang","family":"Ji","sequence":"first","affiliation":[{"name":"School of Information Engineering, Zhengzhou University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuomin","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Zhengzhou University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-2124-8668","authenticated-orcid":false,"given":"Haofei","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Aerospace and Intelligent Equipment, Xihua University, Chengdu 610039, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peng","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wanming","family":"Hao","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Zhengzhou University, Zhengzhou 450001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2663","DOI":"10.1109\/TSP.2021.3071210","article-title":"Deep Learning Enabled Semantic Communication Systems","volume":"69","author":"Xie","year":"2021","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2598","DOI":"10.1109\/JSAC.2022.3191112","article-title":"Performance Optimization for Semantic Communications: An Attention-Based Reinforcement Learning Approach","volume":"40","author":"Wang","year":"2022","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1109\/JSAC.2022.3221968","article-title":"Wireless Semantic Communications for Video Conferencing","volume":"41","author":"Jiang","year":"2023","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1109\/MWC.101.2100269","article-title":"Semantic Communications: Overview, Open Issues, and Future Research Directions","volume":"29","author":"Luo","year":"2022","journal-title":"IEEE Wirel. Commun."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MWC.002.2200468","article-title":"Task-Oriented Communications for 6G: Vision, Principles, and Technologies","volume":"30","author":"Shi","year":"2023","journal-title":"IEEE Wirel. Commun."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"28293","DOI":"10.1109\/ACCESS.2025.3532797","article-title":"Semantic Communication Empowered 6G Networks: Techniques, Applications, and Challenges","volume":"13","author":"Wang","year":"2025","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, P., Xu, X., Sun, M., Gao, H., Ma, N., Wang, X., Zhang, R., Wang, J., and Niyato, D. (IEEE Commun. Stand. Mag., 2026). Toward Native AI in 6G Standardization: The Roadmap of Semantic Communication, IEEE Commun. Stand. Mag., early access.","DOI":"10.1109\/MCOMSTD.2026.3669900"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1109\/COMST.2022.3223224","article-title":"Semantic Communications for Future Internet: Fundamentals, Applications, and Challenges","volume":"25","author":"Yang","year":"2023","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"45456","DOI":"10.1109\/ACCESS.2023.3269848","article-title":"Making Sense of Meaning: A Survey on Metrics for Semantic and Goal-Oriented Communication","volume":"11","author":"Getu","year":"2023","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1109\/JSAC.2022.3221990","article-title":"Personalized Saliency in Task-Oriented Semantic Communications: Image Transmission and Performance Analysis","volume":"41","author":"Kang","year":"2023","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1389","DOI":"10.1109\/LWC.2023.3275383","article-title":"Wireless Image Transmission With Semantic and Security Awareness","volume":"12","author":"Zhang","year":"2023","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1109\/MWC.011.2200547","article-title":"Rethinking Wireless Communication Security in Semantic Internet of Things","volume":"30","author":"Du","year":"2023","journal-title":"IEEE Wirel. Commun."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2243","DOI":"10.1109\/LCOMM.2024.3452715","article-title":"Secure Semantic Communications: From Perspective of Physical Layer Security","volume":"28","author":"Li","year":"2024","journal-title":"IEEE Commun. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, X., and Peng, F. (2025). Semantic Communication Physical Layer Security Performance Analysis. Electronics, 14.","DOI":"10.3390\/electronics14071316"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2955","DOI":"10.1109\/TCCN.2025.3589577","article-title":"A physical Layer Security Framework for IRS-Assisted Integrated Sensing and Semantic Communication Systems","volume":"11","author":"Amiriara","year":"2025","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2592","DOI":"10.1109\/JSAC.2023.3288249","article-title":"Physical-Layer Adversarial Robustness for Deep Learning-Based Semantic Communications","volume":"41","author":"Nan","year":"2023","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yuan, Z., Yang, Y., Wang, D., and Ma, X. (2022). Energy-Efficient Trajectory Optimization for UAV-Enabled Cellular Communications Based on Physical-Layer Security. Aerospace, 9.","DOI":"10.3390\/aerospace9020050"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2850","DOI":"10.1109\/TVT.2021.3057397","article-title":"Joint Trajectory and Power Allocation Design for Secure Artificial Noise Aided UAV Communications","volume":"70","author":"Mamaghani","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5394","DOI":"10.1109\/TWC.2019.2936025","article-title":"Intelligent Reflecting Surface Enhanced Wireless Network via Joint Active and Passive Beamforming","volume":"18","author":"Wu","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2487","DOI":"10.1109\/TWC.2020.3042828","article-title":"Robust Transmission Design for Intelligent Reflecting Surface-Aided Secure Communication Systems With Imperfect Cascaded CSI","volume":"20","author":"Hong","year":"2021","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1109\/LWC.2020.3027969","article-title":"Joint Optimization for Secure Intelligent Reflecting Surface Assisted UAV Networks","volume":"10","author":"Fang","year":"2021","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1109\/MWC.010.2000528","article-title":"When UAV Meets IRS: Expanding Air-Ground Networks via Passive Reflection","volume":"28","author":"Pang","year":"2021","journal-title":"IEEE Wirel. Commun."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3747","DOI":"10.1109\/TWC.2017.2688328","article-title":"Energy-Efficient UAV Communication with Trajectory Optimization","volume":"16","author":"Zeng","year":"2017","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1109\/COMST.2021.3063822","article-title":"Single and Multi-Agent Deep Reinforcement Learning for AI-Enabled Wireless Networks: A Tutorial","volume":"23","author":"Feriani","year":"2021","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_25","first-page":"1856","article-title":"Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor","volume":"80","author":"Haarnoja","year":"2018","journal-title":"Proc. Int. Conf. Mach. Learn."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1016\/j.icte.2022.06.004","article-title":"Deep Reinforcement Learning-Based Model-Free Path Planning and Collision Avoidance for UAVs: A Soft Actor\u2013Critic With Hindsight Experience Replay Approach","volume":"9","author":"Lee","year":"2023","journal-title":"ICT Express"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e3031","DOI":"10.7717\/peerj-cs.3031","article-title":"Enhancing Reliable and Energy-Efficient UAV Communications With RIS and Deep Reinforcement Learning","volume":"11","author":"Ahmad","year":"2025","journal-title":"PeerJ Comput. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"89520","DOI":"10.1109\/ACCESS.2024.3419888","article-title":"Physical Layer Security for IRS-UAV-Assisted Cell-Free Massive MIMO Systems","volume":"12","author":"Dang","year":"2024","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"13179","DOI":"10.1109\/TVT.2025.3552777","article-title":"Cross-Layer Security for Semantic Communications: Metrics and Optimization","volume":"74","author":"Wang","year":"2025","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"3313","DOI":"10.1109\/TCOMM.2021.3051897","article-title":"Intelligent Reflecting Surface-Aided Wireless Communications: A Tutorial","volume":"69","author":"Wu","year":"2021","journal-title":"IEEE Trans. Commun."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1546","DOI":"10.1109\/COMST.2021.3077737","article-title":"Reconfigurable Intelligent Surfaces: Principles and Opportunities","volume":"23","author":"Liu","year":"2021","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1109\/TWC.2020.3024860","article-title":"Deep Reinforcement Learning-Based Intelligent Reflecting Surface for Secure Wireless Communications","volume":"20","author":"Yang","year":"2021","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"6170","DOI":"10.1109\/TCOMM.2021.3085780","article-title":"Weighted Sum Secrecy Rate Maximization Using Intelligent Reflecting Surface","volume":"69","author":"Niu","year":"2021","journal-title":"IEEE Trans. Commun."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Miao, J., Li, T., Bai, S., Yan, S., and Zhao, Y. (2023). Secrecy capacity enhancement in active IRS-assisted UAV communication system. Sensors, 23.","DOI":"10.3390\/s23094377"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1394","DOI":"10.1109\/LWC.2022.3170849","article-title":"Resource Allocation for Text Semantic Communications","volume":"11","author":"Yan","year":"2022","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Reimers, N., and Gurevych, I. (2019). Sentence-BERT: Sentence embeddings using siamese BERT-networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China, 3\u20137 November 2019, Association for Computational Linguistics.","DOI":"10.18653\/v1\/D19-1410"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"102427","DOI":"10.1016\/j.phycom.2024.102427","article-title":"Multi-IRSs Enhanced UAV Secure Semantic Communication System","volume":"66","author":"Sun","year":"2024","journal-title":"Phys. Commun."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2329","DOI":"10.1109\/TWC.2019.2902559","article-title":"Energy Minimization for Wireless Communication With Rotary-Wing UAV","volume":"18","author":"Zeng","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/18\/5779\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T04:18:44Z","timestamp":1789618724000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/18\/5779"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,11]]},"references-count":38,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["s26185779"],"URL":"https:\/\/doi.org\/10.3390\/s26185779","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,11]]}}}