{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T16:50:22Z","timestamp":1780073422709,"version":"3.54.0"},"reference-count":18,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,8,1]],"date-time":"2023-08-01T00:00:00Z","timestamp":1690848000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,3]],"date-time":"2023-08-03T00:00:00Z","timestamp":1691020800000},"content-version":"vor","delay-in-days":2,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010665","name":"H2020 Marie Sk\u0142odowska-Curie Actions","doi-asserted-by":"publisher","award":["872752"],"award-info":[{"award-number":["872752"]}],"id":[{"id":"10.13039\/100010665","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mobile Netw Appl"],"published-print":{"date-parts":[[2023,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Densification of networks through heterogeneous cells deployment is considered a key technology to satisfy the huge traffic growth in future wireless systems. In addition to achieving the required communication capacity and efficiency, another significant challenge arises from the broadcast nature of wireless channels: vulnerability to wiretapping. Physical-layer security is envisaged as an additional level of security to provide confidentiality of radio communications. Typical characteristics of the wireless channel (noise, interference) can be exploited to keep a message confidential from potential eavesdroppers. In particular, heterogeneous networks (HetNet) have inherent security features: while the legitimate user can benefit of the HetNet architecture, the eavesdropper is strongly affected by the inter-cell interference. This paper presents an overview of HetNets intrinsic security benefits, mainly focusing on users association and resource allocation policies. In particular, allocation of radio resources is a poorly investigated topic when related to information security. However, in systems with a large radio resource reuse like HetNets, co-channel interference can be suitably exploited to resist to the eavesdropper. This paper presents a new framework for radio resources allocation using reinforcement learning (Q-learning) to increase the security level in HetNets. A coordinated scheduling among different cells using the same radio resources is proposed based on the exploitation of the spatial information. The goal is to optimize the security at physical layer. The reinforcement learning approach represents a feasible and efficient solution to the proposed problem.<\/jats:p>","DOI":"10.1007\/s11036-023-02149-z","type":"journal-article","created":{"date-parts":[[2023,8,3]],"date-time":"2023-08-03T10:01:56Z","timestamp":1691056916000},"page":"1473-1481","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A new framework for Physical Layer Security in HetNets based on Radio Resource Allocation and Reinforcement Learning"],"prefix":"10.1007","volume":"28","author":[{"given":"Dania","family":"Marabissi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea","family":"Abrardo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lorenzo","family":"Mucchi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,8,3]]},"reference":[{"key":"2149_CR1","doi-asserted-by":"crossref","unstructured":"Wang L, Wong K, Jin S, Zheng G, Heath RW (2018) A new look at physical layer security, caching, and wireless energy harvesting for heterogeneous ultra-dense networks. IEEE Communications Magazine 56(6):49-55","DOI":"10.1109\/MCOM.2018.1700439"},{"key":"2149_CR2","doi-asserted-by":"crossref","unstructured":"Wong CY, Cheng RS, Lataief KB, Murch RD (1999) Multiuser OFDM with adaptive subcarrier, bit, and power allocation. IEEE J Sel Areas Commun 17(10):1747-1758","DOI":"10.1109\/49.793310"},{"key":"2149_CR3","doi-asserted-by":"crossref","unstructured":"] K. I. Ahmed, H. Tabassum, and E. Hossain, Deep Learning for Radio Resource Allocation in Multi-Cell Networks, IEEE Network, November\/December 2019","DOI":"10.1109\/MNET.2019.1900029"},{"key":"2149_CR4","doi-asserted-by":"crossref","unstructured":"Hao Ye, Geoffrey Ye Li, and Biing-Hwang Fred Juang, Deep Reinforcement Learning Based Resource Allocation for V2V Communications, IEEE Transactions in Vehicular Technology, Vol. 68, No. 4, 2019","DOI":"10.1109\/TVT.2019.2897134"},{"key":"2149_CR5","doi-asserted-by":"crossref","unstructured":"Faris B. Mismar , Brian L. Evans , and Ahmed Alkhateeb , Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination, IEEE Transactions on Communications, VOL. 68, NO. 3, 2020","DOI":"10.1109\/TCOMM.2019.2961332"},{"key":"2149_CR6","doi-asserted-by":"crossref","unstructured":"Bloch M, Barros J (2011) Physical-Layer Security: From Information Theory to Security Engineering. Cambridge University Press","DOI":"10.1017\/CBO9780511977985"},{"key":"2149_CR7","doi-asserted-by":"crossref","unstructured":"L. Mucchi, L. Ronga, X. Zhou, K. Huang, Y. Chen, and R. Wang, A new metric for measuring the security of an environment: The secrecy pressure, IEEE Trans Wireless Commun, vol. 16, no. 5, pp. 3416-3430, 2017","DOI":"10.1109\/TWC.2017.2682245"},{"key":"2149_CR8","doi-asserted-by":"crossref","unstructured":"M. Kamel, W. Hamouda, and A. Youssef, Physical layer security in ultra-dense networks, IEEE Wireless Communications Letters, vol. 6, no. 5, pp. 690-693, 2017","DOI":"10.1109\/LWC.2017.2731840"},{"key":"2149_CR9","doi-asserted-by":"crossref","unstructured":"S. Wang, Y. Gao, N. Sha, G. Zhang, and G. Zang, Physical layer security in $$k$$ -tier heterogeneous cellular networks over nakagami- $$m$$ channel during uplink and downlink phases, IEEE Access, vol. 7, pp. 14581-14592, 2019","DOI":"10.1109\/ACCESS.2019.2893246"},{"key":"2149_CR10","doi-asserted-by":"crossref","unstructured":"M.\u00a0Zhou, M.\u00a0Xie, Y.\u00a0Zhang, X.\u00a0Jia, and L.\u00a0Yang, Safeguarding non-best user association aided 5g k-tier hetnets using physical layer security, in 2019 IEEE 89th Vehicular Technology Conference (VTC2019-Spring), 2019, pp. 1-5","DOI":"10.1109\/VTCSpring.2019.8746511"},{"key":"2149_CR11","doi-asserted-by":"crossref","unstructured":"H. Wang, T. Zheng, J. Yuan, D. Towsley, and M. H. Lee, Physical layer security in heterogeneous cellular networks, IEEE Transactions on Communications, vol. 64, no. 3, pp. 1204-1219, 2016","DOI":"10.1109\/TCOMM.2016.2519402"},{"key":"2149_CR12","doi-asserted-by":"crossref","unstructured":"D.\u00a0Marabissi, L.\u00a0Mucchi, and S.\u00a0Casini, Physical-layer security metric for user association in ultra-dense networks, in 2020 International Conference on Computing, Networking and Communications (ICNC), 2020, pp. 487-491","DOI":"10.1109\/ICNC47757.2020.9049809"},{"key":"2149_CR13","doi-asserted-by":"crossref","unstructured":"Y. Wang, Z. Miao, and L. Jiao, Safeguarding the ultra-dense networks with the aid of physical layer security: A review and a case study, IEEE Access, vol. 4, pp. 9082-9092, 2016","DOI":"10.1109\/ACCESS.2016.2635698"},{"key":"2149_CR14","doi-asserted-by":"crossref","unstructured":"X. Wang, M. Tao, J. Mo, and Y. Xu, Power and Subcarrier Allocation for Physical-Layer Security in OFDMA-Based Broadband Wireless Networks, IEEE Transactions on Information Forensics and Security, vol. 6, no. 3 pp. 693-702, 2011","DOI":"10.1109\/TIFS.2011.2159206"},{"key":"2149_CR15","doi-asserted-by":"crossref","unstructured":"K. Zhang, M. Peng, P. Zhang and X. Li, Secrecy-Optimized Resource Allocation for Device-to-Device Communication Underlaying Heterogeneous Networks, IEEE Transactions on Vehicular Technology, vol. 66, no. 2, pp. 1822-1834, 2017","DOI":"10.1109\/TVT.2016.2566298"},{"key":"2149_CR16","doi-asserted-by":"crossref","unstructured":"M. Ahmed, Y. Li, Z. Yinxiao, M. Sheraz, D. Xu and D. Jin, Secrecy Ensured Socially Aware Resource Allocation in Device-to-Device Communications Underlaying HetNet, IEEE Transactions on Vehicular Technology, vol. 68, no. 5, pp. 4933-4948, 2019","DOI":"10.1109\/TVT.2019.2890879"},{"key":"2149_CR17","doi-asserted-by":"crossref","unstructured":", Z. Miao, and Y. Wang, Physical-Layer-Security-Oriented Frequency Allocation in Ultra-Dense-Networks Based on Location Informations, IEEE Access, vol. 7, pp. 90190-90205, 2019","DOI":"10.1109\/ACCESS.2019.2925809"},{"key":"2149_CR18","doi-asserted-by":"crossref","unstructured":"G. Shiqi, X. Chengwen, F. Zesong, and K. Jingming, Resource allocation for physical layer security in heterogeneous network with hidden eavesdropper, China Communications, vol. 13, no. 3, pp. 82-95, 2016","DOI":"10.1109\/CC.2016.7445504"}],"container-title":["Mobile Networks and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11036-023-02149-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11036-023-02149-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11036-023-02149-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,19]],"date-time":"2024-08-19T17:07:55Z","timestamp":1724087275000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11036-023-02149-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8]]},"references-count":18,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,8]]}},"alternative-id":["2149"],"URL":"https:\/\/doi.org\/10.1007\/s11036-023-02149-z","relation":{},"ISSN":["1383-469X","1572-8153"],"issn-type":[{"value":"1383-469X","type":"print"},{"value":"1572-8153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8]]},"assertion":[{"value":"3 December 2021","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 August 2023","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest"}}]}}