{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,29]],"date-time":"2026-01-29T23:31:48Z","timestamp":1769729508136,"version":"3.49.0"},"reference-count":52,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,12,25]],"date-time":"2023-12-25T00:00:00Z","timestamp":1703462400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development (R&amp;D) Program of China","award":["2022YFB3206800"],"award-info":[{"award-number":["2022YFB3206800"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Full-duplex (FD) and reconfigurable intelligent surface (RIS) are potential technologies for achieving wireless communication effectively. Therefore, in theory, the RIS-aided FD system is supposed to enhance spectral efficiency significantly for the ubiquitous Internet of Things devices in smart cities. However, this technology additionally induces the loop-interference (LI) of RIS on the residual self-interference (SI) of the FD base station, especially in complicated urban outdoor environments, which will somewhat counterbalance the performance benefit. Inspired by this, we first establish an objective and constraints considering the residual SI and LI in two typical urban outdoor scenarios. Then, we decompose the original problem into two subproblems according to the variable types and jointly design the beamforming matrices and phase shifts vector methods. Specifically, we propose a successive convex approximation algorithm and a soft actor\u2013critic deep reinforcement learning-related scheme to solve the subproblems alternately. To prove the effectiveness of our proposal, we introduce benchmarks of RIS phase shifts design for comparison. The simulation results show that the performance of the low-complexity proposed algorithm is only slightly lower than the exhaustive search method and outperforms the fixed-point iteration scheme. Moreover, the proposal in scenario two is more outstanding, demonstrating the application predominance in urban outdoor environments.<\/jats:p>","DOI":"10.3390\/s24010121","type":"journal-article","created":{"date-parts":[[2023,12,25]],"date-time":"2023-12-25T22:59:09Z","timestamp":1703545149000},"page":"121","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Joint Beamforming and Phase Shifts Design for RIS-Aided Multi-User Full-Duplex Systems in Smart Cities"],"prefix":"10.3390","volume":"24","author":[{"given":"Kunbei","family":"Pan","sequence":"first","affiliation":[{"name":"Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China"},{"name":"University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Bin","family":"Zhou","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China"}]},{"given":"Wei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China"}]},{"given":"Cheng","family":"Ju","sequence":"additional","affiliation":[{"name":"Shanghai Institute of Microsystem and Information Technology, Chinese Academy of Sciences, Shanghai 200050, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1109\/MNET.001.1900287","article-title":"A Vision of 6G Wireless Systems: Applications, Trends, Technologies, and Open Research Problems","volume":"34","author":"Saad","year":"2020","journal-title":"IEEE Netw."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Fernando, X., and L\u0103z\u0103roiu, G. (2023). Spectrum Sensing, Clustering Algorithms, and Energy-Harvesting Technology for Cognitive-Radio-Based Internet-of-Things Networks. Sensors, 23.","DOI":"10.3390\/s23187792"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"11891","DOI":"10.1109\/JIOT.2021.3063686","article-title":"Enabling Massive IoT Toward 6G: A Comprehensive Survey","volume":"8","author":"Guo","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Khan, R., Tsiga, N., and Asif, R. (2022). Interference Management with Reflective In-Band Full-Duplex NOMA for Secure 6G Wireless Communication Systems. Sensors, 22.","DOI":"10.3390\/s22072508"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3025","DOI":"10.1109\/TMTT.2019.2896561","article-title":"In-Band Full-Duplex Technology: Techniques and Systems Survey","volume":"67","author":"Kolodziej","year":"2019","journal-title":"IEEE Trans. Microw. Theory Tech."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2729","DOI":"10.1109\/JSAC.2023.3287612","article-title":"Full-Duplex Wireless for 6G: Progress Brings New Opportunities and Challenges","volume":"41","author":"Smida","year":"2023","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1109\/MWC.001.1900534","article-title":"Holographic MIMO Surfaces for 6G Wireless Networks: Opportunities, Challenges, and Trends","volume":"27","author":"Huang","year":"2020","journal-title":"IEEE Wirel. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Selvaraj, M., Vijay, R., Anbazhagan, R., and Rengarajan, A. (2023). Reconfigurable Metasurface: Enabling Tunable Reflection in 6G Wireless Communications. Sensors, 23.","DOI":"10.3390\/s23229166"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"23570","DOI":"10.1109\/JIOT.2022.3203890","article-title":"Reconfigurable Intelligent Surfaces for 6G IoT Wireless Positioning: A Contemporary Survey","volume":"9","author":"Chen","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_10","first-page":"145","article-title":"Depuration based Efficient Coverage Mechanism for Wireless Sensor Network","volume":"8","author":"Ashraf","year":"2020","journal-title":"J. Electr. Comput. Eng. Innov."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, J., Gao, B., Yu, Z., Li, C., Tang, W., Liang, L., Li, X., Jin, S., Cheng, Q., and Cui, T.J. (2022, January 26\u201329). Coverage Enhancement of 5G Commercial Network based on Reconfigurable Intelligent Surface. Proceedings of the 2022 IEEE 96th Vehicular Technology Conference (VTC2022-Fall), London, UK.","DOI":"10.1109\/VTC2022-Fall57202.2022.10012701"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"18672","DOI":"10.1109\/JIOT.2023.3268659","article-title":"Adaptive Modulation based on Nondata-Aided Error Vector Magnitude for Smart Systems in Smart Cities","volume":"10","author":"Yang","year":"2023","journal-title":"IEEE Internet Things J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/MCOM.2015.7263346","article-title":"Prototyping Real-Time Full Duplex Radios","volume":"53","author":"Chung","year":"2015","journal-title":"IEEE Commun. Mag."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1109\/LWC.2020.3042754","article-title":"Approximate Distributions of the Residual Self-Interference Power in Multi-tap Full-Duplex Systems","volume":"10","author":"Abusabah","year":"2021","journal-title":"IEEE Wireless Commun. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"24721","DOI":"10.1109\/JIOT.2022.3194544","article-title":"Tightly Coupled Integration of GNSS, INS, and LiDAR for Vehicle Navigation in Urban Environments","volume":"9","author":"Li","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"11554","DOI":"10.1109\/TVT.2021.3111397","article-title":"Joint Subcarrier Assignment and Power Allocation for OFDMA Full Duplex Distributed Antenna Systems","volume":"70","author":"Liu","year":"2021","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"922","DOI":"10.1109\/LCOMM.2022.3141546","article-title":"Antenna Selection for Full-Duplex Distributed Massive MIMO via the Elite Preservation Genetic Algorithm","volume":"26","author":"Zhu","year":"2022","journal-title":"IEEE Commun. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11432-020-3139-9","article-title":"Joint Optimization of Spectral Efficiency for Cell-Free Massive MIMO with Network-Assisted Full Duplexing","volume":"64","author":"Xia","year":"2021","journal-title":"Sci. China Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4852","DOI":"10.1109\/TCOMM.2022.3174071","article-title":"Joint Power Control and Passive Beamforming in Reconfigurable Intelligent Surface Assisted User-Centric Networks","volume":"70","author":"Lu","year":"2022","journal-title":"IEEE Trans. Commun."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"8216","DOI":"10.1109\/TWC.2022.3164903","article-title":"Joint Beamforming Design for Multiuser MISO Downlink Aided by A Reconfigurable Intelligent Surface and A Relay","volume":"21","author":"Obeed","year":"2022","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"5444","DOI":"10.1109\/TCOMM.2023.3286462","article-title":"RIS-Assisted Self-Interference Mitigation for In-Band Full-Duplex Transceivers","volume":"71","author":"Zhang","year":"2023","journal-title":"IEEE Trans. Commun."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"134733","DOI":"10.1109\/ACCESS.2021.3114713","article-title":"Cooperative Communications for Improving the Performance of Bidirectional Full-Duplex System with Multiple Reconfigurable Intelligent Surfaces","volume":"9","author":"Nguyen","year":"2021","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1629","DOI":"10.1109\/LWC.2022.3169910","article-title":"Joint Beamforming Optimization for RIS-Aided Full-Duplex Communication","volume":"11","author":"Guan","year":"2022","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ku, C.-J., Shen, L.-H., and Feng, K.-T. (2022, January 12\u201315). Reconfigurable Intelligent Surface Assisted Interference Mitigation for 6G Full-Duplex MIMO Communication Systems. Proceedings of the 2022 IEEE 33rd Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Kyoto, Japan.","DOI":"10.1109\/PIMRC54779.2022.9978133"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1563","DOI":"10.1109\/LCOMM.2022.3170061","article-title":"Deep Reinforcement Learning for RIS-Assisted FD Systems: Single or Distributed RIS?","volume":"26","author":"Faisal","year":"2022","journal-title":"IEEE Commun. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1109\/TSP.2021.3049652","article-title":"Multiuser Full-Duplex Two-Way Communications via Intelligent Reflecting Surface","volume":"69","author":"Peng","year":"2021","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3133","DOI":"10.1109\/COMST.2019.2916583","article-title":"Applications of Deep Reinforcement Learning in Communications and Networking: A Survey","volume":"21","author":"Luong","year":"2019","journal-title":"IEEE Commun. Surveys Tutor."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1109\/TVT.2019.2953809","article-title":"Subcarrier Assignment Schemes Based on Q-Learning in Wideband Cognitive Radio Networks","volume":"69","author":"Zhou","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1109\/TCOMM.2019.2961332","article-title":"Deep Reinforcement Learning for 5G Networks: Joint Beamforming, Power Control, and Interference Coordination","volume":"68","author":"Mismar","year":"2020","journal-title":"IEEE Trans. Commun."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2331","DOI":"10.1109\/TCOMM.2021.3051680","article-title":"Antenna Clustering for Simultaneous Wireless Information and Power Transfer in A MIMO Full-Duplex System: A Deep Reinforcement Learning-Based Design","volume":"69","author":"Akrout","year":"2021","journal-title":"IEEE Trans. Commun."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Bo, Z., Li, M., Liu, Y., Liu, Q., Chang, Z., and Hu, Y. (2022, January 10\u201313). Deep Reinforcement Learning based Joint Active and Passive Beamforming Design for RIS-Assisted MISO Systems. Proceedings of the 2022 IEEE Wireless Communications and Networking Conference (WCNC), Austin, TX, USA.","DOI":"10.1109\/WCNC51071.2022.9771666"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1494","DOI":"10.1109\/JPROC.2022.3174030","article-title":"Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces","volume":"110","author":"Alexandropoulos","year":"2022","journal-title":"Proc. IEEE"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"4157","DOI":"10.1109\/TWC.2019.2922609","article-title":"Reconfigurable Intelligent Surfaces for Energy Efficiency in Wireless Communication","volume":"18","author":"Huang","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"202795","DOI":"10.1109\/ACCESS.2020.3031959","article-title":"Intelligent Surfaces for 6G Wireless Networks: A Survey of Optimization and Performance Analysis Techniques","volume":"8","author":"Alghamdi","year":"2020","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1109\/LWC.2020.2980225","article-title":"Hybrid Precoding Design for Reconfigurable Intelligent Surface Aided mmWave Communication Systems","volume":"9","author":"Pradhan","year":"2020","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4896","DOI":"10.1109\/TWC.2014.2334610","article-title":"On the Spectral Efficiency of Full-Duplex Small Cell Wireless Systems","volume":"13","author":"Nguyen","year":"2014","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"8393","DOI":"10.1109\/TWC.2021.3092597","article-title":"Reconfigurable Intelligent Surfaces Aided mmWave NOMA: Joint Power Allocation, Phase Shifts, and Hybrid Beamforming Optimization","volume":"20","author":"Xiu","year":"2021","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"4296","DOI":"10.1109\/TWC.2012.102612.111278","article-title":"Experiment-Driven Characterization of Full-Duplex Wireless Systems","volume":"11","author":"Duarte","year":"2012","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2220","DOI":"10.1109\/TCOMM.2017.2665488","article-title":"Spectral and Energy Efficiencies in Full-Duplex Wireless Information and Power Transfer","volume":"65","author":"Nguyen","year":"2017","journal-title":"IEEE Trans. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"7331","DOI":"10.1109\/TCOMM.2019.2924010","article-title":"Wireless Networks Design in the Era of Deep Learning: Model-Based, AI-Based, or Both?","volume":"67","author":"Zappone","year":"2019","journal-title":"IEEE Trans. Commun."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/JIOT.2020.3025365","article-title":"Reinforcement Learning Meets Wireless Networks: A Layering Perspective","volume":"8","author":"Chen","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3893","DOI":"10.1109\/LCOMM.2021.3117929","article-title":"Deep Reinforcement Learning for Optimizing RIS-Assisted HD-FD Wireless Systems","volume":"25","author":"Faisal","year":"2021","journal-title":"IEEE Commun. Lett."},{"key":"ref_43","unstructured":"Haarnoja, T., Zhou, A., Abbeel, P., and Levine, S. (2018). Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with A Stochastic Actor. arXiv."},{"key":"ref_44","unstructured":"Christodoulou, P. (2019). Soft Actor-Critic for Discrete Action Settings. arXiv."},{"key":"ref_45","unstructured":"Bertsekas, D.P. (2000). Dynamic Programming and Optimal Control, Athena Scientific."},{"key":"ref_46","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."},{"key":"ref_47","unstructured":"Fujimoto, S., Hoof, H.V., and Meger, D. (2018). Addressing Function Approximation Error in Actor-Critic Methods. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"8037","DOI":"10.1109\/TCOMM.2019.2933217","article-title":"Joint Power Control and User Association for NOMA-Based Full-Duplex Systems","volume":"67","author":"Nguyen","year":"2019","journal-title":"IEEE Trans. Commun."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2439","DOI":"10.1109\/TVT.2017.2773506","article-title":"Energy-Efficient Heterogeneous Cellular Networks with Spectrum Underlay and Overlay Access","volume":"67","author":"Tang","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3064","DOI":"10.1109\/TWC.2020.2970061","article-title":"Weighted Sum-Rate Maximization for Reconfigurable Intelligent Surface Aided Wireless Networks","volume":"19","author":"Guo","year":"2020","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Yu, X., Xu, D., and Schober, R. (2019, January 11\u201313). MISO Wireless Communication Systems via Intelligent Reflecting Surfaces: (Invited Paper). Proceedings of the 2019 IEEE\/CIC International Conference on Communications in China (ICCC), Changchun, China.","DOI":"10.1109\/ICCChina.2019.8855810"},{"key":"ref_52","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/121\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:41:57Z","timestamp":1760132517000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/1\/121"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,25]]},"references-count":52,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["s24010121"],"URL":"https:\/\/doi.org\/10.3390\/s24010121","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,25]]}}}