{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T14:18:30Z","timestamp":1765808310023,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2024,5,11]],"date-time":"2024-05-11T00:00:00Z","timestamp":1715385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Science Foundation","award":["2128656"],"award-info":[{"award-number":["2128656"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Charging stations and electric vehicle (EV) charging networks signify a significant advancement in technology as a frontier application of the Social Internet of Things (SIoT), presenting both challenges and opportunities for current 6G wireless networks. One primary challenge in this integration is limited wireless network resources, particularly when serving a large number of users within distributed EV charging networks in the SIoT. Factors such as congestion during EV travel, varying EV user preferences, and uncertainties in decision-making regarding charging station resources significantly impact system operation and network resource allocation. To address these challenges, this paper develops a novel framework harnessing the potential of emerging technologies, specifically reconfigurable intelligent surfaces (RISs) and causal-structure-enhanced asynchronous advantage actor\u2013critic (A3C) reinforcement learning techniques. This framework aims to optimize resource allocation, thereby enhancing communication support within EV charging networks. Through the integration of RIS technology, which enables control over electromagnetic waves, and the application of causal reinforcement learning algorithms, the framework dynamically adjusts resource allocation strategies to accommodate evolving conditions in EV charging networks. An essential aspect of this framework is its ability to simultaneously meet real-world social requirements, such as ensuring efficient utilization of network resources. Numerical simulation results validate the effectiveness and adaptability of this approach in improving wireless network efficiency and enhancing user experience within the SIoT context. Through these simulations, it becomes evident that the developed framework offers promising solutions to the challenges posed by integrating the SIoT with EV charging networks.<\/jats:p>","DOI":"10.3390\/fi16050165","type":"journal-article","created":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T08:33:03Z","timestamp":1715589183000},"page":"165","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Reconfigurable-Intelligent-Surface-Enhanced Dynamic Resource Allocation for the Social Internet of Electric Vehicle Charging Networks with Causal-Structure-Based Reinforcement Learning"],"prefix":"10.3390","volume":"16","author":[{"given":"Yuzhu","family":"Zhang","sequence":"first","affiliation":[{"name":"Department of Electrical & Biomedical Engineering, University of Nevada, Reno, NV 89557, USA"}]},{"given":"Hao","family":"Xu","sequence":"additional","affiliation":[{"name":"Department of Electrical & Biomedical Engineering, University of Nevada, Reno, NV 89557, USA"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dimitriadou, K., Rigogiannis, N., Fountoukidis, S., Kotarela, F., Kyritsis, A., and Papanikolaou, N. (2023). Current trends in electric vehicle charging infrastructure; opportunities and challenges in wireless charging integration. Energies, 16.","DOI":"10.3390\/en16042057"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4171","DOI":"10.1109\/TITS.2020.3023899","article-title":"Resource efficient vehicle-to-grid (V2G) communication systems for electric vehicle enabled microgrids","volume":"22","author":"Umoren","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1109\/COMST.2020.3029723","article-title":"Challenges and solutions for cellular based V2X communications","volume":"23","author":"Gyawali","year":"2020","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lu, J., and Li, X. (2022, January 9\u201311). The Benefits of Hydrogen Energy Transmission and Conversion Systems to the Renewable Power Grids: Day-ahead Unit Commitment. Proceedings of the 2022 North American Power Symposium (NAPS), Salt Lake City, UT, USA.","DOI":"10.1109\/NAPS56150.2022.10012154"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"16418","DOI":"10.1002\/er.6889","article-title":"Intelligent charging station in 5G environments: Challenges and perspectives","volume":"45","author":"Bizon","year":"2021","journal-title":"Int. J. Energy Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1007\/s12243-022-00938-3","article-title":"5G, 6G, and Beyond: Recent advances and future challenges","volume":"78","author":"Salahdine","year":"2023","journal-title":"Ann. Telecommun."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1109\/COMST.2017.2694469","article-title":"A survey on network methodologies for real-time analytics of massive IoT data and open research issues","volume":"19","author":"Verma","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3594","DOI":"10.1016\/j.comnet.2012.07.010","article-title":"The social internet of things (siot)\u2013when social networks meet the internet of things: Concept, architecture and network characterization","volume":"56","author":"Atzori","year":"2012","journal-title":"Comput. Netw."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"194384","DOI":"10.1109\/ACCESS.2020.3031288","article-title":"Relay-assisted technology in optical wireless communications: A survey","volume":"8","author":"Liu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1016\/0022-4359(95)90020-9","article-title":"Communication flows in distribution channels: Impact on assessments of communication quality and satisfaction","volume":"71","author":"Mohr","year":"1995","journal-title":"J. Retail."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1109\/JIOT.2018.2867334","article-title":"Markov decision-based pilot optimization for 5G V2X vehicular communications","volume":"6","author":"Yang","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2646","DOI":"10.1109\/ACCESS.2022.3140278","article-title":"Reconfigurable Intelligent Surface (RIS) in the Sub-6 GHz Band: Design, Implementation, and Real-World Demonstration","volume":"10","author":"Araghi","year":"2022","journal-title":"IEEE Access"},{"key":"ref_13","first-page":"1698","article-title":"Beam-scanning leaky-wave antennas","volume":"3","author":"Choi","year":"2016","journal-title":"Handb. Antenna Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1109\/MMM.2021.3064118","article-title":"Holographic-based leaky-wave structures: Transformation of guided waves to leaky waves","volume":"22","author":"Araghi","year":"2021","journal-title":"IEEE Microw. Mag."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.trd.2016.08.028","article-title":"The design of electric vehicle charging network","volume":"49","author":"Huang","year":"2016","journal-title":"Transp. Res. Part D Transp. Environ."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mei, A., Morabito, G., Santi, P., and Stefa, J. (2011, January 10\u201315). Social-aware stateless forwarding in pocket switched networks. Proceedings of the 2011 Proceedings IEEE INFOCOM, Shanghai, China.","DOI":"10.1109\/INFCOM.2011.5935076"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"164","DOI":"10.4236\/jcc.2015.35021","article-title":"Internet of Things (IoT): A literature review","volume":"3","author":"Madakam","year":"2015","journal-title":"J. Comput. Commun."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.comcom.2019.03.009","article-title":"Social Internet of Things (SIoT): Foundations, thrust areas, systematic review and future directions","volume":"139","author":"Roopa","year":"2019","journal-title":"Comput. Commun."},{"key":"ref_19","unstructured":"Gasse, M., Grasset, D., Gaudron, G., and Oudeyer, P.Y. (2021). Causal reinforcement learning using observational and interventional data. arXiv."},{"key":"ref_20","unstructured":"Zhu, S., Ng, I., and Chen, Z. (2019). Causal discovery with reinforcement learning. arXiv."},{"key":"ref_21","unstructured":"Babaeizadeh, M., Frosio, I., Tyree, S., Clemons, J., and Kautz, J. (2016). Reinforcement learning through asynchronous advantage actor-critic on a gpu. arXiv."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1839","DOI":"10.1109\/JSAC.2020.3000835","article-title":"Reconfigurable intelligent surface assisted multiuser MISO systems exploiting deep reinforcement learning","volume":"38","author":"Huang","year":"2020","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lee, G., Jung, M., Kasgari, A.T.Z., Saad, W., and Bennis, M. (2020, January 7\u201311). Deep reinforcement learning for energy-efficient networking with reconfigurable intelligent surfaces. Proceedings of the ICC 2020\u20142020 IEEE International Conference on Communications (ICC), Dublin, Ireland.","DOI":"10.1109\/ICC40277.2020.9149380"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"18797","DOI":"10.1109\/ACCESS.2020.2968595","article-title":"Deep Deterministic Policy Gradient (DDPG)-Based Resource Allocation Scheme for NOMA Vehicular Communications","volume":"8","author":"Xu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Saito, Y., Kishiyama, Y., Benjebbour, A., Nakamura, T., Li, A., and Higuchi, K. (2013, January 2\u20135). Non-orthogonal multiple access (NOMA) for cellular future radio access. Proceedings of the 2013 IEEE 77th Vehicular Technology Conference (VTC Spring), Dresden, Germany.","DOI":"10.1109\/VTCSpring.2013.6692652"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"101223","DOI":"10.1016\/j.pmcj.2020.101223","article-title":"An approach to compute the scope of a social object in a Multi-IoT scenario","volume":"67","author":"Cauteruccio","year":"2020","journal-title":"Pervasive Mob. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, J., and Liang, Y.C. (June, January 28). Transmit Beamforming Design for Multiuser Multi-IoT-Device Symbiotic Radios. Proceedings of the ICC 2023-IEEE International Conference on Communications, Rome, Italy.","DOI":"10.1109\/ICC45041.2023.10279394"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.comcom.2020.08.007","article-title":"TOT: Trust aware opportunistic transmission in cognitive radio Social Internet of Things","volume":"162","author":"Wang","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1016\/j.dcan.2022.07.004","article-title":"An effective communication and computation model based on a hybridgraph-deeplearning approach for siot","volume":"8","author":"Mekala","year":"2022","journal-title":"Digit. Commun. Netw."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e1554","DOI":"10.1002\/ecm.1554","article-title":"Applying the structural causal model framework for observational causal inference in ecology","volume":"93","author":"Arif","year":"2023","journal-title":"Ecol. Monogr."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhang, Y., and Xu, H. (2024). Distributed Data-Driven Learning-Based Optimal Dynamic Resource Allocation for Multi-RIS-Assisted Multi-User Ad-Hoc Network. Algorithms, 17.","DOI":"10.3390\/a17010045"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1001\/jama.2022.1816","article-title":"Causal directed acyclic graphs","volume":"327","author":"Lipsky","year":"2022","journal-title":"JAMA"},{"key":"ref_33","unstructured":"Mooij, J.M., Janzing, D., and Sch\u00f6lkopf, B. (2013). From ordinary differential equations to structural causal models: The deterministic case. arXiv."},{"key":"ref_34","unstructured":"Kirk, D.E. (2004). Optimal Control Theory: An Introduction, Courier Corporation."},{"key":"ref_35","unstructured":"Rosu, I. (2024, May 02). The Bellman Principle of Optimality. Available online: http:\/\/faculty.chicagogsb.edu\/ioanid.rosu\/research\/notes\/bellman.pdf."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1719","DOI":"10.1109\/JLT.2015.2398894","article-title":"Channel characteristics of visible light communications within dynamic indoor environment","volume":"33","author":"Chvojka","year":"2015","journal-title":"J. Lightwave Technol."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/5\/165\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:44:16Z","timestamp":1760107456000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/5\/165"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,11]]},"references-count":36,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["fi16050165"],"URL":"https:\/\/doi.org\/10.3390\/fi16050165","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2024,5,11]]}}}