{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T11:53:42Z","timestamp":1779364422003,"version":"3.53.0"},"reference-count":43,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T00:00:00Z","timestamp":1697155200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Korea Government","award":["RS-2022-00165225"],"award-info":[{"award-number":["RS-2022-00165225"]}]},{"name":"Korea Government","award":["2022-0-01200"],"award-info":[{"award-number":["2022-0-01200"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The enormous increase in heterogeneous wireless devices operating in real-time applications for Internet of Things (IoT) applications presents new challenges, including heterogeneity, reliability, and scalability. To address these issues effectively, a novel architecture has been introduced, combining Software-Defined Wireless Sensor Networks (SDWSN) with the IoT, known as the SDWSN-IoT. However, wireless IoT devices deployed in such systems face limitations in the energy supply, unpredicted network changes, and the quality of service requirements. Such challenges necessitate the careful design of the underlying routing protocol, as failure to address them often results in constantly disconnected networks with poor network performance. In this paper, we present an intelligent, energy-efficient multi-objective routing protocol based on the Reinforcement Learning (RL) algorithm with Dynamic Objective Selection (DOS-RL). The primary goal of applying the proposed DOS-RL routing scheme is to optimize energy consumption in IoT networks, a paramount concern given the limited energy reserves of wireless IoT devices and the adaptability to network changes to facilitate a seamless adaption to sudden network changes, mitigating disruptions and optimizing the overall network performance. The algorithm considers correlated objectives with informative-shaped rewards to accelerate the learning process. Through the diverse simulations, we demonstrated improved energy efficiency and fast adaptation to unexpected network changes by enhancing the packet delivery ratio and reducing data delivery latency when compared to traditional routing protocols such as the Open Shortest Path First (OSPF) and the multi-objective Q-routing for Software-Defined Networks (SDN-Q).<\/jats:p>","DOI":"10.3390\/s23208435","type":"journal-article","created":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T10:16:12Z","timestamp":1697192172000},"page":"8435","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":40,"title":["An Energy-Efficient Routing Protocol with Reinforcement Learning in Software-Defined Wireless Sensor Networks"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4406-6397","authenticated-orcid":false,"given":"Daniel","family":"Godfrey","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Chungnam National University, Daejeon 34134, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"BeomKyu","family":"Suh","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Chungnam National University, Daejeon 34134, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Byung Hyun","family":"Lim","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Chungnam National University, Daejeon 34134, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyu-Chul","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Chungnam National University, Daejeon 34134, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8366-3533","authenticated-orcid":false,"given":"Ki-Il","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Chungnam National University, Daejeon 34134, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1016\/j.scs.2018.01.053","article-title":"Towards sustainable smart cities: A review of trends, architectures, components, and open challenges in smart cities","volume":"38","author":"Silva","year":"2018","journal-title":"Sustain. Cities Soc."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1109\/JIOT.2013.2296516","article-title":"An information framework for creating a smart city through internet of things","volume":"1","author":"Jin","year":"2014","journal-title":"IEEE Internet Things J."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"429","DOI":"10.3390\/smartcities4020024","article-title":"IoT in smart cities: A survey of technologies, practices and challenges","volume":"4","author":"Syed","year":"2021","journal-title":"Smart Cities"},{"key":"ref_4","unstructured":"Mainetti, L., Patrono, L., and Vilei, A. (2011, January 15\u201317). Evolution of wireless sensor networks towards the internet of things: A survey. Proceedings of the IEEE SoftCOM 2011, 19th International Conference on Software, Telecommunications and Computer Networks, Split, Croatia."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JIOT.2016.2615180","article-title":"IoT middleware: A survey on issues and enabling technologies","volume":"4","author":"Ngu","year":"2016","journal-title":"IEEE Internet Things J."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"15501477211067740","DOI":"10.1177\/15501477211067740","article-title":"Wireless power transfer and energy harvesting in distributed sensor networks: Survey, opportunities, and challenges","volume":"18","author":"Ijemaru","year":"2022","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.comcom.2011.09.009","article-title":"Cluster size optimization in sensor networks with decentralized cluster-based protocols","volume":"35","author":"Amini","year":"2012","journal-title":"Comput. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1872","DOI":"10.1109\/ACCESS.2017.2666200","article-title":"A survey on software-defined wireless sensor networks: Challenges and design requirements","volume":"5","author":"Kobo","year":"2017","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"95397","DOI":"10.1109\/ACCESS.2019.2928564","article-title":"A survey of networking applications applying the software defined networking concept based on machine learning","volume":"7","author":"Zhao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2233","DOI":"10.1109\/TII.2014.2300753","article-title":"Internet of things in industries: A survey","volume":"10","author":"He","year":"2014","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_11","unstructured":"Sharma, N., Shamkuwar, M., and Singh, I. (2019). Internet of Things and Big Data Analytics for Smart Generation, Springer."},{"key":"ref_12","first-page":"1","article-title":"Applications of big data to smart cities","volume":"6","author":"Mohamed","year":"2015","journal-title":"J. Internet Serv. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Nishi, H., and Nakamura, Y. (2020). IoT-based monitoring for smart community. Urban Syst. Des., 335\u2013344.","DOI":"10.1016\/B978-0-12-816055-8.00010-5"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e3677","DOI":"10.1002\/ett.3677","article-title":"An overview of security and privacy in smart cities\u2019 IoT communications","volume":"33","author":"Zahmatkesh","year":"2022","journal-title":"Trans. Emerg. Telecommun. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2395","DOI":"10.1007\/s11277-021-09000-2","article-title":"Architectural design, improvement, and challenges of distributed software-defined wireless sensor networks","volume":"122","author":"Bukar","year":"2022","journal-title":"Wirel. Pers. Commun."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"103341","DOI":"10.1016\/j.csi.2019.03.009","article-title":"Energy efficient and reliable data gathering using internet of software-defined mobile sinks for WSNs-based smart grid applications","volume":"66","author":"Faheem","year":"2019","journal-title":"Comput. Stand. Interfaces"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1896","DOI":"10.1109\/LCOMM.2012.092812.121712","article-title":"Sensor OpenFlow: Enabling software-defined wireless sensor networks","volume":"16","author":"Luo","year":"2012","journal-title":"IEEE Commun. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mathebula, I., Isong, B., Gasela, N., and Abu-Mahfouz, A.M. (2019, January 12\u201314). Analysis of SDN-based security challenges and solution approaches for SDWSN usage. Proceedings of the 2019 IEEE 28th International Symposium on Industrial Electronics (ISIE), Vancouver, BC, Canada.","DOI":"10.1109\/ISIE.2019.8781268"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"23560","DOI":"10.1109\/ACCESS.2022.3153521","article-title":"A survey on machine learning software-defined wireless sensor networks (ml-SDWSNS): Current status and major challenges","volume":"10","author":"Marchegiani","year":"2022","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Shah, S.F.A., Iqbal, M., Aziz, Z., Rana, T.A., Khalid, A., Cheah, Y.N., and Arif, M. (2022). The role of machine learning and the internet of things in smart buildings for energy efficiency. Appl. Sci., 12.","DOI":"10.3390\/app12157882"},{"key":"ref_21","first-page":"100582","article-title":"Energy and latency reductions at the fog gateway using a machine learning classifier","volume":"31","author":"Suryadevara","year":"2021","journal-title":"Sustain. Comput. Inform. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Musaddiq, A., Nain, Z., Ahmad Qadri, Y., Ali, R., and Kim, S.W. (2020). Reinforcement learning-enabled cross-layer optimization for low-power and lossy networks under heterogeneous traffic patterns. Sensors, 20.","DOI":"10.3390\/s20154158"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2595","DOI":"10.1109\/COMST.2018.2846401","article-title":"Deep learning for intelligent wireless networks: A comprehensive survey","volume":"20","author":"Mao","year":"2018","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1996","DOI":"10.1109\/COMST.2014.2320099","article-title":"Machine learning in wireless sensor networks: Algorithms, strategies, and applications","volume":"16","author":"Alsheikh","year":"2014","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1109\/MNET.2017.1700200","article-title":"Machine learning for networking: Workflow, advances and opportunities","volume":"32","author":"Wang","year":"2017","journal-title":"IEEE Netw."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"DeMedeiros, K., Hendawi, A., and Alvarez, M. (2023). A survey of AI-based anomaly detection in IoT and sensor networks. Sensors, 23.","DOI":"10.3390\/s23031352"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Kanawaday, A., and Sane, A. (2017, January 24\u201326). Machine learning for predictive maintenance of industrial machines using IoT sensor data. Proceedings of the 2017 8th IEEE International Conference on Software Engineering and Service Science (ICSESS), Beijing, China.","DOI":"10.1109\/ICSESS.2017.8342870"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"108957","DOI":"10.1016\/j.comnet.2022.108957","article-title":"Energy-aware task scheduling and offloading using deep reinforcement learning in SDN-enabled IoT network","volume":"210","author":"Sellami","year":"2022","journal-title":"Comput. Netw."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ouhab, A., Abreu, T., Slimani, H., and Mellouk, A. (2020, January 7\u201311). Energy-efficient clustering and routing algorithm for large-scale SDN-based IoT monitoring. Proceedings of the ICC 2020\u20142020 IEEE International Conference on Communications (ICC), Dublin, Ireland.","DOI":"10.1109\/ICC40277.2020.9148659"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"8059","DOI":"10.1109\/JIOT.2020.3002427","article-title":"RJCC: Reinforcement-learning-based joint communicational-and-computational resource allocation mechanism for smart city IoT","volume":"7","author":"Xu","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4319","DOI":"10.1109\/JIOT.2018.2859480","article-title":"NetworkAI: An intelligent network architecture for self-learning control strategies in software defined networks","volume":"5","author":"Yao","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3495","DOI":"10.1109\/JIOT.2021.3102130","article-title":"Improving the software-defined wireless sensor networks routing performance using reinforcement learning","volume":"9","author":"Younus","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"64533","DOI":"10.1109\/ACCESS.2018.2877686","article-title":"DROM: Optimizing the routing in software-defined networks with deep reinforcement learning","volume":"6","author":"Yu","year":"2018","journal-title":"IEEE Access"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Andres, A., Villar-Rodriguez, E., Martinez, A.D., and Del Ser, J. (2021, January 18\u201322). Collaborative exploration and reinforcement learning between heterogeneously skilled agents in environments with sparse rewards. Proceedings of the 2021 International Joint Conference on Neural Networks (IJCNN), Virtual.","DOI":"10.1109\/IJCNN52387.2021.9534146"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"55916","DOI":"10.1109\/ACCESS.2019.2913776","article-title":"Reinforcement learning based routing in networks: Review and classification of approaches","volume":"7","author":"Mammeri","year":"2019","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1007\/s00158-009-0460-7","article-title":"The weighted sum method for multi-objective optimization: New insights","volume":"41","author":"Marler","year":"2010","journal-title":"Struct. Multidiscip. Optim."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"4909","DOI":"10.1109\/TITS.2021.3054625","article-title":"Deep reinforcement learning for autonomous driving: A survey","volume":"23","author":"Kiran","year":"2021","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Brys, T., Van Moffaert, K., Now\u00e9, A., and Taylor, M.E. (2014, January 5\u20139). Adaptive objective selection for correlated objectives in multi-objective reinforcement learning. Proceedings of the 2014 International Conference on Autonomous Agents and Multi-Agent Systems, Paris, France.","DOI":"10.1109\/IJCNN.2014.6889637"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1007\/s00607-020-00844-3","article-title":"IEEE 802.15. 4 historical revolution versions: A survey","volume":"103","author":"Alkama","year":"2021","journal-title":"Computing"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3119","DOI":"10.1007\/s11277-017-3987-8","article-title":"A model-based reinforcement learning algorithm for routing in energy harvesting mobile ad-hoc networks","volume":"95","author":"Maleki","year":"2017","journal-title":"Wirel. Pers. Commun."},{"key":"ref_41","first-page":"527","article-title":"Network simulations with the ns-3 simulator","volume":"14","author":"Henderson","year":"2008","journal-title":"SIGCOMM Demonstr."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Yin, H., Liu, P., Liu, K., Cao, L., Zhang, L., Gao, Y., and Hei, X. (2020, January 17\u201318). ns3-ai: Fostering artificial intelligence algorithms for networking research. Proceedings of the 2020 Workshop on ns-3, Gaithersburg, MD, USA.","DOI":"10.1145\/3389400.3389404"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Gaw\u0142owicz, P., and Zubow, A. (2019, January 25\u201329). Ns-3 meets openai gym: The playground for machine learning in networking research. Proceedings of the 22nd International ACM Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems, Miami Beach, FL, USA.","DOI":"10.1145\/3345768.3355908"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8435\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:06:08Z","timestamp":1760130368000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,13]]},"references-count":43,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23208435"],"URL":"https:\/\/doi.org\/10.3390\/s23208435","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,13]]}}}