{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T13:22:27Z","timestamp":1780406547623,"version":"3.54.1"},"reference-count":44,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2020,3,10]],"date-time":"2020-03-10T00:00:00Z","timestamp":1583798400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"DEMIS","award":["57142907"],"award-info":[{"award-number":["57142907"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Over the recent era, Wireless Sensor Network (WSN) has attracted much attention among industrialists and researchers owing to its contribution to numerous applications including military, environmental monitoring and so on. However, reducing the network delay and improving the network lifetime are always big issues in the domain of WSN. To resolve these downsides, we propose an Energy-Efficient Scheduling using the Deep Reinforcement Learning (DRL) (E2S-DRL) algorithm in WSN. E2S-DRL contributes three phases to prolong network lifetime and to reduce network delay that is: the clustering phase, duty-cycling phase and routing phase. E2S-DRL starts with the clustering phase where we reduce the energy consumption incurred during data aggregation. It is achieved through the Zone-based Clustering (ZbC) scheme. In the ZbC scheme, hybrid Particle Swarm Optimization (PSO) and Affinity Propagation (AP) algorithms are utilized. Duty cycling is adopted in the second phase by executing the DRL algorithm, from which, E2S-DRL reduces the energy consumption of individual sensor nodes effectually. The transmission delay is mitigated in the third (routing) phase using Ant Colony Optimization (ACO) and the Firefly Algorithm (FFA). Our work is modeled in Network Simulator 3.26 (NS3). The results are valuable in provisions of upcoming metrics including network lifetime, energy consumption, throughput and delay. From this evaluation, it is proved that our E2S-DRL reduces energy consumption, reduces delays by up to 40% and enhances throughput and network lifetime up to 35% compared to the existing cTDMA, DRA, LDC and iABC methods.<\/jats:p>","DOI":"10.3390\/s20051540","type":"journal-article","created":{"date-parts":[[2020,3,10]],"date-time":"2020-03-10T11:59:36Z","timestamp":1583841576000},"page":"1540","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":72,"title":["Refining Network Lifetime of Wireless Sensor Network Using Energy-Efficient Clustering and DRL-Based Sleep Scheduling"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8993-0332","authenticated-orcid":false,"given":"Ramadhani","family":"Sinde","sequence":"first","affiliation":[{"name":"Department of Information Technology System Development and Management, Nelson-Mandela-AIST, Arusha 23311, Tanzania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Feroza","family":"Begum","sequence":"additional","affiliation":[{"name":"Faculty of Integrated Technologies, Universiti Brunei Darussalam, Gadong BE 1410, Brunei Darussalam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Karoli","family":"Njau","sequence":"additional","affiliation":[{"name":"Department of Water Resources and Environmental Science and Engineering, Nelson-Mandela-AIST, Arusha 23311, Tanzania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9443-957X","authenticated-orcid":false,"given":"Shubi","family":"Kaijage","sequence":"additional","affiliation":[{"name":"Department of Communication Science and Engineering, Nelson-Mandela-AIST, Arusha 23311, Tanzania"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,3,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1049\/iet-wss.2018.5025","article-title":"Design of a novel routing architecture for harsh environment monitoring in heterogeneous WSN","volume":"8","author":"Verma","year":"2018","journal-title":"IET Wirel. Sens. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2019\/7367281","article-title":"A Heterogeneous Energy Wireless Sensor Network Clustering Protocol","volume":"2019","author":"Zeng","year":"2019","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1109\/TSMC.2018.2833204","article-title":"A Low-Latency Communication Scheme for Mobile Wireless Sensor Control Systems","volume":"49","author":"Huang","year":"2018","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_4","first-page":"1","article-title":"Self-Learning-Based Data Aggregation Scheduling Policy in Wireless Sensor Networks","volume":"2018","author":"Lu","year":"2018","journal-title":"J. Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1007\/s12083-018-0647-z","article-title":"Multi working sets alternate covering scheme for continuous partial coverage in WSNs","volume":"12","author":"Huang","year":"2018","journal-title":"Peer-to-Peer Netw. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"340","DOI":"10.1080\/00051144.2019.1637174","article-title":"Optimized cluster head selection using krill herd algorithm for wireless sensor network","volume":"60","author":"Karthick","year":"2019","journal-title":"Automatika"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2575","DOI":"10.1007\/s11277-018-5948-2","article-title":"Proposed Energy Efficient Algorithm for Clustering and Routing in WSN","volume":"103","author":"Morsy","year":"2018","journal-title":"Wirel. Pers. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1007\/s10922-016-9379-7","article-title":"A Genetic Algorithm-Based, Dynamic Clustering Method towards Improved WSN Longevity","volume":"25","author":"Yuan","year":"2016","journal-title":"J. Netw. Syst. Manag."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.jnca.2018.04.005","article-title":"A Pareto optimization-based approach to clustering and routing in Wireless Sensor Networks","volume":"114","author":"Elhabyan","year":"2018","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/j.jksus.2018.04.031","article-title":"Fuzzy based enhanced cluster head selection (FBECS) for WSN","volume":"32","author":"Mehra","year":"2020","journal-title":"J. King Saud Univ. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hamzah, A., Shurman, M., Al-Jarrah, O., and Taqieddin, E. (2019). Energy-Efficient Fuzzy-Logic-Based Clustering Technique for Hierarchical Routing Protocols in Wireless Sensor Networks. Sensors, 19.","DOI":"10.3390\/s19030561"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2019\/3237623","article-title":"Adaptive Fuzzy-Based Energy and Delay-Aware Routing Protocol for a Heterogeneous Sensor Network","volume":"2019","author":"Mothku","year":"2019","journal-title":"J. Comput. Netw. Commun."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"e43","DOI":"10.1002\/itl2.43","article-title":"Context-aware medium access control protocols in wireless sensor networks","volume":"1","author":"Ghrab","year":"2018","journal-title":"Internet Technol. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e4196","DOI":"10.1002\/cpe.4196","article-title":"Dynamic scheming the duty cycle in the opportunistic routing sensor network","volume":"29","author":"Niu","year":"2017","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.inffus.2018.08.005","article-title":"Energy-aware Scheduling for Information Fusion in Wireless Sensor Network Surveillance","volume":"48","author":"Xiao","year":"2018","journal-title":"Inform. Fusion"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3422","DOI":"10.1109\/JSEN.2017.2692246","article-title":"A Distributed Delay-Efficient Data Aggregation Scheduling for Duty-Cycled WSNs","volume":"17","author":"Kang","year":"2017","journal-title":"IEEE Sens. J."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1186\/s13638-018-1108-3","article-title":"Delay-aware tree construction and scheduling for data aggregation in duty-cycled wireless sensor networks","volume":"2018","author":"Le","year":"2018","journal-title":"EURASIP J. Wirel. Commun. Netw."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.jss.2019.05.032","article-title":"A routing algorithm for wireless sensor networks based on clustering and an fpt-approximation algorithm","volume":"155","author":"Yarinezhad","year":"2019","journal-title":"J. Syst. Softw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"106863","DOI":"10.1016\/j.comnet.2019.106863","article-title":"AREOR\u2013Adaptive ranking based energy efficient opportunistic routing scheme in Wireless Sensor Network","volume":"162","author":"Chithaluru","year":"2019","journal-title":"Comput. Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.aeue.2016.12.001","article-title":"Energy efficient cross layer based adaptive threshold routing protocol for WSN","volume":"72","author":"Singh","year":"2017","journal-title":"AEU Int. J. Electron. Commun."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1016\/j.compeleceng.2017.10.007","article-title":"An energy efficient clustering scheme using multilevel routing for wireless sensor network","volume":"69","author":"Muthukumaran","year":"2018","journal-title":"Comput. Electr. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1007\/s11277-017-5064-8","article-title":"Q-MOHRA: QoS Assured Multi-objective Hybrid Routing Algorithm for Heterogeneous WSN","volume":"100","author":"Kulkarni","year":"2017","journal-title":"Wirel. Pers. Commun."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"101029","DOI":"10.1016\/j.pmcj.2019.05.010","article-title":"MOFPL: Multi-objective fractional particle lion algorithm for the energy aware routing in the WSN","volume":"58","author":"Bhardwaj","year":"2019","journal-title":"Pervasive Mob. Comput."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lahane, S.R., and Jariwala, K.N. (2018, January 6\u20139). Network Structured Based Routing Techniques in Wireless Sensor Network. Proceedings of the 2018 3rd International Conference for Convergence in Technology (I2CT), Pune, India.","DOI":"10.1109\/I2CT.2018.8529374"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Fei, X., Wang, Y., Liu, A., and Cao, N. (2017, January 21\u201324). Research on Low Power Hierarchical Routing Protocol in Wireless Sensor Networks. Proceedings of the 2017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC), Guangzhou, China.","DOI":"10.1109\/CSE-EUC.2017.256"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Li, A., and Chen, G. (2018, January 25\u201327). Clustering Routing Algorithm Based on Energy Threshold and Location Distribution for Wireless Sensor Network. Proceedings of the 2018 37th Chinese Control Conference (CCC), Wuhan, China.","DOI":"10.23919\/ChiCC.2018.8484098"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1007\/s11277-018-5341-1","article-title":"Optimal Node Clustering and Scheduling in Wireless Sensor Networks","volume":"100","author":"Mann","year":"2018","journal-title":"Wirel. Pers. Commun."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Nguyen, T., Pan, J., and Dao, T. (2019). A Compact Bat Algorithm for Unequal Clustering in Wireless Sensor Networks. Appl. Sci., 9.","DOI":"10.3390\/app9101973"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1007\/s11277-018-6021-x","article-title":"Data Aggregation in Wireless Sensor Networks Using Firefly Algorithm","volume":"104","author":"Mosavvar","year":"2018","journal-title":"Wirel. Pers. Commun."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kang, J., Sohn, I., and Lee, S.H. (2018). Enhanced Message-Passing Based LEACH Protocol for Wireless Sensor Networks. Sensors, 19.","DOI":"10.3390\/s19010075"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1951","DOI":"10.1007\/s11277-019-06368-0","article-title":"Energy Efficiency Trade-Off between Duty-Cycling and Wake-Up Radio Techniques in IoT Networks","volume":"107","author":"Sosnowski","year":"2019","journal-title":"Wirel. Pers. Commun."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Du, Y., Xu, Y., Xue, L., Wang, L., and Zhang, F. (2019). An Energy-Efficient Cross-Layer Routing Protocol for Cognitive Radio Networks Using Apprenticeship Deep Reinforcement Learning. Energies, 12.","DOI":"10.3390\/en12142829"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Serrano, W. (2019). Deep Reinforcement Learning Algorithms in Intelligent Infrastructure. Infrastructures, 4.","DOI":"10.3390\/infrastructures4030052"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Adam, M.S., Por, L.Y., Hussain, M.R., Khan, N., Ang, T.F., Anisi, M.H., Huang, Z., and Ali, I. (2019). An Adaptive Wake-Up-Interval to Enhance Receiver-Based Ps-Mac Protocol for Wireless Sensor Networks. Sensors, 19.","DOI":"10.3390\/s19173732"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1109\/TWC.2017.2762674","article-title":"A Cooperative Clustering Protocol with Duty Cycling for Energy Harvesting Enabled Wireless Sensor Networks","volume":"17","author":"Bahbahani","year":"2018","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2214","DOI":"10.1109\/JSYST.2017.2751645","article-title":"An Efficient Minimum-Latency Collision-Free Scheduling Algorithm for Data Aggregation in Wireless Sensor Networks","volume":"12","author":"Nguyen","year":"2018","journal-title":"IEEE Syst. J."},{"key":"ref_37","first-page":"259","article-title":"An Enhancement Approach for Reducing the Energy Consumption in Wireless Sensor Networks","volume":"30","author":"Elshrkawey","year":"2018","journal-title":"J. King Saud Univ. Comput. Inf. Sci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.eij.2018.01.002","article-title":"Hybrid meta-heuristic optimization based energy efficient protocol for wireless sensor networks","volume":"19","author":"Kaur","year":"2018","journal-title":"Egypt. Inform. J."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Arora, V.K., Sharma, V., and Sachdeva, M. (2019). A multiple pheromone ant colony optimization scheme, for energy-efficient wireless sensor networks. Soft Comput.","DOI":"10.1007\/s00500-019-03933-4"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"4963","DOI":"10.1007\/s12652-019-01186-5","article-title":"ACO optimized self-organized tree-based energy balance algorithm for wireless sensor network","volume":"10","author":"Arora","year":"2019","journal-title":"J. Ambient Intell. Humaniz. Comput."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/s13673-018-0153-6","article-title":"A multi-hop graph-based approach for an energy-efficient routing protocol in wireless sensor networks","volume":"8","author":"Rhim","year":"2018","journal-title":"Hum. Centric Comput. Inf. Sci."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1420","DOI":"10.1109\/JIOT.2017.2734280","article-title":"A Distributed Routing Algorithm for Data Collection in Low-Duty-Cycle Wireless Sensor Networks","volume":"4","author":"Liu","year":"2017","journal-title":"IEEE Internet Things J."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Jiang, C., Li, T.-S., Liang, J., and Wu, H. (2017). Low-Latency and Energy-Efficient Data Preservation Mechanism in Low-Duty-Cycle Sensor Networks. Sensors, 17.","DOI":"10.3390\/s17051051"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"12727","DOI":"10.1007\/s10586-018-1748-4","article-title":"A cluster based mobile data gathering using SDMA and PSO techniques in WSN","volume":"22","author":"Vijayalakshmi","year":"2018","journal-title":"Clust. Comput."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1540\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:05:55Z","timestamp":1760173555000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/5\/1540"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,10]]},"references-count":44,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2020,3]]}},"alternative-id":["s20051540"],"URL":"https:\/\/doi.org\/10.3390\/s20051540","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,3,10]]}}}