{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T16:55:27Z","timestamp":1773248127009,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2025,4,30]],"date-time":"2025-04-30T00:00:00Z","timestamp":1745971200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Applications of wireless sensor networks have significantly increased in the modern era. These networks operate on a limited power supply in the form of batteries, which are normally difficult to replace on a frequent basis. In wireless sensor networks, sensor nodes alternate between sleep and active states to conserve energy through different methods. Duty cycling is among the most commonly used methods. However, it suffers from problems like unnecessary idle listening, extra energy consumption, and packet drop rate. A Deep Reinforcement Learning-based B-MAC protocol called (RL-BMAC) has been proposed to address this issue. The proposed protocol deploys a deep reinforcement learning agent with fixed hyperparameters to optimize the duty cycling of the nodes. The reinforcement learning agent monitors essential parameters such as energy level, packet drop rate, neighboring nodes\u2019 status, and preamble sampling. The agent stores the information as a representative state and adjusts the duty cycling of all nodes. The performance of RL-BMAC is compared to that of conventional B-MAC through extensive simulations. The results obtained from the simulations indicate that RL-BMAC outperforms B-MAC in terms of throughput by 58.5%, packet drop rate by 44.8%, energy efficiency by 35%, and latency by 26.93%<\/jats:p>","DOI":"10.3390\/info16050369","type":"journal-article","created":{"date-parts":[[2025,4,30]],"date-time":"2025-04-30T05:50:17Z","timestamp":1745992217000},"page":"369","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["RL-BMAC: An RL-Based MAC Protocol for Performance Optimization in Wireless Sensor Networks"],"prefix":"10.3390","volume":"16","author":[{"given":"Owais","family":"Khan","sequence":"first","affiliation":[{"name":"Department of Computer and Software Technology, University of Swat, Swat 19120, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sana","family":"Ullah","sequence":"additional","affiliation":[{"name":"Department of Computer and Software Technology, University of Swat, Swat 19120, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Muzammil","family":"Khan","sequence":"additional","affiliation":[{"name":"Department of Computer and Software Technology, University of Swat, Swat 19120, Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Han-Chieh","family":"Chao","sequence":"additional","affiliation":[{"name":"Department of Applied Informatics, Fo Guang University, Yilan 262307, Taiwan"},{"name":"Department of Artificial Intelligence, Tamkang University, New Taipei 251301, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,4,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Yadav, A.K., and Kumar, A. (2023, January 29\u201330). The Smart Analysis of Prolong Lifetime in Industrial Wireless Sensor Networks. Proceedings of the 2023 International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), Ballar, India.","DOI":"10.1109\/ICDCECE57866.2023.10151049"},{"key":"ref_2","first-page":"1628537","article-title":"WSN Protocols and Security Challenges for Environmental Monitoring Applications: A Survey","volume":"2022","author":"Engmann","year":"2022","journal-title":"J. Sens."},{"key":"ref_3","unstructured":"Ye, W., Heidemann, J., and Estrin, D. (2002, January 23\u201327). An Energy-Efficient MAC Protocol for Wireless Sensor Networks. Proceedings of the Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies, New York, NY, USA."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Polastre, J., Hill, J., and Culler, D. (2004, January 3\u20135). Versatile low power media access for wireless sensor networks. Proceedings of the 2nd International Conference on Embedded Networked Sensor Systems, Baltimore, MD, USA.","DOI":"10.1145\/1031495.1031508"},{"key":"ref_5","unstructured":"Sun, X., Pan, Z., and Bertino, E. (2019, January 26\u201328). Time-Aware and Energy Efficient Data Collection Mechanism for Duty-Cycled Wireless Sensor Networks. Proceedings of the Artificial Intelligence and Security, New York, NY, USA."},{"key":"ref_6","unstructured":"Lee, H., and Kim, S. (2023). Optimizing LoRa Networks with Deep Reinforcement Learning. arXiv."},{"key":"ref_7","first-page":"1993","article-title":"Energy and Security Trade-off in Wireless Sensor Networks using DRL","volume":"24","author":"Sharma","year":"2024","journal-title":"Sensors"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"van Dam, T., and Langendoen, K. (2003, January 5\u20137). An Adaptive Energy-Efficient MAC Protocol for Wireless Sensor Networks. Proceedings of the 1st International Conference on Embedded Networked Sensor Systems, Los Angeles, CA, USA.","DOI":"10.1145\/958491.958512"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"El-Hoiydi, A., and Decotignie, J.D. (2004). WiseMAC: An Ultra Low Power MAC Protocol for Multi-hop Wireless Sensor Networks. International Symposium on Algorithms and Experiments for Sensor Systems, Wireless Networks and Distributed Robotics, Springer.","DOI":"10.1007\/978-3-540-27820-7_4"},{"key":"ref_10","unstructured":"Buettner, M., Yee, G.V., Anderson, E., and Han, R. (November, January 31). X-MAC: A Short Preamble MAC Protocol for Duty-Cycled Wireless Sensor Networks. Proceedings of the 4th International Conference on Embedded Networked Sensor Systems, Boulder, CO, USA."},{"key":"ref_11","unstructured":"van Hoesel, L., and Havinga, P. (2024, January 22\u201323). A Lightweight Medium Access Protocol (LMAC) for Wireless Sensor Networks. Proceedings of the INSS\u201904. Society of Instrument and Control Engineers (SICE), Tokyo, Japan."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rhee, I., Warrier, A., Aia, M., and Min, J. (2005, January 2\u20134). Z-MAC: A Hybrid MAC for Wireless Sensor Networks. Proceedings of the 3rd International Conference on Embedded Networked Sensor Systems, San Diego, CA, USA.","DOI":"10.1145\/1098918.1098929"},{"key":"ref_13","unstructured":"Blok, V. (2022, January 25\u201327). Sleep Scheduling for Enhancing the Lifetime of Three-Dimensional Heterogeneous Wireless Sensor Networks. Proceedings of the CCF Conference on Computer Supported Cooperative Work and Social Computing, Taiyuan, China."},{"key":"ref_14","first-page":"1547","article-title":"Energy aware multilevel clustering scheme with Wake-Up Sleep Algorithm in underwater wireless sensor networks","volume":"18","author":"Pulipati","year":"2023","journal-title":"J. Eng. Appl. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"16043","DOI":"10.1007\/s00521-020-04705-0","article-title":"Evidence of power-law behavior in cognitive IoT applications","volume":"32","author":"Beboratta","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2165","DOI":"10.1109\/JSEN.2017.2665680","article-title":"Energy-aware approaches for energy harvesting powered wireless sensor nodes","volume":"17","author":"Ruan","year":"2017","journal-title":"IEEE Sens. J."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1007\/s00607-021-00951-9","article-title":"IoT-cloud based healthcare model for COVID-19 detection: An enhanced k-nearest neighbour classifier based approach","volume":"105","author":"Mukherjee","year":"2021","journal-title":"Computing"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Magsi, H., Sodhro, A.H., Al-Rakhami, M.S., Zahid, N., Pirbhulal, S., and Wang, L. (2021). A novel adaptive battery-aware algorithm for data transmission in IoT-based healthcare applications. Electronics, 10.","DOI":"10.3390\/electronics10040367"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1049\/iet-com.2015.0368","article-title":"Energy-efficient adaptive transmission power control for wireless body area networks","volume":"10","author":"Sodhro","year":"2016","journal-title":"IET Commun."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"13825","DOI":"10.1109\/JIOT.2021.3086186","article-title":"Task scheduling for energy-harvesting-based IoT: A survey and critical analysis","volume":"8","author":"Sandhu","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_21","first-page":"350","article-title":"Energy aware routing for low energy ad hoc sensor networks","volume":"Volume 1","author":"Shah","year":"2002","journal-title":"Proceedings of the IEEE Wireless Communications and Networking Conference"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1333","DOI":"10.1109\/49.779917","article-title":"Minimum energy mobile wireless networks","volume":"17","author":"Rodoplu","year":"1999","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"Mnih","year":"2015","journal-title":"Nature"},{"key":"ref_25","unstructured":"Konda, V.R., and Tsitsiklis, J.N. (2000, January 1). Actor-critic algorithms. Proceedings of the Advances in Neural Information Processing Systems, Denver, CO, USA."},{"key":"ref_26","unstructured":"Rummery, G.A., and Niranjan, M. (1994). On-Line Q-Learning Using Connectionist Systems, Cambridge University Engineering Department. Technical Report, Technical Report CUED\/F-INFENG\/TR 166."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Van Hasselt, H., Guez, A., and Silver, D. (2016, January 12\u201317). Deep reinforcement learning with double Q-learning. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5755","DOI":"10.1109\/ACCESS.2016.2606541","article-title":"A new energy prediction algorithm for energy-harvesting wireless sensor networks with Q-learning","volume":"4","author":"Kosunalp","year":"2016","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2254","DOI":"10.1016\/j.rser.2017.08.066","article-title":"Forecasting daily global solar irradiance generation using machine learning","volume":"82","author":"Sharma","year":"2018","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.inffus.2018.09.013","article-title":"Machine learning algorithms for wireless sensor networks: A survey","volume":"49","author":"Kumar","year":"2019","journal-title":"Inf. Fusion"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1996","DOI":"10.1109\/COMST.2014.2320099","article-title":"Machine learning in wireless sensor networks: Algorithms, strategies, and applications","volume":"16","author":"Alsheikh","year":"2014","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sharma, H., Haque, A., and Blaabjerg, F. (2021). Machine learning in wireless sensor networks for smart cities: A survey. Electronics, 10.","DOI":"10.3390\/electronics10091012"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3337831","DOI":"10.1155\/2022\/3337831","article-title":"ReLeC: A Reinforcement Learning-Based Clustering-Enhanced Protocol for Efficient Energy Optimization in Wireless Sensor Networks","volume":"2022","author":"Sharma","year":"2022","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Dutta, H., Bhuyan, A.K., and Biswas, S. (2023). Reinforcement Learning for Protocol Synthesis in Resource-Constrained Wireless Sensor and IoT Networks. arXiv.","DOI":"10.1007\/978-3-031-29419-8_14"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Keshtiarast, N., Renaldi, O., and Petrova, M. (2024). Wireless MAC Protocol Synthesis and Optimization with Multi-Agent Distributed Reinforcement Learning. arXiv.","DOI":"10.1109\/LNET.2024.3503289"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kim, H.Y., and Kim, S.C. (2023). A Reinforcement Learning-Based Energy Efficient and QoS Supporting MAC Protocol for Wireless Sensor Networks. J. Southwest Jiaotong Univ., 58.","DOI":"10.35741\/issn.0258-2724.58.1.57"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2827","DOI":"10.1007\/s11042-021-11387-w","article-title":"Reinforcement Learning Based Energy Efficient Protocol for Wireless Multimedia Sensor Networks","volume":"81","author":"Joshi","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_38","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_39","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/5\/369\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:24:54Z","timestamp":1760030694000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/16\/5\/369"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,30]]},"references-count":39,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5]]}},"alternative-id":["info16050369"],"URL":"https:\/\/doi.org\/10.3390\/info16050369","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,30]]}}}