{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,3]],"date-time":"2026-04-03T06:46:24Z","timestamp":1775198784411,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,17]],"date-time":"2021-08-17T00:00:00Z","timestamp":1629158400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In wireless rechargeable sensor networks (WRSNs), a mobile charger (MC) moves around to compensate for sensor nodes\u2019 energy via a wireless medium. In such a context, designing a charging strategy that optimally prolongs the network lifetime is challenging. This work aims to solve the challenges by introducing a novel, on-demand charging algorithm for MC that attempts to maximize the network lifetime, where the term \u201cnetwork lifetime\u201d is defined by the interval from when the network starts till the first target is not monitored by any sensor. The algorithm, named Fuzzy Q-charging, optimizes both the time and location in which the MC performs its charging tasks. Fuzzy Q-charging uses Fuzzy logic to determine the optimal charging-energy amounts for sensors. From that, we propose a method to find the optimal charging time at each charging location. Fuzzy Q-charging leverages Q-learning to determine the next charging location for maximizing the network lifetime. To this end, Q-charging prioritizes the sensor nodes following their roles and selects a suitable charging location where MC provides sufficient power for the prioritized sensors. We have extensively evaluated the effectiveness of Fuzzy Q-charging in comparison to the related works. The evaluation results show that Fuzzy Q-charging outperforms the others. First, Fuzzy Q-charging can guarantee an infinite lifetime in the WSRNs, which have a sufficient large sensor number or a commensurate target number. Second, in other cases, Fuzzy Q-charging can extend the time until the first target is not monitored by 6.8 times on average and 33.9 times in the best case, compared to existing algorithms.<\/jats:p>","DOI":"10.3390\/s21165520","type":"journal-article","created":{"date-parts":[[2021,8,17]],"date-time":"2021-08-17T21:17:06Z","timestamp":1629235026000},"page":"5520","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["An On-Demand Charging for Connected Target Coverage in WRSNs Using Fuzzy Logic and Q-Learning"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6547-7641","authenticated-orcid":false,"given":"Phi Le","family":"Nguyen","sequence":"first","affiliation":[{"name":"The School of Information and Communication Technology, Hanoi University of Science and Technology, Ha Noi 11615, Vietnam"}]},{"given":"Van Quan","family":"La","sequence":"additional","affiliation":[{"name":"The School of Information and Communication Technology, Hanoi University of Science and Technology, Ha Noi 11615, Vietnam"}]},{"given":"Anh Duy","family":"Nguyen","sequence":"additional","affiliation":[{"name":"The School of Information and Communication Technology, Hanoi University of Science and Technology, Ha Noi 11615, Vietnam"}]},{"given":"Thanh Hung","family":"Nguyen","sequence":"additional","affiliation":[{"name":"The School of Information and Communication Technology, Hanoi University of Science and Technology, Ha Noi 11615, Vietnam"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0400-3084","authenticated-orcid":false,"given":"Kien","family":"Nguyen","sequence":"additional","affiliation":[{"name":"The Graduate School of Engineering, Chiba University, 1-33, Yayoi-cho, Inage-ku, Chiba 263-8522, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1109\/TETC.2017.2687319","article-title":"A Disaster Management-Oriented Path Planning for Mobile Anchor Node-Based Localization in Wireless Sensor Networks","volume":"8","author":"Han","year":"2017","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.compag.2015.08.011","article-title":"Wireless sensor networks for agriculture: The state-of-the-art in practice and future challenges","volume":"118","author":"Ojha","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102439","DOI":"10.1016\/j.jnca.2019.102439","article-title":"TELPAC: A time and energy efficient protocol for locating and patching coverage holes in WSNs","volume":"147","author":"Nguyen","year":"2019","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Le Nguyen, P., Ji, Y., Le, K., and Nguyen, T. (2018, January 12\u201315). Load balanced and constant stretch routing in the vicinity of holes in WSNs. Proceedings of the 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC), Las Vegas, NV, USA.","DOI":"10.1109\/CCNC.2018.8319190"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hanh, N.T., Le Nguyen, P., Tuyen, P.T., Binh, H.T.T., Kurniawan, E., and Ji, Y. (2018, January 12\u201315). Node placement for target coverage and network connectivity in WSNs with multiple sinks. Proceedings of the 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC), Las Vegas, NV, USA.","DOI":"10.1109\/CCNC.2018.8319207"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1016\/j.asoc.2018.11.022","article-title":"Periodic charging planning for a mobile WCE in wireless rechargeable sensor networks based on hybrid PSO and GA algorithm","volume":"75","author":"Lyu","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2250","DOI":"10.1109\/TNET.2017.2684159","article-title":"Joint Charging Tour Planning and Depot Positioning for Wireless Sensor Networks Using Mobile Chargers","volume":"25","author":"Jiang","year":"2017","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1591","DOI":"10.1109\/TNET.2018.2841420","article-title":"Charging Utility Maximization in Wireless Rechargeable Sensor Networks by Charging Multiple Sensors Simultaneously","volume":"26","author":"Ma","year":"2018","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xu, W., Liang, W., Kan, H., Xu, Y., and Zhang, X. (2019, January 7\u201310). Minimizing the Longest Charge Delay of Multiple Mobile Chargers for Wireless Rechargeable Sensor Networks by Charging Multiple Sensors Simultaneously. Proceedings of the 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS), Dallas, TX, USA.","DOI":"10.1109\/ICDCS.2019.00092"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lin, C., Zhou, Y., Ma, F., Deng, J., Wang, L., and Wu, G. (May, January 29). Minimizing Charging Delay for Directional Charging in Wireless Rechargeable Sensor Networks. Proceedings of the IEEE INFOCOM 2019-IEEE Conference on Computer Communications, Paris, France.","DOI":"10.1109\/INFOCOM.2019.8737589"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Feng, Y., Liu, N., Wang, F., Qian, Q., and Li, X. (2016, January 22\u201327). Starvation avoidance mobile energy replenishment for wireless rechargeable sensor networks. Proceedings of the 2016 IEEE International Conference on Communications (ICC), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICC.2016.7510769"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1109\/TMC.2017.2703094","article-title":"TSCA: A Temporal-Spatial Real-Time Charging Scheduling Algorithm for On-Demand Architecture in Wireless Rechargeable Sensor Networks","volume":"17","author":"Lin","year":"2018","journal-title":"IEEE Trans. Mobile Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.comnet.2018.10.023","article-title":"Double warning thresholds for preemptive charging scheduling in Wireless Rechargeable Sensor Networks","volume":"148","author":"Lin","year":"2019","journal-title":"Comput. Netw."},{"key":"ref_14","first-page":"2715","article-title":"A Fuzzy Logic-based On-demand Charging Algorithm for Wireless Rechargeable Sensor Networks with Multiple Chargers","volume":"1233","author":"Tomar","year":"2020","journal-title":"IEEE Trans. Mobile Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"102278","DOI":"10.1016\/j.adhoc.2020.102278","article-title":"A Deep Reinforcement Learning-Based On-Demand Charging Algorithm for Wireless Rechargeable Sensor Networks","volume":"110","author":"Cao","year":"2020","journal-title":"Ad Hoc Netw."},{"key":"ref_16","first-page":"28","article-title":"Adaptive online mobile charging for node failure avoidance in wireless rechargeable sensor networks","volume":"126","author":"Zhu","year":"2018","journal-title":"Comput. Netw."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.jnca.2018.02.017","article-title":"An efficient scheduling scheme for mobile charger in on-demand wireless rechargeable sensor networks","volume":"114","author":"Kaswan","year":"2018","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Xu, W., Liang, W., Jia, X., and Xu, Z. (2016, January 27\u201330). Maximizing Sensor Lifetime in a Rechargeable Sensor Network via Partial Energy Charging on Sensors. Proceedings of the 2016 13th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON), London, UK.","DOI":"10.1109\/SAHCN.2016.7733001"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1007\/978-981-13-3600-3_16","article-title":"Hybrid Neuro-fuzzy Method for Data Analysis of Brain Activity Using EEG Signals","volume":"900","author":"Krishnamurthi","year":"2019","journal-title":"Soft Comput. Signal Process."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Behera, S.K., Jena, L., Rath, A.K., and Sethy, P.K. (2018, January 3\u20135). Disease Classification and Grading of Orange Using Machine Learning and Fuzzy Logic. Proceedings of the 2018 International Conference on Communication and Signal Processing (ICCSP), Chennai, India.","DOI":"10.1109\/ICCSP.2018.8524415"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1109\/TFUZZ.2018.2864940","article-title":"Finite-Time Convergence Adaptive Fuzzy Control for Dual-Arm Robot with Unknown Kinematics and Dynamics","volume":"27","author":"Yang","year":"2019","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1016\/j.ins.2017.10.032","article-title":"A generalized type-2 fuzzy logic approach for dynamic parameter adaptation in bee colony optimization applied to fuzzy controller design","volume":"460\u2013461","author":"Castillo","year":"2018","journal-title":"Inf. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"26438","DOI":"10.1109\/ACCESS.2018.2832448","article-title":"Channel Access Scheme With Alignment Reference Interval Adaptation (ARIA) for Frequency Reuse in Unlicensed Band LTE: Fuzzy Q-Learning Approach","volume":"6","author":"Yang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1459","DOI":"10.1007\/s11277-019-06795-z","article-title":"Energy Efficient Fuzzy Routing Protocol for Wireless Sensor Networks","volume":"110","author":"Jain","year":"2020","journal-title":"Wirel. Pers. Commun."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1007\/s11277-019-06483-y","article-title":"Fuzzy and PSO Based Clustering Scheme in Underwater Acoustic Sensor Networks Using Energy and Distance Parameters","volume":"108","author":"Krishnaswamy","year":"2019","journal-title":"Wirel. Pers. Commun."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1829","DOI":"10.1007\/s11276-017-1635-6","article-title":"On-demand fuzzy clustering and ant-colony optimisation based mobile data collection in wireless sensor network","volume":"25","author":"Ghosh","year":"2019","journal-title":"Wirel. Netw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1186\/s13638-019-1374-8","article-title":"Similarity-aware data aggregation using fuzzy c-means approach for wireless sensor networks","volume":"2019","author":"Wan","year":"2019","journal-title":"EURASIP J. Wirel. Commun. Netw."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.apenergy.2018.03.017","article-title":"Fuzzy Q-Learning for multi-agent decentralized energy management in microgrids","volume":"219","author":"Kofinas","year":"2018","journal-title":"Appl. Energy"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1007\/s00521-017-3106-5","article-title":"A fuzzy reinforcement learning approach to thermal unit commitment problem","volume":"31","author":"Avin","year":"2019","journal-title":"Neural Comput. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Van Quan, L., Nguyen, P.L., Nguyen, T.H., and Nguyen, K. (2020, January 24\u201327). Q-learning-based, Optimized On-demand Charging Algorithm in WRSN. Proceedings of the 2020 IEEE 19th International Symposium on Network Computing and Applications (NCA), Cambridge, MA, USA.","DOI":"10.1109\/NCA51143.2020.9306695"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1931","DOI":"10.1109\/TMC.2012.161","article-title":"Energy Provisioning in Wireless Rechargeable Sensor Networks","volume":"12","author":"He","year":"2013","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Karp, B., and Kung, H.T. (2000, January 6\u201311). GPSR: Greedy Perimeter Stateless Routing for Wireless Networks. Proceedings of the 6th Annual International Conference on Mobile Computing and Networking, Boston, MA, USA.","DOI":"10.1145\/345910.345953"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/98.878533","article-title":"GPS-less low-cost outdoor localization for very small devices","volume":"7","author":"Bulusu","year":"2000","journal-title":"IEEE Pers. Commun."},{"key":"ref_34","unstructured":"Fang, Q., Gao, J., and Guibas, L.J. (2004, January 7\u201311). Locating and bypassing routing holes in sensor networks. Proceedings of the IEEE INFOCOM, Hong Kong, China."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Yu, F., Park, S., Tian, Y., Jin, M., and Kim, S. (2008, January 11\u201314). Efficient Hole Detour Scheme for Geographic Routing in Wireless Sensor Networks. Proceedings of the VTC Spring 2008-IEEE Vehicular Technology Conference, Marina Bay, Singapore.","DOI":"10.1109\/VETECS.2008.44"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kim, S., Kim, C., Cho, H., Yim, Y., and Kim, S. (2016, January 23\u201325). Void Avoidance Scheme for Real-Time Data Dissemination in Irregular Wireless Sensor Networks. Proceedings of the 2016 IEEE 30th International Conference on Advanced Information Networking and Applications (AINA), Crans-Montana, Switzerland.","DOI":"10.1109\/AINA.2016.59"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Tian, Y., Yu, F., Choi, Y., Park, S., Lee, E., Jin, M., and Kim, S.-H. (2008, January 19\u201323). Energy-Efficient Data Dissemination Protocol for Detouring Routing Holes in Wireless Sensor Networks. Proceedings of the 2008 IEEE International Conference on Communications, Beijing, China.","DOI":"10.1109\/ICC.2008.442"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1049\/iet-com.2010.0266","article-title":"Geographic hole-bypassing forwarding protocol for wireless sensor networks","volume":"5","author":"Li","year":"2011","journal-title":"IET Commun."},{"key":"ref_39","first-page":"18:1","article-title":"A Low-Stretch-Guaranteed and Lightweight Geographic Routing Protocol for Large-Scale Wireless Sensor Networks","volume":"11","author":"Won","year":"2014","journal-title":"ACM Trans. Sens. Netw. (TOSN)"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/j.comnet.2017.10.001","article-title":"Distributed Hole-Bypassing Protocol in WSNs with Constant Stretch and Load Balancing","volume":"129","author":"Nguyen","year":"2017","journal-title":"Comput. Netw."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Nguyen, P., Ji, Y., Trung, N.T., and Hung, N.T. (November, January 30). Constant stretch and load balanced routing protocol for bypassing multiple holes in wireless sensor networks. Proceedings of the 2017 IEEE 16th International Symposium on Network Computing and Applications (NCA), Cambridge, MA, USA.","DOI":"10.1109\/NCA.2017.8171330"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1339","DOI":"10.1109\/TMC.2017.2771424","article-title":"Energy-Aware Dual-Path Geographic Routing to Bypass Routing Holes in Wireless Sensor Networks","volume":"17","author":"Huang","year":"2018","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1109\/TVT.2015.2391119","article-title":"Optimal Charging in Wireless Rechargeable Sensor Networks","volume":"65","author":"Fu","year":"2016","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2950","DOI":"10.30684\/etj.34.15A.15","article-title":"Distance Estimation Based on RSSI and Log-Normal Shadowing Models for ZigBee Wireless Sensor Network","volume":"34","author":"Mohammed","year":"2016","journal-title":"Eng. Technol. J."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5520\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:45:26Z","timestamp":1760165126000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5520"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,17]]},"references-count":44,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21165520"],"URL":"https:\/\/doi.org\/10.3390\/s21165520","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,17]]}}}