{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T01:27:44Z","timestamp":1780450064000,"version":"3.54.1"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T00:00:00Z","timestamp":1693440000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T00:00:00Z","timestamp":1693440000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Wireless Netw"],"published-print":{"date-parts":[[2024,1]]},"DOI":"10.1007\/s11276-023-03384-8","type":"journal-article","created":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T13:01:50Z","timestamp":1693486910000},"page":"421-436","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["On optimizing the charging trajectory of mobile chargers in wireless sensor networks: a deep reinforcement learning approach"],"prefix":"10.1007","volume":"30","author":[{"given":"Newsha","family":"Nowrozian","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1963-3185","authenticated-orcid":false,"given":"Farzad","family":"Tashtarian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yahya","family":"Forghani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,8,31]]},"reference":[{"key":"3384_CR1","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1016\/j.future.2019.01.021","volume":"98","author":"M Rajasekaran","year":"2019","unstructured":"Rajasekaran, M., Yassine, A., Hossain, M. S., Alhamid, M. F., & Guizani, M. (2019). Autonomous monitoring in healthcare environment: Reward-based energy charging mechanism for IoMT wireless sensing nodes. Future Generation Computer Systems, 98, 565\u2013576.","journal-title":"Future Generation Computer Systems"},{"issue":"279","key":"3384_CR2","first-page":"2332","volume":"7","author":"F Sumi","year":"2018","unstructured":"Sumi, F., Dutta, L., & Sarker, F. (2018). Future with Wireless Power Transfer Technology. J Electr Electron Syst, 7(279), 2332\u20132796.","journal-title":"J Electr Electron Syst"},{"issue":"12","key":"3384_CR3","doi-asserted-by":"publisher","DOI":"10.1002\/dac.3264","volume":"30","author":"F Tashtarian","year":"2017","unstructured":"Tashtarian, F., Sohraby, K., & Varasteh, A. (2017). Multihop data gathering in wireless sensor networks with a mobile sink. International Journal of Communication Systems, 30(12), e3264.","journal-title":"International Journal of Communication Systems"},{"issue":"2","key":"3384_CR4","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1109\/COMST.2015.2499783","volume":"18","author":"X Lu","year":"2015","unstructured":"Lu, X., Wang, P., Niyato, D., Kim, D. I., & Han, Z. (2015). Wireless charging technologies: Fundamental standards and network applications. IEEE Communications Surveys & Tutorials, 18(2), 1413\u20131452.","journal-title":"IEEE Communications Surveys & Tutorials"},{"key":"3384_CR5","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/8035065","author":"F Engmann","year":"2018","unstructured":"Engmann, F., Katsriku, F. A., Abdulai, J.-D., Adu-Manu, K. S., & Banaseka, F. K. (2018). Prolonging the lifetime of wireless sensor networks: a review of current techniques. Wireless Communications and Mobile Computing. https:\/\/doi.org\/10.1155\/2018\/8035065","journal-title":"Wireless Communications and Mobile Computing"},{"issue":"5834","key":"3384_CR6","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1126\/science.1143254","volume":"317","author":"A Kurs","year":"2007","unstructured":"Kurs, A., Karalis, A., Moffatt, R., Joannopoulos, J. D., Fisher, P., & Solja\u010di\u0107, M. (2007). Wireless power transfer via strongly coupled magnetic resonances. Science, 317(5834), 83\u201386.","journal-title":"Science"},{"key":"3384_CR7","doi-asserted-by":"crossref","unstructured":"Peng, Y., Li, Z., Zhang, W., & Qiao, D. (2010). Prolonging sensor network lifetime through wireless charging. In 2010 31st IEEE real-time systems Symposium, (pp. 129\u2013139).","DOI":"10.1109\/RTSS.2010.35"},{"issue":"4","key":"3384_CR8","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1109\/MWC.2013.6590061","volume":"20","author":"L Xie","year":"2013","unstructured":"Xie, L., Shi, Y., Hou, Y. T., & Lou, A. (2013). Wireless power transfer and applications to sensor networks. IEEE Wireless Communications, 20(4), 140\u2013145.","journal-title":"IEEE Wireless Communications"},{"issue":"6","key":"3384_CR9","doi-asserted-by":"publisher","first-page":"1748","DOI":"10.1109\/TNET.2012.2185831","volume":"20","author":"L Xie","year":"2012","unstructured":"Xie, L., Shi, Y., Hou, Y. T., & Sherali, H. D. (2012). Making sensor networks immortal: An energy-renewal approach with wireless power transfer. IEEE\/ACM Transactions on Networking, 20(6), 1748\u20131761.","journal-title":"IEEE\/ACM Transactions on Networking"},{"key":"3384_CR10","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/j.jnca.2018.02.017","volume":"114","author":"A Kaswan","year":"2018","unstructured":"Kaswan, A., Tomar, A., & Jana, P. K. (2018). An efficient scheduling scheme for mobile charger in on-demand wireless rechargeable sensor networks. Journal of Network and Computer Applications, 114, 123\u2013134.","journal-title":"Journal of Network and Computer Applications"},{"issue":"4","key":"3384_CR11","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1109\/MCOM.2015.7081080","volume":"53","author":"Z Ding","year":"2015","unstructured":"Ding, Z., Zhong, C., Ng, D. W. K., Peng, M., Suraweera, H. A., Schober, R., & Poor, H. V. (2015). Application of smart antenna technologies in simultaneous wireless information and power transfer. IEEE Communications Magazine, 53(4), 86\u201393.","journal-title":"IEEE Communications Magazine"},{"issue":"12","key":"3384_CR12","doi-asserted-by":"publisher","first-page":"2657","DOI":"10.3390\/s19122657","volume":"19","author":"X Xu","year":"2019","unstructured":"Xu, X., Chen, L., & Cheng, Z. (2019). Optimizing charging efficiency and maintaining sensor network perpetually in mobile directional charging. Sensors, 19(12), 2657.","journal-title":"Sensors"},{"key":"3384_CR13","doi-asserted-by":"crossref","unstructured":"Lin, C., Zhou, Y., Ma, F., Deng, J., Wang, L., and Wu, G. ( 2019). Minimizing charging delay for directional charging in wireless rechargeable sensor networks. In IEEE INFOCOM Conference on computer communications, (pp. 1819\u20131827).","DOI":"10.1109\/INFOCOM.2019.8737589"},{"key":"3384_CR14","doi-asserted-by":"crossref","unstructured":"Wang, X., Dai, H., Huang, H., Liu, Y., Chen, G., and Dou, W. (2019). Robust scheduling for wireless charger networks. In IEEE INFOCOM Conference on computer communications.(pp. 2323\u20132331).","DOI":"10.1109\/INFOCOM.2019.8737628"},{"key":"3384_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2020.107123","volume":"170","author":"X Ding","year":"2020","unstructured":"Ding, X., Wang, Y., Sun, G., Luo, C., Li, D., Chen, W., & Hu, Q. (2020). Optimal charger placement for wireless power transfer. Computer Networks, 170, 107123.","journal-title":"Computer Networks"},{"key":"3384_CR16","doi-asserted-by":"crossref","unstructured":"Yu, N., Dai, H., Liu, A. X., and Tian, B. (2018). Placement of connected wireless chargers. In IEEE INFOCOM 2018-IEEE Conference on computer communications. (pp. 387\u2013395).","DOI":"10.1109\/INFOCOM.2018.8485934"},{"issue":"6","key":"3384_CR17","doi-asserted-by":"publisher","first-page":"2478","DOI":"10.1109\/TNET.2021.3095280","volume":"29","author":"C Lin","year":"2021","unstructured":"Lin, C., Yang, Z., Dai, H., Cui, L., Wang, L., & Wu, G. (2021). Minimizing charging delay for directional charging. IEEE\/ACM Transactions on Networking., 29(6), 2478\u20132493.","journal-title":"IEEE\/ACM Transactions on Networking."},{"issue":"3","key":"3384_CR18","first-page":"383","volume":"9","author":"N Nowrozian","year":"2021","unstructured":"Nowrozian, N., & Tashtarian, F. (2021). A mobile charger based on wireless power transfer technologies: a survey of concepts, techniques, challenges, and applications on rechargeable wireless sensor networks. Journal of AI and Data Mining, 9(3), 383\u2013402.","journal-title":"Journal of AI and Data Mining"},{"issue":"3","key":"3384_CR19","doi-asserted-by":"publisher","first-page":"1750","DOI":"10.1109\/COMST.2022.3189387","volume":"24","author":"A Kaswan","year":"2022","unstructured":"Kaswan, A., Jana, P. K., & Das, S. K. (2022). A survey on mobile charging techniques in wireless rechargeable sensor networks. IEEE Communications Surveys & Tutorials, 24(3), 1750\u20131779.","journal-title":"IEEE Communications Surveys & Tutorials"},{"key":"3384_CR20","doi-asserted-by":"crossref","unstructured":"He, L., Zhuang, Y., Pan, J., and Xu, J. (2010). Evaluating on-demand data collection with mobile elements in wireless sensor networks. In 2010 IEEE 72nd Vehicular Technology Conference-Fall, (pp. 1\u20135).","DOI":"10.1109\/VETECF.2010.5594515"},{"issue":"9","key":"3384_CR21","doi-asserted-by":"publisher","first-page":"1861","DOI":"10.1109\/TMC.2014.2368557","volume":"14","author":"L He","year":"2014","unstructured":"He, L., Kong, L., Gu, Y., Pan, J., & Zhu, T. (2014). Evaluating the on-demand mobile charging in wireless sensor networks. IEEE Transactions on Mobile Computing, 14(9), 1861\u20131875.","journal-title":"IEEE Transactions on Mobile Computing"},{"issue":"7","key":"3384_CR22","doi-asserted-by":"publisher","first-page":"2069","DOI":"10.1007\/s11276-016-1271-6","volume":"23","author":"X Ye","year":"2017","unstructured":"Ye, X., & Liang, W. (2017). Charging utility maximization in wireless rechargeable sensor networks. Wireless Networks, 23(7), 2069\u20132081.","journal-title":"Wireless Networks"},{"issue":"4","key":"3384_CR23","doi-asserted-by":"publisher","first-page":"1591","DOI":"10.1109\/TNET.2018.2841420","volume":"26","author":"Y Ma","year":"2018","unstructured":"Ma, Y., Liang, W., & Xu, W. (2018). Charging utility maximization in wireless rechargeable sensor networks by charging multiple sensors simultaneously. IEEE\/ACM Transactions on Networking, 26(4), 1591\u20131604.","journal-title":"IEEE\/ACM Transactions on Networking"},{"key":"3384_CR24","doi-asserted-by":"crossref","unstructured":"Huang, H., Lin, S., Chen, L., Gao, J., Mamat, A., & Wu, J. (2015). Dynamic mobile charger scheduling in heterogeneous wireless sensor networks. In 2015 IEEE 12th International Conference on mobile ad hoc and sensor systems, (pp. 379\u2013387).","DOI":"10.1109\/MASS.2015.99"},{"key":"3384_CR25","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1016\/j.asoc.2018.11.022","volume":"75","author":"Z Lyu","year":"2019","unstructured":"Lyu, Z., Wei, Z., Pan, J., Chen, H., Xia, C., Han, J., & Shi, L. (2019). Periodic charging planning for a mobile WCE in wireless rechargeable sensor networks based on hybrid PSO and GA algorithm. Applied Soft Computing, 75, 388\u2013403.","journal-title":"Applied Soft Computing"},{"key":"3384_CR26","doi-asserted-by":"crossref","unstructured":"Tomar, A., & Jana, P. K. (2019). Mobile charging of wireless sensor networks for internet of things: a multi-attribute decision making approach. In International Conference on Distributed Computing and Internet Technology, (pp. 309\u2013324). Cham: Springer.","DOI":"10.1007\/978-3-030-05366-6_26"},{"key":"3384_CR27","volume-title":"Introduction to algorithms","author":"TH Cormen","year":"2001","unstructured":"Cormen, T. H. (2001). Introduction to algorithms. The MIT Press."},{"issue":"3","key":"3384_CR28","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","volume":"27","author":"CE Shannon","year":"1948","unstructured":"Shannon, C. E. (1948). A mathematical theory of communication. The Bell System Technical Journal, 27(3), 379\u2013423.","journal-title":"The Bell System Technical Journal"},{"key":"3384_CR29","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1007\/978-3-642-48318-9_3","volume-title":"Multiple attribute decision making","author":"CL Hwang","year":"1981","unstructured":"Hwang, C. L., & Yoon, K. (1981). Methods for multiple attribute decision making. Multiple attribute decision making (pp. 58\u2013191). Springer."},{"key":"3384_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2020.102278","volume":"110","author":"X Cao","year":"2021","unstructured":"Cao, X., Xu, W., Liu, X., Peng, J., & Liu, T. (2021). A deep reinforcement learning-based on-demand charging algorithm for wireless rechargeable sensor networks. Ad Hoc Networks, 110, 102278.","journal-title":"Ad Hoc Networks"},{"key":"3384_CR31","doi-asserted-by":"crossref","unstructured":"Wei, Z., Liu, F., Lyu, Z., Ding, X., Shi, L., & Xia, C. (2018). Reinforcement learning for a novel mobile charging strategy in wireless rechargeable sensor networks. In International Conference on Wireless Algorithms, Systems, and Applications (pp. 485\u2013496). Cham: Springer","DOI":"10.1007\/978-3-319-94268-1_40"},{"key":"3384_CR32","doi-asserted-by":"publisher","first-page":"84258","DOI":"10.1109\/ACCESS.2020.2992127","volume":"8","author":"Z Wei","year":"2020","unstructured":"Wei, Z., Li, M., Wei, Z., Cheng, L., Lyu, Z., & Liu, F. (2020). A novel on-demand charging strategy based on swarm reinforcement learning in WRSNs. IEEE Access, 8, 84258\u201384271.","journal-title":"IEEE Access"},{"key":"3384_CR33","unstructured":"Le Nguyen, P., Nguyen, T. H., & Nguyen, K. (2020). Qlearning-based, optimized on-demand charging algorithm in WRSN. In 2020 IEEE 19th International Symposium on Network Computing and Applications (NCA). (pp. 1\u20138)"},{"issue":"16","key":"3384_CR34","doi-asserted-by":"publisher","first-page":"5520","DOI":"10.3390\/s21165520","volume":"21","author":"PL Nguyen","year":"2021","unstructured":"Nguyen, P. L., La, V. Q., Nguyen, A. D., Nguyen, T. H., & Nguyen, K. (2021). An on-demand charging for connected target coverage in WRSNs using fuzzy logic and Q-Learning. Sensors, 21(16), 5520.","journal-title":"Sensors"},{"issue":"22","key":"3384_CR35","doi-asserted-by":"publisher","first-page":"15267","DOI":"10.1007\/s00521-021-06146-9","volume":"33","author":"SPR Banoth","year":"2021","unstructured":"Banoth, S. P. R., Donta, P. K., & Amgoth, T. (2021). Dynamic mobile charger scheduling with partial charging strategy for WSNs using deep-Qnetworks. Neural Computing and Applications, 33(22), 15267\u201315279.","journal-title":"Neural Computing and Applications"},{"issue":"10","key":"3384_CR36","doi-asserted-by":"publisher","first-page":"8291","DOI":"10.1109\/JIOT.2020.3044684","volume":"8","author":"C Lee","year":"2020","unstructured":"Lee, C., Na, W., Jang, G., Lee, C., & Cho, S. (2020). Energy-efficient and delay-minimizing charging method with a multiple directional mobile charger. IEEE Internet of Things Journal, 8(10), 8291\u20138303.","journal-title":"IEEE Internet of Things Journal"},{"key":"3384_CR37","doi-asserted-by":"crossref","unstructured":"Riccardo Bonetto, V.L., (2020) Chapter 8\u2013Machine learning. In Computing in Communication Networks.","DOI":"10.1016\/B978-0-12-820488-7.00021-9"},{"key":"3384_CR38","unstructured":"Zeng, X. (2019). Reinforcement learning based approach for the navigation of a pipe-inspection robot at sharp pipe corners. Master\u2019s thesis, University of Twente."},{"issue":"10","key":"3384_CR39","doi-asserted-by":"publisher","first-page":"1931","DOI":"10.1109\/TMC.2012.161","volume":"12","author":"S He","year":"2012","unstructured":"He, S., Chen, J., Jiang, F., Yau, D. K., Xing, G., & Sun, Y. (2012). Energy provisioning in wireless rechargeable sensor networks. IEEE Transactions on Mobile Computing, 12(10), 1931\u20131942.","journal-title":"IEEE Transactions on Mobile Computing"}],"container-title":["Wireless Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11276-023-03384-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11276-023-03384-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11276-023-03384-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,19]],"date-time":"2024-01-19T06:09:24Z","timestamp":1705644564000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11276-023-03384-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,31]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["3384"],"URL":"https:\/\/doi.org\/10.1007\/s11276-023-03384-8","relation":{},"ISSN":["1022-0038","1572-8196"],"issn-type":[{"value":"1022-0038","type":"print"},{"value":"1572-8196","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,31]]},"assertion":[{"value":"31 August 2023","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}