{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T16:30:44Z","timestamp":1778171444008,"version":"3.51.4"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,7,16]],"date-time":"2021-07-16T00:00:00Z","timestamp":1626393600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62072320"],"award-info":[{"award-number":["62072320"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Open Foundation of State Key Laboratory of Networking and Switching Technology","award":["SKLNST-2019-2-06"],"award-info":[{"award-number":["SKLNST-2019-2-06"]}]},{"name":"Scientific Research Fund of Sichuan Provincial Education Department","award":["18ZA0404"],"award-info":[{"award-number":["18ZA0404"]}]},{"name":"Opening Project of Visual Computing and Virtual Reality Key Laboratory of Sichuan Province","award":["SCVCVR2018.02VS"],"award-info":[{"award-number":["SCVCVR2018.02VS"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2021,11,30]]},"abstract":"<jats:p>\n            Wireless charging has been demonstrated as a promising technology for prolonging device operational lifetimes in\n            <jats:bold>Wireless Rechargeable Networks<\/jats:bold>\n            (\n            <jats:bold>WRNs<\/jats:bold>\n            ). To schedule a mobile charger to move along a predesigned trajectory to charge devices, most existing studies assume that the precise location information of devices is already known. Unfortunately, this assumption does not always hold in real mobile application, because the activities of the vast majority of mobile devices carried by mobile agents appear dynamic and random. To the best of our knowledge, this is the first work to study how to wirelessly charge mobile devices with non-deterministic mobility. We aim to provide effective charging service to them, subject to the energy capacity of the mobile charger. We formalize the effective charging problem as a\n            <jats:bold>charging reward maximization problem<\/jats:bold>\n            (\n            <jats:bold>CRMP<\/jats:bold>\n            ), where the amount of reward obtained by charging a device is inversely proportional to the residual lifetime of the device. Then, we prove that CRMP is NP-hard. To derive an effective charging heuristic, an algorithm based on\n            <jats:bold>Reinforcement Learning<\/jats:bold>\n            (\n            <jats:bold>RL<\/jats:bold>\n            ) is proposed. The evaluation results show that the RL-based charging algorithm achieves excellent charging effectiveness. We further interpret the learned heuristic to gain deep and valuable insights into the design options.\n          <\/jats:p>","DOI":"10.1145\/3453682","type":"journal-article","created":{"date-parts":[[2021,7,16]],"date-time":"2021-07-16T14:18:36Z","timestamp":1626445116000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["RLC: A Reinforcement Learning-Based Charging Algorithm\u00a0for Mobile Devices"],"prefix":"10.1145","volume":"17","author":[{"given":"Tang","family":"Liu","sequence":"first","affiliation":[{"name":"Sichuan Normal University; State Key Laboratory of Networking and Switching Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Baijun","family":"Wu","sequence":"additional","affiliation":[{"name":"University of Louisiana at Lafayette, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenzheng","family":"Xu","sequence":"additional","affiliation":[{"name":"Sichuan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xianbo","family":"Cao","sequence":"additional","affiliation":[{"name":"Sichuan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Peng","sequence":"additional","affiliation":[{"name":"Sichuan University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongyi","family":"Wu","sequence":"additional","affiliation":[{"name":"Old Dominion University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,7,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/3026877.3026899"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.3390\/s16091466"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/92.845896"},{"key":"e_1_2_1_4_1","volume-title":"Network Optimization: Continuous and Discrete Models. Citeseer.","author":"Bertsekas Dimitri P.","year":"1998","unstructured":"Dimitri P. Bertsekas . 1998 . Network Optimization: Continuous and Discrete Models. Citeseer. Dimitri P. Bertsekas. 1998. Network Optimization: Continuous and Discrete Models. Citeseer."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2020.102278"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2942358.2942364"},{"key":"e_1_2_1_7_1","unstructured":"Cisco. 2020. Cisco Aironet 1840 Series Access Points Data Sheet. Retrieved from https:\/\/www.cisco.com\/c\/en\/us\/products\/collateral\/wireless\/aironet-1840-series-access-points\/datasheet-c78-742125.html.  Cisco. 2020. Cisco Aironet 1840 Series Access Points Data Sheet. Retrieved from https:\/\/www.cisco.com\/c\/en\/us\/products\/collateral\/wireless\/aironet-1840-series-access-points\/datasheet-c78-742125.html."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2018.2793949"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2018.2887381"},{"key":"e_1_2_1_10_1","volume-title":"Mobile-to-mobile energy replenishment in mission-critical robotic sensor networks","author":"He Liang","unstructured":"Liang He , Peng Cheng , Yu Gu , Jianping Pan , Ting Zhu , and Cong Liu . 2014. Mobile-to-mobile energy replenishment in mission-critical robotic sensor networks . In IEEE INFOCOM. 1195\u20131203. Liang He, Peng Cheng, Yu Gu, Jianping Pan, Ting Zhu, and Cong Liu. 2014. Mobile-to-mobile energy replenishment in mission-critical robotic sensor networks. In IEEE INFOCOM. 1195\u20131203."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2014.2368557"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1137\/0110015"},{"key":"e_1_2_1_13_1","volume-title":"Sobel","author":"Heyman Daniel P.","year":"2004","unstructured":"Daniel P. Heyman and Matthew J . Sobel . 2004 . Stochastic Models in Operations Research : Stochastic Optimization. Vol. 2 . Courier Corporation . Daniel P. Heyman and Matthew J. Sobel. 2004. Stochastic Models in Operations Research: Stochastic Optimization. Vol. 2. Courier Corporation."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2014.02.011"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2018.2857338"},{"key":"e_1_2_1_16_1","volume-title":"Battery materials for ultrafast charging and discharging. Nature 458, 7235","author":"Kang Byoungwoo","year":"2009","unstructured":"Byoungwoo Kang and Gerbrand Ceder . 2009. Battery materials for ultrafast charging and discharging. Nature 458, 7235 ( 2009 ), 190. Byoungwoo Kang and Gerbrand Ceder. 2009. Battery materials for ultrafast charging and discharging. Nature 458, 7235 (2009), 190."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295382"},{"key":"e_1_2_1_18_1","volume-title":"Wireless power transfer via strongly coupled magnetic resonances. Science 317, 5834","author":"Kurs Andre","year":"2007","unstructured":"Andre Kurs , Aristeidis Karalis , Robert Moffatt , John D. Joannopoulos , Peter Fisher , and Marin Solja\u010di\u0107 . 2007. Wireless power transfer via strongly coupled magnetic resonances. Science 317, 5834 ( 2007 ), 83\u201386. Andre Kurs, Aristeidis Karalis, Robert Moffatt, John D. Joannopoulos, Peter Fisher, and Marin Solja\u010di\u0107. 2007. Wireless power transfer via strongly coupled magnetic resonances. Science 317, 5834 (2007), 83\u201386."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2898357"},{"key":"e_1_2_1_20_1","volume-title":"3DCS: A 3-D dynamic collaborative scheduling scheme for wireless rechargeable sensor networks with heterogeneous chargers","author":"Lin Chi","unstructured":"Chi Lin , Chunyang Guo , Jing Deng , and Guowei Wu. 2018. 3DCS: A 3-D dynamic collaborative scheduling scheme for wireless rechargeable sensor networks with heterogeneous chargers . In IEEE ICDCS. 311\u2013320. Chi Lin, Chunyang Guo, Jing Deng, and Guowei Wu. 2018. 3DCS: A 3-D dynamic collaborative scheduling scheme for wireless rechargeable sensor networks with heterogeneous chargers. In IEEE ICDCS. 311\u2013320."},{"key":"e_1_2_1_21_1","volume-title":"mTS: Temporal- and spatial-collaborative charging for wireless rechargeable sensor networks with multiple vehicles","author":"Lin Chi","unstructured":"Chi Lin , Zhiyuan Wang , Jing Deng , Lei Wang , Jiankang Ren , and Guowei Wu. 2018. mTS: Temporal- and spatial-collaborative charging for wireless rechargeable sensor networks with multiple vehicles . In IEEE INFOCOM. 99\u2013107. Chi Lin, Zhiyuan Wang, Jing Deng, Lei Wang, Jiankang Ren, and Guowei Wu. 2018. mTS: Temporal- and spatial-collaborative charging for wireless rechargeable sensor networks with multiple vehicles. In IEEE INFOCOM. 99\u2013107."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2017.2703094"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2016.2616309"},{"key":"e_1_2_1_24_1","volume-title":"Learning an effective charging scheme for mobile devices","author":"Liu Tang","unstructured":"Tang Liu , Baijun Wu , Wenzheng Xu , Xianbo Cao , Jian Peng , and Hongyi Wu. 2020. Learning an effective charging scheme for mobile devices . In IEEE IPDPS. IEEE. Tang Liu, Baijun Wu, Wenzheng Xu, Xianbo Cao, Jian Peng, and Hongyi Wu. 2020. Learning an effective charging scheme for mobile devices. In IEEE IPDPS. IEEE."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM41043.2020.9155262"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2014.6871666"},{"key":"e_1_2_1_27_1","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Alex Graves Ioannis Antonoglou Daan Wierstra and Martin Riedmiller. 2013. Playing atari with deep reinforcement learning. arXiv:1312.5602. Retrieved from https:\/\/arxiv.org\/abs\/1312.5602.  Volodymyr Mnih Koray Kavukcuoglu David Silver Alex Graves Ioannis Antonoglou Daan Wierstra and Martin Riedmiller. 2013. Playing atari with deep reinforcement learning. arXiv:1312.5602. Retrieved from https:\/\/arxiv.org\/abs\/1312.5602."},{"key":"e_1_2_1_28_1","volume-title":"et\u00a0al","author":"Mnih Volodymyr","year":"2015","unstructured":"Volodymyr Mnih , Koray Kavukcuoglu , David Silver , Andrei A. Rusu , Joel Veness , Marc G. Bellemare , Alex Graves , Martin Riedmiller , Andreas K. Fidjeland , Georg Ostrovski , et\u00a0al . 2015 . Human-level control through deep reinforcement learning. Nature 518, 7540 (2015), 529. Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei A. Rusu, Joel Veness, Marc G. Bellemare, Alex Graves, Martin Riedmiller, Andreas K. Fidjeland, Georg Ostrovski, et\u00a0al. 2015. Human-level control through deep reinforcement learning. Nature 518, 7540 (2015), 529."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/528623"},{"key":"e_1_2_1_30_1","volume-title":"Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et\u00a0al.","author":"Silver David","year":"2016","unstructured":"David Silver , Aja Huang , Chris J. Maddison , Arthur Guez , Laurent Sifre , George Van Den Driessche , Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et\u00a0al. 2016 . Mastering the game of Go with deep neural networks and tree search. Nature 529, 7587 (2016), 484\u2013489. David Silver, Aja Huang, Chris J. Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et\u00a0al. 2016. Mastering the game of Go with deep neural networks and tree search. Nature 529, 7587 (2016), 484\u2013489."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1038\/nphys1760"},{"key":"e_1_2_1_32_1","volume-title":"Limits of predictability in human mobility. Science 327, 5968","author":"Song Chaoming","year":"2010","unstructured":"Chaoming Song , Zehui Qu , Nicholas Blumm , and Albert-L\u00e1szl\u00f3 Barab\u00e1si . 2010. Limits of predictability in human mobility. Science 327, 5968 ( 2010 ), 1018\u20131021. Chaoming Song, Zehui Qu, Nicholas Blumm, and Albert-L\u00e1szl\u00f3 Barab\u00e1si. 2010. Limits of predictability in human mobility. Science 327, 5968 (2010), 1018\u20131021."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3312046"},{"key":"e_1_2_1_34_1","volume-title":"Bundle charging: Wireless charging energy minimization in dense wireless sensor networks","author":"Wang Ning","unstructured":"Ning Wang , Jie Wu , and Haipeng Dai . 2019. Bundle charging: Wireless charging energy minimization in dense wireless sensor networks . In IEEE ICDCS. Ning Wang, Jie Wu, and Haipeng Dai. 2019. Bundle charging: Wireless charging energy minimization in dense wireless sensor networks. In IEEE ICDCS."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-94268-1_40"},{"key":"e_1_2_1_36_1","unstructured":"Wicharge. 2020. Long-Rrange Wireless WI-CHARGERS. https:\/\/wi-charge.com\/product_cat\/transmitters\/.  Wicharge. 2020. Long-Rrange Wireless WI-CHARGERS. https:\/\/wi-charge.com\/product_cat\/transmitters\/."},{"key":"e_1_2_1_37_1","volume-title":"Homing spread: Community home-based multi-copy routing in mobile social networks","author":"Wu Jie","unstructured":"Jie Wu , Mingjun Xiao , and Liusheng Huang . 2013. Homing spread: Community home-based multi-copy routing in mobile social networks . In IEEE INFOCOM. 2319\u20132327. Jie Wu, Mingjun Xiao, and Liusheng Huang. 2013. Homing spread: Community home-based multi-copy routing in mobile social networks. In IEEE INFOCOM. 2319\u20132327."},{"key":"e_1_2_1_38_1","volume-title":"Collaborated tasks-driven mobile charging and scheduling: A near optimal result","author":"Wu Tao","year":"1810","unstructured":"Tao Wu , Panlong Yang , Haipeng Dai , Wanru Xu , and Mingxue Xu. 2019. Collaborated tasks-driven mobile charging and scheduling: A near optimal result . In IEEE INFOCOM. IEEE , 1810 \u20131818. Tao Wu, Panlong Yang, Haipeng Dai, Wanru Xu, and Mingxue Xu. 2019. Collaborated tasks-driven mobile charging and scheduling: A near optimal result. In IEEE INFOCOM. IEEE, 1810\u20131818."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491288.2491291"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2020.2973979"},{"key":"e_1_2_1_41_1","volume-title":"Das","author":"Xu Wenzheng","year":"2020","unstructured":"Wenzheng Xu , Zichuan Xu , Jian Peng , Weifa Liang , Tang Liu , Xiaohua Jia , and Sajal K . Das . 2020 . Approximation algorithms for the team orienteering problem. In IEEE INFOCOM. Wenzheng Xu, Zichuan Xu, Jian Peng, Weifa Liang, Tang Liu, Xiaohua Jia, and Sajal K. Das. 2020. Approximation algorithms for the team orienteering problem. In IEEE INFOCOM."},{"key":"e_1_2_1_42_1","volume-title":"Wireless Rechargeable Sensor Networks","author":"Yang Yuanyuan","unstructured":"Yuanyuan Yang and Cong Wang . 2015. Wireless Rechargeable Sensor Networks . Springer . Yuanyuan Yang and Cong Wang. 2015. Wireless Rechargeable Sensor Networks. Springer."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2013.2297926"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/MDM.2008.20"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1526709.1526816"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3453682","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3453682","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:48Z","timestamp":1750193268000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3453682"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,16]]},"references-count":45,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,11,30]]}},"alternative-id":["10.1145\/3453682"],"URL":"https:\/\/doi.org\/10.1145\/3453682","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"value":"1550-4859","type":"print"},{"value":"1550-4867","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,16]]},"assertion":[{"value":"2020-06-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-07-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}