{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T13:50:42Z","timestamp":1773841842798,"version":"3.50.1"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T00:00:00Z","timestamp":1726790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2021YFB2900102"],"award-info":[{"award-number":["2021YFB2900102"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62202449 and 62072436"],"award-info":[{"award-number":["62202449 and 62072436"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2024,9,30]]},"abstract":"<jats:p>For mobile robotic networks in industrial scenarios, reliable and energy-efficient communications are crucial yet challenging. Fortunately, collaborative beamforming (CB) emerges as a promising solution, which can increase the transmission gain and reduce the transmit power of robots by constructing a mobile robot-enabled virtual antenna array (MRVAA). The performance of CB is tightly related to robot positions, necessitating proper robot selection. However, robot selection may expose the network to the risk of unbalanced energy distribution, reducing network lifetime. Additionally, the mobility and variable numbers of robots require flexible and scalable robot selection algorithms. To tackle these challenges, we first formulate a multi-objective optimization problem to reduce the maximum sidelobe level (MSLL) of MRVAA while minimizing the standard deviation of the network energy distribution (SDNED) by selecting robots for CB. Then, based on distributed multi-agent learning (MARL), we propose an effective and scalable robot selection algorithm with energy considered (RoSE) to solve the problem, where difference-rewards function (DRF) and policy sharing are designed for enhancing convergence rate and policy stability. Simulation results show that the RoSE has the scalability to positions and numbers of robots. Furthermore, RoSE surpasses existing selection algorithms in network lifetime and time efficiency, while still maintaining comparable MSLL.<\/jats:p>","DOI":"10.1145\/3678011","type":"journal-article","created":{"date-parts":[[2024,8,13]],"date-time":"2024-08-13T11:12:48Z","timestamp":1723547568000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Reliable and Energy-Efficient Communications in Mobile Robotic Networks by Collaborative Beamforming"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1992-2703","authenticated-orcid":false,"given":"Min","family":"He","sequence":"first","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China and University of Chinese Academy of Sciences, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4517-8385","authenticated-orcid":false,"given":"Yali","family":"Chen","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2824-9601","authenticated-orcid":false,"given":"Min","family":"Liu","sequence":"additional","affiliation":[{"name":"Network Technology Research Center, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China, School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China and Zhongguancun Laboratory, Beijing China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6347-6928","authenticated-orcid":false,"given":"Xiaokun","family":"Fan","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China and University of Chinese Academy of Sciences, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7432-7837","authenticated-orcid":false,"given":"Yuchen","family":"Zhu","sequence":"additional","affiliation":[{"name":"Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China and University of Chinese Academy of Sciences, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2024,9,20]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3094374"},{"issue":"3","key":"e_1_3_1_3_2","doi-asserted-by":"crossref","first-page":"3513","DOI":"10.1109\/JSYST.2018.2830395","article-title":"An energy sensitive computation offloading strategy in cloud robotic network based on GA","volume":"13","author":"Guo Yu","year":"2019","unstructured":"Yu Guo, Zhenqiang Mi, Yang Yang, and Mohammad S. Obaidat. 2019. An energy sensitive computation offloading strategy in cloud robotic network based on GA. IEEE Syst. J. 13, 3 (2019), 3513\u20133523.","journal-title":"IEEE Syst. J."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/7012779"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2019.2948068"},{"issue":"4","key":"e_1_3_1_6_2","doi-asserted-by":"crossref","first-page":"2272","DOI":"10.1109\/JIOT.2017.2728722","article-title":"Context-aware cloud robotics for material handling in cognitive industrial Internet of Things","volume":"5","author":"Wan Jiafu","year":"2018","unstructured":"Jiafu Wan, Shenglong Tang, Qingsong Hua, Di Li, Chengliang Liu, and Jaime Lloret. 2018. Context-aware cloud robotics for material handling in cognitive industrial Internet of Things. IEEE Internet Things J. 5, 4 (2018), 2272\u20132281.","journal-title":"IEEE Internet Things J."},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2017.2766635"},{"issue":"5","key":"e_1_3_1_8_2","doi-asserted-by":"crossref","first-page":"5016","DOI":"10.1109\/TVT.2021.3074398","article-title":"SFPAG-R: A reliable routing algorithm based on sealed first-price auction games for industrial Internet of Things networks","volume":"70","author":"Zhang Wenbo","year":"2021","unstructured":"Wenbo Zhang, Xin Wang, Guangjie Han, Yan Peng, and Mohsen Guizani. 2021. SFPAG-R: A reliable routing algorithm based on sealed first-price auction games for industrial Internet of Things networks. IEEE Trans. Veh. Technol. 70, 5 (2021), 5016\u20135027.","journal-title":"IEEE Trans. Veh. Technol."},{"issue":"21","key":"e_1_3_1_9_2","doi-asserted-by":"crossref","first-page":"7107","DOI":"10.3390\/s21217107","article-title":"Reliable control applications with wireless communication technologies: Application to robotic systems","volume":"21","author":"Calvo Isidro","year":"2021","unstructured":"Isidro Calvo, Eneko Villar, Cristian Napole, Aitor Fern\u00e1ndez, Oscar Barambones, and Jos\u00e9 Miguel Gil-Garc\u00eda. 2021. Reliable control applications with wireless communication technologies: Application to robotic systems. Sensors 21, 21 (2021), 7107.","journal-title":"Sensors"},{"key":"e_1_3_1_10_2","first-page":"1","volume-title":"IEEE Global Commun. Conf.","author":"Ozger Mustafa","year":"2018","unstructured":"Mustafa Ozger, Michal Vondra, and Cicek Cavdar. 2018. Towards beyond visual line of sight piloting of UAVs with ultra reliable low latency communication. In IEEE Global Commun. Conf.1\u20136."},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2020.3000416"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2015.2411602"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2017.2661280"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2019.2955948"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.5555\/1803533"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2017.2720690"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11277-016-3403-9"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2948091"},{"key":"e_1_3_1_19_2","first-page":"345","volume-title":"2018 IEEE Int. Conf. iThings., IEEE GreenCom., IEEE CPSCom., IEEE Smart Data","author":"Bao Xuecai","year":"2018","unstructured":"Xuecai Bao, Hao Liang, and Longzhe Han. 2018. A novel node selection algorithm for collaborative beamforming in wireless sensor networks. In 2018 IEEE Int. Conf. iThings., IEEE GreenCom., IEEE CPSCom., IEEE Smart Data. 345\u2013349."},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2930073"},{"key":"e_1_3_1_21_2","first-page":"2974","volume-title":"Proc. 32th AAAI Conf. Artif. Intell.","author":"Foerster Jakob N.","year":"2018","unstructured":"Jakob N. Foerster, Gregory Farquhar, Triantafyllos Afouras, Nantas Nardelli, and Shimon Whiteson. 2018. Counterfactual multi-agent policy gradients. In Proc. 32th AAAI Conf. Artif. Intell.2974\u20132982."},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.2983519"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM42981.2021.9488827"},{"key":"e_1_3_1_24_2","doi-asserted-by":"crossref","first-page":"2336","DOI":"10.1109\/APMC.2009.5385453","volume-title":"2009 Asia Pacific Microw. Conf.","author":"Malik Nik Noordini Nik Abd","year":"2009","unstructured":"Nik Noordini Nik Abd Malik, Mazlina Esa, and Sharifah Kamilah Syed Yusof. 2009. Optimization of adaptive linear sensor node array in wireless sensor network. In 2009 Asia Pacific Microw. Conf.2336\u20132339."},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2015.08.031"},{"key":"e_1_3_1_26_2","first-page":"1","volume-title":"IEEE 90th Veh. Technol. Conf.","author":"Sun Geng","year":"2019","unstructured":"Geng Sun, Xiaohui Zhao, Shuang Liang, Yanheng Liu, Ying Zhang, and Victor C. M. Leung. 2019. A hybrid optimization approach for suppressing sidelobe level and reducing transmission power in collaborative beamforming. In IEEE 90th Veh. Technol. Conf.1\u20136."},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1177\/1550147719877630"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1155\/2013\/125423"},{"key":"e_1_3_1_29_2","first-page":"141","volume-title":"Int. Conf. Commun., Circuits Syst.","author":"Zhang Wei","year":"2013","unstructured":"Wei Zhang, Haifen Yang, Zhen Yang, Letian Huang, and Zhiyong Guo. 2013. Collaborative beamforming for wireless sensor networks with sector-based node selection. In Int. Conf. Commun., Circuits Syst.141\u2013144."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2010.2077631"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2015.2478898"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2018.2873015"},{"issue":"8","key":"e_1_3_1_33_2","doi-asserted-by":"crossref","first-page":"8381","DOI":"10.1109\/TVT.2022.3171313","article-title":"Security energy efficiency analysis of analog collaborative beamforming with stochastic virtual antenna array of UAV swarm","volume":"71","author":"Jung Haejoon","year":"2022","unstructured":"Haejoon Jung, In-Ho Lee, and Jingon Joung. 2022. Security energy efficiency analysis of analog collaborative beamforming with stochastic virtual antenna array of UAV swarm. IEEE Trans. Veh. Technol. 71, 8 (2022), 8381\u20138397.","journal-title":"IEEE Trans. Veh. Technol."},{"issue":"1","key":"e_1_3_1_34_2","doi-asserted-by":"crossref","first-page":"632","DOI":"10.1109\/TVT.2022.3203008","article-title":"RIS-assisted UAV for fresh data collection in 3D urban environments: A deep reinforcement learning approach","volume":"72","author":"Fan Xiaokun","year":"2023","unstructured":"Xiaokun Fan, Min Liu, Yali Chen, Sheng Sun, Zhongcheng Li, and Xiaobing Guo. 2023. RIS-assisted UAV for fresh data collection in 3D urban environments: A deep reinforcement learning approach. IEEE Trans. Veh. Technol. 72, 1 (2023), 632\u2013647.","journal-title":"IEEE Trans. Veh. Technol."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2005.857028"},{"key":"e_1_3_1_36_2","first-page":"1","volume-title":"IEEE INFOCOM 2017 - IEEE Conference on Computer Communications","author":"Wu Yunlong","year":"2017","unstructured":"Yunlong Wu, Bo Zhang, Shaoshi Yang, Xiaodong Yi, and Xuejun Yang. 2017. Energy-efficient joint communication-motion planning for relay-assisted wireless robot surveillance. In IEEE INFOCOM 2017 - IEEE Conference on Computer Communications. 1\u20139."},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11036-008-0150-5"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-023-04534-8"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.3390\/s22062328"},{"issue":"8","key":"e_1_3_1_40_2","doi-asserted-by":"crossref","first-page":"3900","DOI":"10.3390\/s23083900","article-title":"Joint data transmission and energy harvesting for MISO downlink transmission coordination in wireless IoT networks","volume":"23","author":"Liu Jain-Shing","year":"2023","unstructured":"Jain-Shing Liu, Chun-Hung Richard Lin, Yu-Chen Hu, and Praveen Kumar Donta. 2023. Joint data transmission and energy harvesting for MISO downlink transmission coordination in wireless IoT networks. Sensors 23, 8 (2023), 3900.","journal-title":"Sensors"},{"key":"e_1_3_1_41_2","first-page":"8113","volume-title":"Advances Neural Inf. Process. Syst.","author":"Nguyen Duc Thien","year":"2018","unstructured":"Duc Thien Nguyen, Akshat Kumar, and Hoong Chuin Lau. 2018. Credit assignment for collective multiagent RL with global rewards. In Advances Neural Inf. Process. Syst.. Samy Bengio, Hanna M. Wallach, Hugo Larochelle, Kristen Grauman, Nicol\u00f2 Cesa-Bianchi, and Roman Garnett (Eds.), 8113\u20138124."},{"key":"e_1_3_1_42_2","first-page":"6079","volume-title":"33th AAAI Conf. Artif. Intell.","author":"Kim Woojun","year":"2019","unstructured":"Woojun Kim, Myungsik Cho, and Youngchul Sung. 2019. Message-Dropout: An efficient training method for multi-agent deep reinforcement learning. In 33th AAAI Conf. Artif. Intell.6079\u20136086."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.5555\/3327757.3327828"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.3390\/jsan1020123"},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11276-022-03224-1"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TRO.2006.875494"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678011","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3678011","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:54:08Z","timestamp":1750287248000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3678011"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,20]]},"references-count":46,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,9,30]]}},"alternative-id":["10.1145\/3678011"],"URL":"https:\/\/doi.org\/10.1145\/3678011","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"value":"1550-4859","type":"print"},{"value":"1550-4867","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,20]]},"assertion":[{"value":"2024-01-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-02","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}