{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T16:34:49Z","timestamp":1776530089226,"version":"3.51.2"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,10,20]],"date-time":"2023-10-20T00:00:00Z","timestamp":1697760000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62022088, 61902299, and 62372360"],"award-info":[{"award-number":["62022088, 61902299, and 62372360"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"International Partnership Program of Chinese Academy of Sciences","award":["173321KYSB20200002"],"award-info":[{"award-number":["173321KYSB20200002"]}]},{"name":"Young and Middle-aged Science and Technology Innovation Talent Plan of Shenyang City","award":["RC210482"],"award-info":[{"award-number":["RC210482"]}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"crossref","award":["2019TQ0239 and 2019M663636"],"award-info":[{"award-number":["2019TQ0239 and 2019M663636"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2024,1,31]]},"abstract":"<jats:p>Industrial Wireless Sensor Networks (IWSNs) have been widely used in industrial applications that require highly reliable and real-time wireless transmission. A lot of works have been done to optimize the Relay Node Placement (RNP), which determines the underlying topology of IWSNs and hence impacts the network performance. However, existing RNP algorithms use a fixed communication radius to compute the deployment result at once offline, while ignoring that the radio environment may vary drastically across different locations, also known as radio irregularity. To address this limitation, we propose a Voronoi diagram and Q-learning based RNP (VQRNP) method in this article. Instead of using a fixed communication radius, VQRNP employs the Q-learning algorithm to dynamically update the radio environment of measured areas, uses a Voronoi diagram based method to estimate the radio environment of unmeasured areas, and proposes a coverage extension location selection algorithm to place RNs so as to extend the coverage of the deployed network based on the results estimated by Voronoi diagram based Graph Generating (VGG). In this way, the VQRPN method can adapt itself well to the variation of radio environment and largely speed up the deployment process. Extensive simulations verify that VQRNP significantly outperforms existing RNP algorithms in terms of reliability.<\/jats:p>","DOI":"10.1145\/3617124","type":"journal-article","created":{"date-parts":[[2023,8,23]],"date-time":"2023-08-23T10:53:55Z","timestamp":1692788035000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["A Voronoi Diagram and Q-Learning based Relay Node Placement Method Subject to Radio Irregularity"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3915-1722","authenticated-orcid":false,"given":"Chaofan","family":"Ma","sequence":"first","affiliation":[{"name":"Software College, Zhongyuan University of Technology, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4730-017X","authenticated-orcid":false,"given":"Wei","family":"Liang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and the Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1674-8577","authenticated-orcid":false,"given":"Meng","family":"Zheng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and the Key Laboratory of Networked Control Systems, Chinese Academy of Sciences, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2953-2313","authenticated-orcid":false,"given":"Xiaofang","family":"Xia","sequence":"additional","affiliation":[{"name":"School of Computer Science and Technology, Xidian University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7943-3172","authenticated-orcid":false,"given":"Lin","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Sun Yat-sen University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,10,20]]},"reference":[{"issue":"1","key":"e_1_3_2_2_2","first-page":"823","article-title":"A linear-time algorithm for computing the Voronoi diagram of a convex polygon","volume":"12","author":"Aggarwal A.","year":"2018","unstructured":"A. Aggarwal, L. J. Guibas, J. Saxe, and Peter W. Shor. 2018. A linear-time algorithm for computing the Voronoi diagram of a convex polygon. J. IEEE Syst. 12, 1 (May 2018), 823\u2013833.","journal-title":"J. IEEE Syst."},{"issue":"4","key":"e_1_3_2_3_2","doi-asserted-by":"crossref","first-page":"34:1\u201334:33","DOI":"10.1145\/2240116.2240123","article-title":"Radio link quality estimation in wireless sensor networks: A survey","volume":"8","author":"Baccour N.","year":"2012","unstructured":"N. Baccour, A. Koub\u00e2a, L. Mottola, M. A. Z\u00faniga, H. Youssef, C. A. Boano, and M. Alves. 2012. Radio link quality estimation in wireless sensor networks: A survey. ACM Trans. Sensor Netw. 8, 4 (June 2012), 34:1\u201334:33.","journal-title":"ACM Trans. Sensor Netw."},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2017.2658598"},{"issue":"4","key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.comnet.2014.06.011","article-title":"A shortest path tree based algorithm for relay placement in a wireless sensor network and its performance analysis","volume":"71","author":"Bhattacharya A.","year":"2014","unstructured":"A. Bhattacharya and A. Kumar. 2014. A shortest path tree based algorithm for relay placement in a wireless sensor network and its performance analysis. Comput. Netw. 71, 4 (2014), 48\u201362.","journal-title":"Comput. Netw."},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1023\/A:1018967121276"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2017.2750147"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/LWC.2016.2583426"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2015.2393496"},{"issue":"1","key":"e_1_3_2_10_2","first-page":"16","article-title":"A comprehensive survey on internet of things (IoT) toward 5G wireless systems","volume":"7","author":"Chettri L.","year":"2020","unstructured":"L. Chettri and R. Bera. 2020. A comprehensive survey on internet of things (IoT) toward 5G wireless systems. J. IEEE IoT 7, 1 (January 2020), 16\u201332.","journal-title":"J. IEEE IoT"},{"issue":"1","key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/TSUSC.2017.2666844","article-title":"Energy-aware constrained relay node deployment for sustainable wireless sensor networks","volume":"2","author":"Djenouri D.","year":"2017","unstructured":"D. Djenouri and M. Bagaa. 2017. Energy-aware constrained relay node deployment for sustainable wireless sensor networks. IEEE Trans. Sustainable Comput. 2, 1 (January 2017), 30\u201342.","journal-title":"IEEE Trans. Sustainable Comput."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2019.2917179"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2015.11.009"},{"issue":"28","key":"e_1_3_2_14_2","doi-asserted-by":"crossref","first-page":"2572","DOI":"10.1109\/JSEN.2017.2672501","article-title":"A wireless sensor network border monitoring system: Deployment issues and routing protocols","volume":"17","author":"Hammoudeh M.","year":"2017","unstructured":"M. Hammoudeh, F. Al-Fayez, H. Lloyd, R. Newman, B. Adebisi, A. Bounceur, and A. Abuarqoub. 2017. A wireless sensor network border monitoring system: Deployment issues and routing protocols. J. IEEE Sensors 17, 28 (April 2017), 2572\u20132582.","journal-title":"J. IEEE Sensors"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2009.161"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2015.09.013"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2016.2613504"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2019.2898761"},{"issue":"2","key":"e_1_3_2_19_2","first-page":"Article 31","article-title":"A survey on reliability protocols in wireless sensor networks","volume":"50","author":"Kafi M. A.","year":"2017","unstructured":"M. A. Kafi, J. B. Othman, and N. Badache. 2017. A survey on reliability protocols in wireless sensor networks. ACM Comput. Surv. 50, 2, Article 31 (May 2017).","journal-title":"ACM Comput. Surv."},{"issue":"1","key":"e_1_3_2_20_2","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1109\/JSYST.2016.2524695","article-title":"A pragmatic relay placement approach in 3-D space and Q-learning-based transmission scheme for reliable factory automation applications","volume":"12","author":"Kapil H.","year":"2018","unstructured":"H. Kapil and C. S. R. Murthy. 2018. A pragmatic relay placement approach in 3-D space and Q-learning-based transmission scheme for reliable factory automation applications. J. IEEE Syst. 12, 1 (May 2018), 823\u2013833.","journal-title":"J. IEEE Syst."},{"key":"e_1_3_2_21_2","first-page":"1","article-title":"A Friis-based calibrated model for WiFi terminals positioning","author":"Lassabe F.","year":"2005","unstructured":"F. Lassabe, P. Canalda, P. Chatonnay, F. Spies, and O. Baala. 2005. A Friis-based calibrated model for WiFi terminals positioning. In Proc. IEEE WOWMOM\u201905, 1\u20136.","journal-title":"Proc. IEEE WOWMOM\u201905"},{"key":"e_1_3_2_22_2","first-page":"1","article-title":"Relay node position optimization in complex environment","author":"Li H.","year":"2017","unstructured":"H. Li, C. Ao, Y. Xu, J. Tian, and K. Yamashita. 2017. Relay node position optimization in complex environment. In Proc. IEEE WCNC\u201917, 1\u20136.","journal-title":"Proc. IEEE WCNC\u201917"},{"issue":"6","key":"e_1_3_2_23_2","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1109\/JPROC.2019.2897627","article-title":"WIA-FA and its applications to digital factory: A wireless network solution for factory automation","volume":"107","author":"Liang W.","year":"2019","unstructured":"W. Liang, M. Zheng, J. Zhang, H. Shi, H. Yu, Y. Yang, S. Liu, W. Yang, and X. Zhao. 2019. WIA-FA and its applications to digital factory: A wireless network solution for factory automation. Proc. IEEE 107, 6 (June 2019), 1053\u20131073.","journal-title":"Proc. IEEE"},{"key":"e_1_3_2_24_2","first-page":"Article ID 6497","article-title":"The Rayleigh fading channel prediction via deep learning","volume":"2018","author":"Liao R.-F.","year":"2018","unstructured":"R.-F. Liao, H. Wen, J. Wu, H. Song, F. Pan, and L. Dong. 2018. The Rayleigh fading channel prediction via deep learning. Wirel. Commun. Mobile Comput. 2018 (July 2018), Article ID 6497340.","journal-title":"Wirel. Commun. Mobile Comput."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2016.2617459"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2019.2898993"},{"issue":"1","key":"e_1_3_2_27_2","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.jnca.2017.05.004","article-title":"Delay constrained relay node placement in two-tiered wireless sensor networks: A set-covering-based algorithm","volume":"93","author":"Ma C.","year":"2017","unstructured":"C. Ma, W. Liang, and M. Zheng. 2017. Delay constrained relay node placement in two-tiered wireless sensor networks: A set-covering-based algorithm. J. Netw. Comput. Appl. 93, 1 (April 2017), 76\u201390.","journal-title":"J. Netw. Comput. Appl."},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2015.2456931"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSYST.2018.2838072"},{"issue":"5","key":"e_1_3_2_30_2","first-page":"7946","article-title":"High-reliability and low-latency wireless communication for internet of things: Challenges, fundamentals, and enabling technologies","volume":"6","author":"Ma Z.","year":"2019","unstructured":"Z. Ma, M. Xiao, Y. Xiao, Z. Pang, H. V. Poor, and B. Vucetic. 2019. High-reliability and low-latency wireless communication for internet of things: Challenges, fundamentals, and enabling technologies. J. IEEE IoT 6, 5 (October 2019), 7946\u20137970.","journal-title":"J. IEEE IoT"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2009.2033273"},{"issue":"1","key":"e_1_3_2_32_2","doi-asserted-by":"crossref","first-page":"no. 1","DOI":"10.1016\/j.ejor.2013.08.031","article-title":"Optimal relay node placement in delay constrained wireless sensor network design","volume":"233","author":"Nigam A.","year":"2014","unstructured":"A. Nigam and Y. K. Agarwal. 2014. Optimal relay node placement in delay constrained wireless sensor network design. European J. Oper. Res. 233, 1 (April 2014), no. 1.","journal-title":"European J. Oper. Res."},{"key":"e_1_3_2_33_2","first-page":"3587","article-title":"Relay placement in wireless networks: Minimizing communication cost","author":"Nikolov M.","year":"2004","unstructured":"M. Nikolov and Z. J. Haas. 2004. Relay placement in wireless networks: Minimizing communication cost. IEEE Trans. Wireless Commun. 15, 5 (May 2016), 3587\u20133602.","journal-title":"IEEE Trans. Wireless Commun."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2016.02.003"},{"key":"e_1_3_2_35_2","volume-title":"Wireless Communications: Principles and Practice","author":"Rappaport T. S.","year":"2002","unstructured":"T. S. Rappaport. 2002. Wireless Communications: Principles and Practice. Prentice Hall."},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11277-018-5290-8"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2016.04.025"},{"issue":"2014","key":"e_1_3_2_38_2","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.adhoc.2014.07.003","article-title":"A fault-tolerant relay placement algorithm for ensuring  \\(k\\)  vertex-disjoint shortest paths in wireless sensor networks","volume":"23","author":"Sitanayah L.","year":"2014","unstructured":"L. Sitanayah, K. N. Brown, and C. J. Sreenan. 2014. A fault-tolerant relay placement algorithm for ensuring \\(k\\) vertex-disjoint shortest paths in wireless sensor networks. Ad Hoc Netw. 23, 2014 (April 2014), 145\u2013162.","journal-title":"Ad Hoc Netw."},{"key":"e_1_3_2_39_2","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton R. S.","year":"2018","unstructured":"R. S. Sutton and A. G. Barto. 2018. Reinforcement Learning: An Introduction. The MIT Press."},{"issue":"256","key":"e_1_3_2_40_2","first-page":"2349","article-title":"Multiple-relay selection in amplify-and-forward cooperative wireless networks with multiple source nodes","volume":"2012","author":"Wu J.","year":"2012","unstructured":"J. Wu, Y. D. Zhang, M. G. Amin, and M. Uysal. 2012. Multiple-relay selection in amplify-and-forward cooperative wireless networks with multiple source nodes. J. EURASIP Wireless Commun. Netw. 2012, 256 (August 2012), 2349\u20132362.","journal-title":"J. EURASIP Wireless Commun. Netw."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2011.126"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2013.2291323"},{"issue":"4","key":"e_1_3_2_43_2","doi-asserted-by":"crossref","first-page":"2106","DOI":"10.1109\/TWC.2014.2381217","article-title":"Space-time network coding with transmit antenna selection and maximal-ratio combining","volume":"14","author":"Yang K.","year":"2015","unstructured":"K. Yang, N. Yang, C. Xing, J. Wu, and Z. Zhang. 2015. Space-time network coding with transmit antenna selection and maximal-ratio combining. IEEE Trans. Wireless Commun. 14, 4 (April 2015), 2106\u20132117.","journal-title":"IEEE Trans. Wireless Commun."},{"key":"e_1_3_2_44_2","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1016\/j.ins.2017.08.018","article-title":"Optimal relay placement for lifetime maximization in wireless underground sensor networks","volume":"418","author":"Yuan B.","year":"2017","unstructured":"B. Yuan, H. Chen, and X. Yao. 2017. Optimal relay placement for lifetime maximization in wireless underground sensor networks. Inf. Sci. 418-419 (December 2017), 463\u2013479.","journal-title":"Inf. Sci."},{"issue":"2","key":"e_1_3_2_45_2","doi-asserted-by":"crossref","first-page":"7:1\u20137:34","DOI":"10.1145\/1240226.1240227","article-title":"An analysis of unreliability and asymmetry in low-power wireless links","volume":"3","author":"Zamalloa M. Z.","year":"2007","unstructured":"M. Z. Zamalloa and B. Krishnamachari. 2007. An analysis of unreliability and asymmetry in low-power wireless links. ACM Trans. Sensor Netw. 3, 2 (June 2007), 7:1\u20137:34.","journal-title":"ACM Trans. Sensor Netw."},{"issue":"8","key":"e_1_3_2_46_2","doi-asserted-by":"crossref","first-page":"5554","DOI":"10.1109\/TII.2019.2919653","article-title":"Towards high-performance wireless control: 10-7 packet error rate in real factory environments","volume":"16","author":"Zhan M.","year":"2020","unstructured":"M. Zhan, Z. Pang, D. Dzung, M. Luvisotto, K. Yu, and M. Xiao. 2020. Towards high-performance wireless control: 10-7 packet error rate in real factory environments. IEEE Trans. Ind. Inf. 16, 8 (August 2020), 5554\u20135564.","journal-title":"IEEE Trans. Ind. Inf."},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2010.126"},{"issue":"1","key":"e_1_3_2_48_2","first-page":"325","article-title":"Energy-efficient coverage enhancement strategy for 3-D wireless sensor networks based on a vampire bat optimizer","volume":"7","author":"Zhao X.-Q.","year":"2020","unstructured":"X.-Q. Zhao, Y.-P. Cui, C.-Y. Gao, Z. Guo, and Q. Gao. 2020. Energy-efficient coverage enhancement strategy for 3-D wireless sensor networks based on a vampire bat optimizer. J. IEEE IoT 7, 1 (January 2020), 325\u2013338.","journal-title":"J. IEEE IoT"},{"key":"e_1_3_2_49_2","first-page":"125","article-title":"Impact of radio irregularity on wireless sensor networks","author":"Zhou G.","year":"2004","unstructured":"G. Zhou, T. He, S. Krishnamurthy, and J. A. Stankovic. 2004. Impact of radio irregularity on wireless sensor networks. In Proc. ACM MobiSys\u201904, 125\u2013138.","journal-title":"Proc. ACM MobiSys\u201904"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617124","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3617124","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:07Z","timestamp":1750178167000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617124"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,20]]},"references-count":48,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1,31]]}},"alternative-id":["10.1145\/3617124"],"URL":"https:\/\/doi.org\/10.1145\/3617124","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"value":"1550-4859","type":"print"},{"value":"1550-4867","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,20]]},"assertion":[{"value":"2022-10-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-25","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}