{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:12:48Z","timestamp":1760242368989,"version":"build-2065373602"},"reference-count":29,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2017,6,3]],"date-time":"2017-06-03T00:00:00Z","timestamp":1496448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JSAN"],"abstract":"<jats:p>We consider the scheduling of retransmissions in the low-latency deterministic network (LLDN) extension to the IEEE 802.15.4 standard. We propose a number of retransmission schemes with varying degrees of required changes to the LLDN specification. In particular, we propose a retransmission scheme that uses cooperative relayers and where the best relayer for a source node is learned using a reinforcement-learning method. The method allows for adapting relayer selections in the face of time-varying channels. Our results show that the relayer-based methods achieve a much better reliability over the other methods, both over static (but unknown) and over time-varying channels.<\/jats:p>","DOI":"10.3390\/jsan6020006","type":"journal-article","created":{"date-parts":[[2017,6,6]],"date-time":"2017-06-06T10:53:09Z","timestamp":1496746389000},"page":"6","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Relayer-Enabled Retransmission Scheduling in 802.15.4e LLDN\u2014Exploring a Reinforcement Learning Approach"],"prefix":"10.3390","volume":"6","author":[{"given":"Andreas","family":"Willig","sequence":"first","affiliation":[{"name":"Department of Computer Science and Software Engineering \/Wireless Research Centre, University of Canterbury, Private Bag 4800, Christchurch 8041, New Zealand"}]},{"given":"Yakir","family":"Matusovsky","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering \/Wireless Research Centre, University of Canterbury, Private Bag 4800, Christchurch 8041, New Zealand"}]},{"given":"Adriel","family":"Kind","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Software Engineering \/Wireless Research Centre, University of Canterbury, Private Bag 4800, Christchurch 8041, New Zealand"}]}],"member":"1968","published-online":{"date-parts":[[2017,6,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1109\/SURV.2012.071812.00124","article-title":"Introduction to Industrial Control Networks","volume":"15","author":"Galloway","year":"2013","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4258","DOI":"10.1109\/TIE.2009.2015754","article-title":"Industrial Wireless Sensor Networks: Challenges, Design Principles, and Technical Approaches","volume":"56","author":"Gungor","year":"2009","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/TII.2008.923194","article-title":"Recent and Emerging Topics in Wireless Industrial Communications: A Selection","volume":"4","author":"Willig","year":"2008","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_4","unstructured":"LAN\/MAN Standards Committee of the IEEE Computer Society (2011). IEEE Standard for Local and Metropolitan Area Networks\u2014Part 15.4: Low Rate Wireless Personal Area Networks (LR-WPANs), Institute of Electrical and Electronics Engineers. Revision of 2011."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1109\/TII.2011.2166773","article-title":"Multichannel Superframe Scheduling for IEEE 802.15.4 Industrial Wireless Sensor Networks","volume":"8","author":"Toscano","year":"2012","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_6","unstructured":"IEEE Computer Society (2012). IEEE Standard for Local and Metropolitan Area Networks\u2013Part 15.4: Low-Rate Wireless Personal Area Networks (LR-WPANs)\u2014 Amendment 1: MAC Sublayer, Institute of Electrical and Electronics Engineers. IEEE Std 802.15.4e-2012."},{"key":"ref_7","unstructured":"Chen, F., German, R., and Dressler, F. (April, January 29). Towards IEEE 802.15.4e: A Study of Performance Aspects. Proceedings of the 8th IEEE International Conference on Pervasive Computing and Communications (PERCOM Workshops), Mannheim, Germany."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1109\/JPROC.2003.821914","article-title":"Great Expectations: The Value of Spatial Diversity in Wireless Networks","volume":"92","author":"Diggavi","year":"2004","journal-title":"IEEE Proc."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/s11276-013-0593-x","article-title":"Deadline-Aware Scheduling of Cooperative Relayers in TDMA-Based Wireless Industrial Networks","volume":"20","author":"Willig","year":"2014","journal-title":"Wirel. Netw."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning\u2014An Introduction, MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_11","unstructured":"Bertsekas, D.P., and Tsitsiklis, J.N. (1996). Neuro\u2014Dynamic Programming, Athena Scientific."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Willig, A., Matusovsky, Y., and Kind, A. (2016, January 7\u20139). Retransmission Scheduling in 802.15.4e LLDN\u2014A Reinforcement Learning Approach with Relayers. Proceedings of the International Telecommunication Networks and Applications Conference (ITNAC) 2016, Dunedin, New Zealand.","DOI":"10.1109\/ATNAC.2016.7878784"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1855","DOI":"10.1109\/TII.2016.2535393","article-title":"Scheduling for Source Relaying with Packet Aggregation in Industrial Wireless Networks","volume":"12","author":"Girs","year":"2016","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_14","unstructured":"Feller, W. (1968). An Introduction to Probability Theory and Its Applications\u2014Volume I, John Wiley. [3rd ed.]."},{"key":"ref_15","unstructured":"Korte, B., and Vygen, J. (2005). Combinatorial Optimization\u2014Theory and Algorithms, Springer. [3rd ed.]."},{"key":"ref_16","unstructured":"Bertsekas, D.P. (1999). Nonlinear Programming, Athena Scientific. [2nd ed.]."},{"key":"ref_17","unstructured":"Rappaport, T.S. (2002). Wireless Communications\u2014Principles and Practice, Prentice Hall."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Liu, K.J.R., Sadek, A.K., Su, W., and Kwasinski, A. (2009). Cooperative Communications and Networking, Cambridge University Press.","DOI":"10.1017\/CBO9780511754524"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1561\/1300000004","article-title":"Cooperative Communications","volume":"1","author":"Kramer","year":"2006","journal-title":"Found. Trends Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3062","DOI":"10.1109\/TIT.2004.838089","article-title":"Cooperative Diversity in Wireless Networks: Efficient Protocols and Outage Behaviour","volume":"50","author":"Laneman","year":"2004","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Norris, J.R. (1997). Markov Chains, Cambridge University Press.","DOI":"10.1017\/CBO9780511810633"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1109\/TVT.2013.2267551","article-title":"Cooperative ARQ with Relay Selection: An Analytical Framework Using Semi-Markov Processes","volume":"63","author":"Marchenko","year":"2014","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1109\/TII.2013.2278617","article-title":"Relay-Assisted Wireless Communication Systems in Mining Vehicle Safety Applications","volume":"10","author":"Ni","year":"2014","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1806","DOI":"10.1109\/TII.2014.2327915","article-title":"An Experimental Study of Selective Cooperative Relaying in Industrial Wireless Sensor Networks","volume":"10","author":"Marchenko","year":"2014","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Momoda, M., and Hara, S. (2014, January 2\u20134). Use of IEEE 802.15.4 for a Cooperator-Assisted Wireless Body Area Network. Proceedings of the 8th International Symposium on Medical Information and Communication Technology (ISMICT), Firenze, Italy.","DOI":"10.1109\/ISMICT.2014.6825202"},{"key":"ref_26","unstructured":"Yen, B.X., Hop, D.T., and Yoo, M. (2013, January 28\u201330). Redundant Transmission in wireless networked control system over IEEE 802.15.4e. Proceedings of the International Conference on Information Networking (ICOIN), Bangkok, Thailand."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Dariz, L., Malaguti, G., and Ruggeri, M. (2014, January 1\u20134). Performance Analysis of IEEE 802.15.4 real-time Enhancement. Proceedings of the IEEE 23rd International Symposium on Industrial Electronics (ISIE), Harbiye Istanbul, Turkey.","DOI":"10.1109\/ISIE.2014.6864832"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3655","DOI":"10.1109\/JSEN.2013.2266417","article-title":"On Optimal Scheduling in Duty-Cycled Industrial IoT Applications Using IEEE802.15.4e TSCH","volume":"13","author":"Palattella","year":"2013","journal-title":"IEEE Sens. J."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Yadong, W., and Shihong, D. (2013, January 7\u20139). Study on IEEE802.15.4 Link Reliability in Industrial Environments. Proceedings of the IEEE International Conference on Wireless for Space and Extreme Environments (WiSEE), Baltimore, MD, USA.","DOI":"10.1109\/WiSEE.2013.6737570"}],"container-title":["Journal of Sensor and Actuator Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2224-2708\/6\/2\/6\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:37:54Z","timestamp":1760207874000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2224-2708\/6\/2\/6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,3]]},"references-count":29,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2017,6]]}},"alternative-id":["jsan6020006"],"URL":"https:\/\/doi.org\/10.3390\/jsan6020006","relation":{},"ISSN":["2224-2708"],"issn-type":[{"type":"electronic","value":"2224-2708"}],"subject":[],"published":{"date-parts":[[2017,6,3]]}}}