{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T07:28:48Z","timestamp":1782372528867,"version":"3.54.5"},"reference-count":28,"publisher":"Wiley","license":[{"start":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T00:00:00Z","timestamp":1614988800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003621","name":"Ministry of Science, ICT and Future Planning","doi-asserted-by":"publisher","award":["2016-0-00133"],"award-info":[{"award-number":["2016-0-00133"]}],"id":[{"id":"10.13039\/501100003621","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003621","name":"Ministry of Science, ICT and Future Planning","doi-asserted-by":"publisher","award":["2015-0-00914"],"award-info":[{"award-number":["2015-0-00914"]}],"id":[{"id":"10.13039\/501100003621","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003621","name":"Ministry of Science, ICT and Future Planning","doi-asserted-by":"publisher","award":["2017R1A2B2009095"],"award-info":[{"award-number":["2017R1A2B2009095"]}],"id":[{"id":"10.13039\/501100003621","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003621","name":"Ministry of Science, ICT and Future Planning","doi-asserted-by":"publisher","award":["2019R1I1A1A01058780"],"award-info":[{"award-number":["2019R1I1A1A01058780"]}],"id":[{"id":"10.13039\/501100003621","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010418","name":"IITP","doi-asserted-by":"crossref","award":["2016-0-00133"],"award-info":[{"award-number":["2016-0-00133"]}],"id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100010418","name":"IITP","doi-asserted-by":"crossref","award":["2015-0-00914"],"award-info":[{"award-number":["2015-0-00914"]}],"id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100010418","name":"IITP","doi-asserted-by":"crossref","award":["2017R1A2B2009095"],"award-info":[{"award-number":["2017R1A2B2009095"]}],"id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100010418","name":"IITP","doi-asserted-by":"crossref","award":["2019R1I1A1A01058780"],"award-info":[{"award-number":["2019R1I1A1A01058780"]}],"id":[{"id":"10.13039\/501100010418","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004085","name":"Ministry of Education, Science and Technology","doi-asserted-by":"publisher","award":["2016-0-00133"],"award-info":[{"award-number":["2016-0-00133"]}],"id":[{"id":"10.13039\/501100004085","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004085","name":"Ministry of Education, Science and Technology","doi-asserted-by":"publisher","award":["2015-0-00914"],"award-info":[{"award-number":["2015-0-00914"]}],"id":[{"id":"10.13039\/501100004085","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004085","name":"Ministry of Education, Science and Technology","doi-asserted-by":"publisher","award":["2017R1A2B2009095"],"award-info":[{"award-number":["2017R1A2B2009095"]}],"id":[{"id":"10.13039\/501100004085","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004085","name":"Ministry of Education, Science and Technology","doi-asserted-by":"publisher","award":["2019R1I1A1A01058780"],"award-info":[{"award-number":["2019R1I1A1A01058780"]}],"id":[{"id":"10.13039\/501100004085","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Mobile Information Systems"],"published-print":{"date-parts":[[2021,3,6]]},"abstract":"<jats:p>Reducing transmission delay and maximizing the network lifetime are important issues for wireless sensor networks (WSN). The existing approaches commonly let the nodes periodically sleep to minimize energy consumption, which adversely increases packet forwarding latency. In this study, a novel scheme is proposed, which effectively determines the duty cycle of the nodes and packet forwarding path according to the network condition by employing the event-based mechanism and reinforcement learning technique. This allows low-latency energy-efficient scheduling and reduces the transmission collision between the nodes on the path. The Monte Carlo evaluation method is also adopted to minimize the overhead of the computation of each node in making the decision. Computer simulation reveals that the proposed scheme significantly improves end-to-end latency, waiting time, packet delivery ratio, and energy efficiency compared to the existing schemes including S-MAC and event-driven adaptive duty cycling scheme. <\/jats:p>","DOI":"10.1155\/2021\/6644389","type":"journal-article","created":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T22:35:17Z","timestamp":1615242917000},"page":"1-12","source":"Crossref","is-referenced-by-count":5,"title":["Event Driven Duty Cycling with Reinforcement Learning and Monte Carlo Technique for Wireless Network"],"prefix":"10.1155","volume":"2021","author":[{"given":"Han Yao","family":"Huang","sequence":"first","affiliation":[{"name":"College of Information and Communication Engineering, Sungkyunkwan University Suwon, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tae-Jin","family":"Lee","sequence":"additional","affiliation":[{"name":"College of Information and Communication Engineering, Sungkyunkwan University Suwon, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5522-208X","authenticated-orcid":true,"given":"Hee Yong","family":"Youn","sequence":"additional","affiliation":[{"name":"College of Information and Communication Engineering, Sungkyunkwan University Suwon, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","reference":[{"key":"1","first-page":"1","article-title":"Wireless sensor networks: applications and challenges","author":"A. Alemdar"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1109\/tnet.2004.828953"},{"key":"3","first-page":"171","article-title":"An adaptive energy-efficient MAC protocol for wireless sensor networks","author":"T. Van Dam"},{"key":"4","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2003.09.008"},{"key":"5","first-page":"35","article-title":"June). Asynchronous wakeup for ad hoc networks","author":"R. Zheng"},{"issue":"5","key":"6","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1109\/TMC.2011.94","article-title":"On reliable broadcast in low duty-cycle wireless sensor networks","volume":"11","author":"F. Wang","year":"2011","journal-title":"IEEE Transactions on Mobile Computing"},{"key":"7","first-page":"224","article-title":"An adaptive energy-efficient and low-latency MAC for data gathering in wireless sensor networks","author":"G. Lu"},{"key":"8","first-page":"V3","article-title":"Self-learning scheduling approach for wireless sensor network","author":"J. J Niu"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.3390\/s18020375"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1145\/1614379.1614381"},{"key":"11","article-title":"Self-learning-based data aggregation scheduling policy in wireless sensor networks","volume":"2018","author":"Y. Lu","year":"2018","journal-title":"Journal of Sensors"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1109\/tvt.2009.2015330"},{"key":"13","doi-asserted-by":"publisher","DOI":"10.1038\/nature14540"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1186\/s13677-020-00196-5"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1186\/s13638-020-01767-5"},{"key":"16","doi-asserted-by":"publisher","DOI":"10.1504\/ijsnet.2009.029017"},{"key":"17","first-page":"518","article-title":"Power save mechanisms for multi-hop wireless networks","author":"M. J. Miller"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2004.08.018"},{"key":"19","first-page":"1008","article-title":"Actor-critic algorithms","volume-title":"Advances in Neural Information Processing Systems","author":"V. R. Konda","year":"2000"},{"key":"20","first-page":"1889","article-title":"Trust region policy optimization","author":"J. Schulman"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1109\/tnnls.2017.2773458"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1007\/s11704-020-9153-6"},{"key":"23","first-page":"1040","article-title":"Adaptive data collection protocol using reinforcement learning for VANETs","author":"A. Soua"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.01.023"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1109\/tpds.2011.40"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1613\/jair.301"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.02.119"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1109\/tnet.2018.2868943"}],"container-title":["Mobile Information Systems"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/misy\/2021\/6644389.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/misy\/2021\/6644389.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/misy\/2021\/6644389.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T22:35:23Z","timestamp":1615242923000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/misy\/2021\/6644389\/"}},"subtitle":[],"editor":[{"given":"Marco","family":"Anisetti","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,3,6]]},"references-count":28,"alternative-id":["6644389","6644389"],"URL":"https:\/\/doi.org\/10.1155\/2021\/6644389","relation":{},"ISSN":["1875-905X","1574-017X"],"issn-type":[{"value":"1875-905X","type":"electronic"},{"value":"1574-017X","type":"print"}],"subject":[],"published":{"date-parts":[[2021,3,6]]}}}