{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T17:27:11Z","timestamp":1783099631427,"version":"3.54.6"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,9,10]],"date-time":"2020-09-10T00:00:00Z","timestamp":1599696000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,10]],"date-time":"2020-09-10T00:00:00Z","timestamp":1599696000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Wireless Com Network"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>As the 4th industrial revolution using information becomes an issue, wireless communication technologies such as the Internet of Things have been spotlighted. Therefore, much research is needed to satisfy the technological demands for the future society. A LPWA (low power wide area) in the wireless communication environment enables low-power, long-distance communication to meet various application requirements that conventional wireless communications have been difficult to meet. We propose a method to consume the minimum transmission power relative to the maximum data rate with the target of LoRaWAN among LPWA networks. Reinforcement learning is adopted to find the appropriate parameter values for the minimum transmission power. With deep reinforcement learning, we address the LoRaWAN problem with the goal of optimizing the distribution of network resources such as spreading factor, transmission power, and channel. By creating a number of deep reinforcement learning agents that match the terminal nodes in the network server, the optimal transmission parameters are provided to the terminal nodes. The simulation results show that the proposed method is about 15% better than the existing ADR (adaptive data rate) MAX of LoRaWAN in terms of throughput relative to energy transmission.<\/jats:p>","DOI":"10.1186\/s13638-020-01783-5","type":"journal-article","created":{"date-parts":[[2020,9,10]],"date-time":"2020-09-10T19:29:46Z","timestamp":1599766186000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Network resource optimization with reinforcement learning for low power wide area networks"],"prefix":"10.1186","volume":"2020","author":[{"given":"Gyubong","family":"Park","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wooyeob","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Inwhee","family":"Joe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,9,10]]},"reference":[{"issue":"2","key":"1783_CR1","doi-asserted-by":"publisher","first-page":"855","DOI":"10.1109\/COMST.2017.2652320","volume":"12","author":"U. Raza","year":"2017","unstructured":"U. Raza, P. Kulkarni, M. Sooriyabandara, Low power wide area networks: an overview. IEEE Commun. Surv. Tutorials. 12(2), 855\u2013873 (2017).","journal-title":"IEEE Commun. Surv. Tutorials"},{"key":"1783_CR2","unstructured":"Semtech Corporation, AN1200.22 LoRa Modulation Basics, Application note Revision 2(AN1200.22) (Semtech Corporation, 2015)."},{"issue":"9","key":"1783_CR3","doi-asserted-by":"publisher","first-page":"1466","DOI":"10.3390\/s16091466","volume":"16","author":"A. Augustin","year":"2016","unstructured":"A. Augustin, et al., A study of LoRa: long range & low power networks for the internet of things. Sensors. 16(9), 1466 (2016).","journal-title":"Sensors"},{"key":"1783_CR4","doi-asserted-by":"crossref","unstructured":"V. Hauser, T. Hegr, Proposal of adaptive data rate algorithm for LoRaWAN-based infrastructure, 2017 IEEE 5th International Conference on Future Internet of Things and Cloud (FiCloud) (IEEE, 2017).","DOI":"10.1109\/FiCloud.2017.47"},{"key":"1783_CR5","doi-asserted-by":"crossref","unstructured":"B. Reynders, W. Meert, S. Pollin, Power and spreading factor control in low power wide area networks, 2017 IEEE International Conference on Communications (ICC) (IEEE, 2017).","DOI":"10.1109\/ICC.2017.7996380"},{"key":"1783_CR6","unstructured":"K. Abdelfadeel, C. Cionca, D. Pesch, Poster: A Fair Adaptive Data Rate Algorithm for LoRaWAN, Proceedings of the 2018 International Conference on Embedded Wireless Systems and Networks (EWSN \u016018) (Junction Publishing, 2018)."},{"key":"1783_CR7","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/j.jocs.2017.04.014","volume":"22","author":"Kim","year":"2017","unstructured":"Kim, et al., Adaptive data rate control in low power wide area networks for long range IoT services. J. Comput. Sci.22:, 171\u2013178 (2017).","journal-title":"J. Comput. Sci."},{"issue":"6","key":"1783_CR8","doi-asserted-by":"publisher","first-page":"1716","DOI":"10.3390\/s18061716","volume":"18","author":"Kim","year":"2018","unstructured":"Kim, et al., Contention-aware adaptive data rate for throughput optimization in LoRaWAN. Sensors. 18(6), 1716 (2018).","journal-title":"Sensors"},{"key":"1783_CR9","doi-asserted-by":"crossref","unstructured":"M. El-Aasser, T. Elshabrawy, M. Ashour, Joint spreading factor and coding rate assignment in LoRaWAN networks, 2018 IEEE Global Conference on Internet of Things (GCIoT) (IEEE, 2018).","DOI":"10.1109\/GCIoT.2018.8620147"},{"key":"1783_CR10","doi-asserted-by":"crossref","unstructured":"Cuomo, et al.Towards traffic-oriented spreading factor allocations in LoRaWAN systems, 2018 17th Annual Mediterranean Ad Hoc Networking Workshop (Med-Hoc-Net) (IEEE, 2018), pp. 1\u20138.","DOI":"10.23919\/MedHocNet.2018.8407091"},{"key":"1783_CR11","doi-asserted-by":"crossref","unstructured":"Q. Zhou, J. Xing, L. Hou, R. Xu, K. Zheng, A novel rate and channel control scheme based on data extraction rate for LoRa networks, 2019 IEEE Wireless Communications and Networking Conference (WCNC) (IEEE, 2019).","DOI":"10.1109\/WCNC.2019.8885860"},{"key":"1783_CR12","doi-asserted-by":"crossref","unstructured":"D. Ta, K. Khawam, S. Lahoud, C. Adjih, S. Martin. LoRa-MAB: Toward an Intelligent Resource Allocation Approach for LoRaWAN, 2019 IEEE Global Communications Conference (GLOBECOM) (IEEE, 2019), pp. 1\u20136.","DOI":"10.1109\/GLOBECOM38437.2019.9013345"},{"key":"1783_CR13","unstructured":"R. S. Sutton, A. G. Barto, Reinforcement learning: an introduction, Adaptive Computation and Machine Learning series (Textbook) (The MIT Press, 2014)."},{"issue":"7540","key":"1783_CR14","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/nature14236","volume":"518","author":"V. Mnih","year":"2015","unstructured":"V. Mnih, et al., Human-level control through deep reinforcement learning. Nature. 518(7540), 529 (2015).","journal-title":"Nature"},{"key":"1783_CR15","unstructured":"J. Foerster, I. A Assael, N. de Freitas, S Whiteson, Learning to communicate with deep multi-agent reinforcement learning, Advances in Neural Information Processing Systems (The MIT Press, 2016)."},{"issue":"4","key":"1783_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0172395","volume":"12","author":"A. Tampuu","year":"2017","unstructured":"A. Tampuu, T. Matiisen, D. Kodelja, I. Kuzovkin, K. Korjus, J. Aru, Multiagent cooperation and competition with deep reinforcement learning. PLoS ONE. 12(4), 1\u201315 (2017).","journal-title":"PLoS ONE"},{"key":"1783_CR17","volume-title":"International Conference on Autonomous Agents and Multiagent Systems","author":"J. K. Gupta","year":"2017","unstructured":"J. K. Gupta, M. Egorov, M. Kochenderfer, in International Conference on Autonomous Agents and Multiagent Systems. Cooperative multi-agent control using deep reinforcement learning (SpringerCham, 2017)."},{"key":"1783_CR18","doi-asserted-by":"crossref","unstructured":"F. Cuomo, M Campo, A Caponi, G Bianchi, G Rossini, P Pisani, EXPLoRa: EXtending the Performance of LoRa by suitable spreading factor allocations, 2017 IEEE 13th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob) (IEEE, 2017).","DOI":"10.1109\/WiMOB.2017.8115779"},{"issue":"21","key":"1783_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/s19214723","volume":"19","author":"M. Asad Ullah","year":"2019","unstructured":"M. Asad Ullah, J. Iqbal, A. Hoeller, R. D. Souza, H. Alves, K-means spreading factor allocation for large-scale LoRa networks. Sensors. 19(21), 1\u201319 (2019).","journal-title":"Sensors"},{"key":"1783_CR20","unstructured":"G. Ottoy, et al., LoRaWAN EFM32 (2017). https:\/\/github.com\/DRAMCO\/LoRaWAN_EFM32. DRAMCO, Github."},{"key":"1783_CR21","doi-asserted-by":"crossref","unstructured":"A. D. Jun, S. Hong, W. Lee, K. Lee, I. Joe, Modeling and simulation of LoRa in OPNET, Advanced Multimedia and Ubiquitous Engineering (Springer, 2017).","DOI":"10.1007\/978-981-10-5041-1_88"},{"key":"1783_CR22","volume-title":"Cross-layer framework and optimization for efficient use of the energy budget of IoT nodes, 2019 IEEE Wireless Communications and Networking Conference (WCNC)","author":"G. Callebaut","year":"2019","unstructured":"G. Callebaut, G. Ottoy, L. Van der Perre, Cross-layer framework and optimization for efficient use of the energy budget of IoT nodes, 2019 IEEE Wireless Communications and Networking Conference (WCNC) (IEEE, Marrakesh, 2019)."}],"container-title":["EURASIP Journal on Wireless Communications and Networking"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-020-01783-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13638-020-01783-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13638-020-01783-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,10]],"date-time":"2021-09-10T00:11:32Z","timestamp":1631232692000},"score":1,"resource":{"primary":{"URL":"https:\/\/jwcn-eurasipjournals.springeropen.com\/articles\/10.1186\/s13638-020-01783-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,10]]},"references-count":22,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["1783"],"URL":"https:\/\/doi.org\/10.1186\/s13638-020-01783-5","relation":{},"ISSN":["1687-1499"],"issn-type":[{"value":"1687-1499","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,10]]},"assertion":[{"value":"3 January 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 August 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 September 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"176"}}