{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T23:11:40Z","timestamp":1776121900808,"version":"3.50.1"},"reference-count":62,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,7,28]],"date-time":"2022-07-28T00:00:00Z","timestamp":1658966400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Abdelmalek Essaadi University (UAE)"},{"name":"Tetouan, Morocco and Universidad Polit\u00e9cnica de Cartagena (UPCT) Cartagena, Spain"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Internet of Things (IoT) landscape to cover long-range applications. The LoRa-enabled IoT devices adopt an Adaptive Data Rate-based (ADR) mechanism to assign transmission parameters such as spreading factors, transmission energy, and coding rates. Nevertheless, the energy assessment of these combinations should be considered carefully to select an accurate combination. Accordingly, the computational and transmission energy consumption trade-off should be assessed to guarantee the effectiveness of the physical parameter tuning. This paper provides comprehensive details of LoRa transceiver functioning mechanisms and provides a mathematical model for energy consumption estimation of the end devices EDs. Indeed, in order to select the optimal transmission parameters. We have modeled the LoRa energy optimization and transmission parameter selection problem as a Markov Decision Process (MDP). The dynamic system surveys the environment stats (the residual energy and channel state) and searches for the optimal actions to minimize the long-term average cost at each time slot. The proposed method has been evaluated under different scenarios and then compared to LoRaWAN default ADR in terms of energy efficiency and reliability. The numerical results have shown that our method outperforms the LoRa standard ADR mechanism since it permits the EDs to gain more energy. Besides, it enables the EDs to stand more, consequently performing more transmissions.<\/jats:p>","DOI":"10.3390\/s22155662","type":"journal-article","created":{"date-parts":[[2022,7,28]],"date-time":"2022-07-28T22:43:26Z","timestamp":1659048206000},"page":"5662","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["A Reinforcement Learning Based Transmission Parameter Selection and Energy Management for Long Range Internet of Things"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5802-0387","authenticated-orcid":false,"given":"Yassine","family":"Yazid","sequence":"first","affiliation":[{"name":"Laboratory of Information and Communication Technologies (LabTIC), Ecole Nationale des Sciences Appliqu\u00e9es de Tanger, Abdelmalek Essaadi University, Tangier BP 1818, Morocco"},{"name":"Department of Automation, Electrical Engineering and Electronic Technology, Universidad Polit\u00e9cnica de Cartagena, Plaza del Hospital 1, 30202 Cartagena, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonio","family":"Guerrero-Gonz\u00e1lez","sequence":"additional","affiliation":[{"name":"Department of Automation, Electrical Engineering and Electronic Technology, Universidad Polit\u00e9cnica de Cartagena, Plaza del Hospital 1, 30202 Cartagena, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0658-4222","authenticated-orcid":false,"given":"Imad","family":"Ez-Zazi","sequence":"additional","affiliation":[{"name":"National School of Applied Sciences of Fez (ENSAF), Sidi Mohamed Ben Abdellah University, Fez BP 2626, Morocco"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4953-1000","authenticated-orcid":false,"given":"Ahmed","family":"El Oualkadi","sequence":"additional","affiliation":[{"name":"Laboratory of Information and Communication Technologies (LabTIC), Ecole Nationale des Sciences Appliqu\u00e9es de Tanger, Abdelmalek Essaadi University, Tangier BP 1818, Morocco"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mounir","family":"Arioua","sequence":"additional","affiliation":[{"name":"Laboratory of Information and Communication Technologies (LabTIC), Ecole Nationale des Sciences Appliqu\u00e9es de Tanger, Abdelmalek Essaadi University, Tangier BP 1818, Morocco"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Farias da Costa, V.C., Oliveira, L., and de Souza, J. (2021). Internet of everything (IoE) taxonomies: A survey and a novel knowledge-based taxonomy. Sensors, 21.","DOI":"10.3390\/s21020568"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ter\u00e1n, M., Aranda, J., Carrillo, H., Mendez, D., and Parra, C. (2017, January 16\u201318). IoT-based system for indoor location using bluetooth low energy. Proceedings of the 2017 IEEE Colombian Conference on Communications and Computing (COLCOM), Cartagena, Colombia.","DOI":"10.1109\/ColComCon.2017.8088211"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"5137","DOI":"10.1007\/s11042-017-4584-2","article-title":"A connectivity-increasing mechanism of ZigBee-based IoT devices for wireless multimedia sensor networks","volume":"78","author":"Chang","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_4","unstructured":"Mainetti, L., Patrono, L., and Vilei, A. (2011, January 15\u201317). Evolution of wireless sensor networks towards the internet of things: A survey. Proceedings of the SoftCOM 2011, 19th International Conference on Software, Telecommunications and Computer Networks, Split, Croatia."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.icte.2017.12.005","article-title":"A comparative study of LPWAN technologies for large-scale IoT deployment","volume":"5","author":"Mekki","year":"2019","journal-title":"ICT Express"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1016\/J.ENG.2017.04.011","article-title":"An Internet of energy things based on wireless LPWAN","volume":"3","author":"Song","year":"2017","journal-title":"Engineering"},{"key":"ref_7","unstructured":"Zuniga, J.C., and Ponsard, B. (2020, April 29). Sigfox System Description. LPWAN@ IETF97, 14 November 2016; Volume 25. Available online: https:\/\/datatracker.ietf.org\/meeting\/97\/materials\/slides-97-lpwan-25-sigfox-system-description-00."},{"key":"ref_8","unstructured":"(2022, April 08). Available online: https:\/\/www.ingenu.com\/technology\/rpma\/lpwa\/."},{"key":"ref_9","unstructured":"(2022, April 08). Available online: https:\/\/www.weightless-alliance.org\/."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"870430","DOI":"10.1155\/2013\/870430","article-title":"Survey of the DASH7 alliance protocol for 433 MHz wireless sensor communication","volume":"9","author":"Weyn","year":"2013","journal-title":"Int. J. Distrib. Sens. Netw."},{"key":"ref_11","unstructured":"Alliance, L. (2015). A technical overview of LoRa and LoRaWAN. White Pap., 20."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Vangelista, L., Zanella, A., and Zorzi, M. (2015, January 23\u201325). Long-range IoT technologies: The dawn of LoRaTM. Proceedings of the Future Access Enablers of Ubiquitous and Intelligent Infrastructures, Ohrid, Republic of Macedonia.","DOI":"10.1007\/978-3-319-27072-2_7"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bouguera, T., Diouris, J.F., Chaillout, J.J., Jaouadi, R., and Andrieux, G. (2018). Energy consumption model for sensor nodes based on LoRa and LoRaWAN. Sensors, 18.","DOI":"10.3390\/s18072104"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Slabicki, M., Premsankar, G., and Di Francesco, M. (2018, January 23\u201327). Adaptive configuration of LoRa networks for dense IoT deployments. Proceedings of the NOMS 2018\u20142018 IEEE\/IFIP Network Operations and Management Symposium, Taipei, Taiwan.","DOI":"10.1109\/NOMS.2018.8406255"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Kim, S., Lee, H., and Jeon, S. (2020). An Adaptive Spreading Factor Selection Scheme for a Single Channel LoRa Modem. Sensors, 20.","DOI":"10.3390\/s20041008"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4960","DOI":"10.1109\/TCOMM.2020.2993085","article-title":"Energy Efficient Uplink Transmissions in LoRa Networks","volume":"68","author":"Su","year":"2020","journal-title":"IEEE Trans. Commun."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2177","DOI":"10.1109\/TIM.2018.2814082","article-title":"Monitoring of large-area IoT sensors using a LoRa wireless mesh network system: Design and evaluation","volume":"67","author":"Lee","year":"2018","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bor, M., and Roedig, U. (2017, January 5\u20137). LoRa transmission parameter selection. Proceedings of the 2017 13th International Conference on Distributed Computing in Sensor Systems (DCOSS), Ottawa, ON, Canada.","DOI":"10.1109\/DCOSS.2017.10"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/j.comcom.2020.06.006","article-title":"Experimental vs. simulation analysis of LoRa for vehicular communications","volume":"160","author":"Ortiz","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Han, B., Peng, S., Wu, C., Wang, X., and Wang, B. (2020). LoRa-Based Physical Layer Key Generation for Secure V2V\/V2I Communications. Sensors, 20.","DOI":"10.3390\/s20030682"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"54631","DOI":"10.1109\/ACCESS.2020.2978100","article-title":"Secure Session Key Generation Method for LoRaWAN Servers","volume":"8","author":"Tsai","year":"2020","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.comcom.2020.01.056","article-title":"TS-LoRa: Time-slotted LoRaWAN for the Industrial Internet of Things","volume":"153","author":"Zorbas","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"595","DOI":"10.1016\/j.comcom.2020.02.034","article-title":"Towards an SDR implementation of LoRa: Reverse-engineering, demodulation strategies and assessment over Rayleigh channel","volume":"153","author":"Marquet","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1818","DOI":"10.1109\/LSP.2017.2762960","article-title":"Frequency shift chirp modulation: The LoRa modulation","volume":"24","author":"Vangelista","year":"2017","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Mroue, H., Nasser, A., Parrein, B., Hamrioui, S., Mona-Cruz, E., and Rouyer, G. (2018, January 26\u201328). Analytical and simulation study for LoRa modulation. Proceedings of the 2018 25th International Conference on Telecommunications (ICT), Saint Malo, France.","DOI":"10.1109\/ICT.2018.8464879"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3946","DOI":"10.1109\/TCOMM.2016.2594792","article-title":"Orthogonal chirp division multiplexing","volume":"64","author":"Ouyang","year":"2016","journal-title":"IEEE Trans. Commun."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1109\/LCOMM.2018.2797057","article-title":"Impact of LoRa imperfect orthogonality: Analysis of link-level performance","volume":"22","author":"Croce","year":"2018","journal-title":"IEEE Commun. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1488","DOI":"10.1109\/LSP.2017.2737596","article-title":"Chirp spread spectrum toward the Nyquist signaling rate\u2014Orthogonality condition and applications","volume":"24","author":"Ouyang","year":"2017","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_29","unstructured":"Knight, M., and Seeber, B. (2016, January 12\u201316). Decoding LoRa: Realizing a modern LPWAN with SDR. Proceedings of the GNU Radio Conference, Boulder, CO, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Marquet, A., Montavont, N., and Papadopoulos, G.Z. (2019, January 10\u201312). Investigating theoretical performance and demodulation techniques for lora. Proceedings of the 2019 IEEE 20th International Symposium on \u201cA World of Wireless, Mobile and Multimedia Networks\u201d (WoWMoM), Washington, DC, USA.","DOI":"10.1109\/WoWMoM.2019.8793014"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"7419","DOI":"10.1109\/JIOT.2020.2986164","article-title":"An Enhanced Receiver to Decode Superposed LoRa-like Signals","volume":"7","author":"Temim","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yazid, Y., Ez-Zazi, I., Arioua, M., and Oualkadi, A.E. (2020, January 6\u20138). On the LoRa performances under different physical layer parameter selection. Proceedings of the 2020 International Symposium on Advanced Electrical and Communication Technologies (ISAECT), Virtual.","DOI":"10.1109\/ISAECT50560.2020.9523690"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Haxhibeqiri, J., Van den Abeele, F., Moerman, I., and Hoebeke, J. (2017). LoRa scalability: A simulation model based on interference measurements. Sensors, 17.","DOI":"10.3390\/s17061193"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Ferreira Dias, C., Rodrigues de Lima, E., and Fraidenraich, G. (2019). Bit Error Rate Closed-Form Expressions for LoRa Systems under Nakagami and Rice Fading Channels. Sensors, 19.","DOI":"10.3390\/s19204412"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.jocs.2017.04.014","article-title":"Adaptive data rate control in low power wide area networks for long range IoT services","volume":"22","author":"Kim","year":"2017","journal-title":"J. Comput. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"42778","DOI":"10.1109\/ACCESS.2022.3168139","article-title":"Transmit Power Allocation Schemes for Performance Improvement of Poor Conditioned End Devices in LPWAN","volume":"10","author":"Narieda","year":"2022","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Heeger, D., Garigan, M., Eleni Tsiropoulou, E., and Plusquellic, J. (2021). Secure LoRa Firmware Update with Adaptive Data Rate Techniques. Sensors, 21.","DOI":"10.3390\/s21072384"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Lee, J., Yoon, Y.S., Oh, H.W., and Park, K.R. (2021). DG-LoRa: Deterministic Group Acknowledgment Transmissions in LoRa Networks for Industrial IoT Applications. Sensors, 21.","DOI":"10.3390\/s21041444"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Guo, Q., Yang, F., and Wei, J. (2021). Experimental Evaluation of the Packet Reception Performance of LoRa. Sensors, 21.","DOI":"10.3390\/s21041071"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Reynders, B., Meert, W., and Pollin, S. (2017, January 21\u201325). Power and spreading factor control in low power wide area networks. Proceedings of the 2017 IEEE International Conference on Communications (ICC), Paris, France.","DOI":"10.1109\/ICC.2017.7996380"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Narieda, S., Fujii, T., and Umebayashi, K. (2020). Energy Constrained Optimization for Spreading Factor Allocation in LoRaWAN. Sensors, 20.","DOI":"10.3390\/s20164417"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"38586","DOI":"10.1109\/ACCESS.2020.2973252","article-title":"Deriving and Updating Optimal Transmission Configurations for Lora Networks","volume":"8","author":"Sandoval","year":"2020","journal-title":"IEEE Access"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yazid, Y., Ez-Zazi, I., Arioua, M., and El Oualkadi, A. (2021, January 7\u20138). A Deep Reinforcement Learning Approach For LoRa WAN Energy Optimization. Proceedings of the 2021 IEEE Microwave Theory and Techniques in Wireless Communications (MTTW), Riga, Latvia.","DOI":"10.1109\/MTTW53539.2021.9607147"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"7243","DOI":"10.1109\/TII.2020.2967123","article-title":"Optimal configuration of LoRa networks in smart cities","volume":"16","author":"Premsankar","year":"2020","journal-title":"IEEE Trans. Ind. Inform"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"410","DOI":"10.1016\/j.comcom.2020.02.066","article-title":"Opportunistic LoRa-based gateways for delay-tolerant sensor data collection in urban settings","volume":"154","author":"Florita","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Le, X.C., Vrigneau, B., Gautier, M., Mabon, M., and Berder, O. (2018, January 26\u201328). Energy\/reliability trade-off of LoRa communications over fading channels. Proceedings of the 2018 25th International Conference on Telecommunications (ICT), Saint Malo, France.","DOI":"10.1109\/ICT.2018.8464929"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"3507","DOI":"10.1007\/s11276-020-02276-5","article-title":"Prediction of energy consumption for LoRa based wireless sensors network","volume":"26","author":"Nurgaliyev","year":"2020","journal-title":"Wirel. Netw."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1466","DOI":"10.3390\/s16091466","article-title":"A study of LoRa: Long range & low power networks for the internet of things","volume":"16","author":"Augustin","year":"2016","journal-title":"Sensors"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Ert\u00fcrk, M.A., Ayd\u0131n, M.A., B\u00fcy\u00fckakka\u015flar, M.T., and Evirgen, H. (2019). A Survey on LoRaWAN Architecture, Protocol and Technologies. Future Internet, 11.","DOI":"10.3390\/fi11100216"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Srbinovska, M., Dimcev, V., and Gavrovski, C. (2017, January 6\u20138). Energy consumption estimation of wireless sensor networks in greenhouse crop production. Proceedings of the IEEE EUROCON 2017\u201417th International Conference on Smart Technologies, Ohrid, Republic of Macedonia.","DOI":"10.1109\/EUROCON.2017.8011235"},{"key":"ref_51","unstructured":"Desset, C., and Fort, A. (2003, January 22\u201325). Selection of channel coding for low-power wireless systems. Proceedings of the 57th IEEE Semiannual Vehicular Technology Conference, VTC 2003, Jeju, Korea."},{"key":"ref_52","unstructured":"Joe, I. (2005, January 23\u201326). Optimal packet length with energy efficiency for wireless sensor networks. Proceedings of the 2005 IEEE International Symposium on Circuits and Systems, Kobe, Japan."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1109\/LWC.2016.2647247","article-title":"Low power wide area network analysis: Can LoRa scale?","volume":"6","author":"Georgiou","year":"2017","journal-title":"IEEE Wirel. Commun. Lett."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Ez-Zazi, I., Arioua, M., and El Oualkadi, A. (2020). Adaptive Joint Lossy Source-Channel Coding for Multihop IoT Networks. Wirel. Commun. Mob. Comput., 2020.","DOI":"10.1155\/2020\/2127467"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Casals, L., Mir, B., Vidal, R., and Gomez, C. (2017). Modeling the energy performance of LoRaWAN. Sensors, 17.","DOI":"10.3390\/s17102364"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1778","DOI":"10.1109\/LCOMM.2018.2849718","article-title":"Closed-form approximation of LoRa modulation BER performance","volume":"22","author":"Elshabrawy","year":"2018","journal-title":"IEEE Commun. Lett."},{"key":"ref_57","unstructured":"Puterman, M.L. (2014). Markov Decision Processes: Discrete Stochastic Dynamic Programming, John Wiley & Sons."},{"key":"ref_58","unstructured":"Altman, E. (1999). Constrained Markov Decision Processes: Stochastic Modeling, Routledge."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1336","DOI":"10.1109\/TWC.2015.2489200","article-title":"On the design of temporal compression strategies for energy harvesting sensor networks","volume":"15","author":"Zordan","year":"2015","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Pielli, C., Stefanovic, C., Popovski, P., and Zorzi, M. (2017, January 12\u201314). Minimizing data distortion of periodically reporting iot devices with energy harvesting. Proceedings of the 2017 14th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON), San Diego, CA, USA.","DOI":"10.1109\/SAHCN.2017.7964916"},{"key":"ref_61","unstructured":"(2020, December 18). LoRa-Alliance. Available online: http:\/\/www.lora-alliance.org."},{"key":"ref_62","unstructured":"(2021, January 11). Semtech. Available online: https:\/\/www.semtech.com\/products\/wireless-rf\/lora-core\/sx1261."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5662\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:58:24Z","timestamp":1760140704000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5662"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,28]]},"references-count":62,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22155662"],"URL":"https:\/\/doi.org\/10.3390\/s22155662","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,28]]}}}