{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:53:31Z","timestamp":1760234011564,"version":"build-2065373602"},"reference-count":38,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T00:00:00Z","timestamp":1614902400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JSAN"],"abstract":"<jats:p>This paper presents a data driven framework for performance optimisation of Narrow-Band IoT user equipment. The proposed framework is an edge micro-service that suggests one-time configurations to user equipment communicating with a base station. Suggested configurations are delivered from a Configuration Advocate, to improve energy consumption, delay, throughput or a combination of those metrics, depending on the user-end device and the application. Reinforcement learning utilising gradient descent and genetic algorithm is adopted synchronously with machine and deep learning algorithms to predict the environmental states and suggest an optimal configuration. The results highlight the adaptability of the Deep Neural Network in the prediction of intermediary environmental states, additionally the results present superior performance of the genetic reinforcement learning algorithm regarding its performance optimisation.<\/jats:p>","DOI":"10.3390\/jsan10010021","type":"journal-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T11:46:09Z","timestamp":1614944769000},"page":"21","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Optimising Performance for NB-IoT UE Devices through Data Driven Models"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9499-8195","authenticated-orcid":false,"given":"Omar","family":"Nassef","sequence":"first","affiliation":[{"name":"Center of Telecommunication Research, Kings College London, London WC2R 2LS, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2760-7139","authenticated-orcid":false,"given":"Toktam","family":"Mahmoodi","sequence":"additional","affiliation":[{"name":"Center of Telecommunication Research, Kings College London, London WC2R 2LS, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7794-7479","authenticated-orcid":false,"given":"Foivos","family":"Michelinakis","sequence":"additional","affiliation":[{"name":"Center for Digital Engineering, Simula Metropolitan, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kashif","family":"Mahmood","sequence":"additional","affiliation":[{"name":"Telenor Research, 1360 Fornebu, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ahmed","family":"Elmokashfi","sequence":"additional","affiliation":[{"name":"Center for Digital Engineering, Simula Metropolitan, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.icte.2017.03.004","article-title":"A survey on LPWA technology: LoRa and NB-IoT","volume":"3","author":"Sinha","year":"2017","journal-title":"ICT Express"},{"key":"ref_2","first-page":"90","article-title":"Modeling opportunistic IoT services in open IoT ecosystems","volume":"1867","author":"Fortino","year":"2017","journal-title":"CEUR Workshop Proc."},{"key":"ref_3","unstructured":"(2020, February 20). Non-Access-Stratum (NAS) Protocol for Evolved Packet System (EPS). 3GPP 24.301. Available online: https:\/\/portal.3gpp.org\/desktopmodules\/Specifications\/SpecificationDetails.aspx?specificationId=1072."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Jermyn, J., Jover, R.P., Murynets, I., Istomin, M., and Stolfo, S. (2015, January 14\u201317). Scalability of Machine to Machine systems and the Internet of Things on LTE mobile networks. Proceedings of the 2015 16th IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM), Boston, MA, USA.","DOI":"10.1109\/WoWMoM.2015.7158142"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3796","DOI":"10.1109\/JIOT.2019.2891366","article-title":"Repetitions Versus Retransmissions: Tradeoff in Configuring NB-IoT Random Access Channels","volume":"6","author":"Harwahyu","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"8682","DOI":"10.1109\/TVT.2018.2841348","article-title":"TMED: A Spider-Web-Like Transmission Mechanism for Emergency Data in Vehicular Ad Hoc Networks","volume":"67","author":"Qiu","year":"2018","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_7","unstructured":"(2020, February 20). NB-LTE - Battery Lifetime Evaluation. 3GPP 151393. Available online: https:\/\/www.3gpp.org\/DynaReport\/TDocExMtg--RP-69--31198.htm."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Yeoh, C.Y., bin Man, A., Ashraf, Q.M., and Samingan, A.K. (2018, January 11\u201314). Experimental assessment of battery lifetime for commercial off-the-shelf NB-IoT module. Proceedings of the 2018 20th International Conference on Advanced Communication Technology (ICACT), Chuncheon, Korea.","DOI":"10.23919\/ICACT.2018.8323704"},{"key":"ref_9","unstructured":"Pirayesh, H., Sangdeh, P.K., and Zeng, H. (May, January 29). EE-IoT: An Energy-Efficient IoT Communication Scheme for WLANs. Proceedings of the IEEE Conference on Computer Communications (INFOCOM), Paris, France."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Alshuqayran, N., Ali, N., and Evans, R. (2016, January 4\u20136). A systematic mapping study in microservice architecture. Proceedings of the 2016 IEEE 9th International Conference on Service-Oriented Computing and Applications (SOCA), Macau, China.","DOI":"10.1109\/SOCA.2016.15"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"54074","DOI":"10.1109\/ACCESS.2020.2981434","article-title":"Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA","volume":"8","author":"Alfakih","year":"2020","journal-title":"IEEE Access"},{"key":"ref_12","unstructured":"Mocnej, J., Pekar, A., Seah, W., and Zolotova, I. (2018). Network Traffic Characteristics of the IoT Application Use Cases, School of Engineering and Computer Science, Victoria University of Wellington."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2540","DOI":"10.1109\/JIOT.2020.3017931","article-title":"Building a Lane Merge Coordination for Connected Vehicles Using Deep Reinforcement Learning","volume":"8","author":"Nassef","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2787","DOI":"10.1016\/j.comnet.2010.05.010","article-title":"The internet of things: A survey","volume":"54","author":"Atzori","year":"2010","journal-title":"Comput. Netw."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1109\/MCOM.2017.1600510CM","article-title":"A primer on 3GPP narrowband Internet of Things","volume":"55","author":"Wang","year":"2017","journal-title":"IEEE Commun. Mag."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2621","DOI":"10.1109\/COMST.2017.2721379","article-title":"A Survey of Enabling Technologies of Low Power and Long Range Machine-to-Machine Communications","volume":"19","author":"Wang","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MWC.2019.1800020","article-title":"Narrowband IoT: A Survey on Downlink and Uplink Perspectives","volume":"26","author":"Feltrin","year":"2019","journal-title":"IEEE Wirel. Commun."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Moon, Y., Ha, S., Park, M., Lee, D., and Jeong, J. (2018, January 4\u20137). A Methodology of NB-IoT Mobility Optimization. Proceedings of the Global Internet of Things Summit (GIoTS), Bilbao, Spain.","DOI":"10.1109\/GIOTS.2018.8534564"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5702","DOI":"10.1109\/JIOT.2019.2904799","article-title":"Exploring the Performance Boundaries of NB-IoT","volume":"6","author":"Martinez","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"J\u00f6rke, P., Falkenberg, R., and Wietfeld, C. (2018, January 9\u201313). Power Consumption Analysis of NB-IoT and eMTC in Challenging Smart City Environments. Proceedings of the 2018 IEEE Globecom Workshops (GC Wkshps), Abu Dhabi, United Arab Emirates.","DOI":"10.1109\/GLOCOMW.2018.8644481"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, P., Wu, K., Liang, J., Chen, J., and Tseng, Y. (2018, January 9\u201312). Energy-Efficient Uplink Scheduling for Ultra-Reliable Communications in NB-IoT Networks. Proceedings of the 29th IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC), Bologna, Italy.","DOI":"10.1109\/PIMRC.2018.8580697"},{"key":"ref_22","unstructured":"Feltrin, L., Condoluci, M., Mahmoodi, T., Dohler, M., and Verdone, R. (2018, January 2\u20134). NB-IoT: Performance estimation and optimal configuration. Proceedings of the 24th European Wireless Conference, Catania, Italy."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Li, H., Chen, G., Wang, Y., Gao, Y., and Dong, W. (2018, January 11\u201313). Accurate Performance Modeling of Uplink Transmission in NB-IoT. Proceedings of the 24th IEEE International Conference on Parallel and Distributed Systems (ICPADS), Singapore.","DOI":"10.1109\/PADSW.2018.8644571"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2224","DOI":"10.1109\/COMST.2019.2904897","article-title":"Deep Learning in Mobile and Wireless Networking: A Survey","volume":"21","author":"Zhang","year":"2019","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1424","DOI":"10.1109\/JSAC.2019.2904366","article-title":"Reinforcement Learning for Real-Time Optimization in NB-IoT Networks","volume":"37","author":"Jiang","year":"2019","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chen, L., Chung, W., Chen, I., and Kuo, S. (2018, January 4\u20137). Adaptive Repetition Scheme with Machine Learning for 3GPP NB-IoT. Proceedings of the 23rd IEEE Pacific Rim International Symposium on Dependable Computing (PRDC), Taipei, Taiwan.","DOI":"10.1109\/PRDC.2018.00046"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Guo, Y., and Xiang, M. (2019, January 9\u201313). Multi-Agent Reinforcement Learning Based Energy Efficiency Optimization in NB-IoT Networks. Proceedings of the IEEE GLOBECOM Workshops, Waikoloa, HI, USA.","DOI":"10.1109\/GCWkshps45667.2019.9024676"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ateeq, M., Ishmanov, F., Afzal, M.K., and Naeem, M. (2019). Multi-parametric analysis of reliability and energy consumption in IoT: A deep learning approach. Sensors, 19.","DOI":"10.3390\/s19020309"},{"key":"ref_29","unstructured":"Fu, S., and Zhang, Y. (2020, February 20). CRAWDAD Dataset Due\/Packet-Delivery (v. 2015-04-01). Available online: https:\/\/crawdad.org\/due\/packet-delivery\/20150401\/delay."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"105687","DOI":"10.1109\/ACCESS.2019.2932042","article-title":"A Novel Design Approach for 5G Massive MIMO and NB-IoT Green Networks Using a Hybrid Jaya-Differential Evolution Algorithm","volume":"7","author":"Goudos","year":"2019","journal-title":"IEEE Access"},{"key":"ref_31","unstructured":"(2020, February 20). SARA-N2 Series Power-Optimized NB-IoT (LTE Cat NB1) Modules Data Sheet. Available online: https:\/\/www.u-blox.com\/sites\/default\/files\/SARA-N2_DataSheet_(UBX-15025564).pdf."},{"key":"ref_32","unstructured":"(2020, February 20). Quectel BC95-G Multi-Band NB-IoT Module with Ultra-Low Power Consumption. Available online: https:\/\/www.quectel.com\/UploadFile\/Product\/Quectel_BC95-G_NB-IoT_Specification_V1.9.pdf."},{"key":"ref_33","unstructured":"(2020, November 11). Otii Arc. Available online: https:\/\/www.qoitech.com\/otii\/."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1224","DOI":"10.1109\/JIOT.2020.3013949","article-title":"Dissecting Energy Consumption of NB-IoT Devices Empirically","volume":"8","author":"Michelinakis","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_35","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_36","unstructured":"Berrada, L., Zisserman, A., and Kumar, M.P. (2018). Smooth loss functions for deep top-k classification. arXiv."},{"key":"ref_37","unstructured":"Wang, Z., Schaul, T., Hessel, M., Hasselt, H., Lanctot, M., and Freitas, N. (2016, January 19\u201324). Dueling network architectures for deep reinforcement learning. Proceedings of the 33rd International Conference on Machine Learning, New York, NY, USA."},{"key":"ref_38","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Sardinia, Italy."}],"container-title":["Journal of Sensor and Actuator Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2224-2708\/10\/1\/21\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:33:30Z","timestamp":1760160810000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2224-2708\/10\/1\/21"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,5]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["jsan10010021"],"URL":"https:\/\/doi.org\/10.3390\/jsan10010021","relation":{},"ISSN":["2224-2708"],"issn-type":[{"type":"electronic","value":"2224-2708"}],"subject":[],"published":{"date-parts":[[2021,3,5]]}}}