{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,15]],"date-time":"2025-11-15T10:28:26Z","timestamp":1763202506839,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T00:00:00Z","timestamp":1618272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this article, we address the problem of prolonging the battery life of Internet of Things (IoT) nodes by introducing a smart energy harvesting framework for IoT networks supported by femtocell access points (FAPs) based on the principles of Contract Theory and Reinforcement Learning. Initially, the IoT nodes\u2019 social and physical characteristics are identified and captured through the concept of IoT node types. Then, Contract Theory is adopted to capture the interactions among the FAPs, who provide personalized rewards, i.e., charging power, to the IoT nodes to incentivize them to invest their effort, i.e., transmission power, to report their data to the FAPs. The IoT nodes\u2019 and FAPs\u2019 contract-theoretic utility functions are formulated, following the network economic concept of the involved entities\u2019 personalized profit. A contract-theoretic optimization problem is introduced to determine the optimal personalized contracts among each IoT node connected to a FAP, i.e., a pair of transmission and charging power, aiming to jointly guarantee the optimal satisfaction of all the involved entities in the examined IoT system. An artificial intelligent framework based on reinforcement learning is introduced to support the IoT nodes\u2019 autonomous association to the most beneficial FAP in terms of long-term gained rewards. Finally, a detailed simulation and comparative results are presented to show the pure operation performance of the proposed framework, as well as its drawbacks and benefits, compared to other approaches. Our findings show that the personalized contracts offered to the IoT nodes outperform by a factor of four compared to an agnostic type approach in terms of the achieved IoT system\u2019s social welfare.<\/jats:p>","DOI":"10.3390\/s21082755","type":"journal-article","created":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T22:55:09Z","timestamp":1618354509000},"page":"2755","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Smart Energy Harvesting for Internet of Things Networks"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0969-8508","authenticated-orcid":false,"given":"Fisayo","family":"Sangoleye","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of New Mexico, Albuquerque, NM 87131, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7932-6123","authenticated-orcid":false,"given":"Nafis","family":"Irtija","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of New Mexico, Albuquerque, NM 87131, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1322-1876","authenticated-orcid":false,"given":"Eirini Eleni","family":"Tsiropoulou","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of New Mexico, Albuquerque, NM 87131, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1007\/s10796-014-9492-7","article-title":"The internet of things: A survey","volume":"17","author":"Li","year":"2015","journal-title":"Inf. Syst. Front."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1389","DOI":"10.1109\/JIOT.2018.2799936","article-title":"Software defined networking for energy harvesting internet of things","volume":"5","author":"Huang","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Tsiropoulou, E.E., Paruchuri, S.T., and Baras, J.S. (2017, January 22\u201324). Interest, energy and physical-aware coalition formation and resource allocation in smart IoT applications. Proceedings of the 2017 51st Annual Conference on Information Sciences and Systems (CISS), Baltimore, MD, USA.","DOI":"10.1109\/CISS.2017.7926111"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4436","DOI":"10.1109\/JIOT.2018.2882783","article-title":"Dynamic edge computation offloading for internet of things with energy harvesting: A learning method","volume":"6","author":"Wei","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1016\/j.adhoc.2018.05.013","article-title":"The charger positioning problem in clustered RF-power harvesting wireless sensor networks","volume":"78","author":"Zorbas","year":"2018","journal-title":"Ad Hoc Netw."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Vamvakas, P., Tsiropoulou, E.E., Vomvas, M., and Papavassiliou, S. (2017, January 18\u201320). Adaptive power management in wireless powered communication networks: A user-centric approach. Proceedings of the 2017 IEEE 38th Sarnoff Symposium, Newark, NJ, USA.","DOI":"10.1109\/SARNOF.2017.8080386"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Caillouet, C., Razafindralambo, T., and Zorbas, D. (2019, January 24\u201326). Optimal placement of drones for fast sensor energy replenishment using wireless power transfer. Proceedings of the 2019 Wireless Days (WD), Manchester, UK.","DOI":"10.1109\/WD.2019.8734203"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Adila, A.S., Husam, A., and Husi, G. (2018, January 16\u201318). Towards the self-powered Internet of Things (IoT) by energy harvesting: Trends and technologies for green IoT. Proceedings of the 2018 2nd International Symposium on Small-scale Intelligent Manufacturing Systems (SIMS), Cavan, Ireland.","DOI":"10.1109\/SIMS.2018.8355305"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3194","DOI":"10.1109\/JIOT.2018.2880483","article-title":"Caching in energy harvesting aided Internet of Things: A game-theoretic approach","volume":"6","author":"Yao","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"109901","DOI":"10.1016\/j.rser.2020.109901","article-title":"Design architectures for energy harvesting in the Internet of Things","volume":"128","author":"Zeadally","year":"2020","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"7032","DOI":"10.1109\/JIOT.2020.2982417","article-title":"AI-based joint optimization of QoS and security for 6G energy harvesting internet of things","volume":"7","author":"Mao","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"736","DOI":"10.1109\/JIOT.2017.2742663","article-title":"Internet of hybrid energy harvesting things","volume":"5","author":"Akan","year":"2017","journal-title":"IEEE Internet Things J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2620","DOI":"10.1109\/JIOT.2017.2786705","article-title":"Incentive mechanism design for wireless energy harvesting-based Internet of Things","volume":"5","author":"Hou","year":"2017","journal-title":"IEEE Internet Things J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"9908","DOI":"10.1109\/JIOT.2019.2933335","article-title":"StableSENS: Sampling time decision algorithm for IoT energy harvesting devices","volume":"6","author":"Loreti","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2868","DOI":"10.1109\/JIOT.2018.2849069","article-title":"An on-demand energy requesting scheme for wireless energy harvesting powered IoT networks","volume":"5","author":"Guntupalli","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1007\/s11036-017-0962-2","article-title":"Machine learning and intelligent communications","volume":"23","author":"Huang","year":"2018","journal-title":"Mob. Netw. Appl."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"9175","DOI":"10.1109\/JIOT.2019.2928837","article-title":"Power control in energy harvesting multiple access system with reinforcement learning","volume":"6","author":"Chu","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sikeridis, D., Tsiropoulou, E.E., Devetsikiotis, M., and Papavassiliou, S. (2018, January 29\u201331). Socio-spatial resource management in wireless powered public safety networks. Proceedings of the MILCOM 2018-2018 IEEE Military Communications Conference (MILCOM), Los Angeles, CA, USA.","DOI":"10.1109\/MILCOM.2018.8599752"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1109\/TGCN.2018.2885645","article-title":"Energy-efficient orchestration in wireless powered internet of things infrastructures","volume":"3","author":"Sikeridis","year":"2018","journal-title":"IEEE Trans. Green Commun. Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1109\/TGCN.2018.2839593","article-title":"A distributed energy-harvesting-aware routing algorithm for heterogeneous IoT networks","volume":"2","author":"Nguyen","year":"2018","journal-title":"IEEE Trans. Green Commun. Netw."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"3512","DOI":"10.1109\/JIOT.2020.3023475","article-title":"RF Energy Harvesting for Battery-Less and Maintenance-Free Condition Monitoring of Railway Tracks","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.adhoc.2017.09.003","article-title":"Interest-aware energy collection & resource management in machine to machine communications","volume":"68","author":"Tsiropoulou","year":"2018","journal-title":"Ad Hoc Netw."},{"key":"ref_23","unstructured":"Bolton, P., and Dewatripont, M. (2005). Contract Theory, MIT Press."},{"key":"ref_24","unstructured":"Smith, S.A. (2004). Contract Theory, OUP Oxford."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ertel, W. (2018). Introduction to Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-319-58487-4"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.comcom.2015.05.012","article-title":"Combined power and rate allocation in self-optimized multi-service two-tier femtocell networks","volume":"72","author":"Tsiropoulou","year":"2015","journal-title":"Comput. Commun."},{"key":"ref_27","first-page":"400","article-title":"Performance evaluation of smart home system using internet of things","volume":"8","author":"Gunawan","year":"2018","journal-title":"Int. J. Electr. Comput. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1485","DOI":"10.1109\/OJCOMS.2020.3024778","article-title":"Unified User Association and Contract-Theoretic Resource Orchestration in NOMA Heterogeneous Wireless Networks","volume":"1","author":"Diamanti","year":"2020","journal-title":"IEEE Open J. Commun. Soc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/MCOM.2015.7263349","article-title":"Non-orthogonal multiple access for 5G: Solutions, challenges, opportunities, and future research trends","volume":"53","author":"Dai","year":"2015","journal-title":"IEEE Commun. Mag."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Boyd, S., Boyd, S.P., and Vandenberghe, L. (2004). Convex Optimization, Cambridge University Press.","DOI":"10.1017\/CBO9780511804441"},{"key":"ref_31","first-page":"1","article-title":"Energy-Harvesting Wireless Sensor Networks (EH-WSNs) A Review","volume":"14","author":"Adam","year":"2018","journal-title":"ACM Trans. Sens. Netw. (TOSN)"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/8\/2755\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:47:43Z","timestamp":1760161663000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/8\/2755"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,13]]},"references-count":31,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["s21082755"],"URL":"https:\/\/doi.org\/10.3390\/s21082755","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,4,13]]}}}