{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:04:01Z","timestamp":1760241841675,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2018,8,31]],"date-time":"2018-08-31T00:00:00Z","timestamp":1535673600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010661","name":"Horizon 2020 Framework Programme","doi-asserted-by":"publisher","award":["642743"],"award-info":[{"award-number":["642743"]}],"id":[{"id":"10.13039\/100010661","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Seventh Framework Programme","award":["609090"],"award-info":[{"award-number":["609090"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The Internet-of-things facilitates the development of many groundbreaking applications. A large number of these applications involve mobile end nodes and a sparsely deployed network of base stations that operate as gateways to the Internet. Most of the mobile nodes, at least within city areas, are connected through low power wide area networking technologies (LPWAN) using public frequencies. Mobility and sparse network coverage result in long delays and intermittent connectivity for the end nodes. Disruption Tolerant Networks and utilization of heterogeneous wireless interfaces have emerged as key technologies to tackle the problem at hand. The first technology renders communication resilient to intermittent connectivity by storing and carrying data while the later increases the communication opportunities of the end nodes and at the same time reduces energy consumption whenever short-range communication is possible. However, one has to consider that end nodes are typically both memory and energy constrained devices which makes finding an energy efficient data transmission policy for heterogeneous disruption tolerant networks imperative. In this work we utilize information related to the spatial availability of network resources and localization information to formulate the problem at hand as a dynamic programming problem. Next, we utilize the framework of Markov Decision Processes to derive approximately optimal and suboptimal data transmission policies. We also prove that we can achieve improved packet transmission policies and reduce energy consumption, extending battery lifetime. This is achieved by knowing the spatial availability of heterogeneous network resources combined with the mobile node\u2019s location information. Numerical resultsshow significant gains achieved by utilizing the derived approximately optimal and suboptimal policies.<\/jats:p>","DOI":"10.3390\/s18092891","type":"journal-article","created":{"date-parts":[[2018,8,31]],"date-time":"2018-08-31T10:57:52Z","timestamp":1535713072000},"page":"2891","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Energy Efficient Policies for Data Transmission in Disruption Tolerant Heterogeneous IoT Networks"],"prefix":"10.3390","volume":"18","author":[{"given":"George","family":"Stamatakis","sequence":"first","affiliation":[{"name":"Institute of Computer Science, Foundation for Research and Technology Hellas, N. Plastira 100, 70013 Heraklion, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9566-531X","authenticated-orcid":false,"given":"Elias Z.","family":"Tragos","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, Foundation for Research and Technology Hellas, N. Plastira 100, 70013 Heraklion, Greece"},{"name":"Insight Centre for Data Analytics, University College Dublin, Belfield, D04 V1W8 Dublin 4, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Apostolos","family":"Traganitis","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, Foundation for Research and Technology Hellas, N. Plastira 100, 70013 Heraklion, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1080\/01436597.2016.1191942","article-title":"The economics of the Internet-of-things in the Global South","volume":"38","author":"Kshetri","year":"2017","journal-title":"Third World Q."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Angelakis, V., Tragos, E., P\u00f6hls, H., Kapovits, A., and Bassi, A. (2017). Designing, Developing, and Facilitating Smart Cities, Springer.","DOI":"10.1007\/978-3-319-44924-1"},{"key":"ref_3","first-page":"17","article-title":"Mobile Wireless Sensor Networks Overview","volume":"2","author":"Rezazadeh","year":"2012","journal-title":"Int. J. Comput. Commun. Netw."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Tragos, E.Z., Fragkiadakis, A., Askoxylakis, I., and Siris, V.A. (July, January 28). The impact of interference on the performance of a multi-path metropolitan wireless mesh network. Proceedings of the 2011 IEEE Symposium on Computers and Communications (ISCC), Kerkyra, Greece.","DOI":"10.1109\/ISCC.2011.5983840"},{"key":"ref_5","unstructured":"Tragos, E.Z., Lignan, A., Fragkiadakis, A., and Fabregas, M. (2018, January 14\u201316). An Experimental Evaluation of Network Reliability in a Secure Internet-of-things Deployment. Proceedings of the International Conference on Embedded Wireless Systems and Networks (EWSN), Madrid, Spain."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1109\/TMC.2007.1006","article-title":"Delay\/fault-tolerant mobile sensor network (DFT-MSN): A new paradigm for pervasive information gathering","volume":"6","author":"Wang","year":"2007","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"554","DOI":"10.1109\/TNET.2009.2039491","article-title":"Design and field experimentation of an energy-efficient architecture for DTN throwboxes","volume":"18","author":"Banerjee","year":"2010","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1016\/j.adhoc.2008.06.003","article-title":"Energy conservation in wireless sensor networks: A survey","volume":"7","author":"Anastasi","year":"2009","journal-title":"Ad Hoc Netw."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Inzerilli, T., Vegni, A.M., Neri, A., and Cusani, R. (2008, January 12\u201314). A location-based vertical handover algorithm for limitation of the ping-pong effect. Proceedings of the 2008 IEEE International Conference on Wireless and Mobile Computing, Networking and Communications, Avignon, France.","DOI":"10.1109\/WiMob.2008.64"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"P\u00f6ttner, W.B., B\u00fcsching, F., Von Zengen, G., and Wolf, L. (2012, January 8\u201311). Data elevators: Applying the bundle protocol in delay tolerant wireless sensor networks. Proceedings of the 2012 IEEE 9th International Conference on Mobile Adhoc and Sensor Systems (MASS), Las Vegas, NV, USA.","DOI":"10.1109\/MASS.2012.6502520"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Auzias, M., Mah\u00e9o, Y., and Raimbault, F. (2015, January 24\u201326). CoAP over BP for a delay-tolerant Internet-of-things. Proceedings of the 2015 3rd International Conference on Future Internet-of-things and Cloud, Rome, Italy.","DOI":"10.1109\/FiCloud.2015.33"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1531","DOI":"10.1016\/j.jnca.2012.12.028","article-title":"Opportunistic IoT: Exploring the harmonious interaction between human and the Internet-of-things","volume":"36","author":"Guo","year":"2013","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wirtz, H., R\u00fcth, J., Serror, M., Bitsch Link, J.\u00c1., and Wehrle, K. (2014, January 7). Opportunistic interaction in the challenged Internet-of-things. Proceedings of the 9th ACM MobiCom workshop on Challenged networks, Maui, HI, USA.","DOI":"10.1145\/2645672.2645679"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"S\u00f6derman, P., Grinnemo, K.J., Hidell, M., and Sj\u00f6din, P. (2015, January 9\u201311). Mind the smartgap: A buffer management algorithm for delay tolerant wireless sensor networks. Proceedings of the European Conference on Wireless Sensor Networks, Porto, Portugal.","DOI":"10.1007\/978-3-319-15582-1_7"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Benhamida, F.Z., Bouabdellah, A., and Challal, Y. (2017, January 4\u20136). Using delay tolerant network for the Internet-of-things: Opportunities and challenges. Proceedings of the Information and Communication Systems (ICICS), Irbid, Jordan.","DOI":"10.1109\/IACS.2017.7921980"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Doering, M., Rottmann, S., and Wolf, L. (2011, January 26\u201330). Design and implementation of a low-power energy management module with emergency reserve for solar powered dtn-nodes. Proceedings of the 3rd Extreme Conference on Communication: The Amazon Expedition, Manaus, Brazil.","DOI":"10.1145\/2414393.2414399"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.jnca.2017.04.004","article-title":"Throwboxes in delay tolerant networks: A survey of placement strategies, buffering capacity, and mobility models","volume":"91","author":"Qirtas","year":"2017","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1109\/COMST.2017.2652320","article-title":"Low Power Wide Area Networks: An Overview","volume":"19","author":"Raza","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_19","unstructured":"(2018, July 20). Available online: https:\/\/www.link-labs.com\/."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1466","DOI":"10.3390\/s16091466","article-title":"A study of LoRa: Long range & low power networks for the Internet of things","volume":"16","author":"Augustin","year":"2016","journal-title":"Sensors"},{"key":"ref_21","unstructured":"(2018, July 20). Available online: https:\/\/sigfoxconnect.com\/."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1109\/MCOM.2017.1600510CM","article-title":"A primer on 3GPP narrowband Internet-of-things","volume":"55","author":"Wang","year":"2017","journal-title":"IEEE Commun. Mag."},{"key":"ref_23","unstructured":"(2011). IEEE Standard for Local and metropolitan area networks\u2014Part 15.4: Low-Rate Wireless Personal Area Networks (LR-WPANs). IEEE Std 802.15.4-2011 (Revision of IEEE Std 802.15.4-2006), IEEE."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Traganitis, P.A., Shen, Y., and Giannakis, G.B. (September, January 28). Network topology inference via elastic net structural equation models. Proceedings of the 2017 25th European Signal Processing Conference (EUSIPCO), Kos, Greece.","DOI":"10.23919\/EUSIPCO.2017.8081186"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Traganitis, P.A., Shen, Y., and Giannakis, G.B. (2017, January 1\u20134). Topology inference of multilayer networks. Proceedings of the 2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Atlanta, GA, USA.","DOI":"10.1109\/INFCOMW.2017.8116495"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Papakostas, D., Basaras, P., Katsaros, D., and Tassiulas, L. (2016, January 1\u20133). Backbone formation in military multi-layer ad hoc networks using complex network concepts. Proceedings of MILCOM 2016\u20142016 IEEE Military Communications Conference, Baltimore, MD, USA.","DOI":"10.1109\/MILCOM.2016.7795434"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Emara, M., Filippou, M.C., and Karls, I. (arXiv, 2018). Availability and Reliability of Wireless Links in 5G Systems: A Space-Time Approach, arXiv.","DOI":"10.1109\/GLOCOMW.2018.8644278"},{"key":"ref_28","unstructured":"IEEE Standard for Information Technology (2011). Part 15.4; Wireless Medium Access Control (MAC) and Physical Layer (PHY) Specifications for Low-Rate Wireless Personal Area Networks (LRWPANs), IEEE Computer Society."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Goursaud, C., and Gorce, J. (2015). Dedicated networks for IoT: PHY\/MAC state of the art and challenges. EAI Endorsed Trans. Int. Things.","DOI":"10.4108\/eai.26-10-2015.150597"},{"key":"ref_30","unstructured":"Bertsekas, D. (2012). Dynamic Programming and Optimal Control, Athena Scientific."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Sutton, R.S., and Barto, A.G. (1998). Reinforcement Learning: An Introduction, MIT Press.","DOI":"10.1109\/TNN.1998.712192"},{"key":"ref_32","unstructured":"Puterman, M.L. (2014). Markov Decision Processes: Discrete Stochastic Dynamic Programming, John Wiley & Sons."},{"key":"ref_33","unstructured":"Bertsekas, D. (2017). Dynamic Programming and Optimal Control, Athena Scientific."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bertsekas, D.P. (2013). Rollout algorithms for discrete optimization: A survey. Handbook of Combinatorial Optimization, Springer.","DOI":"10.1007\/978-1-4419-7997-1_8"},{"key":"ref_35","unstructured":"Makridakis, S.G., Wheelwright, S.C., and Hyndman, R.J. (1997). Forecasting: Methods and Applications, Wiley. [3rd ed.]."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Stamatakis, G., Tragos, E.Z., and Traganitis, A. (2015, January 24\u201328). Periodic collection of spectrum occupancy data by energy constrained cognitive IoT devices. Proceedings of the 2015 International Wireless Communications and Mobile Computing Conference (IWCMC), Dubrovnik, Croatia.","DOI":"10.1109\/IWCMC.2015.7289199"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Stamatakis, G., Tragos, E.Z., and Traganitis, A. (2015, January 6\u201310). A Two-Stage Spectrum Assignment Scheme for Power and QoS Constrained Cognitive CSMA\/CA Networks. Proceedings of the 2015 Globecom Workshops (GC Wkshps), San Diego, CA, USA.","DOI":"10.1109\/GLOCOMW.2015.7414183"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/9\/2891\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:22:29Z","timestamp":1760196149000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/9\/2891"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,31]]},"references-count":37,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2018,9]]}},"alternative-id":["s18092891"],"URL":"https:\/\/doi.org\/10.3390\/s18092891","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,8,31]]}}}