{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,24]],"date-time":"2025-08-24T01:52:46Z","timestamp":1756000366171,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":41,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,23]],"date-time":"2021-08-23T00:00:00Z","timestamp":1629676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"EC H2020, IoTAC - Security By Design IoT Development and Certificate Framework with Front-end Access Control.","award":["952684"],"award-info":[{"award-number":["952684"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,23]]},"DOI":"10.1145\/3472735.3473390","type":"proceedings-article","created":{"date-parts":[[2021,8,13]],"date-time":"2021-08-13T23:26:21Z","timestamp":1628897181000},"page":"26-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Reinforcement Learning and Energy-Aware Routing"],"prefix":"10.1145","author":[{"given":"Piotr","family":"Fr\u00f6hlich","sequence":"first","affiliation":[{"name":"Institute of Theoretical and Applied Informatics, IITIS-PAN Gliwice, Silesia, Poland"}]},{"given":"Erol","family":"Gelenbe","sequence":"additional","affiliation":[{"name":"Institute of Theoretical and Applied Informatics, IITIS-PAN Gliwice, Silesia, Poland & Lab. I3S, Universit\u00e9 C\u00f4te d'Azur Nice, France"}]},{"given":"Mateusz","family":"Nowak","sequence":"additional","affiliation":[{"name":"Institute of Theoretical and Applied Informatics, IITIS-PAN Gliwice, Silesia, Poland"}]}],"member":"320","published-online":{"date-parts":[[2021,8,23]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3390\/challe6010117"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/sec.1737"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2620728.2620744"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","unstructured":"Andreas Berl et al. 2010. Energy-efficient cloud computing. The computer journal 53 7 (2010) 1045--1051.  Andreas Berl et al. 2010. Energy-efficient cloud computing. The computer journal 53 7 (2010) 1045--1051.","DOI":"10.1093\/comjnl\/bxp080"},{"key":"e_1_3_2_1_5_1","volume-title":"R\u00e9duire la consommation \u00e9nerg\u00e9tique du num\u00e9rique. Conseil G\u00e9neral de l'\u00c9conomie","author":"Campana Mireille","year":"2019","unstructured":"Mireille Campana , Jean Cuegniet , Michel Scmitt , and C\u00e9dric Siben . 2019. R\u00e9duire la consommation \u00e9nerg\u00e9tique du num\u00e9rique. Conseil G\u00e9neral de l'\u00c9conomie , Ministry of Finances , Paris ( 2019 ). https:\/\/www.economie.gouv.fr\/files\/files\/directions_services\/cge\/consommation-energique-numerique.pdf Mireille Campana, Jean Cuegniet, Michel Scmitt, and C\u00e9dric Siben. 2019. R\u00e9duire la consommation \u00e9nerg\u00e9tique du num\u00e9rique. Conseil G\u00e9neral de l'\u00c9conomie, Ministry of Finances, Paris (2019). https:\/\/www.economie.gouv.fr\/files\/files\/directions_services\/cge\/consommation-energique-numerique.pdf"},{"key":"e_1_3_2_1_6_1","volume-title":"Godlove Suila Kuaban, and Dariusz Marek","author":"Czach\u00f3rski Tadeusz","year":"2021","unstructured":"Tadeusz Czach\u00f3rski , Erol Gelenbe , Godlove Suila Kuaban, and Dariusz Marek . 2021 . Time-Dependent Performance of a Multi-Hop Software Defined Network. Applied Sciences 11, 6 (2021). https:\/\/doi.org\/10.3390\/app11062469 Tadeusz Czach\u00f3rski, Erol Gelenbe, Godlove Suila Kuaban, and Dariusz Marek. 2021. Time-Dependent Performance of a Multi-Hop Software Defined Network. Applied Sciences 11, 6 (2021). https:\/\/doi.org\/10.3390\/app11062469"},{"key":"e_1_3_2_1_7_1","volume-title":"Climate Crisis: The unsustainable use of online video. https:\/\/theshiftproject.org\/wp-content\/uploads\/2019\/07\/2019-02.pdf","author":"Efoui-Hess Maxime","year":"2019","unstructured":"Maxime Efoui-Hess . 2019 . Climate Crisis: The unsustainable use of online video. https:\/\/theshiftproject.org\/wp-content\/uploads\/2019\/07\/2019-02.pdf Maxime Efoui-Hess. 2019. Climate Crisis: The unsustainable use of online video. https:\/\/theshiftproject.org\/wp-content\/uploads\/2019\/07\/2019-02.pdf"},{"key":"e_1_3_2_1_8_1","unstructured":"Hugues Ferreboeuf and etal 2019. Lean ICT: Towards Digital Sobriety.  Hugues Ferreboeuf and et al. 2019. Lean ICT: Towards Digital Sobriety."},{"key":"e_1_3_2_1_9_1","volume-title":"Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), 2016 IEEE 24th International Symposium on. IEEE, 283--288","author":"Francois Frederic","year":"2016","unstructured":"Frederic Francois and Erol Gelenbe . 2016 . Optimizing secure sdn-enabled interdata centre overlay networks through cognitive routing. In Modeling , Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), 2016 IEEE 24th International Symposium on. IEEE, 283--288 . Frederic Francois and Erol Gelenbe. 2016. Optimizing secure sdn-enabled interdata centre overlay networks through cognitive routing. In Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), 2016 IEEE 24th International Symposium on. IEEE, 283--288."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"crossref","unstructured":"P. Fr\u00f6hlich E. Gelenbe J. Fio\u0142ka J. Checinski M. Nowak and Z. Filus. 2021. Smart SDN Management of Fog Services to Optimize QoS and Energy. Sensors 21 (April 2021) 3105. https:\/\/doi.org\/10.3390\/s21093105  P. Fr\u00f6hlich E. Gelenbe J. Fio\u0142ka J. Checinski M. Nowak and Z. Filus. 2021. Smart SDN Management of Fog Services to Optimize QoS and Energy. Sensors 21 (April 2021) 3105. https:\/\/doi.org\/10.3390\/s21093105","DOI":"10.3390\/s21093105"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1989.1.4.502"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1538788.1538809"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2755977"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2020.2992559"},{"key":"e_1_3_2_1_15_1","volume-title":"24th Tyrrhenian International Workshop on Digital Communications - Green ICT (TIWDC). IEEEXpress, 1--6. https:\/\/doi.org\/10","author":"Gelenbe E.","year":"2013","unstructured":"E. Gelenbe , D. Gesbert , D. Gunduz , H. K\u00fclah , and E. Uysal-Biyiko glu. 2013. Energy harvesting communication networks: Optimization and demonstration (the E-CROPS project) . In 24th Tyrrhenian International Workshop on Digital Communications - Green ICT (TIWDC). IEEEXpress, 1--6. https:\/\/doi.org\/10 .1109\/TIWDC. 2013 .6664201 E. Gelenbe, D. Gesbert, D. Gunduz, H. K\u00fclah, and E. Uysal-Biyiko glu. 2013. Energy harvesting communication networks: Optimization and demonstration (the E-CROPS project). In 24th Tyrrhenian International Workshop on Digital Communications - Green ICT (TIWDC). IEEEXpress, 1--6. https:\/\/doi.org\/10.1109\/TIWDC.2013.6664201"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2004.03.009"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-5316(01)00042-6"},{"key":"e_1_3_2_1_18_1","unstructured":"Erol Gelenbe and Toktam Mahmoodi. 2011. Energy-Aware Routing in the Cognitive Packet Network. 7--12. https:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.725.5635&rep=rep1&type=pdf  Erol Gelenbe and Toktam Mahmoodi. 2011. Energy-Aware Routing in the Cognitive Packet Network. 7--12. https:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.725.5635&rep=rep1&type=pdf"},{"key":"e_1_3_2_1_19_1","volume-title":"Social Informatics and Telecommunications Engineering","volume":"22","author":"Gelenbe E.","unstructured":"E. Gelenbe and S. Silvestri . 2009. Optimisation of Power Consumption in Wired Packet Networks. In QShine 2009. Lecture Notes of the Institute for Computer Sciences , Social Informatics and Telecommunications Engineering , Vol. 22 . Springer, Berlin, Heidelberg, 717--629. https:\/\/doi.org\/10.1007\/978-3-642-10625-5_45 E. Gelenbe and S. Silvestri. 2009. Optimisation of Power Consumption in Wired Packet Networks. In QShine 2009. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, Vol. 22. Springer, Berlin, Heidelberg, 717--629. https:\/\/doi.org\/10.1007\/978-3-642-10625-5_45"},{"key":"e_1_3_2_1_20_1","volume-title":"24th International Symposium on Computer and Information Sciences. IEEEXplore, 292--297","author":"Gelenbe E.","year":"2009","unstructured":"E. Gelenbe and S. Silvestri . 2009. Reducing power consumption in wired networks . In 24th International Symposium on Computer and Information Sciences. IEEEXplore, 292--297 . https:\/\/doi.org\/10.1109\/ISCIS. 2009 .5291829 E. Gelenbe and S. Silvestri. 2009. Reducing power consumption in wired networks. In 24th International Symposium on Computer and Information Sciences. IEEEXplore, 292--297. https:\/\/doi.org\/10.1109\/ISCIS.2009.5291829"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/0307-904X(91)90055-T"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxy029"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","unstructured":"N. Huin M. Rifai F. Giroire D. Lopez Pacheco G. Urvoy-Keller and J. Moulierac. 2017. Bringing Energy Aware Routing Closer to Reality with SDN Hybrid Networks. (2017) 1--7. https:\/\/doi.org\/10.1109\/GLOCOM.2017.8254456  N. Huin M. Rifai F. Giroire D. Lopez Pacheco G. Urvoy-Keller and J. Moulierac. 2017. Bringing Energy Aware Routing Closer to Reality with SDN Hybrid Networks. (2017) 1--7. https:\/\/doi.org\/10.1109\/GLOCOM.2017.8254456","DOI":"10.1109\/GLOCOM.2017.8254456"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGCN.2018.2842123"},{"key":"e_1_3_2_1_25_1","volume-title":"How to stop data centres from gobbling up the world's electricity: The energy-efficiency drive at the information factories that serve us Facebook, Google and Bitcoin. Nature 561 (September","author":"Jones Nicola","year":"2018","unstructured":"Nicola Jones . 2018. How to stop data centres from gobbling up the world's electricity: The energy-efficiency drive at the information factories that serve us Facebook, Google and Bitcoin. Nature 561 (September 2018 ), 163--166. https:\/\/doi.org\/10.1038\/d41586-018-06610-y Nicola Jones. 2018. How to stop data centres from gobbling up the world's electricity: The energy-efficiency drive at the information factories that serve us Facebook, Google and Bitcoin. Nature 561 (September 2018), 163--166. https:\/\/doi.org\/10.1038\/d41586-018-06610-y"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2017.1600970"},{"key":"e_1_3_2_1_27_1","volume-title":"Securing Internet of Things (IoT) with Software Defined Networking (SDN)","author":"Kalkan K\u00fcbra","year":"2017","unstructured":"K\u00fcbra Kalkan and Sherali Zeadally . 2017. Securing Internet of Things (IoT) with Software Defined Networking (SDN) . IEEE Communications Magazine (November 2017 ). https:\/\/doi.org\/10.1109\/MCOM.2017.1700714 K\u00fcbra Kalkan and Sherali Zeadally. 2017. Securing Internet of Things (IoT) with Software Defined Networking (SDN). IEEE Communications Magazine (November 2017). https:\/\/doi.org\/10.1109\/MCOM.2017.1700714"},{"key":"e_1_3_2_1_28_1","unstructured":"George Kamiya. 2020. Data Centres and Data Transmission Networks. https:\/\/www.iea.org\/reports\/data-centres-and-data-transmission-networks  George Kamiya. 2020. Data Centres and Data Transmission Networks. https:\/\/www.iea.org\/reports\/data-centres-and-data-transmission-networks"},{"key":"e_1_3_2_1_29_1","article-title":"Self-Awareness in Computer","volume":"2014","author":"Keller Ariane","year":"2014","unstructured":"Ariane Keller , Daniel Borkmann , Stephan Neuhaus , and Markus Happe . 2014 . Self-Awareness in Computer Networks. Int. J. Reconfig. Comp. 2014 (2014), 692076:1-692076:16. https:\/\/doi.org\/10.1155\/2014\/692076 Ariane Keller, Daniel Borkmann, Stephan Neuhaus, and Markus Happe. 2014. Self-Awareness in Computer Networks. Int. J. Reconfig. Comp. 2014 (2014), 692076:1-692076:16. https:\/\/doi.org\/10.1155\/2014\/692076","journal-title":"Networks. Int. J. Reconfig. Comp."},{"key":"e_1_3_2_1_30_1","volume-title":"Kurinec and Sumeet Walia (Eds.)","author":"Santosh","year":"2020","unstructured":"Santosh K. Kurinec and Sumeet Walia (Eds.) . 2020 . Energy Efficient Computing & Electronics: Devices to Systems. CRC Press . https:\/\/doi.org\/10.1109\/MIE.2020.2966835 Santosh K. Kurinec and Sumeet Walia (Eds.). 2020. Energy Efficient Computing & Electronics: Devices to Systems. CRC Press. https:\/\/doi.org\/10.1109\/MIE.2020.2966835"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/GLOCOMW.2010.5700175"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CAMAD.2010.5686955"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.adhoc.2014.11.001"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jnca.2016.03.016"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"crossref","unstructured":"Barbara Pernici et al. 2012. What IS can do for environmental sustainability: a report from CAiSE'11 panel on Green and sustainable IS. Communications of the Association for Information Systems 30 1 (2012).  Barbara Pernici et al. 2012. What IS can do for environmental sustainability: a report from CAiSE'11 panel on Green and sustainable IS. Communications of the Association for Information Systems 30 1 (2012).","DOI":"10.17705\/1CAIS.03018"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/bxp053"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1021\/ac60214a047"},{"key":"e_1_3_2_1_38_1","unstructured":"R. S. Sutton and A. G. Barto. 2018. Reinforcement learning: An Introduction 2nd edition. MIT Press.  R. S. Sutton and A. G. Barto. 2018. Reinforcement learning: An Introduction 2nd edition. MIT Press."},{"key":"e_1_3_2_1_39_1","volume-title":"Home Page of Onos Project: Open source SDN controller. https:\/\/onosproject.org [Online","author":"Vachuska Thomas","year":"2020","unstructured":"Thomas Vachuska , Andrea Campanella , Carmelo Cascone , Charles Chan , Jordan Halterman , Jian Li , and Brian O'Connor . 2020. Home Page of Onos Project: Open source SDN controller. https:\/\/onosproject.org [Online ; Last accessed 13 Mar 2020 ]. Thomas Vachuska, Andrea Campanella, Carmelo Cascone, Charles Chan, Jordan Halterman, Jian Li, and Brian O'Connor. 2020. Home Page of Onos Project: Open source SDN controller. https:\/\/onosproject.org [Online; Last accessed 13 Mar 2020]."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"crossref","unstructured":"R. Verdecchia F. Ricchiuti A. Hankel P. Lago and G. Procaccianti. 2017. Green ICT Research and Challenges. In Advances and New Trends in Environmental Informatics. Progress in IS V. Wohlgemuth F. Fuchs-Kittowski and J. Wittmann (Eds.). Springer Cham. https:\/\/doi.org\/10.1007\/978-3-319-44711-7_4  R. Verdecchia F. Ricchiuti A. Hankel P. Lago and G. Procaccianti. 2017. Green ICT Research and Challenges. In Advances and New Trends in Environmental Informatics. Progress in IS V. Wohlgemuth F. Fuchs-Kittowski and J. Wittmann (Eds.). Springer Cham. https:\/\/doi.org\/10.1007\/978-3-319-44711-7_4","DOI":"10.1007\/978-3-319-44711-7_4"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2012.07.016"}],"event":{"name":"SIGCOMM '21: ACM SIGCOMM 2021 Conference","sponsor":["SIGCOMM ACM Special Interest Group on Data Communication"],"location":"Virtual Event USA","acronym":"SIGCOMM '21"},"container-title":["Proceedings of the 4th FlexNets Workshop on Flexible Networks Artificial Intelligence Supported Network Flexibility and Agility"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472735.3473390","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3472735.3473390","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:48:35Z","timestamp":1750193315000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3472735.3473390"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,23]]},"references-count":41,"alternative-id":["10.1145\/3472735.3473390","10.1145\/3472735"],"URL":"https:\/\/doi.org\/10.1145\/3472735.3473390","relation":{},"subject":[],"published":{"date-parts":[[2021,8,23]]},"assertion":[{"value":"2021-08-23","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}