{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T22:15:31Z","timestamp":1784931331926,"version":"3.55.0"},"reference-count":38,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T00:00:00Z","timestamp":1727308800000},"content-version":"vor","delay-in-days":269,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Journal of Computer Networks and Communications"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:p>Edge computing allows IoT tasks to be processed by devices with passive processing capacity at the network\u2019s edge and near IoT devices instead of being sent to cloud servers. However, 5G\u2010enabled architectures such as Fog Radio Access Network (F\u2010RAN) use smart devices to bring the delay down to even a few milliseconds. This is important, especially in latency\u2010sensitive applications such as online digital games. However, a trade\u2010off must be made between the delay and energy consumption. If too many tasks are processed locally on edge devices or fog servers, energy consumption increases because mobile devices such as smartphones and tablets have limited energy charges. This paper proposes a Deep Reinforcement Learning (DRL) method for offloading optimization. In designing states, we consider all three critical components of memory consumption, the number of CPU cycles, and network mode. This makes the modeling aware of the workload of the tasks. As a result, the model matches the requirements of the real world. For each mobile device that submits a task to the system, we consider a reward. It includes the total delay of tasks and energy consumption. The output of our DRL model specifies to which edge\/fog\/cloud device each task should be offloaded. The results show that the DRL technique produces less resource waste than RL when the number of tasks is very high. In addition, DRL consumes 30% less network resources than the FIFO method. As a result, DRL provides a better trade\u2010off between offloading and local execution than other methods.<\/jats:p>","DOI":"10.1155\/2024\/6255511","type":"journal-article","created":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T12:50:58Z","timestamp":1727355058000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Multiobjective Offloading Optimization in Fog Computing Using Deep Reinforcement Learning"],"prefix":"10.1155","volume":"2024","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9137-6545","authenticated-orcid":false,"given":"Hojjat","family":"Mashal","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0292-7008","authenticated-orcid":false,"given":"Mohammad Hossein","family":"Rezvani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,9,26]]},"reference":[{"key":"e_1_2_10_1_2","doi-asserted-by":"publisher","DOI":"10.55730\/1300-0632.3979"},{"key":"e_1_2_10_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11277-021-08684-w"},{"key":"e_1_2_10_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2019.02.009"},{"key":"e_1_2_10_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00607-020-00812-x"},{"key":"e_1_2_10_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-022-03542-1"},{"key":"e_1_2_10_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3603703"},{"key":"e_1_2_10_7_2","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton R. S.","year":"2018"},{"key":"e_1_2_10_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2021.04.028"},{"key":"e_1_2_10_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/tvt.2020.3041929"},{"key":"e_1_2_10_10_2","doi-asserted-by":"publisher","DOI":"10.23919\/icn.2020.0020"},{"key":"e_1_2_10_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/twc.2019.2901850"},{"key":"e_1_2_10_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/tii.2018.2883991"},{"key":"e_1_2_10_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/jiot.2018.2875915"},{"key":"e_1_2_10_14_2","doi-asserted-by":"publisher","DOI":"10.1002\/spe.2509"},{"key":"e_1_2_10_15_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.comcom.2020.02.017"},{"key":"e_1_2_10_16_2","doi-asserted-by":"publisher","DOI":"10.1049\/iet-its.2019.0783"},{"key":"e_1_2_10_17_2","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/6455617"},{"key":"e_1_2_10_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2023.10.012"},{"key":"e_1_2_10_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2019.09.060"},{"key":"e_1_2_10_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/jiot.2020.2981557"},{"key":"e_1_2_10_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/tvt.2023.3309321"},{"key":"e_1_2_10_22_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics9091501"},{"key":"e_1_2_10_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/jiot.2021.3126101"},{"key":"e_1_2_10_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2023.111179"},{"key":"e_1_2_10_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/tnsm.2021.3087258"},{"key":"e_1_2_10_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/tnse.2022.3172794"},{"key":"e_1_2_10_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/access.2024.3376670"},{"key":"e_1_2_10_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/jiot.2020.3009540"},{"key":"e_1_2_10_29_2","doi-asserted-by":"crossref","unstructured":"MebrekA. EsseghirM. andMerghem-BoulahiaL. Energy-efficient solution based on reinforcement learning approach in fog networks Proceedings of the 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC) June 2019 Tangier Morocco IEEE.","DOI":"10.1109\/IWCMC.2019.8766441"},{"key":"e_1_2_10_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/jiot.2018.2878435"},{"key":"e_1_2_10_31_2","doi-asserted-by":"crossref","unstructured":"ZhuS. LiP. Wang LiL. SamuelA. andZhaoY. March. Deep reinforced energy efficient traffic grooming in fog-cloud elastic optical networks Proceedings of the 2020 Optical Fiber Communications Conference and Exhibition (OFC) March 2020 San Diego CA USA IEEE 1\u20133.","DOI":"10.1364\/OFC.2020.M1A.4"},{"key":"e_1_2_10_32_2","doi-asserted-by":"crossref","unstructured":"DehuryC. K.andSriramaS. N. Personalized service delivery using reinforcement learning in fog and cloud environment Proceedings of the 21st International Conference on Information Integration and Web-Based Applications & Services December 2019 Munich Germany 522\u2013529.","DOI":"10.1145\/3366030.3366055"},{"key":"e_1_2_10_33_2","doi-asserted-by":"publisher","DOI":"10.1108\/ijicc-03-2020-0021"},{"key":"e_1_2_10_34_2","doi-asserted-by":"crossref","unstructured":"DehuryC. K.andSriramaS. N. An efficient service dispersal mechanism for fog and cloud computing using deep reinforcement learning Proceedings of the 2020 20th IEEE\/ACM International Symposium on Cluster Cloud and Internet Computing (CCGRID) May 2020 Melbourne Australia IEEE 589\u2013598.","DOI":"10.1109\/CCGrid49817.2020.00-34"},{"key":"e_1_2_10_35_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.biosx.2022.100180"},{"key":"e_1_2_10_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-020-03230-y"},{"key":"e_1_2_10_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/tnet.2015.2487344"},{"key":"e_1_2_10_38_2","first-page":"99","article-title":"Complexity analysis of real-time reinforcement learning","volume":"93","author":"Koenig S.","year":"1993","journal-title":"AAAI"}],"container-title":["Journal of Computer Networks and Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2024\/6255511","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,26]],"date-time":"2024-09-26T12:51:06Z","timestamp":1727355066000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2024\/6255511"}},"subtitle":[],"editor":[{"given":"Ihsan","family":"Ali","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":38,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.1155\/2024\/6255511"],"URL":"https:\/\/doi.org\/10.1155\/2024\/6255511","archive":["Portico"],"relation":{},"ISSN":["2090-7141","2090-715X"],"issn-type":[{"value":"2090-7141","type":"print"},{"value":"2090-715X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1]]},"assertion":[{"value":"2022-10-14","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-17","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-26","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"6255511"}}