{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T14:59:05Z","timestamp":1773413945840,"version":"3.50.1"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2022,12,20]],"date-time":"2022-12-20T00:00:00Z","timestamp":1671494400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61901099"],"award-info":[{"award-number":["61901099"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100003787","name":"Natural Science Foundation of Hebei Province","doi-asserted-by":"crossref","award":["F2020501037"],"award-info":[{"award-number":["F2020501037"]}],"id":[{"id":"10.13039\/501100003787","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Science and Technology Project of Hebei Education Department","award":["ZD2022164"],"award-info":[{"award-number":["ZD2022164"]}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["N2223031 and XJS210107"],"award-info":[{"award-number":["N2223031 and XJS210107"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Japan Society for the Promotion of Science (JSPS) Grants-in-Aid for Scientific Research","award":["JP18K18044 and JP21K17736"],"award-info":[{"award-number":["JP18K18044 and JP21K17736"]}]},{"DOI":"10.13039\/501100021171","name":"Guangdong Basic and Applied Basic Research Foundation","doi-asserted-by":"crossref","award":["2020A1515110079"],"award-info":[{"award-number":["2020A1515110079"]}],"id":[{"id":"10.13039\/501100021171","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"crossref","award":["2021M692501"],"award-info":[{"award-number":["2021M692501"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Sen. Netw."],"published-print":{"date-parts":[[2023,5,31]]},"abstract":"<jats:p>The Internet of Medical Things (IoMT) and Artificial Intelligence (AI) have brought unprecedented opportunities to meet massive behavioral data access and personalization requirements for Internet of Behavior (IoB). They facilitate the communication and computing resource allocation to guarantee low delay and energy consumption demands in healthcare. This article presents an improved offloading algorithm for Mobile Edge Computing (MEC) based on Deep Q Network (DQN) and Simulated Annealing (SA) for IoB. Firstly, we analyze the network model and establish a task cost function based on processing delay and energy consumption. Secondly, we define a Distributed Optimization Problem (DOP) to maximize individual utilities and system utility, which is proved to be a potential countermeasure. Thirdly, we conduct Markov modeling for the current offloading strategy-making scheme and define the objectives and constraints of the optimization function. At the same time, the SA is introduced into the DQN Algorithm, which improves the capacity of the algorithm by focusing on the exploration in the early stage and following the experience value in the later stage. From the simulation results, we can see that compared with the traditional scheme, the proposed strategy can maximize the utilization of the system and reduce processing delay and energy consumption.<\/jats:p>","DOI":"10.1145\/3532093","type":"journal-article","created":{"date-parts":[[2022,5,2]],"date-time":"2022-05-02T12:25:24Z","timestamp":1651494324000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":45,"title":["A MEC Offloading Strategy Based on Improved DQN and Simulated Annealing for Internet of Behavior"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8006-364X","authenticated-orcid":false,"given":"Xiaoming","family":"Yuan","sequence":"first","affiliation":[{"name":"Qinghuangdao Branch Campus, Northeastern University China, Qinhuangdao, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5442-8956","authenticated-orcid":false,"given":"Hansen","family":"Tian","sequence":"additional","affiliation":[{"name":"Qinghuangdao Branch Campus, Northeastern University China, Qinhuangdao, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0836-0591","authenticated-orcid":false,"given":"Zedan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Qinghuangdao Branch Campus, Northeastern University China, Qinhuangdao, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7688-8849","authenticated-orcid":false,"given":"Zheyu","family":"Zhao","sequence":"additional","affiliation":[{"name":"Qinghuangdao Branch Campus, Northeastern University China, Qinhuangdao, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8173-0408","authenticated-orcid":false,"given":"Lei","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Integrated Service Networks, Xidian University and Xidian Guangzhou Institute of Technology China, Guangzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0229-2460","authenticated-orcid":false,"given":"Arun Kumar","family":"Sangaiah","sequence":"additional","affiliation":[{"name":"School of Computing Science and Engineering, Vellore Institute of Technology, India and National Yunlin University of Science and Technology Taiwan, Douliou, Taiwan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5735-2507","authenticated-orcid":false,"given":"Keping","family":"Yu","sequence":"additional","affiliation":[{"name":"Graduate School of Science and Engineering, Hosei University Japan, Tokyo, Japan"}]}],"member":"320","published-online":{"date-parts":[[2022,12,20]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2980196"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3081694"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2015.2487344"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/EDGE50951.2020.00019"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCC.2019.2898657"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCCN.2021.3093436"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2021.3120075"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.3045653"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2021.09.044"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2019.2944742"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.3038721"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2021.3114259"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.2018.1700202"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/TITS.2022.3142566"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/GLOBECOM46510.2021.9685884"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2017.2682318"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2017.2745201"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2016.2611964"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/SURV.2013.121313.00064"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSE.2020.2978856"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2020.3001355"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCC51575.2020.9345083"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/TSIPN.2015.2448520"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.001.1800510"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3070544"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNSE.2021.3101842"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397809"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS48716.2020.243558"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3117263"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2020.3014896"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2960631"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2018.8485977"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2020.3033285"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2020.2990529"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2021.3128954"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.2999617"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICAIIS49377.2020.9194840"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCCS52626.2021.9449231"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.23919\/JCC.2020.05.015"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCChina.2016.7636777"}],"container-title":["ACM Transactions on Sensor Networks"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3532093","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3532093","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:23Z","timestamp":1750183763000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3532093"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,20]]},"references-count":40,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,5,31]]}},"alternative-id":["10.1145\/3532093"],"URL":"https:\/\/doi.org\/10.1145\/3532093","relation":{},"ISSN":["1550-4859","1550-4867"],"issn-type":[{"value":"1550-4859","type":"print"},{"value":"1550-4867","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,20]]},"assertion":[{"value":"2021-09-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-13","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}