{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,24]],"date-time":"2025-08-24T01:28:11Z","timestamp":1755998891283,"version":"3.41.2"},"reference-count":47,"publisher":"World Scientific Pub Co Pte Ltd","issue":"13","funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2020YFB0905900"],"award-info":[{"award-number":["2020YFB0905900"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Science and technology project of SGCC(State Grid Corporation of China): The key technology for electric internet of things","award":["SGTJDK00DWJS2100223"],"award-info":[{"award-number":["SGTJDK00DWJS2100223"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2022,10]]},"abstract":"<jats:p> There has been a lot of research on edge-computing task offloading in deep reinforcement learning (DRL). Deep reinforcement learning is one of the important algorithms in the current AI field, but there is still room for improvement in the time cost and adaptive correction ability of the algorithm. This paper studies the application of DRL algorithms in edge-computing task offloading, and its key innovation is to propose an MADRLCO algorithm, which is based on the design idea of the Actor\u2013Critic framework, uses the DNN model to act as an Actor, and can more accurately locate the initial decision through iterative training, and use the LSTM model to optimize the Critic, which can be more accurate. The optimal decision can be located in a short period of time. The main work of this paper is divided into three parts: (1) The AC algorithm of the Actor\u2013Critic framework in DRL is proposed to be applied to edge-computing task offloading. (2) To address the weak generalization ability of the basic version of the Actor\u2013Critic algorithm in multi-objective optimization, the sequential quantitative correction and adaptive correction parameter K method are used to optimize the Critic frame, thereby improving the generalization ability of the model in multi-objective decision-making and improving the rationality of decision-making results. (3) Aiming at the problem of large time cost in the critical framework of the model, a search algorithm for resource allocation-related parameters based on the time-series prediction method is proposed (time-series forecasting is a research branch of pattern recognition), which reduces the time overhead of the algorithm and improves the adaptive correction capability of the model. The algorithm in this paper can adapt to not only the time-varying network channel state, but also the time-varying number of device connections. Finally, it is proved by experiments that compared with the DRL calculation offloading algorithm based on DNN plus binary search, the MADRLCO algorithm reduces the model training time by 66.27%, and in the environment of the time-varying number of devices in the metasystem, the average model average. The standard calculation rate is 0.0403 higher than that of the current optimal algorithm. <\/jats:p>","DOI":"10.1142\/s021800142252019x","type":"journal-article","created":{"date-parts":[[2022,6,9]],"date-time":"2022-06-09T07:51:53Z","timestamp":1654761113000},"source":"Crossref","is-referenced-by-count":4,"title":["Adaptive Compute Offloading Algorithm for Metasystem Based on Deep Reinforcement Learning"],"prefix":"10.1142","volume":"36","author":[{"given":"Chunxin","family":"Wang","sequence":"first","affiliation":[{"name":"Tianjin University, Tianjin 300072, P. R. China"},{"name":"State Grid Information & Telecommunication Co., Ltd., Beijing 100031, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wensheng","family":"Wang","sequence":"additional","affiliation":[{"name":"State Grid Information & Telecommunication Co., Ltd., Beijing 100031, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenjing","family":"Li","sequence":"additional","affiliation":[{"name":"State Grid Information & Telecommunication Co., Ltd., Beijing 100031, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhu","family":"Liu","sequence":"additional","affiliation":[{"name":"State Grid Information & Telecommunication Co., Ltd., Beijing 100031, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinhong","family":"Zhu","sequence":"additional","affiliation":[{"name":"State Grid Information & Telecommunication Co., Ltd., Beijing 100031, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nan","family":"Zhang","sequence":"additional","affiliation":[{"name":"State Grid Information & Telecommunication Co., Ltd., Beijing 100031, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2022,11,2]]},"reference":[{"issue":"4","key":"S021800142252019XBIB001","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1109\/MCOM.2015.7081084","volume":"53","author":"Bi S.","year":"2015","journal-title":"IEEE Commun. Mag."},{"key":"S021800142252019XBIB002","doi-asserted-by":"publisher","DOI":"10.1109\/TWC.2018.2821664"},{"key":"S021800142252019XBIB003","first-page":"1","volume-title":"Proc. 2022 IEEE Int. Conf. Consumer Electronics (ICCE)","author":"Chen P. H.","year":"2022"},{"issue":"4","key":"S021800142252019XBIB004","doi-asserted-by":"crossref","first-page":"4517","DOI":"10.1109\/TNSM.2021.3103533","volume":"18","author":"Chen Z.","year":"2021","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"S021800142252019XBIB005","doi-asserted-by":"crossref","first-page":"21246","DOI":"10.1109\/ACCESS.2018.2882000","volume":"7","author":"Cui Y.","year":"2019","journal-title":"IEEE Access"},{"issue":"1","key":"S021800142252019XBIB006","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1186\/s13638-021-01905-7","volume":"2021","author":"Fu Y.","year":"2021","journal-title":"EURASIP J. Wirel. Commun. Netw."},{"issue":"8","key":"S021800142252019XBIB007","doi-asserted-by":"crossref","first-page":"1875","DOI":"10.1007\/s13042-020-01077-8","volume":"11","author":"Fu F.","year":"2020","journal-title":"Int. J. Mach. Learn. Cybern."},{"issue":"5","key":"S021800142252019XBIB008","doi-asserted-by":"crossref","first-page":"5549","DOI":"10.1109\/TVT.2020.2982000","volume":"69","author":"Guo S.","year":"2020","journal-title":"IEEE Trans. Veh. Technol."},{"issue":"2","key":"S021800142252019XBIB009","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1080\/00207543.2019.1701208","volume":"59","author":"Haz\u0131r \u00d6.","year":"2021","journal-title":"Int. J. Prod. Res."},{"key":"S021800142252019XBIB010","first-page":"1","volume-title":"Proc. 2021 IEEE VTS 17th Asia Pacific Wireless Communications Symp. (APWCS)","author":"Hori S.","year":"2021"},{"issue":"11","key":"S021800142252019XBIB011","doi-asserted-by":"crossref","first-page":"2581","DOI":"10.1109\/TMC.2019.2928811","volume":"19","author":"Huang L.","year":"2019","journal-title":"IEEE Trans. Mob. Comput."},{"key":"S021800142252019XBIB012","doi-asserted-by":"publisher","DOI":"10.1016\/j.dcan.2018.10.003"},{"key":"S021800142252019XBIB013","first-page":"3816237","volume":"2019","author":"Huang B.","year":"2019","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"S021800142252019XBIB014","first-page":"2765491","volume":"2020","author":"Huang B.","year":"2020","journal-title":"Wirel. Commun. Mob. Comput."},{"issue":"1","key":"S021800142252019XBIB015","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1186\/s13638-020-1652-5","volume":"2020","author":"Huang X.","year":"2020","journal-title":"EURASIP J. Wirel. Commun. Netw."},{"issue":"1","key":"S021800142252019XBIB016","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JIOT.2021.3095077","volume":"9","author":"Imteaj A.","year":"2022","journal-title":"IEEE Internet Things J."},{"issue":"12","key":"S021800142252019XBIB017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.23919\/JCC.2021.12.001","volume":"18","author":"Jiao J.","year":"2021","journal-title":"China Commun."},{"issue":"2","key":"S021800142252019XBIB018","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1109\/TCCN.2020.3018159","volume":"7","author":"Kai C.","year":"2020","journal-title":"IEEE Trans. Cogn. Commun. Netw."},{"key":"S021800142252019XBIB019","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1109\/SmartIoT49966.2020.00018","volume-title":"Proc. 2020 IEEE Int. Conf. Smart Internet of Things (SmartIoT)","author":"Khan U. A.","year":"2020"},{"key":"S021800142252019XBIB020","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1016\/j.future.2019.12.039","volume":"105","author":"Kuang L.","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"issue":"6","key":"S021800142252019XBIB021","doi-asserted-by":"crossref","first-page":"10119","DOI":"10.1109\/JIOT.2019.2935543","volume":"6","author":"Lei L.","year":"2019","journal-title":"IEEE Internet Things J."},{"issue":"1","key":"S021800142252019XBIB022","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1186\/s13638-019-1624-9","volume":"2020","author":"Li G.","year":"2020","journal-title":"EURASIP J. Wirel. Commun. Netw."},{"issue":"1","key":"S021800142252019XBIB023","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1186\/s13677-021-00232-y","volume":"10","author":"Liao Z.","year":"2021","journal-title":"J. Cloud Comput."},{"key":"S021800142252019XBIB025","first-page":"1","volume-title":"Proc. 2020 IEEE Wireless Communications and Networking Conf. (WCNC)","author":"Liu J.","year":"2020"},{"issue":"4","key":"S021800142252019XBIB026","doi-asserted-by":"crossref","first-page":"2704","DOI":"10.1109\/TII.2021.3087726","volume":"18","author":"Lu W.","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"issue":"1","key":"S021800142252019XBIB027","doi-asserted-by":"crossref","first-page":"012059","DOI":"10.1088\/1742-6596\/1229\/1\/012059","volume":"1229","author":"Meng H.","year":"2019","journal-title":"J. Phys., Conf. Ser."},{"key":"S021800142252019XBIB028","doi-asserted-by":"crossref","first-page":"1319","DOI":"10.1109\/TMC.2020.3025116","volume":"21","author":"Ning Z.","year":"2022","journal-title":"IEEE Trans. Mob. Comput."},{"issue":"6","key":"S021800142252019XBIB029","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1145\/3317572","volume":"10","author":"Ning Z.","year":"2019","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"S021800142252019XBIB030","doi-asserted-by":"crossref","first-page":"134742","DOI":"10.1109\/ACCESS.2019.2942052","volume":"7","author":"Pan S.","year":"2019","journal-title":"IEEE Access"},{"issue":"2","key":"S021800142252019XBIB031","doi-asserted-by":"crossref","first-page":"2089","DOI":"10.1109\/TNSM.2021.3072433","volume":"18","author":"Plachy J.","year":"2021","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"issue":"8","key":"S021800142252019XBIB032","doi-asserted-by":"crossref","first-page":"8050","DOI":"10.1109\/TVT.2019.2924015","volume":"68","author":"Qiu X.","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"S021800142252019XBIB033","doi-asserted-by":"crossref","first-page":"69194","DOI":"10.1109\/ACCESS.2019.2919736","volume":"7","author":"Ren J.","year":"2019","journal-title":"IEEE Access"},{"key":"S021800142252019XBIB034","first-page":"1213","volume-title":"Proc. 2020 IEEE Int. Symp. Antennas and Propagation and North American Radio Science Meeting","author":"Sun P.","year":"2020"},{"issue":"4","key":"S021800142252019XBIB035","doi-asserted-by":"crossref","first-page":"3061","DOI":"10.1109\/TVT.2019.2895593","volume":"68","author":"Sun Y.","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"S021800142252019XBIB036","first-page":"344","volume-title":"Proc. 2021 Int. Conf. Artificial Intelligence in Information and Communication (ICAIIC)","author":"Tilahun F. D.","year":"2021"},{"key":"S021800142252019XBIB037","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.ins.2020.05.057","volume":"537","author":"Tong Z.","year":"2020","journal-title":"Inf. Sci."},{"issue":"10","key":"S021800142252019XBIB038","doi-asserted-by":"crossref","first-page":"2491","DOI":"10.1109\/TPDS.2021.3067654","volume":"32","author":"Tran-Dang H.","year":"2021","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"S021800142252019XBIB039","doi-asserted-by":"crossref","first-page":"114935","DOI":"10.1109\/ACCESS.2019.2935545","volume":"7","author":"Wang D.","year":"2019","journal-title":"IEEE Access"},{"issue":"3","key":"S021800142252019XBIB040","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1109\/TETC.2019.2902661","volume":"9","author":"Wang J.","year":"2019","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"issue":"2","key":"S021800142252019XBIB041","first-page":"108","volume":"42","author":"Wu Z.","year":"2019","journal-title":"J. Beijing Univ. Posts Telecommun."},{"key":"S021800142252019XBIB042","doi-asserted-by":"crossref","first-page":"107617","DOI":"10.1016\/j.patcog.2020.107617","volume":"109","author":"Ye R.","year":"2021","journal-title":"Pattern Recognit."},{"key":"S021800142252019XBIB043","doi-asserted-by":"publisher","DOI":"10.1109\/JSAC.2016.2545382"},{"issue":"3","key":"S021800142252019XBIB044","doi-asserted-by":"crossref","first-page":"1397","DOI":"10.1109\/TWC.2016.2633522","volume":"16","author":"You C.","year":"2016","journal-title":"IEEE Trans. Wirel. Commun."},{"issue":"2","key":"S021800142252019XBIB045","doi-asserted-by":"crossref","first-page":"1405","DOI":"10.1109\/TII.2021.3088407","volume":"18","author":"Zhang K.","year":"2021","journal-title":"IEEE Trans. Ind. Inform."},{"issue":"7","key":"S021800142252019XBIB046","doi-asserted-by":"crossref","first-page":"236","DOI":"10.23919\/JCC.2021.07.019","volume":"18","author":"Zhang S.","year":"2021","journal-title":"China Commun."},{"issue":"1","key":"S021800142252019XBIB047","first-page":"114","volume":"41","author":"Zhang H.","year":"2020","journal-title":"J. Commun."},{"issue":"5","key":"S021800142252019XBIB048","doi-asserted-by":"crossref","first-page":"7635","DOI":"10.1109\/JIOT.2019.2903191","volume":"6","author":"Zhang K.","year":"2019","journal-title":"IEEE Internet Things J."}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S021800142252019X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,29]],"date-time":"2022-11-29T05:54:23Z","timestamp":1669701263000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S021800142252019X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10]]},"references-count":47,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2022,10]]}},"alternative-id":["10.1142\/S021800142252019X"],"URL":"https:\/\/doi.org\/10.1142\/s021800142252019x","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"type":"print","value":"0218-0014"},{"type":"electronic","value":"1793-6381"}],"subject":[],"published":{"date-parts":[[2022,10]]},"article-number":"2252019"}}