{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,31]],"date-time":"2026-10-31T21:28:32Z","timestamp":1793482112944,"version":"4.5.0"},"reference-count":28,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2022,10,7]],"date-time":"2022-10-07T00:00:00Z","timestamp":1665100800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,12,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Industrial Internet of Things (IIoT) is a promising mechanism of Industry 4.0. Mobile edge computing (MEC) is an emerging mechanism that is an enabler for IoT applications, which applies computation offloading mechanism to offload workload from IoT devices to MEC servers to enhance computing quality. This paper addresses the computation offloading problem under a heterogeneously loaded MEC-enabled IIoT network, which specifically applies one-hop offloading for devices and task queue for devices and servers. We first formulate our computation offloading problem as a Markov Decision Process, then design a dueling deep Q-network-based computation offloading method for better optimizing the value function for specific state and advantage function for specific action. Experimental results verify that our scheme reduces more energy consumption (30%), latency (50%) and task dropped rate (50%) of IIoT devices, compared with other popular methods.<\/jats:p>","DOI":"10.1093\/comjnl\/bxac133","type":"journal-article","created":{"date-parts":[[2022,10,8]],"date-time":"2022-10-08T13:26:14Z","timestamp":1665235574000},"page":"2887-2896","source":"Crossref","is-referenced-by-count":9,"title":["A Dueling DQN-Based Computational Offloading Method in MEC-Enabled IIoT Network"],"prefix":"10.1093","volume":"66","author":[{"given":"Ching-Kuo","family":"Hsu","sequence":"first","affiliation":[{"name":"Department of Information Management, National Chung Cheng University , Chiayi 621301, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,10,7]]},"reference":[{"key":"2023121811453395700_ref1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.compind.2018.04.015","article-title":"The industrial internet of things (IIoT): An analysis framework","volume":"101","author":"Boyes","year":"2018","journal-title":"Comput Ind"},{"key":"2023121811453395700_ref2","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/bs.adcom.2019.10.010","article-title":"Industry 4.0: Industrial internet of things (IIOT)","volume":"117","author":"Munirathinam","year":"2020","journal-title":"Adv. Comput"},{"key":"2023121811453395700_ref3","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1109\/MCE.2016.2590118","article-title":"Mobile-edge computing architecture: The role of MEC in the Internet of Things","volume":"5","author":"Sabella","year":"2016","journal-title":"IEEE Consum. Electron. Mag."},{"key":"2023121811453395700_ref4","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1109\/JIOT.2017.2750180","article-title":"Mobile edge computing: A survey","volume":"5","author":"Abbas","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"2023121811453395700_ref5","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1016\/j.cie.2018.11.030","article-title":"A review of Internet of Things (IoT) embedded sustainable supply chain for industry 4.0 requirements","volume":"127","author":"Manavalan","year":"2019","journal-title":"Comput. Ind. Eng."},{"key":"2023121811453395700_ref6","doi-asserted-by":"crossref","first-page":"1628","DOI":"10.1109\/COMST.2017.2682318","article-title":"Mobile edge computing: A survey on architecture and computation offloading","volume":"19","author":"Mach","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"2023121811453395700_ref7","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1109\/LNET.2020.3037822","article-title":"PageRank-Based Multi-Hop Computation Offloading in D2D Networks","volume":"2","author":"Fan","year":"2020","journal-title":"IEEE Netw. Lett."},{"key":"2023121811453395700_ref8","doi-asserted-by":"crossref","first-page":"117354","DOI":"10.1109\/ACCESS.2020.3004711","article-title":"A secure industrial internet of things (IIoT) framework for resource management in smart manufacturing","volume":"8","author":"Abuhasel","year":"2020","journal-title":"IEEE Access"},{"key":"2023121811453395700_ref9","doi-asserted-by":"crossref","first-page":"3559","DOI":"10.1109\/TII.2019.2897805","article-title":"Performance optimization for blockchain-enabled industrial Internet of Things (IIoT) systems: A deep reinforcement learning approach","volume":"15","author":"Liu","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"2023121811453395700_ref10","doi-asserted-by":"crossref","first-page":"2756","DOI":"10.1109\/TII.2019.2954334","article-title":"Distributed Q-learning aided heterogeneous network association for energy-efficient IIoT","volume":"16","author":"Wang","year":"2019","journal-title":"IEEE Trans. Ind. Inform."},{"key":"2023121811453395700_ref11","doi-asserted-by":"crossref","first-page":"2813","DOI":"10.1109\/TWC.2020.2968426","article-title":"Delay-aware computation offloading in NOMA MEC under differentiated uploading delay","volume":"19","author":"Sheng","year":"2020","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"2023121811453395700_ref12","doi-asserted-by":"crossref","first-page":"2023","DOI":"10.1007\/s11276-021-02554-w","article-title":"Joint computation offloading and task caching for multi-user and multi-task MEC systems: reinforcement learning-based algorithms","volume":"23","author":"Elgendy","year":"2021","journal-title":"Wirel. Netw."},{"key":"2023121811453395700_ref13","doi-asserted-by":"crossref","first-page":"4987","DOI":"10.1109\/JIOT.2020.2972061","article-title":"A game-based computation offloading method in vehicular multiaccess edge computing networks","volume":"7","author":"Wang","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"2023121811453395700_ref14","doi-asserted-by":"crossref","first-page":"47509","DOI":"10.1109\/ACCESS.2020.2979774","article-title":"Computation offloading and resource allocation for the Internet of Things in energy-constrained MEC-enabled HetNets","volume":"8","author":"Tang","year":"2020","journal-title":"IEEE Access"},{"key":"2023121811453395700_ref15","doi-asserted-by":"crossref","first-page":"1896","DOI":"10.1109\/JIOT.2020.3015970","article-title":"Service-oriented energy-latency tradeoff for iot task partial offloading in mec-enhanced multi-rat networks","volume":"8","author":"Qin","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"2023121811453395700_ref16","doi-asserted-by":"crossref","first-page":"5404","DOI":"10.1109\/TWC.2020.2993071","article-title":"Offloading and resource allocation with general task graph in mobile edge computing: A deep reinforcement learning approach","volume":"19","author":"Yan","year":"2020","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"2023121811453395700_ref17","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1109\/TNSE.2018.2813333","article-title":"Renewable energy-aware big data analytics in geo-distributed data centers with reinforcement learning","volume":"7","author":"Xu","year":"2018","journal-title":"IEEE Trans. Netw. Sci. Eng."},{"key":"2023121811453395700_ref18","doi-asserted-by":"crossref","first-page":"976","DOI":"10.1109\/TII.2018.2883991","article-title":"Traffic and computation co-offloading with reinforcement learning in fog computing for industrial applications","volume":"15","author":"Wang","year":"2018","journal-title":"IEEE Trans. Ind. Inform."},{"key":"2023121811453395700_ref19","first-page":"1","volume-title":"2018 IEEE 87th Vehicular Technology Conference, VTC Spring 2018, Porto, Portugal, June 3\u20136","author":"Chen","year":"2018"},{"key":"2023121811453395700_ref20","doi-asserted-by":"crossref","first-page":"2581","DOI":"10.1109\/TMC.2019.2928811","article-title":"Deep reinforcement learning for online computation offloading in wireless powered mobile-edge computing networks","volume":"19","author":"Huang","year":"2019","journal-title":"IEEE Trans. Mob. Comput."},{"key":"2023121811453395700_ref21","doi-asserted-by":"crossref","first-page":"4005","DOI":"10.1109\/JIOT.2018.2876279","article-title":"Optimized computation offloading performance in virtual edge computing systems via deep reinforcement learning","volume":"6","author":"Chen","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"2023121811453395700_ref22","doi-asserted-by":"crossref","first-page":"9255","DOI":"10.1109\/JIOT.2020.2981557","article-title":"Edge QoE: Computation offloading with deep reinforcement learning for Internet of Things","volume":"7","author":"Lu","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"2023121811453395700_ref23","doi-asserted-by":"crossref","first-page":"1985","DOI":"10.1109\/TMC.2020.3036871","article-title":"Deep reinforcement learning for task offloading in mobile edge computing systems","volume":"21","author":"Tang","year":"2020","journal-title":"IEEE Trans. Mob. Comput."},{"key":"2023121811453395700_ref24","first-page":"793","volume-title":"International Conference on Parallel Processing and Applied Mathematics, PPAM 2013, Warsaw, Poland, September 8\u201311","author":"Vogeleer","year":"2013"},{"key":"2023121811453395700_ref25","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/BF01130406","article-title":"Processor design for portable systems","volume":"13","author":"Burd","year":"1996","journal-title":"J. VLSI Signal Process Syst"},{"key":"2023121811453395700_ref26","doi-asserted-by":"crossref","first-page":"2322","DOI":"10.1109\/COMST.2017.2745201","article-title":"A survey on mobile edge computing: The communication perspective","volume":"19","author":"Mao","year":"2017","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"2023121811453395700_ref27","volume-title":"Deep learning","author":"Goodfellow","year":"2016"},{"key":"2023121811453395700_ref28","doi-asserted-by":"crossref","first-page":"6018","DOI":"10.1109\/JIOT.2021.3110319","article-title":"Energy-efficient joint task assignment and power control in energy-harvesting D2D offloading communications","volume":"9","author":"Hamdi","year":"2022","journal-title":"IEEE Internet Things J."}],"container-title":["The Computer Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/66\/12\/2887\/54446697\/bxac133.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/66\/12\/2887\/54446697\/bxac133.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,18]],"date-time":"2023-12-18T11:46:11Z","timestamp":1702899971000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/comjnl\/article\/66\/12\/2887\/6751160"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,7]]},"references-count":28,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,10,7]]},"published-print":{"date-parts":[[2023,12,14]]}},"URL":"https:\/\/doi.org\/10.1093\/comjnl\/bxac133","relation":{},"ISSN":["0010-4620","1460-2067"],"issn-type":[{"value":"0010-4620","type":"print"},{"value":"1460-2067","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,12]]},"published":{"date-parts":[[2022,10,7]]}}}