{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,11]],"date-time":"2025-09-11T07:52:34Z","timestamp":1757577154794,"version":"3.37.3"},"reference-count":62,"publisher":"Wiley","license":[{"start":{"date-parts":[[2020,12,12]],"date-time":"2020-12-12T00:00:00Z","timestamp":1607731200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004868","name":"Jiangxi University of Finance and Economics","doi-asserted-by":"publisher","award":["24","GJJ171011","GJJ180251","61961021"],"award-info":[{"award-number":["24","GJJ171011","GJJ180251","61961021"]}],"id":[{"id":"10.13039\/501100004868","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100009102","name":"Education Department of Jiangxi Province","doi-asserted-by":"publisher","award":["24","GJJ171011","GJJ180251","61961021"],"award-info":[{"award-number":["24","GJJ171011","GJJ180251","61961021"]}],"id":[{"id":"10.13039\/501100009102","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["24","GJJ171011","GJJ180251","61961021"],"award-info":[{"award-number":["24","GJJ171011","GJJ180251","61961021"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Wireless Communications and Mobile Computing"],"published-print":{"date-parts":[[2020,12,12]]},"abstract":"<jats:p>In the next-generation wireless communications system of Beyond 5G networks, video streaming services have held a surprising proportion of the whole network traffic. Furthermore, the user preference and demand towards a specific video might be different because of the heterogeneity of users\u2019 processing capabilities and the variation of network condition. Thus, it is a complicated decision problem with high-dimensional state spaces to choose appropriate quality videos according to users\u2019 actual network condition. To address this issue, in this paper, a Content Distribution Network and Cluster-based Mobile Edge Computing framework has been proposed to enhance the ability of caching and computing and promote the collaboration among edge severs. Then, we develop a novel deep reinforcement learning-based framework to automatically obtain the intracluster collaborative caching and transcoding decisions, which are executed based on video popularity, user requirement prediction, and abilities of edge servers. Simulation results demonstrate that the quality of video streaming service can be significantly improved by using the designed deep reinforcement learning-based algorithm with less backhaul consumption and processing costs.<\/jats:p>","DOI":"10.1155\/2020\/6684293","type":"journal-article","created":{"date-parts":[[2020,12,13]],"date-time":"2020-12-13T02:35:09Z","timestamp":1607826909000},"page":"1-16","source":"Crossref","is-referenced-by-count":14,"title":["Deep Reinforcement Learning-Based Collaborative Video Caching and Transcoding in Clustered and Intelligent Edge B5G Networks"],"prefix":"10.1155","volume":"2020","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5003-4741","authenticated-orcid":true,"given":"Zheng","family":"Wan","sequence":"first","affiliation":[{"name":"School of Information Management, Jiangxi University of Finance and Economics, No. 665, West Yuping Road, Nanchang, Jiangxi 330032, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4929-4439","authenticated-orcid":true,"given":"Yan","family":"Li","sequence":"additional","affiliation":[{"name":"School of Information Management, Jiangxi University of Finance and Economics, No. 665, West Yuping Road, Nanchang, Jiangxi 330032, China"},{"name":"School of Information Engineering, Nanchang Institute of Technology, No. 289, Tianxiang Road, Nanchang, Jiangxi 330099, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"key":"1","doi-asserted-by":"publisher","DOI":"10.1109\/MWC.001.1900476"},{"key":"2","doi-asserted-by":"publisher","DOI":"10.1109\/MNET.001.1800526"},{"key":"3","doi-asserted-by":"publisher","DOI":"10.1109\/MWC.2019.1800411"},{"volume-title":"Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2017-2022 White Paper","year":"2019","author":"Cisco","key":"4"},{"issue":"6","key":"5","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1109\/JSAC.2018.2844961","article-title":"Online edge caching and wireless delivery in fog-aided networks with dynamic content popularity","volume":"36","author":"S. M. Azimi","year":"2018","journal-title":"IEEE Journal on Selected Areas in Communications"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2017.3051521"},{"key":"7","article-title":"Mobile edge computing-a key technology towards 5G","volume":"11","author":"Y. C. Hu","year":"2015","journal-title":"ETSI White Paper"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2016.2597169"},{"article-title":"A survey on mobile edge computing","author":"A. Ahmed","key":"9","doi-asserted-by":"crossref","DOI":"10.1109\/ISCO.2016.7727082"},{"key":"10","doi-asserted-by":"publisher","DOI":"10.1109\/ISIT.2016.7541539"},{"issue":"12","key":"11","doi-asserted-by":"crossref","first-page":"3590","DOI":"10.1109\/JSAC.2016.2611964","article-title":"Dynamic computation offloading for mobile-edge computing with energy harvesting devices","volume":"34","author":"Y. Mao","year":"2016","journal-title":"IEEE Journal on Selected Areas in Communications"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1109\/MCOM.2017.1600863"},{"key":"13","first-page":"23","article-title":"iDASH: improved dynamic adaptive streaming over HTTP using scalable video coding","volume-title":"Proceeding of ACM Multimedia Systems","author":"Y. S\u00e1nchez dela Fuente","year":"2011"},{"issue":"4","key":"14","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1109\/TMC.2018.2850026","article-title":"Edge computing assisted adaptive mobile video streaming","volume":"18","author":"A. Mehrabi","year":"2019","journal-title":"IEEE Transactions on Mobile Computing"},{"issue":"5","key":"15","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1109\/TSC.2018.2828426","article-title":"Adaptive wireless video streaming based on edge computing: opportunities and approaches","volume":"12","author":"D. Wang","year":"2019","journal-title":"IEEE Transactions on Services Computing"},{"issue":"9","key":"16","doi-asserted-by":"crossref","first-page":"1965","DOI":"10.1109\/TMC.2018.2871147","article-title":"Adaptive bitrate video caching and processing in mobile-edge computing networks","volume":"18","author":"T. X. Tran","year":"2019","journal-title":"IEEE Transactions on Mobile Computing"},{"key":"17","article-title":"On mobile edge caching","volume":"21","author":"J. Yao","year":"2019","journal-title":"IEEE Communications Surveys & Tutorials"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1016\/j.dcan.2019.08.004"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2973000"},{"key":"20","doi-asserted-by":"publisher","DOI":"10.1109\/TCOMM.2019.2935047"},{"key":"21","article-title":"Detection and localization of rebar in concrete by deep learning using ground penetrating radar","volume":"118","author":"H. Liu","year":"2020","journal-title":"Automation in Construction"},{"key":"22","doi-asserted-by":"publisher","DOI":"10.1016\/j.phycom.2020.101181"},{"first-page":"426","article-title":"Deep reinforcement learning: an overview","author":"S. S. Mousavi","key":"23"},{"key":"24","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-56991-8_32"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2017.2751641"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2020.2970550"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.3020400"},{"key":"28","first-page":"1","article-title":"Intelligent secure mobile edge computing for beyond 5G wireless networks","volume":"99","author":"S. Lai","year":"2020","journal-title":"Physical Communication"},{"key":"29","article-title":"Deep reinforcement learning based mobile edge computing for intelligent Internet of things","volume":"43, article 101184","author":"R. Zhao","year":"2020","journal-title":"Physical Communication"},{"volume-title":"Reinforcement Learning: An Introduction","year":"2018","author":"R. S. Sutton","key":"30"},{"key":"31","article-title":"Playing atari with deep reinforcement learning","volume-title":"NIPS Deep Learning Workshop","author":"V. Mnih","year":"2013"},{"issue":"7540","key":"32","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/nature14236","article-title":"Human-level control through deep reinforcement learning","volume":"518","author":"V. Mnih","year":"2015","journal-title":"Nature"},{"key":"33","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2019.2951219"},{"key":"34","doi-asserted-by":"crossref","DOI":"10.1109\/TVT.2017.2731798","article-title":"Energy efficient power allocation in multi-tier 5g networks using enhanced online learning","volume":"66","author":"I. AlQerm","year":"2017","journal-title":"IEEE Transactions on Vehicular Technology"},{"key":"35","article-title":"Green resource allocation based on deep reinforcement learning in content-centric iot","volume":"8","author":"X. He","year":"2020","journal-title":"IEEE Transactions on Emerging Topics in Computing"},{"key":"36","doi-asserted-by":"crossref","DOI":"10.1109\/JSAC.2019.2933973","article-title":"Multi-agent deep reinforcement learning for dynamic power allocation in wireless networks","volume":"37","author":"Y. S. Nasir","year":"2019","journal-title":"IEEE Journal on Selected Areas in Communications"},{"issue":"10","key":"37","article-title":"Integrated networking, caching and computing for connected vehicles: a deep reinforcement learning approach","volume":"99","author":"H. TY","year":"2017","journal-title":"IEEE Transactions on Vehicular Technology"},{"key":"38","first-page":"1","article-title":"Deep reinforcement learning based computation offloading and resource allocation for mec","author":"J. Li","year":"2018"},{"key":"39","article-title":"Deep reinforcement learning for online computation offloading in wireless powered mobile-edge computing networks","volume":"99","author":"L. Huang","year":"2018","journal-title":"IEEE Transactions on Mobile Computing"},{"key":"40","article-title":"Optimized computation offloading performance in virtual edge computing systems via deep reinforcement learning","volume":"6","author":"X. Chen","year":"2018","journal-title":"IEEE Internet of Things Journal"},{"article-title":"Joint offloading and streaming in mobile edges: a deep reinforcement learning approach","author":"S. Park","key":"41","doi-asserted-by":"crossref","DOI":"10.1109\/VTS-APWCS.2019.8851667"},{"article-title":"Deep reinforcement learning-based offloading decision optimization in mobile edge computing","author":"H. Zhang","key":"42","doi-asserted-by":"crossref","DOI":"10.1109\/WCNC.2019.8886332"},{"key":"43","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.future.2019.01.059","article-title":"Task migration for mobile edge computing using deep reinforcement learning","volume":"96","author":"Z. Cheng","year":"2019","journal-title":"Future Generation Computer Systems"},{"key":"44","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2017.2685434"},{"article-title":"Cache-enabled adaptive bit rate streaming via deep self-transfer reinforcement learning","author":"Z. Zhang","key":"45","doi-asserted-by":"crossref","DOI":"10.1109\/WCSP.2018.8555916"},{"first-page":"449","article-title":"A deep learning approach for optimizing content delivering in cache-enabled hetnet","author":"L. Lei","key":"46"},{"key":"47","doi-asserted-by":"publisher","DOI":"10.1109\/MWC.2018.1700321"},{"key":"48","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1016\/j.future.2019.08.032","article-title":"Q-learning based collaborative cache allocation in mobile edge computing","volume":"102","author":"C. H. Wei","year":"2020","journal-title":"Future Generation Computer Systems"},{"author":"Z. Yang","key":"49","article-title":"Deep reinforcement learning in cache-aided MEC networks"},{"author":"Z. Chen","key":"50","article-title":"A deep reinforcement learning-based framework for content caching"},{"key":"51","doi-asserted-by":"publisher","DOI":"10.1109\/TCCN.2020.2968326"},{"first-page":"439","article-title":"Deep multi-agent reinforcement learning for cooperative edge caching","author":"M. C. Gursoy","key":"52"},{"key":"53","article-title":"When wireless video streaming meets AI: a deep learning approach","volume":"27","author":"L. Liu","year":"2019","journal-title":"IEEE Wireless Communications"},{"key":"54","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2020.29738288"},{"article-title":"Content-aware personalised rate adaptation for adaptive streaming via deep video analysis","author":"G. Gao","key":"55","doi-asserted-by":"crossref","DOI":"10.1109\/ICC.2019.8761156"},{"key":"56","doi-asserted-by":"publisher","DOI":"10.1109\/TVT.2020.2968498"},{"key":"57","doi-asserted-by":"publisher","DOI":"10.1109\/TCOMM.2020.2974738"},{"article-title":"Intelligent edge-assisted crowdcast with deep reinforcement learning for personalized QoE","author":"F. Wang","key":"58","doi-asserted-by":"crossref","DOI":"10.1109\/INFOCOM.2019.8737456"},{"first-page":"670","article-title":"Towards QoS-aware cloud live transcoding: a deep reinforcement learning approach","author":"Z. Pang","key":"59"},{"issue":"4","key":"60","first-page":"187","article-title":"A buffer-based approach to rate adaptation: evidence from a large video streaming service","volume":"44","author":"T. Y. Huang","year":"2015","journal-title":"acm special interest group on data communication"},{"key":"61","doi-asserted-by":"publisher","DOI":"10.1109\/TNET.2012.2201166"},{"issue":"8","key":"62","doi-asserted-by":"crossref","first-page":"1777","DOI":"10.1109\/TCSVT.2016.2556584","article-title":"Online cloud transcoding and distribution for crowdsourced live game video streaming","volume":"27","author":"Y. Zheng","year":"2017","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"}],"container-title":["Wireless Communications and Mobile Computing"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/wcmc\/2020\/6684293.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/wcmc\/2020\/6684293.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/wcmc\/2020\/6684293.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,13]],"date-time":"2020-12-13T02:35:21Z","timestamp":1607826921000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/wcmc\/2020\/6684293\/"}},"subtitle":[],"editor":[{"given":"Lisheng","family":"Fan","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2020,12,12]]},"references-count":62,"alternative-id":["6684293","6684293"],"URL":"https:\/\/doi.org\/10.1155\/2020\/6684293","relation":{},"ISSN":["1530-8677","1530-8669"],"issn-type":[{"type":"electronic","value":"1530-8677"},{"type":"print","value":"1530-8669"}],"subject":[],"published":{"date-parts":[[2020,12,12]]}}}