{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T01:09:39Z","timestamp":1776215379949,"version":"3.50.1"},"reference-count":27,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,5,2]],"date-time":"2023-05-02T00:00:00Z","timestamp":1682985600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,4,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>As a key issue of network virtualisation, virtual network embedding (VNE) aims to embed multiple virtual network requests (VNRs) from different applications onto the substrate network effectively. In real networks, about 90% of traffic is generated by different quality of service (QoS) sensitive applications. However, most existing VNE algorithms do not account for the difference. Although several VNE algorithms considered the delay metric of applications, they usually provide strict delay guarantees for all VNRs, leading to a low VNR acceptance ratio. In this paper, we focus on the VNE problem involving multiple QoS metrics and propose a multiple QoS metrics-aware VNE algorithm based on reinforcement learning (RLQ-VNE). We first classify VNRs according to their different requirements for multiple QoS metrics including delay, jitter and packet loss rate, and then introduce reinforcement learning to implement differentiated VNE. Specifically, RLQ-VNE provides strict QoS guarantees for the VNRs with high-level QoS requirements and provides lower QoS guarantees for the VNRs with low-level QoS requirements, thus balancing the QoS guarantee and request acceptance ratio. Simulation results from multiple experimental scenarios show that RLQ-VNE improves the request acceptance ratio and network resource utilisation by sacrificing less QoS.<\/jats:p>","DOI":"10.1093\/comjnl\/bxad050","type":"journal-article","created":{"date-parts":[[2023,5,3]],"date-time":"2023-05-03T14:56:38Z","timestamp":1683125798000},"page":"1171-1186","source":"Crossref","is-referenced-by-count":8,"title":["A Multiple QoS Metrics-Aware Virtual Network Embedding Algorithm"],"prefix":"10.1093","volume":"67","author":[{"given":"Meilian","family":"Lu","sequence":"first","affiliation":[{"name":"Beijing University of Posts and Telecommunications State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), , Beijing 100876 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Meng","family":"Li","sequence":"additional","affiliation":[{"name":"Beijing University of Posts and Telecommunications State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), , Beijing 100876 , China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,5,2]]},"reference":[{"key":"2024041716572467300_ref1","doi-asserted-by":"crossref","first-page":"8572","DOI":"10.1109\/ACCESS.2016.2632421","article-title":"Virtual network embedding based on the degree and clustering coefficient information","volume":"4","author":"Zhang","year":"2017","journal-title":"IEEE Access"},{"key":"2024041716572467300_ref2","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1631\/FITEE.1400147","article-title":"Virtual network embedding based on real-time topological attributes","volume":"16","author":"Ding","year":"2015","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"2024041716572467300_ref3","first-page":"7416953","volume-title":"Proceedings of Globecom\u201915, San Diego, CA, USA, 06\u2013-10 December","author":"Yu","year":"2015"},{"key":"2024041716572467300_ref4","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1109\/JIOT.2017.2773489","article-title":"Novel node-ranking approach and multiple topology attributes-based embedding algorithm for single-domain virtual network embedding","volume":"5","author":"Cao","year":"2018","journal-title":"IEEE Internet Things J."},{"key":"2024041716572467300_ref5","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/s10922-019-09500-4","article-title":"Security aware virtual network embedding algorithm using information entropy TOPSIS","volume":"28","author":"Zhang","year":"2020","journal-title":"J. Network Syst. Manage."},{"key":"2024041716572467300_ref6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.comcom.2015.07.014","article-title":"A modified ACO algorithm for virtual network embedding based on graph decomposition","volume":"80","author":"Zhu","year":"2016","journal-title":"Comput. Commun."},{"key":"2024041716572467300_ref7","doi-asserted-by":"crossref","first-page":"55026","DOI":"10.1109\/ACCESS.2018.2861990","article-title":"Collaborative dynamic virtual network embedding algorithm based on resource importance measures","volume":"6","author":"Lu","year":"2018","journal-title":"IEEE Access"},{"key":"2024041716572467300_ref8","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1109\/TSMC.2018.2884523","article-title":"Distributed virtual network embedding system with historical archives and set-based particle swarm optimization","volume":"51","author":"Song","year":"2021","journal-title":"IEEE Trans. Syst. Man Cybern.: Syst."},{"key":"2024041716572467300_ref9","doi-asserted-by":"crossref","first-page":"936","DOI":"10.1109\/TNSM.2022.3152309","article-title":"Resource fragmentation-aware embedding in dynamic network virtualization environments","volume":"19","author":"Lu","year":"2022","journal-title":"IEEE Trans. Network Serv. Manage."},{"key":"2024041716572467300_ref10","first-page":"166","volume-title":"Proceedings of IEEE WCNC 2022, Austin, TX, USA, 10\u2013-13 April","author":"Maity","year":"2022"},{"key":"2024041716572467300_ref11","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1007\/s10922-015-9349-5","article-title":"LIVE: learning and inference for virtual network embedding","volume":"24","author":"Liao","year":"2016","journal-title":"J. Netw. Syst. Manag."},{"key":"2024041716572467300_ref12","first-page":"7818395","volume-title":"Proceedings of CNSM 2016, Montreal, Canada, Oct. 31\u2013Nov. 4","author":"Blenk","year":"2017"},{"key":"2024041716572467300_ref13","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1109\/TCYB.2016.2645123","article-title":"Virtual network embedding via Monte Carlo tree search","volume":"48","author":"Haeri","year":"2018","journal-title":"IEEE Trans. Cybern."},{"key":"2024041716572467300_ref14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neucom.2018.01.025","article-title":"A novel reinforcement learning algorithm for virtual network embedding","volume":"284","author":"Yao","year":"2018","journal-title":"Neurocomputing"},{"key":"2024041716572467300_ref15","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1109\/TETC.2018.2871549","article-title":"RDAM: a reinforcement learning based dynamic attribute matrix representation for virtual network embedding","volume":"9","author":"Yao","year":"2021","journal-title":"IEEE Trans. Emerg. Top. Comput."},{"key":"2024041716572467300_ref16","doi-asserted-by":"crossref","first-page":"9389","DOI":"10.1109\/JIOT.2021.3095094","article-title":"Dynamic virtual network embedding algorithm based on graph convolution neural network and reinforcement learning","volume":"9","author":"Zhang","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"2024041716572467300_ref17","doi-asserted-by":"crossref","first-page":"4075","DOI":"10.1109\/TNSM.2021.3120297","article-title":"VNE-HRL: a proactive virtual network embedding algorithm based on hierarchical reinforcement learning","volume":"18","author":"Cheng","year":"2021","journal-title":"IEEE Trans. Network Serv. Manage."},{"key":"2024041716572467300_ref18","first-page":"879","volume-title":"Proceedings of IEEE Infocom Workshop 2019: NI 2019: Network Intelligence: Machine Learning for Networking, Orange County Convention Center, Orlando FL, United States, 6\u201314 June","author":"Dolati","year":"2019"},{"key":"2024041716572467300_ref19","first-page":"106","volume-title":"Proceedings of WPMC 2013, Atlantic City, NJ, USA, 24\u201327 June","author":"Liao","year":"2013"},{"key":"2024041716572467300_ref20","first-page":"341","volume-title":"Proceedings of ICCNC 2014, Honolulu, HI, USA, 03\u201306 February","author":"Ivaturi","year":"2014"},{"key":"2024041716572467300_ref21","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1145\/3092819.3092827","article-title":"A Markov reward-based resource-latency aware heuristic for the virtual network embedding problem","volume":"44","author":"Bianchi","year":"2017","journal-title":"ACM SIGMETRICS Perform. Eval. Rev."},{"key":"2024041716572467300_ref22","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1109\/TNSM.2018.2876789","article-title":"A self-adaptive virtual network embedding algorithm based on software-defined networks","volume":"16","author":"Li","year":"2019","journal-title":"IEEE Trans. Network Serv. Manage."},{"key":"2024041716572467300_ref23","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.jnca.2018.10.005","article-title":"Online power aware coordinated virtual network embedding with 5G delay constraint","volume":"124","author":"Hejja","year":"2018","journal-title":"J. Network Comput. Appl."},{"key":"2024041716572467300_ref24","first-page":"1061","article-title":"VNE solution for network differentiated QoS and security requirements: from the perspective of deep reinforcement learning","volume":"103","author":"Wang","year":"2021","journal-title":"Comput. Secur."},{"key":"2024041716572467300_ref25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/MNET.2017.1700200","article-title":"Machine learning for networking: workflow, advances and opportunities","volume":"32","author":"Wang","year":"2018","journal-title":"IEEE Network"},{"key":"2024041716572467300_ref26","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1109\/TNSM.2020.2971543","article-title":"A continuous decision virtual network embedding scheme relying on reinforcement learning","volume":"24","author":"Yao","year":"2020","journal-title":"IEEE Trans. Network Serv. Manage."},{"key":"2024041716572467300_ref27","doi-asserted-by":"crossref","first-page":"2305","DOI":"10.1109\/TNSM.2020.3012588","article-title":"A dynamic and collaborative multi-layer virtual network embedding algorithm in SDN based on reinforcement learning","volume":"17","author":"Lu","year":"2020","journal-title":"IEEE Trans. Network Serv. Manage."}],"container-title":["The Computer Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/67\/3\/1171\/57231745\/bxad050.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/comjnl\/article-pdf\/67\/3\/1171\/57231745\/bxad050.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,17]],"date-time":"2024-04-17T20:00:05Z","timestamp":1713384005000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/comjnl\/article\/67\/3\/1171\/7147952"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,2]]},"references-count":27,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,5,2]]},"published-print":{"date-parts":[[2024,4,14]]}},"URL":"https:\/\/doi.org\/10.1093\/comjnl\/bxad050","relation":{},"ISSN":["0010-4620","1460-2067"],"issn-type":[{"value":"0010-4620","type":"print"},{"value":"1460-2067","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,3]]},"published":{"date-parts":[[2023,5,2]]}}}