{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,22]],"date-time":"2025-07-22T11:11:55Z","timestamp":1753182715307},"reference-count":21,"publisher":"Institute of Electrical and Electronics Engineers (IEEE)","issue":"7","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Commun."],"published-print":{"date-parts":[[2023,7,1]]},"DOI":"10.1587\/transcom.2022ebp3160","type":"journal-article","created":{"date-parts":[[2023,1,9]],"date-time":"2023-01-09T22:09:36Z","timestamp":1673302176000},"page":"557-570","source":"Crossref","is-referenced-by-count":5,"title":["Dynamic VNF Scheduling: A Deep Reinforcement Learning Approach"],"prefix":"10.23919","volume":"E106.B","author":[{"given":"Zixiao","family":"ZHANG","sequence":"first","affiliation":[{"name":"Kyoto University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fujun","family":"HE","sequence":"additional","affiliation":[{"name":"Kyoto University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eiji","family":"OKI","sequence":"additional","affiliation":[{"name":"Kyoto University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"263","reference":[{"key":"1","doi-asserted-by":"crossref","unstructured":"[1] U. Ashraf, \u201cPlacing controllers in software-defined wireless mesh networks,\u201d 2018 Int. Conf. Comput. Math. Eng. Technol. (iCoMET 2018) on, pp.1-4, March 2018. 10.1109\/icomet.2018.8346386","DOI":"10.1109\/ICOMET.2018.8346386"},{"key":"2","doi-asserted-by":"crossref","unstructured":"[2] S.I. Kim and H.S. Kim, \u201cA VNF placement method based on VNF characteristics,\u201d 2021 Int. Conf. Inf. Netw. (ICOIN 2021), pp.864-869, 2021. 10.1109\/icoin50884.2021.9334022","DOI":"10.1109\/ICOIN50884.2021.9334022"},{"key":"3","doi-asserted-by":"crossref","unstructured":"[3] Z. Wang, J. Zhang, H. Wei, and T. Huang, \u201cHieff: Enabling efficient VNF clusters by coordinating VNF scaling and flow scheduling,\u201d 2020 IEEE 39th Int. Perform. Comput. Commun. Conf. (IPCCC 2020), pp.1-8, 2020. 10.1109\/ipccc50635.2020.9391534","DOI":"10.1109\/IPCCC50635.2020.9391534"},{"key":"4","doi-asserted-by":"crossref","unstructured":"[4] X. Zhao, X. Jia, and Y. Hua, \u201cAn efficient VNF deployment algorithm for SFC scaling-out based on the proposed scaling management mechanism,\u201d 2020 Inf. Commun. Technol. Conf. (ICTC 2020), pp.166-170, 2020. 10.1109\/ictc49638.2020.9123252","DOI":"10.1109\/ICTC49638.2020.9123252"},{"key":"5","doi-asserted-by":"publisher","unstructured":"[5] J. Li, W. Shi, N. Zhang, and X. Shen, \u201cDelay-aware VNF scheduling: A reinforcement learning approach with variable action set,\u201d IEEE Trans. Cogn. Commun. Netw., vol.7, no.1, pp.304-318, 2021. 10.1109\/tccn.2020.2988908","DOI":"10.1109\/TCCN.2020.2988908"},{"key":"6","doi-asserted-by":"crossref","unstructured":"[6] J.F. Riera, E. Escalona, J. Batall\u00e9, E. Grasa, and J.A. Garc\u00eda-Esp\u00edn, \u201cVirtual network function scheduling: Concept and challenges,\u201d 2014 Int. Conf. Smart Commun. Netw. Technol. (SaCoNeT 2014), pp.1-5, 2014. 10.1109\/saconet.2014.6867768","DOI":"10.1109\/SaCoNeT.2014.6867768"},{"key":"7","doi-asserted-by":"crossref","unstructured":"[7] J.F. Riera, X. Hesselbach, E. Escalona, J.A. Garc\u00eda-Esp\u00edn, and E. Grasa, \u201cOn the complex scheduling formulation of virtual network functions over optical networks,\u201d 2014 16th Int. Conf. Transparent Opt. Netw. (ICTON 2014), pp.1-5, 2014. 10.1109\/icton.2014.6876564","DOI":"10.1109\/ICTON.2014.6876564"},{"key":"8","doi-asserted-by":"crossref","unstructured":"[8] N. Yamaguchi, O. Fukuda, and H. Okumura, \u201cModel-based reinforcement learning with missing data,\u201d 2020 8th Int. Symp. Comput. Netw. Workshops (CANDARW 2020), pp.168-171, 2020. 10.1109\/candarw51189.2020.00042","DOI":"10.1109\/CANDARW51189.2020.00042"},{"key":"9","doi-asserted-by":"crossref","unstructured":"[9] K. Shiomoto and T. Kurimoto, \u201cPolicy gradient-based deep reinforcement learning for deadline-aware transfer over wide area networks,\u201d 2021 7th IEEE Int. Conf. Netw. Softwarization (NetSoft 2021), pp.166-170, 2021. 10.1109\/netsoft51509.2021.9492675","DOI":"10.1109\/NetSoft51509.2021.9492675"},{"key":"10","doi-asserted-by":"crossref","unstructured":"[10] J. Bae, J. Lee, and S. Chong, \u201cBeyond max-weight scheduling: A reinforcement learning-based approach,\u201d 2019 WiOPT, pp.1-8, 2019. 10.23919\/wiopt47501.2019.9144097","DOI":"10.23919\/WiOPT47501.2019.9144097"},{"key":"11","doi-asserted-by":"publisher","unstructured":"[11] T. Zhou, D. Tang, H. Zhu, and L. Wang, \u201cReinforcement learning with composite rewards for production scheduling in a smart factory,\u201d IEEE Access, vol.9, pp.752-766, 2021. 10.1109\/access.2020.3046784","DOI":"10.1109\/ACCESS.2020.3046784"},{"key":"12","doi-asserted-by":"crossref","unstructured":"[12] S. Yang and Z. Xu, \u201cIntelligent scheduling for permutation flow shop with dynamic job arrival via deep reinforcement learning,\u201d 2021 IEEE 5th Adv. Inf. Technol. Electron. Autom. Control Conf. (IAEAC 2021), vol.5, pp.2672-2677, 2021. 10.1109\/iaeac50856.2021.9390893","DOI":"10.1109\/IAEAC50856.2021.9390893"},{"key":"13","doi-asserted-by":"publisher","unstructured":"[13] Y. Wang, H. Liu, W. Zheng, Y. Xia, Y. Li, P. Chen, K. Guo, and H. Xie, \u201cMulti-objective workflow scheduling with deep-Qnetwork-based multi-agent reinforcement learning,\u201d IEEE Access, vol.7, pp.39974-39982, 2019. 10.1109\/access.2019.2902846","DOI":"10.1109\/ACCESS.2019.2902846"},{"key":"14","doi-asserted-by":"publisher","unstructured":"[14] Z. Yan, J. Ge, Y. Wu, L. Li, and T. Li, \u201cAutomatic virtual network embedding: A deep reinforcement learning approach with graph convolutional networks,\u201d IEEE J. Sel. Areas Commun., vol.38, no.6, pp.1040-1057, 2020. 10.1109\/jsac.2020.2986662","DOI":"10.1109\/JSAC.2020.2986662"},{"key":"15","doi-asserted-by":"publisher","unstructured":"[15] X. Chen, B. Li, R. Proietti, H. Lu, Z. Zhu, and S. J. B. Yoo, \u201cDeepRMSA: A deep reinforcement learning framework for routing, modulation and spectrum assignment in elastic optical networks,\u201d J. Light. Technol, vol.37, no.16, pp.4155-4163, 2019. 10.1109\/jlt.2019.2923615","DOI":"10.1109\/JLT.2019.2923615"},{"key":"16","doi-asserted-by":"crossref","unstructured":"[16] J. Guo, Z. Chang, S. Wang, H. Ding, Y. Feng, L. Mao, and Y. Bao, \u201cWho limits the resource efficiency of my datacenter: An analysis of alibaba datacenter traces,\u201d 2019 IEEE\/ACM 27th Int. Symp. Qual. of Serv. (IWQoS 2019), pp.1-10, IEEE, 2019. 10.1145\/3326285.3329074","DOI":"10.1145\/3326285.3329074"},{"key":"17","doi-asserted-by":"crossref","unstructured":"[17] S. Geissler, S. Lange, F. Wamser, T. Zinner, and T. Ho\u00df feld, \u201cKOMon \u2014 Kernel-based online monitoring of VNF packet processing times,\u201d 2019 International Conference on Networked Systems (NetSys), pp.1-8, 2019. 10.1109\/netsys.2019.8854514","DOI":"10.1109\/NetSys.2019.8854514"},{"key":"18","doi-asserted-by":"crossref","unstructured":"[18] J. Zhang, J. Tang, X. Zhang, W. Ouyang, and D. Wang, \u201cA survey of network traffic generation,\u201d Third International Conference on Cyberspace Technology (CCT 2015), pp.1-6, 2015. 10.1049\/cp.2015.0862","DOI":"10.1049\/cp.2015.0862"},{"key":"19","doi-asserted-by":"crossref","unstructured":"[19] Z. Kuai and S. Wang, \u201cFair virtual network function scheduling with deep reinforcement learning,\u201d 2021 IEEE Gl. Comms. Conf. (GLOBECOM 2021), pp.1-6, 2021. 10.1109\/globecom46510.2021.9686006","DOI":"10.1109\/GLOBECOM46510.2021.9686006"},{"key":"20","doi-asserted-by":"publisher","unstructured":"[20] J. Xuan, H. Yang, X. Zhao, X. Ma, and X. Yang, \u201cDeep reinforcement learning-based algorithm for VNF-SC deployment,\u201d Sec. Comms. Netw, vol.2021, 2021. 10.1155\/2021\/7398206","DOI":"10.1155\/2021\/7398206"},{"key":"21","doi-asserted-by":"crossref","unstructured":"[21] N. He, S. Yang, F. Li, S. Trajanovski, F.A. Kuipers, and X. Fu, \u201cyyA-DDPG: Attention mechanism-based deep reinforcement learning for NFV,\u201d 2021 IEEE\/ACM 29th Int. Symp. Qual. Serv. (IWQOS), pp.1-10, 2021. 10.1109\/iwqos52092.2021.9521285","DOI":"10.1109\/IWQOS52092.2021.9521285"}],"container-title":["IEICE Transactions on Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transcom\/E106.B\/7\/E106.B_2022EBP3160\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,11]],"date-time":"2024-10-11T22:06:58Z","timestamp":1728684418000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transcom\/E106.B\/7\/E106.B_2022EBP3160\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,1]]},"references-count":21,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2023]]}},"URL":"https:\/\/doi.org\/10.1587\/transcom.2022ebp3160","relation":{},"ISSN":["0916-8516","1745-1345"],"issn-type":[{"type":"print","value":"0916-8516"},{"type":"electronic","value":"1745-1345"}],"subject":[],"published":{"date-parts":[[2023,7,1]]},"article-number":"2022EBP3160"}}