{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T00:40:36Z","timestamp":1781311236249,"version":"3.54.1"},"reference-count":32,"publisher":"Institute of Electrical and Electronics Engineers (IEEE)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IEICE Trans. Commun."],"published-print":{"date-parts":[[2023,12,1]]},"DOI":"10.1587\/transcom.2023ebp3039","type":"journal-article","created":{"date-parts":[[2023,7,31]],"date-time":"2023-07-31T22:12:46Z","timestamp":1690841566000},"page":"1424-1440","source":"Crossref","is-referenced-by-count":1,"title":["Joint Virtual Network Function Deployment and Scheduling via Heuristics and Deep Reinforcement Learning"],"prefix":"10.23919","volume":"E106.B","author":[{"given":"Zixiao","family":"ZHANG","sequence":"first","affiliation":[{"name":"Kyoto University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eiji","family":"OKI","sequence":"additional","affiliation":[{"name":"Kyoto University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"263","reference":[{"key":"1","doi-asserted-by":"crossref","unstructured":"[1] M. Markowski, P. Ryba, and K. Pucha\u0142a, \u201cSoftware defined networking research laboratory-experimental topologies and scenarios,\u201d 2016 3rd Eur. Netw. Intell. Conf. (ENIC), pp.252-256, 2016. 10.1109\/enic.2016.044","DOI":"10.1109\/ENIC.2016.044"},{"key":"2","doi-asserted-by":"crossref","unstructured":"[2] M.G. Khan, J. Taheri, A. Kassler, and M. Darula, \u201cAutomated analysis and profiling of virtual network functions: The NFV-inspector approach,\u201d 2018 IEEE Conf. Netw. Func. Virtual. Soft. Def. Netw. (NFV-SDN), pp.1-2, 2018. 10.1109\/nfv-sdn.2018.8725697","DOI":"10.1109\/NFV-SDN.2018.8725697"},{"key":"3","doi-asserted-by":"publisher","unstructured":"[3] Z. Zhang, F. He, and E. Oki, \u201cDynamic VNF scheduling: A deep reinforcement learning approach,\u201d IEICE Trans. Commun., vol.E106-B, no.7, pp.557-570, July 2023. 10.1587\/transcom.2022ebp3160","DOI":"10.1587\/transcom.2022EBP3160"},{"key":"4","doi-asserted-by":"publisher","unstructured":"[4] N. Promwongsa, A. Ebrahimzadeh, R.H. Glitho, and N. Crespi, \u201cJoint VNF placement and scheduling for latency-sensitive services,\u201d IEEE Trans. Netw. Sci. Eng., vol.9, no.4, pp.2432-2449, 2022. 10.1109\/tnse.2022.3163927","DOI":"10.1109\/TNSE.2022.3163927"},{"key":"5","doi-asserted-by":"publisher","unstructured":"[5] Y. Zhang, F. He, T. Sato, and E. Oki, \u201cNetwork service scheduling with resource sharing and preemption,\u201d IEEE Trans. Netw. Service Manage., vol.17, no.2, pp.764-778, 2020. 10.1109\/tnsm.2019.2956949","DOI":"10.1109\/TNSM.2019.2956949"},{"key":"6","doi-asserted-by":"publisher","unstructured":"[23] Y. Zhang, F. He, and E. Oki, \u201cService mapping and scheduling with uncertain processing time in network function virtualization,\u201d IEEE Trans. Cloud Comput., vol.11, no.2, pp.1315-1333, 2023. 10.1109\/tcc.2021.3132008","DOI":"10.1109\/TCC.2021.3132008"},{"key":"7","doi-asserted-by":"publisher","unstructured":"[7] P.T. Quang, Y. Hadjadj-Aoul, and A. Outtagarts, \u201cA deep reinforcement learning approach for VNF forwarding graph embedding,\u201d IEEE Trans. Netw. Service Manag., vol.16, no.4, pp.1318-1331, 2019. 10.1109\/tnsm.2019.2947905","DOI":"10.1109\/TNSM.2019.2947905"},{"key":"8","doi-asserted-by":"crossref","unstructured":"[8] Z. Zhang and E. Oki, \u201cJoint VNF scheduling and deployment: A dynamic scenario,\u201d 13th Int. Conf. Info. Commun. Tech. Conv. (ICTC), pp.1-6, 2022. 10.1109\/ictc55196.2022.9952956","DOI":"10.1109\/ICTC55196.2022.9952956"},{"key":"9","doi-asserted-by":"crossref","unstructured":"[9] A. Ebrahimzadeh, N. Promwongsa, S.N. Afrasiabi, C. Mouradian, W. Li, \u00c1. Recse, R. Szab\u00f3, and R.H. Glitho, \u201ch-horizon sequential look-ahead greedy algorithm for VNF-FG embedding,\u201d 2021 IEEE Conf. Netw. Func. Virtual. Soft. Def. Netw. (NFV-SDN), pp.41-46, 2021. 10.1109\/nfv-sdn53031.2021.9665063","DOI":"10.1109\/NFV-SDN53031.2021.9665063"},{"key":"10","doi-asserted-by":"crossref","unstructured":"[10] M. Mechtri, C. Ghribi, and D. Zeghlache, \u201cVNF placement and chaining in distributed cloud,\u201d 2016 IEEE 9th Int. Conf. Cld. Comput. (CLOUD), pp.376-383, 2016. 10.1109\/cloud.2016.0057","DOI":"10.1109\/CLOUD.2016.0057"},{"key":"11","doi-asserted-by":"publisher","unstructured":"[11] S. Umeyama, \u201cAn eigendecomposition approach to weighted graph matching problems,\u201d IEEE Trans. PatternAnal. Mach. Intell., vol.10, no.5, pp.695-703, 1988. 10.1109\/34.6778","DOI":"10.1109\/34.6778"},{"key":"12","doi-asserted-by":"crossref","unstructured":"[12] L. Ruiz, R.J. Dur\u00e1n, I. de Miguel, N. Merayo, J.C. Aguado, P. Fern\u00e1ndez, R.M. Lorenzo, and E.J. Abril, \u201cJoint VNF-provisioning and virtual topology design in 5G optical metro networks,\u201d 2019 21st Int. Conf. Trans. Opt. Netw. (ICTON), pp.1-4, 2019. 10.1109\/icton.2019.8840523","DOI":"10.1109\/ICTON.2019.8840523"},{"key":"13","doi-asserted-by":"publisher","unstructured":"[13] L. Liu, S. Guo, G. Liu, and Y. Yang, \u201cJoint dynamical VNF placement and SFC routing in NFV-enabled SDNs,\u201d IEEE Trans. Netw. Service Manag., vol.18, no.4, pp.4263-4276, 2021. 10.1109\/tnsm.2021.3091424","DOI":"10.1109\/TNSM.2021.3091424"},{"key":"14","doi-asserted-by":"publisher","unstructured":"[14] J. Pei, P. Hong, M. Pan, J. Liu, and J. Zhou, \u201cOptimal VNF placement via deep reinforcement learning in SDN\/NFV-enabled networks,\u201d IEEE J. Sel. Areas Commun., vol.38, no.2, pp.263-278, 2020. 10.1109\/jsac.2019.2959181","DOI":"10.1109\/JSAC.2019.2959181"},{"key":"15","doi-asserted-by":"publisher","unstructured":"[15] M. Akbari, M. R. Abedi, R. Joda, M. Pourghasemian, N. Mokari, and M. Erol-Kantarci, \u201cAge of information aware VNF scheduling in industrial IoT using deep reinforcement learning,\u201d IEEE J. Sel. Areas Commun., vol.39, no.8, pp.2487-2500, 2021. 10.1109\/jsac.2021.3087264","DOI":"10.1109\/JSAC.2021.3087264"},{"key":"16","doi-asserted-by":"publisher","unstructured":"[16] Z. Kuai, T. Wang, and S. Wang, \u201cFair virtual network function mapping and scheduling using proximal policy optimization,\u201d IEEE Trans. Commun., vol.70, no.11, pp.7434-7445, 2022. 10.1109\/tcomm.2022.3211071","DOI":"10.1109\/TCOMM.2022.3211071"},{"key":"17","unstructured":"[17] \u201cIBM ILOG CPLEX Optimization Studio,\u201d Accessed: March 13, 2023, [Online]. Available: https:\/\/www.ibm.com\/products\/ilog-cplex-optimization-studio"},{"key":"18","unstructured":"[18] Z. Wang, S. Tom, H. Matteo, H. Hado, L. Marc, and F. Nando, \u201cDueling network architectures for deep reinforcement learning,\u201d Int. Conf. Mach. Learn., vol.48, pp.1995-2003, 2016."},{"key":"19","unstructured":"[19] M. Volodymyr, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller, \u201cPlaying Atari with deep reinforcement learning,\u201d arXiv preprint arXiv:1312.5602, 2013. 10.48550\/arXiv.1312.5602"},{"key":"20","unstructured":"[20] K. Vijay and T. John, \u201cActor-critic algorithms,\u201d Advances in Neural Information Processing Systems, vol.12, 1999."},{"key":"21","unstructured":"[21] \u201cWelcome to Python.org,\u201d Accessed: March 13, 2023, [Online]. Available: https:\/\/www.python.org"},{"key":"22","doi-asserted-by":"crossref","unstructured":"[22] J. Zhang, J. Tang, X. Zhang, W. Ouyang, and D. Wang, \u201cA survey of network traffic generation,\u201d Third International Conference on Cyberspace Technology (CCT 2015), pp.1-6, 2015. 10.1049\/cp.2015.0862","DOI":"10.1049\/cp.2015.0862"},{"key":"23","doi-asserted-by":"publisher","unstructured":"[23] Y. Zhang, F. He, and E. Oki, \u201cService mapping and scheduling with uncertain processing time in network function virtualization,\u201d IEEE Trans. Cloud Comput., vol.11, no.2, pp.1315-1333, 2023. 10.1109\/tcc.2021.3132008","DOI":"10.1109\/TCC.2021.3132008"},{"key":"24","doi-asserted-by":"publisher","unstructured":"[24] J. Li, W. Shi, N. Zhang, and X. Shen, \u201cDelay-aware VNF scheduling: A reinforcement learning approach with variable action set,\u201d IEEE Trans. Cogn. Commun. Netw., vol.7, no.1, pp.304-318, May 2020. 10.1109\/tccn.2020.2988908","DOI":"10.1109\/TCCN.2020.2988908"},{"key":"25","doi-asserted-by":"publisher","unstructured":"[25] T. Gao, X. Li, Y. Wu, W. Zou, S. Huang, M. Tornatore, and B. Mukherjee, \u201cCost-efficient VNF placement and scheduling in public cloud networks,\u201d IEEE Trans. Commun., vol.68, no.8, pp.4946-4959, May 2020. 10.1109\/tcomm.2020.2992504","DOI":"10.1109\/TCOMM.2020.2992504"},{"key":"26","doi-asserted-by":"crossref","unstructured":"[26] M. Mitchell, An Introduction to Genetic Algorithms, MIT Press, 1998. 10.7551\/mitpress\/3927.001.0001","DOI":"10.7551\/mitpress\/3927.001.0001"},{"key":"27","unstructured":"[27] N. T\u00e9llez, M. Jimeno, A. Salazar, and E. Nino-Ruiz, \u201cA tabu search method for load balancing in fog computing,\u201d Int. J. Artif. Intell., vol.16, no.2, pp.1-30, 2018."},{"key":"28","doi-asserted-by":"publisher","unstructured":"[28] F. He, T. Sato, B. C. Chatterjee, T. Kurimoto, U. Shigeo, and E. Oki, \u201cRobust optimization model for primary and backup resource allocation in cloud providers,\u201d IEEE Trans. Cloud Comput., vol.10, no.4, pp.2920-2935, Oct.-Dec. 2022. 10.1109\/tcc.2021.3051018","DOI":"10.1109\/TCC.2021.3051018"},{"key":"29","doi-asserted-by":"publisher","unstructured":"[29] K. Yokouchi, F. He, and E. Oki, \u201cBackup resource allocation of virtual machines with two-stage probabilistic protection,\u201d IEEE Trans. Netw. Service Manag., Early Access, 2023. 10.1109\/tnsm.2023.3273522","DOI":"10.1109\/TNSM.2023.3273522"},{"key":"30","doi-asserted-by":"publisher","unstructured":"[30] I.A. Moschakis and H.D. Karatza, \u201cMulti-criteria scheduling of bag-of-tasks applications on heterogeneous interlinked clouds with simulated annealing,\u201d Journal of Systems and Software, vol.101, pp.1-14, 2015. 10.1016\/j.jss.2014.11.014","DOI":"10.1016\/j.jss.2014.11.014"},{"key":"31","doi-asserted-by":"publisher","unstructured":"[31] A. Suzuki, R. Kawahara, and S. Harada, \u201cCooperative multi-agent deep reinforcement learning for dynamic virtual network allocation with traffic fluctuations,\u201d IEEE Trans. Netw. Service Manag., vol.19, no.3, pp.1982-2000, 2022. 10.1109\/tnsm.2022.3149243","DOI":"10.1109\/TNSM.2022.3149243"},{"key":"32","doi-asserted-by":"publisher","unstructured":"[32] K. Tokuda, T. Sato, and E. Oki, \u201cNetwork slice reconfiguration with deep reinforcement learning under variable number of service function chains,\u201d Computer Networks, vol.224, no.109636, pp.1-17, April 2023. 10.1016\/j.comnet.2023.109636","DOI":"10.1016\/j.comnet.2023.109636"}],"container-title":["IEICE Transactions on Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transcom\/E106.B\/12\/E106.B_2023EBP3039\/_pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T12:03:19Z","timestamp":1729857799000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jstage.jst.go.jp\/article\/transcom\/E106.B\/12\/E106.B_2023EBP3039\/_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,1]]},"references-count":32,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2023]]}},"URL":"https:\/\/doi.org\/10.1587\/transcom.2023ebp3039","relation":{},"ISSN":["0916-8516","1745-1345"],"issn-type":[{"value":"0916-8516","type":"print"},{"value":"1745-1345","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,1]]},"article-number":"2023EBP3039"}}