{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:22:43Z","timestamp":1777656163615,"version":"3.51.4"},"reference-count":40,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2019,3,27]],"date-time":"2019-03-27T00:00:00Z","timestamp":1553644800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The internet of things (IoT) is essential for the implementation of applications and services that require the ability to sense the surrounding environment through sensors and modify it through actuators. However, IoT devices usually have limited computing capabilities and hence are not always sufficient to directly host resource-intensive services. Fog computing, which extends and complements the cloud, can support the IoT with computing resources and services that are deployed close to where data are sensed and actions need to be performed. Virtualisation is an essential feature in the cloud as in the fog, and containers have been recently getting much popularity to encapsulate fog services. Besides, container migration among fog nodes may enable several emerging use cases in different IoT domains (e.g., smart transportation, smart industry). In this paper, we first report container migration use cases in the fog and discuss containerisation. We then provide a comprehensive overview of the state-of-the-art migration techniques for containers, i.e., cold, pre-copy, post-copy, and hybrid migrations. The main contribution of this work is the extensive performance evaluation of these techniques that we conducted over a real fog computing testbed. The obtained results shed light on container migration within fog computing environments by clarifying, in general, which migration technique might be the most appropriate under certain network and service conditions.<\/jats:p>","DOI":"10.3390\/s19071488","type":"journal-article","created":{"date-parts":[[2019,3,29]],"date-time":"2019-03-29T03:38:52Z","timestamp":1553830732000},"page":"1488","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":103,"title":["Container Migration in the Fog: A Performance Evaluation"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0511-2565","authenticated-orcid":false,"given":"Carlo","family":"Puliafito","sequence":"first","affiliation":[{"name":"DINFO, University of Florence, Via di S. Marta 3, 50139 Florence, Italy"},{"name":"Department of Information Engineering, University of Pisa, Largo Lucio Lazzarino 1, 56122 Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7833-5471","authenticated-orcid":false,"given":"Carlo","family":"Vallati","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Pisa, Largo Lucio Lazzarino 1, 56122 Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8876-4176","authenticated-orcid":false,"given":"Enzo","family":"Mingozzi","sequence":"additional","affiliation":[{"name":"Department of Information Engineering, University of Pisa, Largo Lucio Lazzarino 1, 56122 Pisa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1469-7860","authenticated-orcid":false,"given":"Giovanni","family":"Merlino","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Messina, Contrada di Dio, Sant\u2019Agata, 98166 Messina, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6299-140X","authenticated-orcid":false,"given":"Francesco","family":"Longo","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Messina, Contrada di Dio, Sant\u2019Agata, 98166 Messina, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0385-2711","authenticated-orcid":false,"given":"Antonio","family":"Puliafito","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Messina, Contrada di Dio, Sant\u2019Agata, 98166 Messina, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,3,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2787","DOI":"10.1016\/j.comnet.2010.05.010","article-title":"The Internet of Things: A Survey","volume":"54","author":"Atzori","year":"2010","journal-title":"Comput. Netw."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2347","DOI":"10.1109\/COMST.2015.2444095","article-title":"Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications","volume":"17","author":"Guizani","year":"2015","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_3","unstructured":"Manyika, J., Chui, M., Bisson, P., Woetzel, J., Dobbs, R., Bughin, J., and Aharon, D. (2015). The Internet of Things: Mapping the Value Beyond the Hype, McKinsey Global Institute. Available online: http:\/\/www.mckinsey.com\/business-functions\/digital-mckinsey\/our-insights\/the-internet-of-things-the-value-of-digitizing-the-physical-world."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Delicato, F.C., Pires, P.F., and Batista, T. (2017). The Resource Management Challenge in IoT. Resource Management for Internet of Things, Springer International Publishing.","DOI":"10.1007\/978-3-319-54247-8"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s11036-013-0489-0","article-title":"Big Data: A Survey","volume":"19","author":"Chen","year":"2014","journal-title":"Mob. Netw. Appl."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bonomi, F., Milito, R., Zhu, J., and Addepalli, S. (2012, January 17). Fog Computing and its Role in the Internet of Things. Proceedings of the 1st Workshop on Mobile Cloud Computing (MCC), Helsinki, Finland.","DOI":"10.1145\/2342509.2342513"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1145\/3301443","article-title":"Fog Computing for the Internet of Things: A Survey","volume":"19","author":"Puliafito","year":"2019","journal-title":"ACM Trans. Internet Tech."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1109\/MPRV.2013.77","article-title":"The Role of Cloudlets in Hostile Environments","volume":"12","author":"Satyanarayanan","year":"2013","journal-title":"IEEE Pervasive Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1109\/MC.2017.9","article-title":"The Emergence of Edge Computing","volume":"50","author":"Satyanarayanan","year":"2017","journal-title":"Computer"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1109\/MC.2016.145","article-title":"The Promise of Edge Computing","volume":"49","author":"Shi","year":"2016","journal-title":"Computer"},{"key":"ref_11","unstructured":"Cisco (2019, January 14). Fog Computing and the Internet of Things: Extend the Cloud to Where the Things Are. Available online: https:\/\/www.cisco.com\/c\/dam\/en_us\/solutions\/trends\/iot\/docs\/computing-overview.pdf."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1206","DOI":"10.1109\/COMST.2018.2794881","article-title":"A Survey on Virtual Machine Migration: Challenges, Techniques, and Open Issues","volume":"20","author":"Zhang","year":"2018","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13677-017-0092-1","article-title":"A Critical Survey of Live Virtual Machine Migration Techniques","volume":"6","author":"Choudhary","year":"2017","journal-title":"J. Cloud Comput."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ha, K., Abe, Y., Eiszler, T., Chen, Z., Hu, W., Amos, B., Upadhyaya, R., Pillai, P., and Satyanarayanan, M. (2017, January 28). You Can Teach Elephants to Dance: Agile VM Handoff for Edge Computing. Proceedings of the ACM\/IEEE 2nd Symposium on Edge Computing (SEC), San Jose, CA, USA.","DOI":"10.1145\/3132211.3134453"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/MNET.2018.1700175","article-title":"Consolidate IoT Edge Computing with Lightweight Virtualization","volume":"32","author":"Morabito","year":"2018","journal-title":"IEEE Netw."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, N., Varghese, B., Matthaiou, M., and Nikolopoulos, D.S. (2018). ENORM: A Framework For Edge NOde Resource Management. IEEE Trans. Serv. Comput.","DOI":"10.1109\/TSC.2017.2753775"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tang, Z., Zhou, X., Zhang, F., Jia, W., and Zhao, W. (2018). Migration Modeling and Learning Algorithms for Containers in Fog Computing. IEEE Trans. Serv. Comput.","DOI":"10.1109\/TSC.2018.2827070"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ma, L., Yi, S., Carter, N., and Li, Q. (2018). Efficient Live Migration of Edge Services Leveraging Container Layered Storage. IEEE Trans. Mob. Comput.","DOI":"10.1109\/TMC.2018.2871842"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Puliafito, C., Mingozzi, E., Vallati, C., Longo, F., and Merlino, G. (2018, January 18\u201320). Companion Fog Computing: Supporting Things Mobility Through Container Migration at the Edge. Proceedings of the IEEE 4th International Conference on Smart Computing (SMARTCOMP), Taormina, Italy.","DOI":"10.1109\/SMARTCOMP.2018.00079"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Nadgowda, S., Suneja, S., Bila, N., and Isci, C. (2017, January 5\u20138). Voyager: Complete Container State Migration. Proceedings of the IEEE 37th International Conference on Distributed Computing Systems (ICDCS), Atlanta, GA, USA.","DOI":"10.1109\/ICDCS.2017.91"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Puliafito, C., Mingozzi, E., Vallati, C., Longo, F., and Merlino, G. (2018, January 18\u201320). Virtualization and Migration at the Network Edge: An Overview. Proceedings of the IEEE 4th International Conference on Smart Computing (SMARTCOMP), Taormina, Italy.","DOI":"10.1109\/SMARTCOMP.2018.00031"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Kakakhel, S.R.U., Mukkala, L., Westerlund, T., and Plosila, J. (2018, January 23\u201326). Virtualization at the Network Edge: A Technology Perspective. Proceedings of the IEEE 3rd International Conference on Fog and Mobile Edge Computing (FMEC), Barcelona, Spain.","DOI":"10.1109\/FMEC.2018.8364049"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Puliafito, C., Mingozzi, E., and Anastasi, G. (2017, January 29\u201331). Fog Computing for the Internet of Mobile Things: Issues and Challenges. Proceedings of the IEEE 3rd International Conference on Smart Computing (SMARTCOMP), Hong Kong, China.","DOI":"10.1109\/SMARTCOMP.2017.7947010"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1109\/MNET.2017.1700271","article-title":"Challenges and Solutions in Fog Computing Orchestration","volume":"32","author":"Jiang","year":"2018","journal-title":"IEEE Netw."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhu, C., Tao, J., Pastor, G., Xiao, Y., Ji, Y., Zhou, Q., Li, Y., and Yl\u00e4-J\u00e4\u00e4ski, A. (2018). Folo: Latency and Quality Optimized Task Allocation in Vehicular Fog Computing. IEEE Internet Things J.","DOI":"10.1109\/SAHCN.2018.8397129"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fern\u00e1ndez-Caram\u00e9s, T.M., Fraga-Lamas, P., Su\u00e1rez-Albela, M., and Vilar-Montesinos, M. (2018). A Fog Computing and Cloudlet Based Augmented Reality System for the Industry 4.0 Shipyard. Sensors, 18.","DOI":"10.3390\/s18061798"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1594","DOI":"10.1109\/TCOMM.2017.2787700","article-title":"Computation Offloading and Resource Allocation in Mixed Fog\/Cloud Computing Systems With Min-Max Fairness Guarantee","volume":"66","author":"Du","year":"2018","journal-title":"IEEE Trans. Commun."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1109\/MCOM.2018.1700795","article-title":"Secure and Sustainable Load Balancing of Edge Data Centers in Fog Computing","volume":"56","author":"Puthal","year":"2018","journal-title":"IEEE Commun. Mag."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"23947","DOI":"10.1109\/ACCESS.2017.2766165","article-title":"Adaptive Energy-Aware Computation Offloading for Cloud of Things Systems","volume":"5","author":"Nan","year":"2017","journal-title":"IEEE Access"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Dastjerdi, A.V., Gupta, H., Calheiros, R.N., Ghosh, S.K., and Buyya, R. (2016). Fog Computing: Principles, Architectures, and Applications. Internet of Things, Elsevier.","DOI":"10.1016\/B978-0-12-805395-9.00004-6"},{"key":"ref_31","first-page":"8","article-title":"Virtualization with KVM","volume":"2008","author":"Habib","year":"2008","journal-title":"Linux J."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.comnet.2019.01.013","article-title":"Security in Hardware Assisted Virtualization for Cloud Computing\u2014State of the Art Issues and Challenges","volume":"151","author":"Asvija","year":"2019","journal-title":"Comput. Netw."},{"key":"ref_33","first-page":"222","article-title":"Hypervisor: A Survey on Concepts and Taxonomy","volume":"2","author":"Desai","year":"2013","journal-title":"Int. J. Innov. Technol. Explor. Eng."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1145\/1272998.1273025","article-title":"Container-based Operating System Virtualization: A Scalable, High-performance Alternative to Hypervisors","volume":"41","author":"Soltesz","year":"2007","journal-title":"ACM SIGOPS Oper. Syst. Rev."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"8835","DOI":"10.1109\/ACCESS.2017.2704444","article-title":"Virtualization on Internet of Things Edge Devices with Container Technologies: A Performance Evaluation","volume":"5","author":"Morabito","year":"2017","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Bellavista, P., and Zanni, A. (2017, January 5\u20137). Feasibility of Fog Computing Deployment Based on Docker Containerization over RaspberryPi. Proceedings of the 18th International Conference on Distributed Computing and Networking (ICDCN), Hyderabad, India.","DOI":"10.1145\/3007748.3007777"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Ismail, B.I., Goortani, E.M., Ab Karim, M.B., Tat, W.M., Setapa, S., Luke, J.Y., and Hoe, O.H. (2015, January 24\u201326). Evaluation of Docker as Edge Computing Platform. Proceedings of the IEEE Conference on Open Systems (ICOS), Melaka, Malaysia.","DOI":"10.1109\/ICOS.2015.7377291"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/j.future.2016.08.025","article-title":"A Performance Comparison of Container-based Technologies for the Cloud","volume":"68","author":"Kozhirbayev","year":"2017","journal-title":"Future Gen. Comput. Syst."},{"key":"ref_39","unstructured":"Biederman, E.W., and Networx, L. (2006, January 19\u201322). Multiple Instances of the Global Linux Namespaces. Proceedings of the Linux Symposium, Ottawa, ON, Canada."},{"key":"ref_40","unstructured":"Ali Babar, M., and Ramsey, B. (2019, March 25). Understanding Container Isolation Mechanisms for Building Security-Sensitive Private Cloud; Technical Report. Available online: https:\/\/www.researchgate.net\/publication\/316602321_Understanding_Container_Isolation_Mechanisms_for_Building_Security-Sensitive_Private_Cloud."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/7\/1488\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:40:54Z","timestamp":1760186454000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/7\/1488"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,27]]},"references-count":40,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["s19071488"],"URL":"https:\/\/doi.org\/10.3390\/s19071488","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,27]]}}}