{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T05:31:07Z","timestamp":1778823067876,"version":"3.51.4"},"reference-count":65,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2024,7,13]],"date-time":"2024-07-13T00:00:00Z","timestamp":1720828800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Fog computing as a paradigm was offered more than a decade ago to solve Cloud Computing issues. Long transmission distances, higher data flow, data loss, latency, and energy consumption lead to providing services at the edge of the network. But, fog devices are known for being mobile and heterogenous. Their resources can be limited, and their availability can be constantly changing. A service placement optimization is needed to meet the QoS requirements. We propose a service placement orchestration, which functions as a multi-agent system. Fog computing services are represented by agents that can both work independently and cooperate. Service placement is being completed by a two-stage optimization method. Our service placement orchestrator is distributed, services are discovered dynamically, resources can be monitored, and communication messages among fog nodes can be signed and encrypted as a solution to the weakness of multi-agent systems due to the lack of monitoring tools and security.<\/jats:p>","DOI":"10.3390\/fi16070248","type":"journal-article","created":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T08:35:17Z","timestamp":1721032517000},"page":"248","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Multi-Agent Dynamic Fog Service Placement Approach"],"prefix":"10.3390","volume":"16","author":[{"given":"Nerijus","family":"\u0160atkauskas","sequence":"first","affiliation":[{"name":"Faculty of Informatics, Kaunas University of Technology, Kaunas LT-51368, Lithuania"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4567-5023","authenticated-orcid":false,"given":"Algimantas","family":"Ven\u010dkauskas","sequence":"additional","affiliation":[{"name":"Faculty of Informatics, Kaunas University of Technology, Kaunas LT-51368, Lithuania"}]}],"member":"1968","published-online":{"date-parts":[[2024,7,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/spe.3243","article-title":"A Decade of Research in Fog Computing: Relevance, Challenges, and Future Directions","volume":"54","author":"Srirama","year":"2024","journal-title":"Softw. Pract. Exp."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1928","DOI":"10.1080\/00207543.2023.2290229","article-title":"The Applications of Internet of Things (IoT) in Industrial Management: A Science Mapping Review","volume":"62","author":"Mu","year":"2024","journal-title":"Int. J. Prod. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"100549","DOI":"10.1016\/j.cosrev.2023.100549","article-title":"Fog Computing for Next-Generation Internet of Things: Fundamental, State-of-the-Art and Research Challenges","volume":"48","author":"Hazra","year":"2023","journal-title":"Comput. Sci. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"100049","DOI":"10.1016\/j.teler.2023.100049","article-title":"A Review on Fog Computing: Issues, Characteristics, Challenges, and Potential Applications","volume":"10","author":"Das","year":"2023","journal-title":"Telemat. Inform. Rep."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.future.2023.09.014","article-title":"Evaluating NiFi and MQTT Based Serverless Data Pipelines in Fog Computing Environments","volume":"150","author":"Mirampalli","year":"2024","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_6","first-page":"633","article-title":"Multi-Layer Fog-Cloud Architecture for Optimizing the Placement of IoT Applications in Smart Cities","volume":"75","author":"Aldossary","year":"2023","journal-title":"Comput. Mater. Contin."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1007\/s11277-022-10160-y","article-title":"Machine Learning for Fog Computing: Review, Opportunities and a Fog Application Classifier and Scheduler","volume":"129","author":"Aqib","year":"2023","journal-title":"Wirel. Pers Commun"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tran-Dang, H., and Kim, D.-S. (2023). Fog Computing: Fundamental Concepts and Recent Advances in Architectures and Technologies. Cooperative and Distributed Intelligent Computation in Fog Computing: Concepts, Architectures, and Frameworks, Springer Nature.","DOI":"10.1007\/978-3-031-33920-2"},{"key":"ref_9","unstructured":"Buyya, R., and Vahid Dastjerdi, A. (2016). Chapter 4\u2014Fog Computing: Principles, Architectures, and Applications. Internet of Things, Morgan Kaufmann."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"109519","DOI":"10.1016\/j.comnet.2022.109519","article-title":"Defense Scheme against Advanced Persistent Threats in Mobile Fog Computing Security","volume":"221","author":"Waqas","year":"2023","journal-title":"Comput. Netw."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1007\/s11036-019-01430-4","article-title":"Fog Computing for 5G-Enabled Tactile Internet: Research Issues, Challenges, and Future Research Directions","volume":"28","author":"Aggarwal","year":"2023","journal-title":"Mob. Netw. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"100907","DOI":"10.1016\/j.iot.2023.100907","article-title":"An Integrating Computing Framework Based on Edge-Fog-Cloud for Internet of Healthcare Things Applications","volume":"23","year":"2023","journal-title":"Internet Things"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"73303","DOI":"10.1109\/ACCESS.2023.3294479","article-title":"A Comprehensive Survey on the Cooperation of Fog Computing Paradigm-Based IoT Applications: Layered Architecture, Real-Time Security Issues, and Solutions","volume":"11","author":"Burhan","year":"2023","journal-title":"IEEE Access"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"28573","DOI":"10.1109\/ACCESS.2018.2831228","article-title":"Multi-Agent Systems: A Survey","volume":"6","author":"Dorri","year":"2018","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, J., Deng, X., Guo, J., and Zeng, Z. (2023). Resilient Consensus Control for Multi-Agent Systems: A Comparative Survey. Sensors, 23.","DOI":"10.3390\/s23062904"},{"key":"ref_16","first-page":"213","article-title":"An Overview of Concepts, Applications, Difficulties, Unresolved Issues in Fog Computing and Machine Learning","volume":"1","author":"Jayanagara","year":"2023","journal-title":"Int. Trans. Artif. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"100866","DOI":"10.1016\/j.iot.2023.100866","article-title":"A Comprehensive Review on Internet of Things Application Placement in Fog Computing Environment","volume":"23","author":"Apat","year":"2023","journal-title":"Internet Things"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lahmar, I.B., and Boukadi, K. (2020, January 20\u201323). Resource Allocation in Fog Computing: A Systematic Mapping Study. Proceedings of the 2020 Fifth International Conference on Fog and Mobile Edge Computing (FMEC), Paris, France.","DOI":"10.1109\/FMEC49853.2020.9144705"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"20635","DOI":"10.1109\/ACCESS.2023.3241240","article-title":"Multi-Objective Grey Wolf Optimizer Algorithm for Task Scheduling in Cloud-Fog Computing","volume":"11","author":"Saif","year":"2023","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"105998","DOI":"10.1016\/j.engappai.2023.105998","article-title":"Optimal Fog Node Selection Based on Hybrid Particle Swarm Optimization and Firefly Algorithm in Dynamic Fog Computing Services","volume":"121","author":"Ogundoyin","year":"2023","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"45393","DOI":"10.1109\/ACCESS.2023.3266822","article-title":"Workload Allocation toward Energy Consumption-Delay Trade-Off in Cloud-Fog Computing Using Multi-Objective NPSO Algorithm","volume":"11","author":"Saif","year":"2023","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"133607","DOI":"10.1109\/ACCESS.2023.3337034","article-title":"An Intelligent Scheduling Strategy in Fog Computing System Based on Multi-Objective Deep Reinforcement Learning Algorithm","volume":"11","author":"Ibrahim","year":"2023","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"121","DOI":"10.23919\/JCN.2022.000058","article-title":"DISCO: Distributed Computation Offloading Framework for Fog Computing Networks","volume":"25","author":"Kim","year":"2023","journal-title":"J. Commun. Netw."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.jpdc.2022.12.001","article-title":"Optimal Placement of Applications in the Fog Environment: A Systematic Literature Review","volume":"174","author":"Islam","year":"2023","journal-title":"J. Parallel Distrib. Comput."},{"key":"ref_25","unstructured":"Righi, R. (2020). Scheduling Problems: New Applications and Trends, BoD\u2013Books on Demand."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"321:1","DOI":"10.1145\/3592598","article-title":"Placement of Microservices-Based IoT Applications in Fog Computing: A Taxonomy and Future Directions","volume":"55","author":"Pallewatta","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_27","first-page":"368","article-title":"Towards Distributed and Autonomous IoT Service Placement in Fog Computing Using Asynchronous Advantage Actor-Critic Algorithm","volume":"35","author":"Zare","year":"2023","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3391196","article-title":"An Overview of Service Placement Problem in Fog and Edge Computing","volume":"53","author":"Salaht","year":"2021","journal-title":"ACM Comput. Surv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"103724","DOI":"10.1016\/j.jnca.2023.103724","article-title":"Mobility-Aware Fog Computing in Dynamic Networks with Mobile Nodes: A Survey","volume":"219","author":"Ostrowski","year":"2023","journal-title":"J. Netw. Comput. Appl."},{"key":"ref_30","first-page":"9:1","article-title":"Latency-Aware Application Module Management for Fog Computing Environments","volume":"19","author":"Mahmud","year":"2018","journal-title":"ACM Trans. Internet Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"30:1","DOI":"10.1145\/3239565","article-title":"A Dynamic Service Migration Mechanism in Edge Cognitive Computing","volume":"19","author":"Chen","year":"2019","journal-title":"ACM Trans. Internet Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e3626","DOI":"10.1002\/ett.3626","article-title":"Mobile-Aware Dynamic Resource Management for Edge Computing","volume":"30","author":"Filiposka","year":"2019","journal-title":"Trans. Emerg. Telecommun. Technol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"10028","DOI":"10.1109\/JIOT.2019.2935056","article-title":"Joint Container Placement and Task Provisioning in Dynamic Fog Computing","volume":"6","author":"Mseddi","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/TNET.2018.2880874","article-title":"Decentralized Algorithm for Randomized Task Allocation in Fog Computing Systems","volume":"27","year":"2019","journal-title":"IEEE\/ACM Trans. Netw."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"4150","DOI":"10.1109\/JIOT.2018.2875520","article-title":"Folo: Latency and Quality Optimized Task Allocation in Vehicular Fog Computing","volume":"6","author":"Zhu","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1109\/TNSM.2017.2788945","article-title":"A Decentralized Replica Placement Algorithm for Edge Computing","volume":"15","author":"Aral","year":"2018","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2244","DOI":"10.1109\/TWC.2019.2901850","article-title":"An Online Optimization Framework for Distributed Fog Network Formation with Minimal Latency","volume":"18","author":"Lee","year":"2019","journal-title":"IEEE Trans. Wirel. Commun."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"100193","DOI":"10.1016\/j.hcc.2023.100193","article-title":"Fog-Computing Based Mobility and Resource Management for Resilient Mobile Networks","volume":"4","author":"Zhao","year":"2023","journal-title":"High-Confid. Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"104893","DOI":"10.1016\/j.micpro.2023.104893","article-title":"Resilience and Load Balancing in Fog Networks: A Multi-Criteria Decision Analysis Approach","volume":"101","author":"Ebrahim","year":"2023","journal-title":"Microprocess. Microsyst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"111910","DOI":"10.1016\/j.jss.2023.111910","article-title":"MicroFog: A Framework for Scalable Placement of Microservices-Based IoT Applications in Federated Fog Environments","volume":"209","author":"Pallewatta","year":"2024","journal-title":"J. Syst. Softw."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"109512","DOI":"10.1016\/j.comnet.2022.109512","article-title":"S-HIDRA: A Blockchain and SDN Domain-Based Architecture to Orchestrate Fog Computing Environments","volume":"221","author":"Caminero","year":"2023","journal-title":"Comput. Netw."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Dogani, J., Yazdanpanah, A., Zare, A., and Khunjush, F. (2023). A Two-Tier Multi-Objective Service Placement in Container-Based Fog-Cloud Computing Platforms. Clust. Comput, 1\u201324.","DOI":"10.21203\/rs.3.rs-3130299\/v1"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"93129","DOI":"10.1109\/ACCESS.2023.3307026","article-title":"Dynamic, Context-Aware Cross-Layer Orchestration of Containerized Applications","volume":"11","author":"Sofia","year":"2023","journal-title":"IEEE Access"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"558","DOI":"10.1109\/TNSM.2023.3290137","article-title":"Resilient Edge Service Placement under Demand and Node Failure Uncertainties","volume":"21","author":"Cheng","year":"2024","journal-title":"IEEE Trans. Netw. Serv. Manag."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.comcom.2023.12.016","article-title":"DCSP: A Delay and Cost-Aware Service Placement and Load Distribution Algorithm for IoT-Based Fog Networks","volume":"215","author":"Azizi","year":"2024","journal-title":"Comput. Commun."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"100817","DOI":"10.1016\/j.iot.2023.100817","article-title":"An Integrated Approach of ML-Metaheuristics for Secure Service Placement in Fog-Cloud Ecosystem","volume":"22","author":"Singh","year":"2023","journal-title":"Internet Things"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2747","DOI":"10.1007\/s00607-023-01191-9","article-title":"Adaptive Configuration of IoT Applications in the Fog Infrastructure","volume":"105","author":"Chouat","year":"2023","journal-title":"Computing"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"845","DOI":"10.1007\/s10586-023-03985-0","article-title":"Imperialist Competitive Based Approach for Efficient Deployment of IoT Services in Fog Computing","volume":"27","author":"Zare","year":"2023","journal-title":"Clust. Comput"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"3779","DOI":"10.1109\/JIOT.2023.3306238","article-title":"Orchestration and Management of Adaptive IoT-Centric Distributed Applications","volume":"11","author":"Amjad","year":"2024","journal-title":"IEEE Internet Things J."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"48910","DOI":"10.1109\/ACCESS.2024.3352024","article-title":"Resilient Energy Efficient IoT Infrastructure with Server and Network Protection for Healthcare Monitoring Applications","volume":"12","author":"Isa","year":"2024","journal-title":"IEEE Access"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Mutlag, A.A., Ghani, M.K.A., Mohammed, M.A., Lakhan, A., Mohd, O., Abdulkareem, K.H., and Garcia-Zapirain, B. (2021). Multi-Agent Systems in Fog\u2013Cloud Computing for Critical Healthcare Task Management Model (CHTM) Used for ECG Monitoring. Sensors, 21.","DOI":"10.3390\/s21206923"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Jain, M., Saihjpal, V., Singh, N., and Singh, S.B. (2022). An Overview of Variants and Advancements of PSO Algorithm. Appl. Sci., 12.","DOI":"10.3390\/app12178392"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"e13683","DOI":"10.1016\/j.heliyon.2023.e13683","article-title":"A Method for Selecting Processes for Automation with AHP and TOPSIS","volume":"9","author":"Costa","year":"2023","journal-title":"Heliyon"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Liutkevi\u010dius, A., Morkevi\u010dius, N., Ven\u010dkauskas, A., and Toldinas, J. (2022). Distributed Agent-Based Orchestrator Model for Fog Computing. Sensors, 22.","DOI":"10.3390\/s22155894"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Morkevicius, N., Ven\u010dkauskas, A., \u0160atkauskas, N., and Toldinas, J. (2021). Method for Dynamic Service Orchestration in Fog Computing. Electronics, 10.","DOI":"10.3390\/electronics10151796"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1109\/TEVC.2004.826067","article-title":"Handling Multiple Objectives with Particle Swarm Optimization","volume":"8","author":"Coello","year":"2004","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/0270-0255(87)90473-8","article-title":"The Analytic Hierarchy Process\u2014What It Is and How It Is Used","volume":"9","author":"Saaty","year":"1987","journal-title":"Math. Model."},{"key":"ref_58","unstructured":"(2024, May 14). NodeMcu\u2014An Open-Source Firmware Based on ESP8266 Wifi-Soc. Available online: https:\/\/www.nodemcu.com\/index_en.html#fr_54745c8bd775ef4b99000011."},{"key":"ref_59","unstructured":"(2024, May 14). ESP8266 Wi-Fi SoC | Espressif Systems. Available online: https:\/\/www.espressif.com\/en\/products\/socs\/esp8266."},{"key":"ref_60","unstructured":"(2022, August 02). Jade Site | Java Agent DEvelopment Framework. Available online: https:\/\/jade.tilab.com\/."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1109\/TAP.2010.2090460","article-title":"Modification of Real-Number and Binary PSO Algorithms for Accelerated Convergence","volume":"59","author":"Modiri","year":"2011","journal-title":"IEEE Trans. Antennas Propagat."},{"key":"ref_62","unstructured":"Shi, Y., and Eberhart, R. (1998, January 4\u20139). A Modified Particle Swarm Optimizer. Proceedings of the 1998 IEEE International Conference on Evolutionary Computation Proceedings, IEEE World Congress on Computational Intelligence (Cat. No. 98TH8360), Anchorage, AK, USA."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1007\/s11721-016-0128-z","article-title":"Inertia Weight Control Strategies for Particle Swarm Optimization","volume":"10","author":"Harrison","year":"2016","journal-title":"Swarm Intell."},{"key":"ref_64","unstructured":"(2024, April 15). Tutorials & Guides | Jade Site. Available online: https:\/\/jade.tilab.com\/documentation\/tutorials-guides\/."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Wang, J., Wang, X., Li, X., and Yi, J. (2023). A Hybrid Particle Swarm Optimization Algorithm with Dynamic Adjustment of Inertia Weight Based on a New Feature Selection Method to Optimize SVM Parameters. Entropy, 25.","DOI":"10.3390\/e25030531"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/7\/248\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:16:19Z","timestamp":1760109379000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/16\/7\/248"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,13]]},"references-count":65,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["fi16070248"],"URL":"https:\/\/doi.org\/10.3390\/fi16070248","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,13]]}}}