{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,31]],"date-time":"2026-10-31T22:25:26Z","timestamp":1793485526552,"version":"4.5.0"},"reference-count":36,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T00:00:00Z","timestamp":1782432000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Coordinating agents in dynamic and uncertain environments remains a fundamental challenge in multi-agent systems (MAS) research, particularly in contexts where the composition of agent organizations directly affects overall system performance. While significant effort has focused on task allocation and individual agent planning, predicting the systemic impact of organizational changes and selecting optimal organizational structures under uncertainty remain less explored in MAS. This paper addresses this challenge by introducing a decision-making framework that models structural reorganization as a Markov Decision Process (MDP), where actions represent organizational structures rather than individual agent behaviors, and organizational selection is guided by the anticipated impact on the overall system state. The proposed model captures the stochastic dynamics of multi-agent intervention and diverse agent capabilities through a probabilistic transition function, while a reward function guides the selection of coalition structures that maximize operational effectiveness. The framework is solved using value iteration and evaluated on the RoboCup Rescue simulation platform. Results show that the derived optimal policy identifies, at each decision step, an appropriate coalition structure that reduces system degradation while efficiently utilizing available agents.<\/jats:p>","DOI":"10.3390\/systems14070741","type":"journal-article","created":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T05:58:04Z","timestamp":1782799084000},"page":"741","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Toward an Effective Organizational Adaptation in Multi-Agent Systems: A Model Based on Markov Decision Processes"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-1459-9431","authenticated-orcid":false,"given":"Narimane","family":"Sahel","sequence":"first","affiliation":[{"name":"Research Laboratory on Computer Science\u2019s Complex Systems (ReLa(CS)2), University of Oum El Bouaghi, Oum El Bouaghi 04000, Algeria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2824-3402","authenticated-orcid":false,"given":"Varun","family":"Gupta","sequence":"additional","affiliation":[{"name":"Multidisciplinary Research Centre for Innovations in SMEs (MrciS), Gisma University of Applied Sciences, 14469 Potsdam, Germany"},{"name":"International Services for Society Research Group (INSERAS), University of Alcala, Plaza de la Victoria 2, 28802 Alcala de Henares, Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8709-0680","authenticated-orcid":false,"given":"Toufik","family":"Marir","sequence":"additional","affiliation":[{"name":"Research Laboratory on Computer Science\u2019s Complex Systems (ReLa(CS)2), University of Oum El Bouaghi, Oum El Bouaghi 04000, Algeria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-4914-3042","authenticated-orcid":false,"given":"Maroua","family":"Bouzid","sequence":"additional","affiliation":[{"name":"GREYC Laboratory, University of Caen Normandie, 14000 Caen, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chetna","family":"Gupta","sequence":"additional","affiliation":[{"name":"School of Computer Science Engineering and Technology, Bennett University, Greater Noida 201301, India"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,6,26]]},"reference":[{"key":"ref_1","unstructured":"Wooldridge, M. (2009). An Introduction to Multiagent Systems, John Wiley & Sons."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ferber, J., Gutknecht, O., and Michel, F. (2003). From agents to organizations: An organizational view of multi-agent systems. Agent-Oriented Software Engineering IV; International Workshop on Agent-Oriented Software Engineering, Springer.","DOI":"10.1007\/978-3-540-24620-6_15"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"59","DOI":"10.5430\/air.v2n3p59","article-title":"A comparison of organization-centered and agent-centered multi-agent systems","volume":"2","author":"Jensen","year":"2013","journal-title":"Artif. Intell. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1145\/958961.958963","article-title":"Developing multiagent systems: The Gaia methodology","volume":"12","author":"Zambonelli","year":"2003","journal-title":"ACM Trans. Softw. Eng. Methodol. (TOSEM)"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Tamrabet, Z., Nessah, D., Marir, T., Gupta, V., and Mokhati, F. (2025). The Impact of the Organization on the Autonomy of Agents. Information, 16.","DOI":"10.3390\/info16100838"},{"key":"ref_6","unstructured":"Picard, G., H\u00fcbner, J.F., Boissier, O., and Gleizes, M.P. (2009). Reorganisation and self-organisation in multi-agent systems. Proceedings of the 1st International Workshop on Organizational Modeling, ORGMOD, 2009, Universit\u00e4t Hamburg."},{"key":"ref_7","unstructured":"Abbas, H.A., Shaheen, S.I., and Amin, M.H. (2015). Organization of multi-agent systems: An overview. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/s10458-007-9023-8","article-title":"Automated organization design for multi-agent systems","volume":"16","author":"Sims","year":"2008","journal-title":"Auton. Agents Multi-Agent Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1109\/MS.2010.18","article-title":"Self-adaptation using multiagent systems","volume":"27","author":"Weyns","year":"2009","journal-title":"IEEE Softw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"28573","DOI":"10.1109\/ACCESS.2018.2831228","article-title":"Multi-agent systems: A survey","volume":"6","author":"Dorri","year":"2018","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1017\/S0269888905000317","article-title":"A survey of multi-agent organizational paradigms","volume":"19","author":"Horling","year":"2004","journal-title":"Knowl. Eng. Rev."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Sahel, N., Marir, T., Gupta, V., and Bouzid, M. (2024). Dynamic Aspects of Multiagent Systems Organizations: A Survey. Proceedings of the International Conference on Computer Science\u2019s Complex Systems and their Applications, Springer.","DOI":"10.1007\/978-3-031-90758-6_16"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1109\/TSMC.2015.2504350","article-title":"A survey of self-organization mechanisms in multiagent systems","volume":"47","author":"Ye","year":"2016","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_14","unstructured":"Puterman, M.L. (2014). Markov Decision Processes: Discrete Stochastic Dynamic Programming, John Wiley & Sons."},{"key":"ref_15","unstructured":"Han, S., Zhang, Q., Yao, Y., Jin, W., and Xu, Z. (2024). LLM multi-agent systems: Challenges and open problems. arXiv."},{"key":"ref_16","unstructured":"Cordova, C., Taverner, J., Del Val, E., and Argente, E. (2024). A systematic review of norm emergence in multi-agent systems. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ferber, J., and Gutknecht, O. (1998). A meta-model for the analysis and design of organizations in multi-agent systems. Proceedings International Conference on Multi Agent Systems (Cat. No. 98EX160), IEEE.","DOI":"10.1109\/ICMAS.1998.699041"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chebout, M.S., Marir, T., and Gupta, V. (2023). Noragr: A normative agent groupe role model for organizational centered open multi-agent systems. 2023 Third International Conference on Theoretical and Applicative Aspects of Computer Science (ICTAACS), IEEE.","DOI":"10.1109\/ICTAACS60400.2023.10449565"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hannoun, M., Boissier, O., Sichman, J.S., and Sayettat, C. (2000). MOISE: An organizational model for multi-agent systems. Proceedings of the Ibero-American Conference on Artificial Intelligenc, Springer.","DOI":"10.1007\/3-540-44399-1_17"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"H\u00fcbner, J.F., Sichman, J.S., and Boissier, O. (2002). A model for the structural, functional, and deontic specification of organizations in multiagent systems. Proceedings of the Brazilian Symposium on Artificial Intelligence, Springer.","DOI":"10.1007\/3-540-36127-8_12"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1549","DOI":"10.1613\/jair.1.13683","article-title":"Data-driven revision of conditional norms in multi-agent systems","volume":"75","author":"Alechina","year":"2022","journal-title":"J. Artif. Intell. Res."},{"key":"ref_22","first-page":"12","article-title":"Automatic synthesis of dynamic norms for multi-agent systems","volume":"Volume 19","author":"Alechina","year":"2022","journal-title":"Proceedings of the International Conference on Principles of Knowledge Representation and Reasoning"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yan, E., Nardin, L.G., H\u00fcbner, J.F., and Boissier, O. (2024). An agent-centric perspective on norm enforcement and sanctions. Proceedings of the International Workshop on Coordination, Organizations, Institutions, Norms, and Ethics for Governance of Multi-Agent Systems, Springer.","DOI":"10.1007\/978-3-031-82039-7_6"},{"key":"ref_24","unstructured":"Riad, M., de Carvalho, V.R., and Golpayegani, F. (2023). Multi-Value Alignment in Normative Multi-Agent System: Evolutionary Optimisation Approach. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"6211","DOI":"10.1007\/s40747-023-01071-x","article-title":"Dynamic role discovery and assignment in multi-agent task decomposition","volume":"9","author":"Xia","year":"2023","journal-title":"Complex Intell. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1109\/TEVC.2023.3268076","article-title":"A multiagent cooperative learning system with evolution of social roles","volume":"28","author":"Hou","year":"2023","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_27","unstructured":"Lu, S., Shao, J., Luo, B., and Lin, T. (2024). Morphagent: Empowering agents through self-evolving profiles and decentralized collaboration. arXiv."},{"key":"ref_28","unstructured":"Goel, H., Omama, M., Chalaki, B., Tadiparthi, V., Pari, E.M., and Chinchali, S. (2025). R3DM: Enabling Role Discovery and Diversity Through Dynamics Models in Multi-Agent Reinforcement Learning. arXiv."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.compind.2014.10.011","article-title":"Dynamic self-organization in holonic multi-agent manufacturing systems: The ADACOR evolution","volume":"66","author":"Barbosa","year":"2015","journal-title":"Comput. Ind."},{"key":"ref_30","first-page":"29","article-title":"A Model for Selecting the Best Organizational Paradigm at Run Time for Self-Organizing Multi-Agent Systems; an IoT Case Study","volume":"11","author":"Rahmanzadeh","year":"2019","journal-title":"Int. J. Inf. Commun. Technol. Res."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"K\u00f6hler-Bu\u00dfmeier, M., and Capra, L. (2024). Modelling and Simulation of Adaptive Multi-Agent Systems with Stochastic Nets-Within-Nets. Proceedings of the 16th International Joint Conference on Computational Intelligence, SciTePress.","DOI":"10.5220\/0013019700003837"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yang, Y., Chai, H., Shao, S., Song, Y., Qi, S., Rui, R., and Zhang, W. (2025). Agentnet: Decentralized evolutionary coordination for llm-based multi-agent systems. arXiv.","DOI":"10.32388\/WS0VIM"},{"key":"ref_33","unstructured":"Wang, N., Zhang, Y., Liu, S., Zhao, X., Cheng, G., and Xu, Y. (2025). DRAMA: A Dynamic and Robust Allocation-Based Multi-Agent System for Changing Environments. arXiv."},{"key":"ref_34","unstructured":"Tastan, N., Horvath, S., and Nandakumar, K. (2025). Stochastic Self-Organization in Multi-Agent Systems. arXiv."},{"key":"ref_35","first-page":"39","article-title":"Robocup rescue: A grand challenge for multiagent and intelligent systems","volume":"22","author":"Kitano","year":"2001","journal-title":"AI Mag."},{"key":"ref_36","first-page":"126","article-title":"The robocup-rescue: An it challenge to emergency response problem in disaster","volume":"Volume 1","author":"Tadkoro","year":"2000","journal-title":"2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies"}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/7\/741\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T07:23:03Z","timestamp":1782804183000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/7\/741"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,26]]},"references-count":36,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2026,7]]}},"alternative-id":["systems14070741"],"URL":"https:\/\/doi.org\/10.3390\/systems14070741","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,26]]}}}