{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:11:12Z","timestamp":1760148672290,"version":"build-2065373602"},"reference-count":65,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T00:00:00Z","timestamp":1685318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>The design of agents interacting with human beings is becoming a crucial problem in many real-life applications. Different methods have been proposed in the research areas of human\u2013computer interaction (HCI) and multi-agent systems (MAS) to model teams of participants (agents and humans). It is then necessary to build models analyzing their decisions when interacting, while taking into account the specificities of these interactions. This paper, therefore, aimed to propose an explicit model of such interactions based on game theory, taking into account, not only environmental characteristics (e.g., criticality), but also human characteristics (e.g., workload and experience level) for the intervention (or not) of agents, to help the latter. Game theory is a well-known approach to studying such social interactions between different participants. Existing works on the construction of game matrices required different ad hoc descriptors, depending on the application studied. Moreover, they generally focused on the interactions between agents, without considering human beings in the analysis. We show that these descriptors can be classified into two categories, related to their effect on the interactions. The set of descriptors to use is thus based on an explicit combination of all interactions between agents and humans (a weighted sum of 2-player matrices). We propose a general model for the construction of game matrices based on any number of participants and descriptors. It is then possible to determine using Nash equilibria whether agents decide (or not) to intervene during the tasks concerned. The model is also evaluated through the determination of the gains obtained by the different participants. Finally, we illustrate and validate the proposed model using a typical scenario (involving two agents and two humans), while describing the corresponding equilibria.<\/jats:p>","DOI":"10.3390\/info14060313","type":"journal-article","created":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T07:49:23Z","timestamp":1685346563000},"page":"313","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Matrices Based on Descriptors for Analyzing the Interactions between Agents and Humans"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4052-4135","authenticated-orcid":false,"given":"Emmanuel","family":"Adam","sequence":"first","affiliation":[{"name":"Universit\u00e9 Polytechnique Hauts-de-France, CNRS, UMR 8201-LAMIH, F-59313 Valenciennes, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-3449-4603","authenticated-orcid":false,"given":"Martial","family":"Razakatiana","sequence":"additional","affiliation":[{"name":"LIMAD-EDMI, University of Fianarantsoa, Fianarantsoa BP 1264, Madagascar"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7722-9848","authenticated-orcid":false,"given":"Ren\u00e9","family":"Mandiau","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Polytechnique Hauts-de-France, CNRS, UMR 8201-LAMIH, F-59313 Valenciennes, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7881-6435","authenticated-orcid":false,"given":"Christophe","family":"Kolski","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Polytechnique Hauts-de-France, CNRS, UMR 8201-LAMIH, F-59313 Valenciennes, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,29]]},"reference":[{"key":"ref_1","unstructured":"Obaid, M., Mubin, O., Nagai, Y., Osawa, H., Abdelrahman, Y., and Fjeld, M. (2020;, January 10\u201313). Game theory-based human-assistant agent interaction model: Feasibility study for a complex task. Proceedings of the HAI \u201920: 8th International Conference on Human-Agent Interaction, Virtual Event, Australia."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Razakatiana, M., Kolski, C., Mandiau, R., and Mahatody, T. (2020, January 6\u20138). Human-agent interaction based on game theory: Case of a road traffic supervision task. Proceedings of the 13th International Conference on Human System Interaction, HSI 2020, Tokyo, Japan.","DOI":"10.1109\/HSI49210.2020.9142687"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1109\/TSMCC.2004.826267","article-title":"Human-robot interaction in rescue robotics","volume":"34","author":"Murphy","year":"2004","journal-title":"IEEE Trans. Syst. Man Cybern. Part C"},{"key":"ref_4","first-page":"1","article-title":"Design of a MAS into a Human Organization: Application to an Information Multi-agent System","volume":"Volume 3030","author":"Giorgini","year":"2003","journal-title":"Proceedings of the Agent-Oriented Information Systems, 5th International Bi-Conference Workshop, AOIS 2003"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1007\/s10458-019-09408-y","article-title":"Explainability in human\u2013agent systems","volume":"33","author":"Rosenfeld","year":"2019","journal-title":"Auton. Agents Multi-Agent Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/BF00155579","article-title":"Trends in distributed artificial intelligence","volume":"6","author":"Moulin","year":"1992","journal-title":"Artif. Intell. Rev."},{"key":"ref_7","first-page":"353","article-title":"Architecture and application of intelligent agent: A survey","volume":"13","year":"1998","journal-title":"Knowl. Eng. Rev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"887","DOI":"10.1016\/S1574-6526(07)03024-6","article-title":"Multi-agent systems","volume":"Volume 3","author":"Lifschitz","year":"2008","journal-title":"Handbook of Knowledge Representation"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"879","DOI":"10.3390\/a2030879","article-title":"Open Problems in Universal Induction & Intelligence","volume":"2","author":"Hutter","year":"2009","journal-title":"Algorithms"},{"key":"ref_10","unstructured":"Wooldridge, M. (2009). An introduction to MultiAgent Systems, Wiley."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Maybury, M., and Wahlster, W. (1998). Readings in Intelligent User Interfaces, Morgan Kaufmann.","DOI":"10.1145\/291080.291081"},{"key":"ref_12","unstructured":"Lew, M., Bakker, E.M., Sebe, N., and Huang, T.S. (2007, January 20). Human-computer intelligent interaction: A survey. Proceedings of the International Workshop on Human-Computer Interaction, Rio de Janeiro, Brazil."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1017\/dsj.2017.8","article-title":"Human-centered design of complex systems: An experience-based approach","volume":"3","author":"Boy","year":"2017","journal-title":"Des. Sci."},{"key":"ref_14","unstructured":"Patern\u00f2, F., Oliver, N., Conati, C., Spano, L.D., and Tintarev, N. (2020, January 17\u201320). What is \u201cintelligent\u201d in intelligent user interfaces?: A meta-analysis of 25 years of IUI. Proceedings of the IUI \u201920: 25th International Conference on Intelligent User Interfaces, Cagliari, Italy."},{"key":"ref_15","unstructured":"Mandiau, R., Kolski, C., Chaib-Draa, B., and Millot, P. (1991, January 16\u201319). A new approach for the cooperation between human(s) and assistance system(s): A system based on intentional states. Proceedings of the World Congress onExpert Systems, Orlando, FL, USA."},{"key":"ref_16","unstructured":"Millot, P., and Mandiau, R. (1995). Man-Machine Cooperative Organizations: Formal and Pragmatic Implementation Methods, Lawrence Erlbaum Associates. Chapter Expertise and Technology: Cognition & Human-Computer Cooperation."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1007\/s10458-015-9284-6","article-title":"Strategic advice provision in repeated human-agent interactions","volume":"30","author":"Azaria","year":"2015","journal-title":"Auton. Agent Multiagent Syst."},{"key":"ref_18","first-page":"1117","article-title":"Cross-fertilisation between human-computer interaction and artificial intelligence","volume":"Volume 3","author":"Marquis","year":"2020","journal-title":"A Guided Tour of Artificial Intelligence Research"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"325","DOI":"10.3233\/AIS-160380","article-title":"Analyzing multi-agent approaches for the design of advanced interactive and collaborative systems","volume":"8","author":"Badeig","year":"2016","journal-title":"J. Ambient Intell. Smart Environ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.simpat.2012.10.012","article-title":"Simulation in contexts involving an interactive table and tangible objects","volume":"31","author":"Kubicki","year":"2013","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2401","DOI":"10.1007\/s10489-018-1361-5","article-title":"Interactive machine learning: Experimental evidence for the human in the algorithmic loop: A case study on Ant Colony Optimization","volume":"49","author":"Holzinger","year":"2019","journal-title":"Appl. Intell."},{"key":"ref_22","first-page":"47","article-title":"It \u2019s Not Too Soon to Be Wary of AI","volume":"56","author":"Russell","year":"2019","journal-title":"IEEE Sprectrum."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Muggleton, S.H., and Chater, N. (2022). Human-Like Machine Intelligence, Oxford University Press.","DOI":"10.1093\/oso\/9780198862536.001.0001"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Werthner, H., Prem, E., Lee, E.A., and Ghezzi, C. (2022). Perspectives on Digital Humanism, Springer.","DOI":"10.1007\/978-3-030-86144-5"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/s10489-007-0045-3","article-title":"Behaviour based on decision matrices for a coordination between agents in a urban traffic simulation","volume":"28","author":"Mandiau","year":"2008","journal-title":"Appl. Intell."},{"key":"ref_26","unstructured":"Osborne, M.J. (2004). An Introduction to Game Theory, MIT Press."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"102387","DOI":"10.1016\/j.cities.2019.06.018","article-title":"Simulation of urban growth using agent-based modeling and game theory with different temporal resolutions","volume":"95","author":"Kaviari","year":"2019","journal-title":"Cities"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.compenvurbsys.2014.09.001","article-title":"A game-theory based agent-cellular model for use in urban growth simulation: A case study of the rapidly urbanizing Wuhan area of central China","volume":"49","author":"Tan","year":"2015","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18564\/jasss.3840","article-title":"A Generative Model of the Mutual Escalation of Anxiety Between Religion Groups","volume":"21","author":"Shults","year":"2018","journal-title":"J. Artif. Soc. Soc. Simul."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1080\/0022250X.1971.9989794","article-title":"Dynamic models of segregation","volume":"1","author":"Schelling","year":"1971","journal-title":"J. Math. Sociol."},{"key":"ref_31","unstructured":"Schelling, T.C. (2006). Micromotives and Macrobehavior, W. W. Norton and Company."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1177\/0022002797041002001","article-title":"The dissemination of culture: A model with local convergence and global polarization","volume":"41","author":"Axelrod","year":"1997","journal-title":"J. Confl. Resolut."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1007\/s11135-019-00856-y","article-title":"A network agent-based model of ethnocentrism and intergroup cooperation","volume":"54","author":"Lemos","year":"2020","journal-title":"Qual. Quant."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1004709","article-title":"Social norms of cooperation in small-scale societies","volume":"12","author":"Santos","year":"2016","journal-title":"PLoS Comput. Biol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1038\/30918","article-title":"Collective dynamics of \u2018small-world\u2019 networks","volume":"393","author":"Watts","year":"1998","journal-title":"Nature"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4039","DOI":"10.1007\/s11269-013-0394-0","article-title":"A framework for an agent-based model to manage water resources conflicts","volume":"27","author":"Akhbari","year":"2013","journal-title":"J. Water Resour. Manag."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"112014","DOI":"10.1016\/j.jenvman.2021.112014","article-title":"Application of the theory of planned behavior with agent-based modeling for sustainable management of vegetative filter strips","volume":"284","author":"Anebagilu","year":"2021","journal-title":"J. Environ. Manag."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3584","DOI":"10.2166\/ws.2021.124","article-title":"An agent-based model for water allocation optimization and comparison with the game theory approach","volume":"21","author":"Noori","year":"2021","journal-title":"Water Supply"},{"key":"ref_39","first-page":"43","article-title":"Privacy and intelligent virtual assistants usage across generations","volume":"26","author":"Kefi","year":"2021","journal-title":"Syst\u00e8mes Inf. Manag."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1177\/0145482X0810201105","article-title":"Inventory of electronic mobility aids for persons with visual impairments: A literature review","volume":"102","author":"Roentgen","year":"2008","journal-title":"J. Vis. Impair. Blind."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1007\/s12599-022-00743-1","article-title":"Intelligent assistants","volume":"64","author":"Dhiman","year":"2022","journal-title":"Bus. Inf. Syst. Eng."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1080\/1463922042000295669","article-title":"Assistance in human\u2013machine interaction: A conceptual framework and a proposal for a taxonomy","volume":"6","author":"Wandke","year":"2007","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref_43","unstructured":"Lecerf, U. (2022). Robust Learning for Autonomous Agents in Stochastic Environments. [Ph.D. Thesis, Sorbonne University]."},{"key":"ref_44","unstructured":"Eckhoff, R.K. (2016). Explosion Hazards in the Process Industries, Gulf Professional Publishing."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1016\/j.net.2022.10.032","article-title":"Using artificial intelligence to detect human errors in nuclear power plants: A case in operation and maintenance","volume":"55","author":"Gursel","year":"2023","journal-title":"Nucl. Eng. Technol."},{"key":"ref_46","unstructured":"Masson, M., and de Keyser, V. Human error: Lesson learned from a field study for the specification of an intelligent error prevention system. Proceedings of the Advances in Industrial Ergonomics and Safety IV."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1080\/10447319509526114","article-title":"Evaluating a user interface with ergonomic criteria","volume":"7","author":"Bastien","year":"1995","journal-title":"Int. J. Hum.-Comput. Interact."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1111\/j.1464-0597.2004.00161.x","article-title":"Evaluation of subjective mental workload: A comparison of SWAT, NASA-TLX, and workload profile methods","volume":"53","author":"Rubio","year":"2004","journal-title":"Appl. Psychol."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1145\/176789.176792","article-title":"Agents that reduce work and information overload","volume":"37","author":"Maes","year":"1994","journal-title":"Commun. ACM"},{"key":"ref_50","unstructured":"Dennis, A., Wixom, B., and Roth, R.M. (2021). Systems Analysis and Design, Wiley. [8th ed.]."},{"key":"ref_51","unstructured":"EU (2012). Directive 2012\/18\/EU of the European Parliament and of the Council of 4 July 2012 on the Control of Major-Accident Hazards Involving Dangerous Substances, Amending and Subsequently Repealing Council Directive 96\/82\/EC Text with EEA Relevance, European Union. Techreport."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Adama, K.Y., Konat\u00e9, J., Ma\u00efga, O.Y., and Tembin\u00e9, H. (2020). Efficient Strategies Algorithms for Resource Allocation Problems. Algorithms, 13.","DOI":"10.3390\/a13110270"},{"key":"ref_53","unstructured":"Neumann, J.V., and Morgenstein, O. (1944). Theory of Games and Economic Behavior, Princeton University Press."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1073\/pnas.36.1.48","article-title":"Equilibrium points in n-person games","volume":"36","author":"Nash","year":"1950","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_55","first-page":"50","article-title":"Game-theory-based multi-agent interaction model","volume":"31","author":"Yuan","year":"2005","journal-title":"Jisuanji Gongcheng\/Comput. Eng."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"201","DOI":"10.25088\/ComplexSystems.21.3.201","article-title":"Investigation of N-Person Games by Agent-based Modeling","volume":"21","author":"Szilagyi","year":"2012","journal-title":"Complex Syst."},{"key":"ref_57","unstructured":"Hamila, H., Grislin-Le Strugeon, E., Mandiau, R., and Mouaddib, A. (2012, January 6\u20138). Strategic dominance and dynamic programming for multi-agent plannning, application to the multi-robot box-pushing problem. Proceedings of the ICAART 2012, 4th International Conference on Agents and Artificial Intelligence, Vilamoura, Algarve, Portugal."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Shoham, Y., and Leyton-Brown, K. (2008). Multiagent Systems: Algorithmic, Game Theoretic and Logicial Foundations, Cambridge University Press.","DOI":"10.1017\/CBO9780511811654"},{"key":"ref_59","unstructured":"Dufour, R., and Dufour, R. (2013). Learning by Doing: A Handbook for Professional Learning Communities at Work, Solution Tree Press."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/S0269888904000116","article-title":"Trust in multi-agent systems","volume":"19","author":"Ramchurn","year":"2004","journal-title":"Knowl. Eng. Rev."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"27:1","DOI":"10.1145\/2816826","article-title":"Trust and Reputation Models for Multi-Agent Systems","volume":"48","author":"Granatyr","year":"2015","journal-title":"ACM Comput. Surv."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Endriss, U., Now\u00e9, A., Dignum, F., and Lomuscio, A. (2021, January 3\u20137). A General Trust Framework for Multi-Agent Systems. Proceedings of the AAMAS \u201921: Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, Virtual Event, UK.","DOI":"10.1145\/3511322.3511329"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1007\/s10726-005-3074-5","article-title":"A Multi-Agent Coalition Formation Method Based on Preference Models","volume":"13","author":"Aknine","year":"2004","journal-title":"Group Decis. Negot."},{"key":"ref_64","unstructured":"Camps, V. (2022, January 27\u201329). Un protocole de concessions monotones pour la formation distribu\u00e9e de coalitions. Proceedings of the SMA et Smart Cities\u2014Trenti\u00e8mes Journ\u00e9es Francophones sur les Syst\u00e8mes Multi-Agents, JFSMA 2022, Saint-Etienne, France."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"e6876","DOI":"10.1002\/cpe.6876","article-title":"A survey on applications of coalition formation in multi-agent systems","volume":"34","author":"Sarkar","year":"2022","journal-title":"Concurr. Comput. Pract. Exp."}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/6\/313\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:44:18Z","timestamp":1760125458000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/6\/313"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,29]]},"references-count":65,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["info14060313"],"URL":"https:\/\/doi.org\/10.3390\/info14060313","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2023,5,29]]}}}