{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T12:02:07Z","timestamp":1777982527130,"version":"3.51.4"},"reference-count":145,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T00:00:00Z","timestamp":1771372800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T00:00:00Z","timestamp":1771372800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["024.004.022"],"award-info":[{"award-number":["024.004.022"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["024.004.022"],"award-info":[{"award-number":["024.004.022"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["024.004.022"],"award-info":[{"award-number":["024.004.022"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["024.004.022"],"award-info":[{"award-number":["024.004.022"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["024.004.022"],"award-info":[{"award-number":["024.004.022"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["024.004.022"],"award-info":[{"award-number":["024.004.022"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["024.004.022"],"award-info":[{"award-number":["024.004.022"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003246","name":"Nederlandse Organisatie voor Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["024.004.022"],"award-info":[{"award-number":["024.004.022"]}],"id":[{"id":"10.13039\/501100003246","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Auton Agent Multi-Agent Syst"],"published-print":{"date-parts":[[2026,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Hybrid Intelligence (HI) is an emerging paradigm in which artificial intelligence (AI) augments human intelligence. The current literature lacks systematic models that guide the design and evaluation of HI systems. Further, discussions around HI primarily focus on technology, neglecting the holistic human-AI ensemble. In this paper, we take the initial steps toward the development of a quality model for characterizing and evaluating HI systems from a human-AI teams perspective. We first conducted a study investigating the adequacy of properties commonly associated with effective human teams to describe HI. The study features the insights of 50 HI researchers, and shows that various human team properties, including boundedness, interdependence, competency, purposefulness, initiative, normativity, and effectiveness, are important for HI systems. Based on these results, we developed a quality model for HI teams composed of seven high-level quality attributes, further refined into 16 specific ones. To evaluate the relevance and understanding of the proposed attributes, we conducted a second empirical investigation by staging competitions in which participants used the quality model to develop and analyze HI usage scenarios. Our analysis of 48 collected scenarios, which we openly release, confirms the proposed attributes\u2019 relevance and highlights insights that emerge when designers consider the quality model in HI system design.<\/jats:p>","DOI":"10.1007\/s10458-025-09730-8","type":"journal-article","created":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T07:22:29Z","timestamp":1771399349000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["From human teams to hybrid intelligence teams: identifying, characterizing, and evaluating foundational quality attributes"],"prefix":"10.1007","volume":"40","author":[{"given":"Davide","family":"Dell\u2019Anna","sequence":"first","affiliation":[]},{"given":"Pradeep K.","family":"Murukannaiah","sequence":"additional","affiliation":[]},{"given":"Mireia","family":"Yurrita","sequence":"additional","affiliation":[]},{"given":"Bernd","family":"Dudzik","sequence":"additional","affiliation":[]},{"given":"Davide","family":"Grossi","sequence":"additional","affiliation":[]},{"given":"Catholijn M.","family":"Jonker","sequence":"additional","affiliation":[]},{"given":"Catharine","family":"Oertel","sequence":"additional","affiliation":[]},{"given":"P\u0131nar","family":"Yolum","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2026,2,18]]},"reference":[{"key":"9730_CR1","doi-asserted-by":"crossref","unstructured":"Ajmeri, N., Guo, H., Murukannaiah, P. K., & Singh, M. P. (2020). Elessar: Ethics in norm-aware agents. In Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems, AAMAS, 2020 (pp. 16\u201324). International Foundation for Autonomous Agents and Multiagent Systems.","DOI":"10.65109\/MGFB4396"},{"key":"9730_CR2","doi-asserted-by":"crossref","unstructured":"Akata, Z., Balliet, D., de Rijke, M., Dignum, F., Dignum, V., Eiben, G., Fokkens, A., Grossi, D., Hindriks, K., Hoos, H., Hung, H., Jonker, C., Monz, C., Neerincx, M., Oliehoek, F., Prakken, H., Schlobach, S., van der Gaag, L., van Harmelen, F., ... Welling, M. (2020). A research agenda for hybrid intelligence: Augmenting human intellect with collaborative, adaptive, responsible, and explainable artificial intelligence. Computer, 53(8), 18\u201328.","DOI":"10.1109\/MC.2020.2996587"},{"issue":"1","key":"9730_CR3","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1007\/s10458-022-09590-6","volume":"37","author":"M Baldoni","year":"2023","unstructured":"Baldoni, M., Baroglio, C., Micalizio, R., & Tedeschi, S. (2023). Accountability in multi-agent organizations: from conceptual design to agent programming. Autonomous Agents and Multiagent Systems, 37(1), 7.","journal-title":"Autonomous Agents and Multiagent Systems"},{"key":"9730_CR4","doi-asserted-by":"crossref","unstructured":"Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019). Beyond accuracy: The role of mental models in human-ai team performance. In Proceedings of the Seventh AAAI Conference on Human Computation and Crowdsourcing, HCOMP, 2019 (pp. 2\u201311). AAAI Press.","DOI":"10.1609\/hcomp.v7i1.5285"},{"key":"9730_CR5","doi-asserted-by":"crossref","unstructured":"Bansal, G., Nushi, B., Kamar, E., Weld, D. S., Lasecki, W. S., & Horvitz, E. (2019). Updates in human-ai teams: Understanding and addressing the performance\/compatibility tradeoff. In Proceedings of the 33rd AAAI Conference on Artificial Intelligence, AAAI, 2019 (pp. 2429\u20132437). AAAI Press.","DOI":"10.1609\/aaai.v33i01.33012429"},{"issue":"2","key":"9730_CR6","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1002\/job.4030140202","volume":"14","author":"TS Bateman","year":"1993","unstructured":"Bateman, T. S., & Crant, J. M. (1993). The proactive component of organizational behavior: A measure and correlates. Journal of Organizational Behavior, 14(2), 103\u2013118.","journal-title":"Journal of Organizational Behavior"},{"key":"9730_CR7","unstructured":"Bhanushali, A. (2023). Ensuring software quality through effective quality assurance testing: Best practices and case studies. International Journal of Advances in Scientific Research and Engineering, 26(1)."},{"key":"9730_CR8","doi-asserted-by":"publisher","first-page":"1208019","DOI":"10.3389\/fpsyg.2023.1208019","volume":"14","author":"N Bienefeld","year":"2023","unstructured":"Bienefeld, N., Kolbe, M., Camen, G., Huser, D., & Buehler, P. K. (2023). Human-ai teaming: Leveraging transactive memory and speaking up for enhanced team effectiveness. Frontiers in Psychology, 14, 1208019.","journal-title":"Frontiers in Psychology"},{"issue":"2\u20133","key":"9730_CR9","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1007\/s10588-006-9537-7","volume":"12","author":"G Boella","year":"2006","unstructured":"Boella, G., van der Torre, L. W. N., & Verhagen, H. (2006). Introduction to normative multiagent systems. Computational & Mathematical Organization Theory, 12(2\u20133), 71\u201379.","journal-title":"Computational & Mathematical Organization Theory"},{"key":"9730_CR10","doi-asserted-by":"crossref","unstructured":"Bordini, R. H., Fisher, M., & Sierhuis, M. (2009). Formal verification of human-robot teamwork. In Proceedings of the 4th ACM\/IEEE International Conference on Human Robot Interaction, HRI 2009 (pp. 267\u2013268). ACM.","DOI":"10.1145\/1514095.1514169"},{"key":"9730_CR11","doi-asserted-by":"crossref","unstructured":"Bradshaw, J. M., Feltovich, P. J., Jung, H., Kulkarni, S., Taysom, W., & Uszok, A. (2003). Dimensions of adjustable autonomy and mixed-initiative interaction. In Postproceedings of the 1st International Workshop on Agents and Computational Autonomy - Potential, Risks, Solutions, AUTONOMY 2003, Lecture Notes in Computer Science (Vol. 2969, pp. 17\u201339). Springer.","DOI":"10.1007\/978-3-540-25928-2_3"},{"issue":"2","key":"9730_CR12","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1109\/MIS.2012.37","volume":"27","author":"JM Bradshaw","year":"2012","unstructured":"Bradshaw, J. M., Dignum, V., Jonker, C., & Sierhuis, M. (2012). Human-agent-robot teamwork. IEEE Intelligent Systems, 27(2), 8\u201313.","journal-title":"IEEE Intelligent Systems"},{"key":"9730_CR13","doi-asserted-by":"crossref","unstructured":"Bradshaw, J. M., Feltovich, P. J., & Johnson, M. (2017). Human\u2013agent interaction. In The handbook of human-machine interaction (pp. 283\u2013300). CRC Press.","DOI":"10.1201\/9781315557380-14"},{"issue":"3","key":"9730_CR14","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1518\/001872095779049372","volume":"37","author":"MT Brannick","year":"1995","unstructured":"Brannick, M. T., Prince, A., Prince, C., & Salas, E. (1995). The measurement of team process. Human Factors, 37(3), 641\u2013651.","journal-title":"Human Factors"},{"issue":"1","key":"9730_CR15","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1002\/capr.12360","volume":"21","author":"V Braun","year":"2021","unstructured":"Braun, V., & Clarke, V. (2021). Can I use TA? Should I use TA? Should I not use TA? Comparing reflexive thematic analysis and other pattern-based qualitative analytic approaches. Counselling and Psychotherapy Research, 21(1), 37\u201347.","journal-title":"Counselling and Psychotherapy Research"},{"issue":"1","key":"9730_CR16","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1007\/s13755-021-00138-8","volume":"9","author":"F Cabitza","year":"2021","unstructured":"Cabitza, F., Campagner, A., & Sconfienza, L. M. (2021). Studying human-ai collaboration protocols: The case of the Kasparov\u2019s law in radiological double reading. Health Information Science and Systems, 9(1), 8.","journal-title":"Health Information Science and Systems"},{"issue":"1","key":"9730_CR17","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1007\/s43681-022-00167-3","volume":"3","author":"L Cavalcante Siebert","year":"2023","unstructured":"Cavalcante Siebert, L., Lupetti, M. L., Aizenberg, E., Beckers, N., Zgonnikov, A., Veluwenkamp, H., Abbink, D., Giaccardi, E., Houben, G.-J., Jonker, C. M., van den Hoven, J., Forster, D., & Lagendijk, R. L. (2023). Meaningful human control: Actionable properties for ai system development. AI and Ethics, 3(1), 241\u2013255.","journal-title":"AI and Ethics"},{"key":"9730_CR18","doi-asserted-by":"crossref","unstructured":"\u00c7elikok, M. M., Oliehoek, F. A., & Kaski, S. (2022). Best-response bayesian reinforcement learning with bayes-adaptive pomdps for centaurs. In Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2022 (pp. 235\u2013243). International Foundation for Autonomous Agents and Multiagent Systems.","DOI":"10.65109\/YEQW7279"},{"key":"9730_CR19","unstructured":"Commission, E., Directorate-General\u00a0for Communications\u00a0Networks, C., & Technology (2019). Ethics guidelines for trustworthy AI. Publications Office."},{"key":"9730_CR20","unstructured":"Congress, I. E. A., & Brown, I. (1985). Ergonomics International 85: Proceedings of the Ninth Congress of the International Ergonomics Association. Taylor & Francis."},{"issue":"5","key":"9730_CR21","first-page":"98","volume":"87","author":"D Coutu","year":"2009","unstructured":"Coutu, D., & Beschloss, M. (2009). Why teams don\u2019t work. Harvard Business Review, 87(5), 98\u2013105.","journal-title":"Harvard Business Review"},{"issue":"4","key":"9730_CR22","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1057\/palgrave.jit.2000077","volume":"21","author":"PL Curseu","year":"2006","unstructured":"Curseu, P. L. (2006). Emergent states in virtual teams: A complex adaptive systems perspective. Journal of Information Technology, 21(4), 249\u2013261.","journal-title":"Journal of Information Technology"},{"key":"9730_CR23","doi-asserted-by":"crossref","unstructured":"Dalpiaz, F., Borgida, A., Horkoff, J., & Mylopoulos, J. (2013). Runtime goal models: Keynote. In IEEE 7th International Conference on Research Challenges in Information Science, RCIS, 2013 (pp. 1\u201311). IEEE.","DOI":"10.1109\/RCIS.2013.6577674"},{"issue":"1","key":"9730_CR24","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1037\/a0017328","volume":"95","author":"LA DeChurch","year":"2010","unstructured":"DeChurch, L. A., & Mesmer-Magnus, J. R. (2010). The cognitive underpinnings of effective teamwork: A meta-analysis. Journal of Applied Psychology, 95(1), 32.","journal-title":"Journal of Applied Psychology"},{"key":"9730_CR25","doi-asserted-by":"publisher","first-page":"105064","DOI":"10.1016\/j.engappai.2022.105064","volume":"114","author":"D Dell\u2019Anna","year":"2022","unstructured":"Dell\u2019Anna, D., & Jamshidnejad, A. (2022). Evolving fuzzy logic systems for creative personalized socially assistive robots. Engineering Applications of Artificial Intelligence, 114, 105064.","journal-title":"Engineering Applications of Artificial Intelligence"},{"issue":"9","key":"9730_CR26","doi-asserted-by":"publisher","first-page":"1969","DOI":"10.1007\/s12369-024-01172-8","volume":"16","author":"D Dell\u2019Anna","year":"2024","unstructured":"Dell\u2019Anna, D., & Jamshidnejad, A. (2024). SONAR: An adaptive control architecture for social norm aware robots. International Journal of Social Robotics, 16(9), 1969\u20132000.","journal-title":"International Journal of Social Robotics"},{"issue":"3","key":"9730_CR27","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1007\/s10515-019-00255-5","volume":"26","author":"D Dell\u2019Anna","year":"2019","unstructured":"Dell\u2019Anna, D., Dalpiaz, F., & Dastani, M. (2019). Requirements-driven evolution of sociotechnical systems via probabilistic reasoning and hill climbing. Automated Software Engineering, 26(3), 513\u2013557.","journal-title":"Automated Software Engineering"},{"key":"9730_CR28","doi-asserted-by":"crossref","unstructured":"Dell\u2019Anna, D., Murukannaiah, P. K., Dudzik, B., Grossi, D., Jonker, C. M., Oertel, C., & Yolum, P. (2024). Toward a quality model for hybrid intelligence teams. In Proceedings of the 23rd International Conference on Autonomous Agents and Multiagent Systems, AAMAS, 2024 (pp. 434\u2013443). International Foundation for Autonomous Agents and Multiagent Systems \/ ACM.","DOI":"10.65109\/HDYK2529"},{"key":"9730_CR29","doi-asserted-by":"publisher","unstructured":"Dell\u2019Anna, D., Murukannaiah, P. K., Dudzik, B., Grossi, D., Jonker, C. M., Oertel, C., & Yolum, P. (2024). Toward a quality model for hybrid intelligence teams - supplementary material. https:\/\/doi.org\/10.5281\/zenodo.10593358","DOI":"10.5281\/zenodo.10593358"},{"key":"9730_CR30","doi-asserted-by":"publisher","unstructured":"Dell\u2019Anna, D., Murukannaiah, P. K., Yurrita, M., Dudzik, B., Grossi, D., Jonker, C. M., Oertel, C., & Yolum, P. (2025). From human teams to hybrid intelligence teams: Identifying, characterizing, and evaluating foundational quality attributes - supplementary material. https:\/\/doi.org\/10.5281\/zenodo.15640622","DOI":"10.5281\/zenodo.15640622"},{"key":"9730_CR31","doi-asserted-by":"crossref","unstructured":"Dellermann, D., Calma, A., Lipusch, N., Weber, T., Weigel, S., & Ebel, P. (2019). The future of human-ai collaboration: A taxonomy of design knowledge for hybrid intelligence systems. In Proceedings of the 52nd Hawaii International Conference on System Sciences, HICSS 2019 (pp. 1\u201310).","DOI":"10.24251\/HICSS.2019.034"},{"issue":"5","key":"9730_CR32","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1007\/s12599-019-00595-2","volume":"61","author":"D Dellermann","year":"2019","unstructured":"Dellermann, D., Ebel, P., S\u00f6llner, M., & Leimeister, J. M. (2019). Hybrid intelligence. Business & Information Systems Engineering, 61(5), 637\u2013643.","journal-title":"Business & Information Systems Engineering"},{"issue":"6","key":"9730_CR33","doi-asserted-by":"publisher","first-page":"1341","DOI":"10.1093\/logcom\/ext058","volume":"24","author":"F Dignum","year":"2014","unstructured":"Dignum, F., & Dignum, V. (2014). A formal semantics for agent (re)organization. Journal of Logic and Computation, 24(6), 1341\u20131363.","journal-title":"Journal of Logic and Computation"},{"key":"9730_CR34","doi-asserted-by":"crossref","unstructured":"Dignum, V. (2017). Responsible autonomy. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI, 2017 (pp. 4698\u20134704). ijcai.org.","DOI":"10.24963\/ijcai.2017\/655"},{"issue":"2","key":"9730_CR35","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1007\/s11023-024-09668-y","volume":"34","author":"R Dobbe","year":"2024","unstructured":"Dobbe, R., & Wolters, A. (2024). Toward sociotechnical AI: Mapping vulnerabilities for machine learning in context. Minds and Machines, 34(2), 12.","journal-title":"Minds and Machines"},{"key":"9730_CR36","doi-asserted-by":"publisher","first-page":"919","DOI":"10.1613\/jair.1.15916","volume":"80","author":"B Dudzik","year":"2024","unstructured":"Dudzik, B., van der Waa, J., Chen, P., Dobbe, R., de Troya, I., Bakker, R. M., de Boer, M. H. T., Smit, Q. T. S., Dell\u2019Anna, D., Erdogan, E., Yolum, P., Wang, S., B\u00e1ez Santamar\u00eda, S., Krause, L., & Kamphorst, B. A. (2024). Viewpoint: Hybrid intelligence supports application development for diabetes lifestyle management. Journal of Artificial Intelligence Research, 80, 919\u2013929.","journal-title":"Journal of Artificial Intelligence Research"},{"issue":"2","key":"9730_CR37","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1007\/s10458-020-09462-x","volume":"34","author":"EH Durfee","year":"2020","unstructured":"Durfee, E. H., Thakur, A., & Goldweber, E. (2020). Teammate-pattern-aware autonomy based on organizational self-design principles. Autonomous Agents and Multiagent Systems, 34(2), 39.","journal-title":"Autonomous Agents and Multiagent Systems"},{"key":"9730_CR38","doi-asserted-by":"crossref","unstructured":"Edgar, G., McWilliams, M., & Scheutz, M. (2023). Improving human-robot team performance with proactivity and shared mental models. In Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems, AAMAS, 2023 (pp. 2322\u20132324). ACM.","DOI":"10.65109\/SEKI9818"},{"issue":"2","key":"9730_CR39","doi-asserted-by":"publisher","first-page":"508","DOI":"10.1080\/17579961.2023.2245683","volume":"15","author":"L Enqvist","year":"2023","unstructured":"Enqvist, L. (2023). \u2018Human oversight\u2019 in the EU artificial intelligence act: What, when and by whom? Law, Innovation and Technology, 15(2), 508\u2013535.","journal-title":"Law, Innovation and Technology"},{"issue":"1","key":"9730_CR40","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1145\/1046931.1046943","volume":"3","author":"S Feldman","year":"2005","unstructured":"Feldman, S. (2005). Quality assurance: Much more than testing: Good qa is not only about technology, but also methods and approaches. Queue, 3(1), 26\u201329.","journal-title":"Queue"},{"issue":"1","key":"9730_CR41","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1007\/s10458-020-09487-2","volume":"35","author":"M Fisher","year":"2021","unstructured":"Fisher, M., Mascardi, V., Rozier, K. Y., Schlingloff, B. H., Winikoff, M., & Yorke-Smith, N. (2021). Towards a framework for certification of reliable autonomous systems. Autonomous Agents and Multiagent Systems, 35(1), 8.","journal-title":"Autonomous Agents and Multiagent Systems"},{"key":"9730_CR42","volume-title":"Human engineering for an effective air-navigation and traffic-control system","author":"PM Fitts","year":"1951","unstructured":"Fitts, P. M. (1951). Human engineering for an effective air-navigation and traffic-control system. Washington, DC: National Research Council."},{"key":"9730_CR43","doi-asserted-by":"crossref","unstructured":"Flathmann, C., Schelble, B. G., Zhang, R., & McNeese, N. J. (2021). Modeling and guiding the creation of ethical human-ai teams. In Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, AIES, Virtual Event, 2021 (pp. 469\u2013479). ACM.","DOI":"10.1145\/3461702.3462573"},{"issue":"6","key":"9730_CR44","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1109\/MIC.2017.4180836","volume":"21","author":"RL Fogues","year":"2017","unstructured":"Fogues, R. L., Murukannaiah, P. K., Such, J. M., & Singh, M. P. (2017). SoSharP: Recommending sharing policies in multiuser privacy scenarios. IEEE Internet Computing, 21(6), 28\u201336.","journal-title":"IEEE Internet Computing"},{"issue":"11&12","key":"9730_CR45","doi-asserted-by":"publisher","first-page":"1589","DOI":"10.1142\/S0218194020400227","volume":"30","author":"G Fujii","year":"2020","unstructured":"Fujii, G., Hamada, K., Ishikawa, F., Masuda, S., Matsuya, M., Myojin, T., Nishi, Y., & Ogawa, H. (2020). Guidelines for quality assurance of machine learning-based artificial intelligence. International Journal of Software Engineering and Knowledge Engineering, 30(11&12), 1589\u20131606.","journal-title":"International Journal of Software Engineering and Knowledge Engineering"},{"key":"9730_CR46","doi-asserted-by":"crossref","unstructured":"Georgara, A., Rodr\u00edguez-Aguilar, J. A., & Sierra, C. (2022). Building contrastive explanations for multi-agent team formation. In Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2022 (pp. 516\u2013524). International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).","DOI":"10.65109\/RFTS6130"},{"key":"9730_CR47","doi-asserted-by":"crossref","unstructured":"Gervits, F., Thurston, D., Thielstrom, R., Fong, T., Pham, Q., & Scheutz, M. (2020). Toward genuine robot teammates: Improving human-robot team performance using robot shared mental models. In Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2020 (pp. 429\u2013437). International Foundation for Autonomous Agents and Multiagent Systems.","DOI":"10.65109\/FVQV5076"},{"issue":"3","key":"9730_CR48","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1007\/s10664-021-10105-2","volume":"27","author":"B Gezici","year":"2022","unstructured":"Gezici, B., & Tarhan, A. K. (2022). Systematic literature review on software quality for ai-based software. Empirical Software Engineering, 27(3), 66.","journal-title":"Empirical Software Engineering"},{"issue":"6","key":"9730_CR49","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1145\/1029036.1029037","volume":"11","author":"K Go","year":"2004","unstructured":"Go, K., & Carroll, J. M. (2004). The blind men and the elephant: views of scenario-based system design. Interactions, 11(6), 44\u201353. https:\/\/doi.org\/10.1145\/1029036.1029037","journal-title":"Interactions"},{"issue":"4","key":"9730_CR50","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1007\/s10506-022-09329-4","volume":"30","author":"G Governatori","year":"2022","unstructured":"Governatori, G., Bench-Capon, T., Verheij, B., Araszkiewicz, M., Francesconi, E., & Grabmair, M. (2022). Thirty years of artificial intelligence and law: The first decade. Artificial Intelligence and Law, 30(4), 481\u2013519.","journal-title":"Artificial Intelligence and Law"},{"key":"9730_CR51","unstructured":"de Greeff, J., de Boer, M. H., Hillerstr\u00f6m, F. H., Bomhof, F., Jorritsma, W., & Neerincx, M. A. (2021). The FATE system: Fair, transparent and explainable decision making. In Proceedings of the AAAI 2021 Spring Symposium on Combining Machine Learning and Knowledge Engineering AAAI-MAKE, 2021, CEUR Workshop Proceedings (Vol. 2846). CEUR-WS.org."},{"key":"9730_CR52","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1007\/s10458-011-9176-3","volume":"25","author":"D Grossi","year":"2012","unstructured":"Grossi, D., & Turrini, P. (2012). Dependence in games and dependence games. Autonomous Agents and Multi-Agent Systems, 25, 284\u2013312.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"issue":"2","key":"9730_CR53","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1007\/s00766-022-00395-3","volume":"28","author":"KM Habibullah","year":"2023","unstructured":"Habibullah, K. M., Gay, G., & Horkoff, J. (2023). Non-functional requirements for machine learning: Understanding current use and challenges among practitioners. Requirements Engineering, 28(2), 283\u2013316.","journal-title":"Requirements Engineering"},{"key":"9730_CR54","unstructured":"Hackman, J. R. (2002). Leading teams: Setting the stage for great performances. Harvard Business Press."},{"issue":"2","key":"9730_CR55","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1017\/S096318010505019X","volume":"14","author":"MA Hall","year":"2005","unstructured":"Hall, M. A. (2005). The importance of trust for ethics, law, and public policy. Cambridge Quarterly of Healthcare Ethics, 14(2), 156\u2013167.","journal-title":"Cambridge Quarterly of Healthcare Ethics"},{"key":"9730_CR56","doi-asserted-by":"crossref","unstructured":"Harbers, M., Jonker, C. M., & Van\u00a0Riemsdijk, M. B. (2014). Context-sensitive sharedness criteria for teamwork. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems (pp. 1507\u20131508).","DOI":"10.65109\/XLCV5664"},{"key":"9730_CR57","unstructured":"Hartson, R., & Pyla, P. S. (2012). The UX Book: Process and guidelines for ensuring a quality user experience. Elsevier."},{"issue":"4","key":"9730_CR58","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/S0090-2616(98)90004-3","volume":"26","author":"ME Haskins","year":"1998","unstructured":"Haskins, M. E., Liedtka, J., & Rosenblum, J. (1998). Beyond teams: Toward an ethic of collaboration. Organizational Dynamics, 26(4), 34\u201350.","journal-title":"Organizational Dynamics"},{"key":"9730_CR59","unstructured":"Hauptman, A. I., Schelble, B. G., & McNeese, N. J. (2022). Adaptive autonomy as a means for implementing shared ethics in human-ai teams. In Proceedings of the AAAI Spring Symposium on AI Engineering (pp. 1\u20137)."},{"key":"9730_CR60","unstructured":"Hemmer, P., Schemmer, M., V\u00f6ssing, M., & K\u00fchl, N. (2021). Human-ai complementarity in hybrid intelligence systems: A structured literature review. In Poceedings of the 25th Pacific Asia Conference on Information Systems, PACIS 2021 (p. 78)."},{"key":"9730_CR61","doi-asserted-by":"crossref","unstructured":"Herrmann, T. (2020). Socio-technical design of hybrid intelligence systems - the case of predictive maintenance. In Proceedings of the First International Conference on Artificial Intelligence in HCI, AI-HCI 2020 (pp. 298\u2013309).","DOI":"10.1007\/978-3-030-50334-5_20"},{"issue":"1","key":"9730_CR62","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1163\/15718069-bja10050","volume":"28","author":"AT Hirblinger","year":"2022","unstructured":"Hirblinger, A. T. (2022). When mediators need machines (and vice versa): Towards a research agenda on hybrid peacemaking intelligence. International Negotiation, 28(1), 94\u2013125.","journal-title":"International Negotiation"},{"key":"9730_CR63","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.applanim.2016.01.015","volume":"177","author":"S Hoummady","year":"2016","unstructured":"Hoummady, S., P\u00e9ron, F., Grandjean, D., Cl\u00e9ro, D., Bernard, B., Titeux, E., Desquilbet, L., & Gilbert, C. (2016). Relationships between personality of human-dog dyads and performances in working tasks. Applied Animal Behaviour Science, 177, 42\u201351.","journal-title":"Applied Animal Behaviour Science"},{"key":"9730_CR64","doi-asserted-by":"crossref","unstructured":"Van\u00a0den Hoven, J., Vermaas, P. E., & Van\u00a0de Poel, I. (2015). Handbook of ethics, values and technological design. Handbook of Ethics, Values, and Technological Design.","DOI":"10.1007\/978-94-007-6970-0"},{"issue":"6","key":"9730_CR65","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1109\/TMM.2010.2055233","volume":"12","author":"H Hung","year":"2010","unstructured":"Hung, H., & Gatica-Perez, D. (2010). Estimating cohesion in small groups using audio-visual nonverbal behavior. IEEE Transactions on Multimedia, 12(6), 563\u2013575.","journal-title":"IEEE Transactions on Multimedia"},{"key":"9730_CR66","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1146\/annurev.psych.56.091103.070250","volume":"56","author":"DR Ilgen","year":"2005","unstructured":"Ilgen, D. R., Hollenbeck, J. R., Johnson, M., & Jundt, D. (2005). Teams in organizations: From input-process-output models to imoi models. Annual Review of Psychology, 56, 517\u2013543.","journal-title":"Annual Review of Psychology"},{"key":"9730_CR67","unstructured":"Isbell, C. L., & Pierce, J. S. (2005). An IP continuum for adaptive interface design. In Proceedings of the 11th International Conference on Human-Computer Interaction, HCI, 2005."},{"key":"9730_CR68","unstructured":"ISO\/IEC 25010 (2011). ISO\/IEC 25010:2011, systems and software engineering \u2014 systems and software quality requirements and evaluation (square) \u2014 system and software quality models."},{"key":"9730_CR69","doi-asserted-by":"crossref","unstructured":"Javdani Rikhtehgar, D., Tiddi, I., Wang, S., Schlobach, S., & Heylen, D. (2024). Assessing the hi-ness of virtual heritage applications with knowledge engineering. In HHAI 2024: Hybrid Human AI Systems for the Social Good (pp. 173\u2013187). IOS Press.","DOI":"10.3233\/FAIA240193"},{"issue":"3","key":"9730_CR70","doi-asserted-by":"publisher","first-page":"501","DOI":"10.1109\/TASL.2008.2008238","volume":"17","author":"DB Jayagopi","year":"2009","unstructured":"Jayagopi, D. B., Hung, H., Yeo, C., & Gatica-Perez, D. (2009). Modeling dominance in group conversations using nonverbal activity cues. IEEE Transactions on Audio, Speech and Language Processing, 17(3), 501\u2013513.","journal-title":"IEEE Transactions on Audio, Speech and Language Processing"},{"issue":"3","key":"9730_CR71","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1007\/s10458-015-9324-2","volume":"31","author":"AS Jensen","year":"2017","unstructured":"Jensen, A. S., Dignum, V., & Villadsen, J. (2017). A framework for organization-aware agents. Autonomous Agents and Multiagent Systems, 31(3), 387\u2013422.","journal-title":"Autonomous Agents and Multiagent Systems"},{"key":"9730_CR72","doi-asserted-by":"crossref","unstructured":"Johnson, M., & Bradshaw, J. M. (2021). How interdependence explains the world of teamwork. In Engineering Artificially Intelligent Systems - A Systems Engineering Approach to Realizing Synergistic Capabilities, Lecture Notes in Computer Science (Vol. 13000, pp. 122\u2013146). Springer.","DOI":"10.1007\/978-3-030-89385-9_8"},{"issue":"1","key":"9730_CR73","doi-asserted-by":"publisher","first-page":"43","DOI":"10.5898\/JHRI.3.1.Johnson","volume":"3","author":"M Johnson","year":"2014","unstructured":"Johnson, M., Bradshaw, J. M., Feltovich, P. J., Jonker, C. M., Van Riemsdijk, M. B., & Sierhuis, M. (2014). Coactive design: Designing support for interdependence in joint activity. Journal of Human-Robot Interaction, 3(1), 43\u201369.","journal-title":"Journal of Human-Robot Interaction"},{"key":"9730_CR74","doi-asserted-by":"crossref","unstructured":"Jonker, C. M., Van\u00a0Riemsdijk, M. B., & Vermeulen, B. (2010). Shared mental models: A conceptual analysis. In International workshop on coordination, organizations, institutions, and norms in agent systems (pp. 132\u2013151). Springer.","DOI":"10.1007\/978-3-642-21268-0_8"},{"issue":"2","key":"9730_CR75","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1109\/MC.2021.3127753","volume":"55","author":"M Jovanovic","year":"2022","unstructured":"Jovanovic, M., & Schmitz, M. (2022). Explainability as a user requirement for artificial intelligence systems. Computer, 55(2), 90\u201394.","journal-title":"Computer"},{"issue":"2","key":"9730_CR76","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1109\/TCSS.2017.2672980","volume":"4","author":"AK Kalia","year":"2017","unstructured":"Kalia, A. K., Buchler, N., DeCostanza, A., & Singh, M. P. (2017). Computing team process measures from the structure and content of broadcast collaborative communications. IEEE Transactions on Computational Social Systems, 4(2), 26\u201339.","journal-title":"IEEE Transactions on Computational Social Systems"},{"issue":"6","key":"9730_CR77","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1109\/MIS.2004.74","volume":"19","author":"G Klien","year":"2004","unstructured":"Klien, G., Woods, D. D., Bradshaw, J. M., Hoffman, R. R., & Feltovich, P. J. (2004). Ten challenges for making automation a \u201cteam player\u2019\u2019 in joint human-agent activity. IEEE Intelligent Systems, 19(6), 91\u201395.","journal-title":"IEEE Intelligent Systems"},{"key":"9730_CR78","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1002\/0471739448.ch6","volume":"53","author":"G Klein","year":"2005","unstructured":"Klein, G., Feltovich, P. J., Bradshaw, J. M., & Woods, D. D. (2005). Common ground and coordination in joint activity. Organizational Simulation, 53, 139\u2013184.","journal-title":"Organizational Simulation"},{"issue":"2","key":"9730_CR79","doi-asserted-by":"publisher","first-page":"403","DOI":"10.1177\/014920639402000206","volume":"20","author":"R Klimoski","year":"1994","unstructured":"Klimoski, R., & Mohammed, S. (1994). Team mental model: Construct or metaphor? Journal of Management, 20(2), 403\u2013437.","journal-title":"Journal of Management"},{"issue":"2","key":"9730_CR80","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1007\/s10458-021-09515-9","volume":"35","author":"ES Kox","year":"2021","unstructured":"Kox, E. S., Kerstholt, J. H., Hueting, T. F., & de Vries, P. W. (2021). Trust repair in human-agent teams: The effectiveness of explanations and expressing regret. Autonomous Agents and Multiagent Systems, 35(2), 30.","journal-title":"Autonomous Agents and Multiagent Systems"},{"key":"9730_CR81","doi-asserted-by":"crossref","unstructured":"Kox, E. S., Kerstholt, J. H., Hueting, T. F., et\u00a0al. (2022). Trust repair in human-agent teams: The effectiveness of explanations and expressing regret. In Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2022 (pp. 1944\u20131946). International Foundation for Autonomous Agents and Multiagent Systems (IFAAMAS).","DOI":"10.65109\/UILK1749"},{"key":"9730_CR82","first-page":"3","volume":"2","author":"H Krasner","year":"2021","unstructured":"Krasner, H. (2021). The cost of poor software quality in the us: A 2020 report. Proceedings of the Consortium for Information & Software QualityTM (CISQTM), 2, 3.","journal-title":"Proceedings of the Consortium for Information & Software QualityTM (CISQTM)"},{"key":"9730_CR83","doi-asserted-by":"crossref","unstructured":"Krinkin, K., & Shichkina, Y. A. (2022). Cognitive architecture for co-evolutionary hybrid intelligence. In Proceedings of the 15th International Conference on Artificial General Intelligence, AGI 2022 (pp. 293\u2013303).","DOI":"10.1007\/978-3-031-19907-3_28"},{"issue":"1","key":"9730_CR84","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1007\/s10458-020-09488-1","volume":"35","author":"AC Kurtan","year":"2021","unstructured":"Kurtan, A. C., & Yolum, P. (2021). Assisting humans in privacy management: an agent-based approach. Autonomous Agents and Multi-Agent Systems, 35(1), 7.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9730_CR85","doi-asserted-by":"crossref","unstructured":"Kuwajima, H., & Ishikawa, F. (2019). Adapting square for quality assessment of artificial intelligence systems. In Proceedings of the IEEE International Symposium on Software Reliability Engineering Workshops, ISSRE Workshops 2019 (pp. 13\u201318). IEEE.","DOI":"10.1109\/ISSREW.2019.00035"},{"key":"9730_CR86","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fgene.2022.868015","volume":"13","author":"C Lee","year":"2022","unstructured":"Lee, C., Lin, J., Prokop, A., Gopalakrishnan, V., Hanna, R. N., Papa, E., Freeman, A., Patel, S., Yu, W., Huhn, M., Sheikh, A.-S., Tan, K., Sellman, B. R., Cohen, T., Mangion, J., Khan, F. M., Gusev, Y., & Shameer, K. (2022). Stargazer: A hybrid intelligence platform for drug target prioritization and digital drug repositioning using streamlit. Frontiers in Genetics, 13, 1\u201312.","journal-title":"Frontiers in Genetics"},{"key":"9730_CR87","unstructured":"Liao, C. (2021). Applying the \u201chuman-dog interaction\u201d metaphor in human-robot interaction: A co-design practice engaging healthy retired adults in China. Royal College of Art (United Kingdom)."},{"key":"9730_CR88","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1109\/THFE2.1960.4503259","volume":"1","author":"JC Licklider","year":"1960","unstructured":"Licklider, J. C. (1960). Man-computer symbiosis. IRE Transactions on Human Factors in Electronics, 1, 4\u201311.","journal-title":"IRE Transactions on Human Factors in Electronics"},{"issue":"1","key":"9730_CR89","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s10458-022-09550-0","volume":"36","author":"E Liscio","year":"2022","unstructured":"Liscio, E., Van Der Meer, M., Siebert, L. C., Jonker, C. M., & Murukannaiah, P. K. (2022). What values should an agent align with? Autonomous Agents and Multi-Agent Systems, 36(1), 23.","journal-title":"Autonomous Agents and Multi-Agent Systems"},{"key":"9730_CR90","unstructured":"Lomov, B., & Venda, V. (1978). Methodological principles of synthesis of hybrid intelligence systems. In Proceedings of the International Conference on Cybernetics and Society, 1978 (pp. 1026\u20131030). IEEE."},{"key":"9730_CR91","doi-asserted-by":"crossref","unstructured":"Mackeprang, M., M\u00fcller-Birn, C., & Stauss, M. T. (2019). Discovering the sweet spot of human-computer configurations: A case study in information extraction. Proceedings of the ACM on Human Computer Interaction, 3(CSCW), 195:1\u2013195:30.","DOI":"10.1145\/3359297"},{"issue":"2","key":"9730_CR92","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1007\/s10458-023-09627-4","volume":"37","author":"G Mahala","year":"2023","unstructured":"Mahala, G., Kafal\u0131, \u00d6., Dam, H., Ghose, A., & Singh, M. P. (2023). A normative approach for resilient multiagent systems. Autonomous Agents and Multiagent Systems, 37(2), 46.","journal-title":"Autonomous Agents and Multiagent Systems"},{"issue":"3","key":"9730_CR93","doi-asserted-by":"publisher","first-page":"356","DOI":"10.2307\/259182","volume":"26","author":"MA Marks","year":"2001","unstructured":"Marks, M. A., Mathieu, J. E., & Zaccaro, S. J. (2001). A temporally based framework and taxonomy of team processes. Academy of Management Review, 26(3), 356\u2013376.","journal-title":"Academy of Management Review"},{"issue":"2","key":"9730_CR94","doi-asserted-by":"publisher","first-page":"328","DOI":"10.35833\/MPCE.2021.000673","volume":"10","author":"A Marot","year":"2022","unstructured":"Marot, A., Kelly, A., Naglic, M., Barbesant, V., Cremer, J., Stefanov, A., & Viebahn, J. (2022). Perspectives on future power system control centers for energy transition. Journal of Modern Power Systems and Clean Energy, 10(2), 328\u2013344.","journal-title":"Journal of Modern Power Systems and Clean Energy"},{"issue":"2","key":"9730_CR95","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1037\/0021-9010.85.2.273","volume":"85","author":"JE Mathieu","year":"2000","unstructured":"Mathieu, J. E., Heffner, T. S., Goodwin, G. F., Salas, E., & Cannon-Bowers, J. A. (2000). The influence of shared mental models on team process and performance. Journal of Applied Psychology, 85(2), 273.","journal-title":"Journal of Applied Psychology"},{"key":"9730_CR96","volume-title":"Groups: Interaction and performance","author":"JE McGrath","year":"1984","unstructured":"McGrath, J. E. (1984). Groups: Interaction and performance (Vol. 14). NJ: Prentice-Hall Englewood Cliffs."},{"issue":"1","key":"9730_CR97","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1207\/S15327957PSPR0401_8","volume":"4","author":"JE McGrath","year":"2000","unstructured":"McGrath, J. E., Arrow, H., & Berdahl, J. L. (2000). The study of groups: Past, present, and future. Personality and Social Psychology Review, 4(1), 95\u2013105.","journal-title":"Personality and Social Psychology Review"},{"issue":"1","key":"9730_CR98","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s10458-024-09649-6","volume":"38","author":"KR McKee","year":"2024","unstructured":"McKee, K. R., Bai, X., & Fiske, S. T. (2024). Warmth and competence in human-agent cooperation. Autonomous Agents and Multiagent Systems, 38(1), 23.","journal-title":"Autonomous Agents and Multiagent Systems"},{"key":"9730_CR99","doi-asserted-by":"crossref","unstructured":"Van Der Meer, M., Liscio, E., Jonker, C. M., Plaat, A., Vossen, P., & Murukannaiah, P. K. (2022). Hyena: A hybrid method for extracting arguments from opinions. In Proceedings of the First International Conference on Hybrid Human-Artificial Intelligence, HHAI 2022 (pp. 17\u201331).","DOI":"10.3233\/FAIA220187"},{"key":"9730_CR100","doi-asserted-by":"crossref","unstructured":"Mehrotra, S. (2021). Modelling trust in human-ai interaction. In Proceedings of the 20th International Conference on Autonomous Agents and Multiagent Systems, Virtual Event, AAMAS, 2021 (pp. 1826\u20131828). ACM.","DOI":"10.65109\/UXJD9998"},{"key":"9730_CR101","first-page":"100070","volume":"3","author":"I Molenaar","year":"2022","unstructured":"Molenaar, I. (2022). The concept of hybrid human-ai regulation: Exemplifying how to support young learners\u2019 self-regulated learning. Computers & Education: Artificial Intelligence, 3, 100070.","journal-title":"Computers & Education: Artificial Intelligence"},{"key":"9730_CR102","doi-asserted-by":"crossref","unstructured":"Mosca, F., & Such, J. M. (2021). ELVIRA: An explainable agent for value and utility-driven multiuser privacy. In Proceedings of the 20th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2021 (pp. 916\u2013924).","DOI":"10.65109\/IQRD3616"},{"issue":"2","key":"9730_CR103","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1007\/s10462-017-9560-8","volume":"51","author":"SA Mostafa","year":"2019","unstructured":"Mostafa, S. A., Ahmad, M. S., & Mustapha, A. (2019). Adjustable autonomy: A systematic literature review. Artificial Intelligence Review, 51(2), 149\u2013186.","journal-title":"Artificial Intelligence Review"},{"key":"9730_CR104","doi-asserted-by":"crossref","unstructured":"Murukannaiah, P. K., Ajmeri, N., & Singh, M. P. (2022). Enhancing creativity as innovation via asynchronous crowdwork. In Proceedings of the 14th ACM Web Science Conference, WebSci 2022 (pp. 66\u201374).","DOI":"10.1145\/3501247.3531555"},{"key":"9730_CR105","doi-asserted-by":"crossref","unstructured":"Nanninga, M. C., Zhang, Y., Lehmann-Willenbrock, N., Szl\u00e1vik, Z., & Hung, H. (2017). Estimating verbal expressions of task and social cohesion in meetings by quantifying paralinguistic mimicry. In Proceedings of the 19th ACM International Conference on Multimodal Interaction, ICMI 2017 (pp. 206\u2013215). ACM.","DOI":"10.1145\/3136755.3136811"},{"key":"9730_CR106","doi-asserted-by":"crossref","unstructured":"Neerincx, M. A., van Diggelen, J., & van Breda, L. (2016). Interaction design patterns for adaptive human-agent-robot teamwork in high-risk domains. In Proceedings of the 13th International Conference on Engineering Psychology and Cognitive Ergonomics, EPCE 2016, Lecture Notes in Computer Science (Vol. 9736, pp. 211\u2013220). Springer.","DOI":"10.1007\/978-3-319-40030-3_22"},{"key":"9730_CR107","doi-asserted-by":"crossref","unstructured":"Nguyen, A. T., Kharosekar, A., Krishnan, S., Krishnan, S., Tate, E., Wallace, B. C., & Lease, M. (2018). Believe it or not: Designing a human-ai partnership for mixed-initiative fact-checking. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, UIST 2018 (pp. 189\u2013199). ACM.","DOI":"10.1145\/3242587.3242666"},{"key":"9730_CR108","doi-asserted-by":"crossref","unstructured":"Nistala, P., Nori, K. V., & Reddy, R. (2019). Software quality models: A systematic mapping study. In Proceedings of the International Conference on Software and System Processes, ICSSP 2019 (pp. 125\u2013134). IEEE \/ ACM.","DOI":"10.1109\/ICSSP.2019.00025"},{"key":"9730_CR109","doi-asserted-by":"crossref","unstructured":"Oertel, C., & Salvi, G. (2013). A gaze-based method for relating group involvement to individual engagement in multimodal multiparty dialogue. In Proceedings of the 2013 International Conference on Multimodal Interaction, ICMI 2013 (pp. 99\u2013106). ACM.","DOI":"10.1145\/2522848.2522865"},{"issue":"5","key":"9730_CR110","doi-asserted-by":"publisher","first-page":"904","DOI":"10.1177\/0018720820960865","volume":"64","author":"T O\u2019neill","year":"2022","unstructured":"O\u2019neill, T., McNeese, N., Barron, A., & Schelble, B. (2022). Human-autonomy teaming: A review and analysis of the empirical literature. Human Factors, 64(5), 904\u2013938.","journal-title":"Human Factors"},{"key":"9730_CR111","doi-asserted-by":"crossref","unstructured":"Panisson, A. R., Engelmann, D. C., & Bordini, R. H. (2021). Engineering explainable agents: An argumentation-based approach. In Proceedings of the 9th International Workshop on Engineering Multi-Agent Systems, EMAS 2021, Revised Selected Papers (pp. 273\u2013291).","DOI":"10.1007\/978-3-030-97457-2_16"},{"issue":"3","key":"9730_CR112","doi-asserted-by":"publisher","first-page":"633","DOI":"10.1177\/0149206308321554","volume":"36","author":"SK Parker","year":"2010","unstructured":"Parker, S. K., & Collins, C. G. (2010). Taking stock: Integrating and differentiating multiple proactive behaviors. Journal of Management, 36(3), 633\u2013662.","journal-title":"Journal of Management"},{"issue":"3","key":"9730_CR113","doi-asserted-by":"publisher","first-page":"633","DOI":"10.3390\/forecast3030039","volume":"3","author":"N Pescetelli","year":"2021","unstructured":"Pescetelli, N. (2021). A brief taxonomy of hybrid intelligence. Forecasting, 3(3), 633\u2013643.","journal-title":"Forecasting"},{"issue":"4","key":"9730_CR114","doi-asserted-by":"publisher","first-page":"923","DOI":"10.1007\/s11948-014-9562-8","volume":"20","author":"AM Petersen","year":"2014","unstructured":"Petersen, A. M., Pavlidis, I. T., & Semendeferi, I. (2014). A quantitative perspective on ethics in large team science. Science and Engineering Ethics, 20(4), 923\u2013945.","journal-title":"Science and Engineering Ethics"},{"key":"9730_CR115","doi-asserted-by":"crossref","unstructured":"Pynadath, D. V., Gurney, N., Kenny, S., et\u00a0al. (2023). Effectiveness of teamwork-level interventions through decision-theoretic reasoning in a minecraft search-and-rescue task. In Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2023 (pp. 2334\u20132336). ACM.","DOI":"10.65109\/KLPF9504"},{"key":"9730_CR116","doi-asserted-by":"crossref","unstructured":"Rakova, B., & Dobbe, R. (2023). Algorithms as social-ecological-technological systems: An environmental justice lens on algorithmic audits. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency, FAccT, 2023 (p. 491). ACM.","DOI":"10.1145\/3593013.3594014"},{"key":"9730_CR117","doi-asserted-by":"crossref","unstructured":"van Riemsdijk, M. B., Hindriks, K. V., & Jonker, C. M. (2009). Programming organization-aware agents. In Proceedings of the 10th International Workshop on Engineering Societies in the Agents World, ESAW, 2009, Lecture Notes in Computer Science (Vol. 5881, pp. 98\u2013112). Springer.","DOI":"10.1007\/978-3-642-10203-5_9"},{"issue":"2","key":"9730_CR118","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1080\/00140139.2021.2000043","volume":"65","author":"AP Roberts","year":"2022","unstructured":"Roberts, A. P., Webster, L. V., Salmon, P. M., Flin, R., Salas, E., Cooke, N. J., Read, G. J., & Stanton, N. A. (2022). State of science: models and methods for understanding and enhancing teams and teamwork in complex sociotechnical systems. Ergonomics, 65(2), 161\u2013187.","journal-title":"Ergonomics"},{"key":"9730_CR119","volume-title":"Toward an understanding of team performance and training","author":"E Salas","year":"1992","unstructured":"Salas, E., Dickinson, T. L., Converse, S. A., & Tannenbaum, S. I. (1992). Toward an understanding of team performance and training. Ablex Publishing."},{"key":"9730_CR120","doi-asserted-by":"crossref","unstructured":"Sawyer, R. K. (2010). Individual and group creativity. In The Cambridge handbook of creativity (pp. 366\u2013380). Cambridge University Press.","DOI":"10.1017\/CBO9780511763205.023"},{"issue":"GROUP","key":"9730_CR121","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3492832","volume":"6","author":"BG Schelble","year":"2022","unstructured":"Schelble, B. G., Flathmann, C., McNeese, N. J., Freeman, G., & Mallick, R. (2022). Let\u2019s think together! assessing shared mental models, performance, and trust in human-agent teams. Proceedings of the ACM on Human-Computer Interaction, 6(GROUP), 1\u201329.","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"9730_CR122","unstructured":"Schulmeyer, G. (2007). Handbook of software quality assurance. Artech."},{"issue":"2","key":"9730_CR123","doi-asserted-by":"publisher","DOI":"10.1016\/j.im.2019.103174","volume":"57","author":"I Seeber","year":"2020","unstructured":"Seeber, I., Bittner, E. A. C., Briggs, R. O., de Vreede, T., de Vreede, G.-J., Elkins, A., Maier, R., Merz, A. B., Oeste-Rei\u00df, S., Randrup, N., Schwabe, G., & S\u00f6llner, M. (2020). Machines as teammates: A research agenda on AI in team collaboration. Information & Management, 57(2), Article 103174.","journal-title":"Information & Management"},{"issue":"1","key":"9730_CR124","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1108\/INTR-12-2019-0503","volume":"30","author":"I Seeber","year":"2020","unstructured":"Seeber, I., Waizenegger, L., Seidel, S., Morana, S., Benbasat, I., & Lowry, P. B. (2020). Collaborating with technology-based autonomous agents. Internet Research, 30(1), 1\u201318.","journal-title":"Internet Research"},{"issue":"4","key":"9730_CR125","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1177\/0008125619862257","volume":"61","author":"YR Shrestha","year":"2019","unstructured":"Shrestha, Y. R., Ben-Menahem, S. M., & Von Krogh, G. (2019). Organizational decision-making structures in the age of artificial intelligence. California Management Review, 61(4), 66\u201383.","journal-title":"California Management Review"},{"issue":"2","key":"9730_CR126","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1007\/s11219-021-09557-y","volume":"30","author":"J Siebert","year":"2022","unstructured":"Siebert, J., Joeckel, L., Heidrich, J., Trendowicz, A., Nakamichi, K., Ohashi, K., Namba, I., Yamamoto, R., & Aoyama, M. (2022). Construction of a quality model for machine learning systems. Software Quality Journal, 30(2), 307\u2013335.","journal-title":"Software Quality Journal"},{"issue":"5","key":"9730_CR127","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1007\/s10726-022-09792-z","volume":"31","author":"D Siemon","year":"2022","unstructured":"Siemon, D. (2022). Elaborating team roles for artificial intelligence-based teammates in human-ai collaboration. Group Decision and Negotiation, 31(5), 871\u2013912.","journal-title":"Group Decision and Negotiation"},{"key":"9730_CR128","doi-asserted-by":"crossref","unstructured":"Singh, M. P. (2013). Norms as a basis for governing sociotechnical systems. ACM Transactions on Intelligent Systems and Technology, 5(1), 21:1\u201321:23.","DOI":"10.1145\/2542182.2542203"},{"key":"9730_CR129","doi-asserted-by":"crossref","unstructured":"Singh, M. P. (2022). Consent as a foundation for responsible autonomy. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022 (pp. 12301\u201312306). AAAI Press.","DOI":"10.1609\/aaai.v36i11.21494"},{"key":"9730_CR130","doi-asserted-by":"crossref","unstructured":"Silva Souza, V. E., Lapouchnian, A., Robinson, W. N., & Mylopoulos, J. (2011). Awareness requirements for adaptive systems. In 2011 ICSE Symposium on Software Engineering for Adaptive and Self-Managing Systems, SEAMS, 2011 (pp. 60\u201369). ACM.","DOI":"10.1145\/1988008.1988018"},{"issue":"3","key":"9730_CR131","first-page":"346","volume":"35","author":"R Suddaby","year":"2010","unstructured":"Suddaby, R. (2010). Editor\u2019s comments: Construct clarity in theories of management and organization. Academy of Management Review, 35(3), 346\u2013357.","journal-title":"Academy of Management Review"},{"issue":"31","key":"9730_CR132","first-page":"1","volume":"31","author":"K Sycara","year":"2006","unstructured":"Sycara, K., & Sukthankar, G. (2006). Literature review of teamwork models. Robotics Institute, Carnegie Mellon University, 31(31), 1\u201331.","journal-title":"Robotics Institute, Carnegie Mellon University"},{"issue":"4","key":"9730_CR133","doi-asserted-by":"publisher","first-page":"e16","DOI":"10.1097\/MLR.0b013e31827feef6","volume":"53","author":"MA Valentine","year":"2015","unstructured":"Valentine, M. A., Nembhard, I. M., & Edmondson, A. C. (2015). Measuring teamwork in health care settings: A review of survey instruments. Medical Care, 53(4), e16\u2013e30.","journal-title":"Medical Care"},{"key":"9730_CR134","doi-asserted-by":"crossref","unstructured":"Varni, G., Pez, A., & Mancini, M. (2021). Get together in the middle-earth: A first step towards hybrid intelligence systems. In Proceedings of the 2021 International Conference on Multimodal Interaction, ICMI 2021, Companion Publication (pp. 249\u2013253). ACM.","DOI":"10.1145\/3461615.3485413"},{"issue":"3","key":"9730_CR135","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1007\/s10458-005-1673-9","volume":"11","author":"J V\u00e1zquez-Salceda","year":"2005","unstructured":"V\u00e1zquez-Salceda, J., Dignum, V., & Dignum, F. (2005). Organizing multiagent systems. Autonomous Agents and Multiagent Systems, 11(3), 307\u2013360.","journal-title":"Autonomous Agents and Multiagent Systems"},{"issue":"1","key":"9730_CR136","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/s10506-007-9057-x","volume":"16","author":"J V\u00e1zquez-Salceda","year":"2008","unstructured":"V\u00e1zquez-Salceda, J., Aldewereld, H., Grossi, D., & Dignum, F. (2008). From human regulations to regulated software agents\u2019 behavior. Artificial Intelligence and Law, 16(1), 73\u201387.","journal-title":"Artificial Intelligence and Law"},{"issue":"4","key":"9730_CR137","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1177\/0021886305281984","volume":"41","author":"R Wageman","year":"2005","unstructured":"Wageman, R., Hackman, J. R., & Lehman, E. (2005). Team diagnostic survey: Development of an instrument. The Journal of Applied Behavioral Science, 41(4), 373\u2013398.","journal-title":"The Journal of Applied Behavioral Science"},{"key":"9730_CR138","volume-title":"Software Quality Models in Practice: Survey Results: Quamoco - the Benchmark for Software Quality","author":"S Wagner","year":"2012","unstructured":"Wagner, S., Lochmann, K., Winter, S., et al. (2012). Software Quality Models in Practice: Survey Results: Quamoco - the Benchmark for Software Quality. TUM, Institut f\u00fcr Informatik: TUM-I."},{"key":"9730_CR139","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.infsof.2015.02.009","volume":"62","author":"S Wagner","year":"2015","unstructured":"Wagner, S., Goeb, A., Heinemann, L., Kl\u00e4s, M., Lampasona, C., Lochmann, K., Mayr, A., Pl\u00f6sch, R., Seidl, A., Streit, J., & Trendowicz, A. (2015). Operationalised product quality models and assessment: The quamoco approach. Information & Software Technology, 62, 101\u2013123.","journal-title":"Information & Software Technology"},{"key":"9730_CR140","doi-asserted-by":"crossref","unstructured":"Wang, N., Pynadath, D. V., & Hill, S. G. (2016). The impact of pomdp-generated explanations on trust and performance in human-robot teams. In Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems (pp. 997\u20131005). ACM.","DOI":"10.65109\/MJOE4434"},{"key":"9730_CR141","doi-asserted-by":"crossref","unstructured":"Wilder, B., Horvitz, E., & Kamar, E. (2020). Learning to complement humans. In Proceedings of the 29th International Joint Conference on Artificial Intelligence, IJCAI 2020 (pp. 1526\u20131533). ijcai.org.","DOI":"10.24963\/ijcai.2020\/212"},{"key":"9730_CR142","doi-asserted-by":"crossref","unstructured":"Yorke-Smith, N., Saadati, S., Myers, K. L., & Morley, D. N. (2012). The design of a proactive personal agent for task management. International Journal on Artificial Intelligence Tools, 21(1).","DOI":"10.1142\/S0218213012500042"},{"key":"9730_CR143","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Lee, M. L., & Carter, S. A. (2022). You complete me: Human-ai teams and complementary expertise. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, CHI 2022 (pp. 114:1\u2013114:28).","DOI":"10.1145\/3491102.3517791"},{"issue":"1","key":"9730_CR144","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1109\/TCSS.2021.3049702","volume":"8","author":"W Zhang","year":"2021","unstructured":"Zhang, W., Ning, H., Liu, L., Jin, Q., & Piuri, V. (2021). Guest editorial: Special issue on hybrid human-artificial intelligence for social computing. IEEE Transactions on Computational Social Systems, 8(1), 118\u2013121.","journal-title":"IEEE Transactions on Computational Social Systems"},{"key":"9730_CR145","unstructured":"Zschech, P., Walk, J., Heinrich, K., V\u00f6ssing, M., & K\u00fchl, N. (2021). A picture is worth a collaboration: Accumulating design knowledge for computer-vision-based hybrid intelligence systems. In Proceedings of the 29th European Conference on Information Systems - Human Values Crisis in a Digitizing World, ECIS 2021 (p. 1673)."}],"container-title":["Autonomous Agents and Multi-Agent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-025-09730-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10458-025-09730-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10458-025-09730-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T08:03:27Z","timestamp":1771401807000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10458-025-09730-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,18]]},"references-count":145,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,6]]}},"alternative-id":["9730"],"URL":"https:\/\/doi.org\/10.1007\/s10458-025-09730-8","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-6874571\/v1","asserted-by":"object"}]},"ISSN":["1387-2532","1573-7454"],"issn-type":[{"value":"1387-2532","type":"print"},{"value":"1573-7454","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,18]]},"assertion":[{"value":"11 June 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 December 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 February 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This work involved human subjects in its research. Approval of all ethical and experimental procedures and protocols was granted by the Utrecht University Ethics assessment Committee.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Participate"}},{"value":"The authors affirm that human research participants provided informed consent for publication of the text published in the article.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}}],"article-number":"10"}}