{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T00:03:23Z","timestamp":1781049803170,"version":"3.54.1"},"reference-count":129,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,1,6]],"date-time":"2025-01-06T00:00:00Z","timestamp":1736121600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:p>Leveraging Artificial Intelligence (AI) in decision support systems has disproportionately focused on technological advancements, often overlooking the alignment between algorithmic outputs and human expectations. A human-centered perspective attempts to alleviate this concern by designing AI solutions for seamless integration with existing processes. Determining what information AI should provide to aid humans is vital, a concept underscored by explainable AI's efforts to justify AI predictions. However, how the information is presented, e.g., the sequence of recommendations and solicitation of interpretations, is equally crucial as complex interactions may emerge between humans and AI. While empirical studies have evaluated human-AI dynamics across domains, a common vocabulary for human-AI interaction protocols is lacking. To promote more deliberate consideration of interaction designs, we introduce a taxonomy of interaction patterns that delineate various modes of human-AI interactivity. We summarize the results of a systematic review of AI-assisted decision making literature and identify trends and opportunities in existing interactions across application domains from 105 articles. We find that current interactions are dominated by simplistic collaboration paradigms, leading to little support for truly interactive functionality. Our taxonomy offers a tool to understand interactivity with AI in decision-making and foster interaction designs for achieving clear communication, trustworthiness, and collaboration.<\/jats:p>","DOI":"10.3389\/fcomp.2024.1521066","type":"journal-article","created":{"date-parts":[[2025,1,6]],"date-time":"2025-01-06T07:04:33Z","timestamp":1736147073000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":74,"title":["Human-AI collaboration is not very collaborative yet: a taxonomy of interaction patterns in AI-assisted decision making from a systematic review"],"prefix":"10.3389","volume":"6","author":[{"given":"Catalina","family":"Gomez","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sue Min","family":"Cho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shichang","family":"Ke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chien-Ming","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mathias","family":"Unberath","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2025,1,6]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"13687","DOI":"10.1038\/s41598-021-93109-8","article-title":"In search of a goldilocks zone for credible AI","volume":"11","author":"Allan","year":"2021","journal-title":"Sci. Rep"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i8.16819","article-title":"\u201cDoes explainable artificial intelligence improve human Decision-Making?\u201d","author":"Alufaisan","year":"2021","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"B3","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1609\/aimag.v35i4.2513","article-title":"Power to the people: the role of humans in interactive machine learning","volume":"35","author":"Amershi","year":"2014","journal-title":"Ai Magaz"},{"key":"B4","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1177\/15553434221104615","article-title":"How much reliability is enough? A Context-Specific view on human interaction with (artificial) agents from different perspectives","volume":"16","author":"Appelganc","year":"2022","journal-title":"J. Cogn. Eng. Decis. Mak"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1145\/3449163","article-title":"\u201cAI-Assisted human labeling: Batching for efficiency without overreliance,\u201d","author":"Ashktorab","year":"2021","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"B6","doi-asserted-by":"publisher","first-page":"430","DOI":"10.1093\/hcr\/hqac010","article-title":"When machine and bandwagon heuristics compete: understanding users' response to conflicting AI and crowdsourced fact-checking","volume":"48","author":"Banas","year":"2022","journal-title":"Hum. Commun. Res"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5285","article-title":"\u201cBeyond accuracy: the role of mental models in human-ai team performance,\u201d","author":"Bansal","year":"2019","journal-title":"Proceedings of the AAAI Conference on Human Computation and Crowdsourcing"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445717","article-title":"\u201cDoes the whole exceed its parts? The effect of AI explanations on complementary team performance,\u201d","author":"Bansal","year":"2021","journal-title":"Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"},{"key":"B9","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1186\/s12911-020-01276-x","article-title":"A qualitative research framework for the design of user-centered displays of explanations for machine learning model predictions in healthcare","volume":"20","author":"Barda","year":"2020","journal-title":"BMC Med. Inform. Decis. Mak"},{"key":"B10","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1007\/978-3-030-85613-7_22","article-title":"\u201cObjectivAIze: Measuring performance and biases in augmented business decision systems,\u201d","volume-title":"Human-Computer Interaction INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 September 3, 2021, Proceedings, Part III 18","author":"Baudel","year":"2021"},{"key":"B11","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1109\/TVCG.2017.2744818","article-title":"Comparing Visual-Interactive labeling with active learning: an experimental study","volume":"24","author":"Bernard","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1145\/3514094.3534164","article-title":"\u201cHow cognitive biases affect XAI-assisted decision-making: a systematic review,\u201d","author":"Bertrand","year":"2022","journal-title":"Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581314","article-title":"\u201cOn selective, mutable and dialogic XAI: a review of what users say about different types of interactive explanations,\u201d","author":"Bertrand","year":"2023","journal-title":"Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584075","article-title":"\u201cDirective explanations for monitoring the risk of diabetes onset: Introducing directive Data-Centric explanations and combinations to support What-If explorations,\u201d","author":"Bhattacharya","year":"2023","journal-title":"Proceedings of the 28th International Conference on Intelligent User Interfaces"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i5.20465","article-title":"\u201cRole of Human-AI interaction in selective prediction,\u201d","author":"Bondi","year":"2022","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1145\/3555212","article-title":"\u201cReliance and automation for Human-AI collaborative data labeling conflict resolution,\u201d","author":"Brachman","year":"2022","journal-title":"Proceedings of the ACM on Human-Computer Interaction, 6(CSCW2)"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377498","article-title":"\u201cProxy tasks and subjective measures can be misleading in evaluating explainable AI systems,\u201d","author":"Bu\u00e7inca","year":"2020","journal-title":"Proceedings of the 25th International Conference on Intelligent User Interfaces"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1145\/3449287","article-title":"\u201cTo trust or to think: cognitive forcing functions can reduce overrelianceon AI in AI-assisted decision-making,\u201d","author":"Bu\u00e7inca","year":"2021","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2021.154","article-title":"\u201cAI-assisted and explainable hate speech detection for social media moderators - a design science approach,\u201d","author":"Bunde","year":"2021","journal-title":"Proceedings of the 54th Hawaii International Conference on System Sciences"},{"key":"B20","doi-asserted-by":"publisher","first-page":"269","DOI":"10.3390\/make5010017","article-title":"Painting the black box white: experimental findings from applying XAI to an ECG reading setting","volume":"5","author":"Cabitza","year":"2023","journal-title":"Mach. Lear. Knowl. Extr"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1145\/3579612","article-title":"\u201cImproving Human-AI collaboration with descriptions of AI behavior,\u201d","author":"Cabrera","year":"2023","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"B22","article-title":"\u201cModeling role-based interactions for agents,\u201d","volume-title":"The Workshop on Agent-Oriented Methodologies at OOPSLA","author":"Cabri","year":"2002"},{"key":"B23","doi-asserted-by":"publisher","first-page":"102285","DOI":"10.1016\/j.artmed.2022.102285","article-title":"BreastScreening-AI: evaluating medical intelligent agents for human-AI interactions","volume":"127","author":"Calisto","year":"2022","journal-title":"Artif. Intell. Med"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1145\/3555572","article-title":"\u201cUnderstanding user reliance on AI in assisted Decision-Making,\u201d","author":"Cao","year":"2022","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584080","article-title":"\u201cSupporting high-uncertainty decisions through ai and logic-style explanations,\u201d","author":"Cau","year":"2023","journal-title":"Proceedings of the 28th International Conference on Intelligent User Interfaces"},{"key":"B26","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1038\/s41746-022-00699-2","article-title":"Explainable medical imaging ai needs human-centered design: guidelines and evidence from a systematic review","volume":"5","author":"Chen","year":"2022","journal-title":"NPJ Digital Med"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.naacl-main.33","article-title":"Mapping the design space of human-ai interaction in text summarization","author":"Cheng","year":"2022","journal-title":"arXiv preprint arXiv:2206.14863"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1145\/3447535.3462487","article-title":"\u201cYou'd better stop! understanding human reliance on machine learning models under covariate shift,\u201d","author":"Chiang","year":"2021","journal-title":"Proceedings of the 13th ACM Web Science Conference 2021"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511121","article-title":"\u201cExploring the effects of machine learning literacy interventions on laypeople's reliance on machine learning models,\u201d","author":"Chiang","year":"2022","journal-title":"Proceedings of the 27th International Conference on Intelligent User Interfaces"},{"key":"B30","article-title":"\u201cInteraction templates: a data-driven approach for authoring robot programs,\u201d","author":"David","year":"2022","journal-title":"PLATEAU: 12th Annual Workshop at the Intersection of PL and HCI"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450698","article-title":"\u201cIncreasing the speed and accuracy of data labeling through an AI assisted interface,\u201d","author":"Desmond","year":"2021","journal-title":"Proceedings of the 26th International Conference on Intelligent User Interfaces"},{"key":"B32","doi-asserted-by":"publisher","first-page":"102792","DOI":"10.1016\/j.ijhcs.2022.102792","article-title":"The effects of domain knowledge on trust in explainable AI and task performance: a case of peer-to-peer lending","volume":"162","author":"Dikmen","year":"2022","journal-title":"International J. Human Computer Studies"},{"key":"B33","doi-asserted-by":"publisher","first-page":"10323","DOI":"10.3390\/app122010323","article-title":"The role of XAI in Advice-Taking from a clinical decision support system: a comparative user study of feature Contribution-Based and Example-Based explanations","volume":"12","author":"Du","year":"2022","journal-title":"Appl. Sci"},{"key":"B34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3185517","article-title":"A review of user interface design for interactive machine learning","volume":"8","author":"Dudley","year":"2018","journal-title":"ACM Trans. Inter. Intell. Syst"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1145\/3512943","article-title":"\u201cHuman-AI collaboration for UX evaluation: effects of explanation and synchronization,\u201d","author":"Fan","year":"2022","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.573","article-title":"\u201cLearning to explain selectively: a case study on question answering,\u201d","author":"Feng","year":"2022","journal-title":"Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533193","article-title":"\u201cWho goes first? Influences of human-AI workflow on decision making in clinical imaging,\u201d","author":"Fogliato","year":"2022","journal-title":"Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency"},{"key":"B38","doi-asserted-by":"publisher","first-page":"678","DOI":"10.1287\/isre.2021.1079","article-title":"Cognitive challenges in Human-Artificial intelligence collaboration: investigating the path toward productive delegation","volume":"33","author":"F\u00fcgener","year":"2022","journal-title":"Inf. Syst. Res"},{"key":"B39","doi-asserted-by":"publisher","first-page":"1383","DOI":"10.1038\/s41598-023-28633-w","article-title":"Non-task expert physicians benefit from correct explainable AI advice when reviewing x-rays","volume":"13","author":"Gaube","year":"2023","journal-title":"Sci. Rep"},{"key":"B40","doi-asserted-by":"publisher","first-page":"102977","DOI":"10.1016\/j.ijhcs.2022.102977","article-title":"Mitigating knowledge imbalance in AI-advised decision-making through collaborative user involvement","volume":"172","author":"Gomez","year":"2023","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.3465622","article-title":"\u201cHuman decision making with machine advice: an experiment on bailing and jailing,\u201d","author":"Grgic-Hlaca","year":"2019","journal-title":"Proceedings of the ACM on Human-Computer Interaction, 3(CSCW)"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3577011","article-title":"Improving workflow integration with XPath: design and evaluation of aHuman-AI diagnosis system in pathology","volume":"30","author":"Gu","year":"2023","journal-title":"ACM Trans. Comput"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1145\/3485447.3512248","article-title":"\u201cTo trust or not to trust: how a conversational interface affects trust in a decision support system,\u201d","author":"Gupta","year":"2022","journal-title":"Proceedings of the ACM Web Conference 2022"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584052","article-title":"\u201cHuman-AI collaboration: the effect of AI delegation on human task performance and task satisfaction,\u201d","author":"Hemmer","year":"2023","journal-title":"Proceedings of the 28th International Conference on Intelligent User Interfaces"},{"key":"B45","doi-asserted-by":"publisher","first-page":"2207","DOI":"10.1007\/s12525-022-00600-9","article-title":"Applying XAI to an AI-based system for candidate management to mitigate bias and discrimination in hiring","volume":"32","author":"Hofeditz","year":"2022","journal-title":"Electr. Markets"},{"key":"B46","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3579628","article-title":"Toward supporting perceptual complementarity in Human-AI collaboration via reflection on unobservables","volume":"7","author":"Holstein","year":"2023","journal-title":"Proc. ACM Hum"},{"key":"B47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3479864","article-title":"Who is the expert? Reconciling algorithm aversion and algorithm appreciation in AI-Supported decision making","volume":"5","author":"Hou","year":"2021","journal-title":"Proc. ACM Hum"},{"key":"B48","doi-asserted-by":"publisher","first-page":"e28659","DOI":"10.2196\/28659","article-title":"A clinical decision support system for sleep staging tasks with explanations from artificial intelligence: User-Centered design and evaluation study","volume":"24","author":"Hwang","year":"2022","journal-title":"J. Med. Internet Res"},{"key":"B49","doi-asserted-by":"publisher","first-page":"108","DOI":"10.1038\/s41398-021-01224-x","article-title":"How machine-learning recommendations influence clinician treatment selections: the example of the antidepressant selection","volume":"11","author":"Jacobs","year":"2021","journal-title":"Transl. Psychiatry"},{"key":"B50","first-page":"353","article-title":"\u201cAn empirical evaluation of predicted outcomes as explanations in human-ai decision-making,\u201d","volume-title":"Joint European Conference on Machine Learning and Knowledge Discovery in Databases","author":"Jakubik","year":"2023"},{"key":"B51","doi-asserted-by":"publisher","first-page":"102839","DOI":"10.1016\/j.ijhcs.2022.102839","article-title":"Who needs explanation and when? Juggling explainable AI and user epistemic uncertainty","volume":"165","author":"Jiang","year":"2022","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584058","article-title":"\u201cIt seems smart, but it acts stupid: development of trust in AI advice in a repeated legal Decision-Making task,\u201d","author":"Kahr","year":"2023","journal-title":"Proceedings of the 28th International Conference on Intelligent User Interfaces"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1145\/3415234","article-title":"\u201cConceptual metaphors impact perceptions of Human-AI collaboration,\u201d","author":"Khadpe","year":"2020","journal-title":"Proceedings of the ACM on Human-Computer Interaction, 4(CSCW2)"},{"key":"B54","doi-asserted-by":"publisher","first-page":"790","DOI":"10.1080\/10447318.2022.2049134","article-title":"Communicating the limitations of AI: The effect of message framing and ownership on trust in artificial intelligence","volume":"39","author":"Kim","year":"2023","journal-title":"Int. J. Hum. Comput. Interact"},{"key":"B55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/bdm.756","article-title":"Revisions and regret: the cost of changing your mind","volume":"26","author":"Kirkeb\u00f8en","year":"2013","journal-title":"J. Behav. Decis. Mak"},{"key":"B56","first-page":"2780","article-title":"\u201cExplaining algorithm aversion with metacognitive bandits,\u201d","author":"Kumar","year":"2021","journal-title":"Proceedings of the Annual Meeting of the Cognitive Science Society"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501999","article-title":"\u201cHuman-AI collaboration via conditional delegation: A case study of content moderation,\u201d","author":"Lai","year":"2022","journal-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594087","article-title":"\u201cTowards a science of human-AI decision making: An overview of design space in empirical human-subject studies,\u201d","author":"Lai","year":"2023","journal-title":"Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency"},{"key":"B59","first-page":"1","article-title":"\u201c\u2018Why is \u2018chicago' deceptive?' Towards building model-driven tutorials for humans,\u201d","volume-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, CHI '20","author":"Lai","year":"2020"},{"key":"B60","doi-asserted-by":"publisher","first-page":"314","DOI":"10.1177\/08465371221131200","article-title":"U\u201cAI\u201d testing: user interface and usability testing of a chest x-ray AI tool in a simulated Real-World workflow","volume":"74","author":"Lam Shin Cheung","year":"2022","journal-title":"Canadian Assoc. Radiol. J"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445472","article-title":"\u201cA human-ai collaborative approach for clinical decision making on rehabilitation assessment,\u201d","author":"Lee","year":"2021","journal-title":"Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"},{"key":"B62","doi-asserted-by":"publisher","first-page":"107539","DOI":"10.1016\/j.chb.2022.107539","article-title":"Effects of explainable artificial intelligence on trust and human behavior in a high-risk decision task","volume":"139","author":"Leichtmann","year":"2023","journal-title":"Comput. Human Behav"},{"key":"B63","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1109\/TTS.2021.3118355","article-title":"Delegation of moral tasks to automated Agents\u2013The impact of risk and context on trusting a machine to perform a task","volume":"3","author":"Liehner","year":"2022","journal-title":"IEEE Trans. Technol. Soc"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450681","article-title":"\u201cRapid assisted visual search: Supporting digital pathologists with imperfect AI,\u201d","author":"Lindvall","year":"2021","journal-title":"Proceedings of the 26th International Conference on Intelligent User Interfaces"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1145\/3479552","article-title":"\u201cUnderstanding the effect of out-of-distribution examples and interactive explanations on Human-AI decision making,\u201d","author":"Liu","year":"2021","journal-title":"Proceedings of the ACM on Human-Computer Interaction, 5(CSCW2)"},{"key":"B66","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1007\/978-3-030-11051-2_93","article-title":"\u201cDesign pattern as a practical tool for designing adaptive interactions connecting human and social robots,\u201d","volume-title":"Intelligent Human Systems Integration 2019: Proceedings of the 2nd International Conference on Intelligent Human Systems Integration (IHSI 2019): Integrating People and Intelligent Systems, February 7-10, 2019, San Diego, California, USA","author":"Ma","year":"2019"},{"key":"B67","doi-asserted-by":"publisher","DOI":"10.1145\/3359297","article-title":"\u201cDiscovering the sweet spot of human\u2013computer configurations: a case study in information extraction,\u201d","author":"Mackeprang","year":"2019","journal-title":"Proceedings of the ACM on Human-Computer Interaction, 3(CSCW)"},{"key":"B68","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1017\/9781316286302.017","author":"Magnusson","year":"2018","journal-title":"Temporal Patterns in Interactions: T-Patterns and Their Detection with THEMETM"},{"key":"B69","doi-asserted-by":"publisher","first-page":"891529","DOI":"10.3389\/frai.2022.891529","article-title":"The relationship between performance and trust in AI in E-Finance","volume":"5","author":"Maier","year":"2022","journal-title":"Front. Artif. Intell"},{"key":"B70","doi-asserted-by":"publisher","first-page":"e26964","DOI":"10.2196\/26964","article-title":"Clinician preimplementation perspectives of a decision-support tool for the prediction of cardiac arrhythmia based on machine learning: near-live feasibility and qualitative study","volume":"8","author":"Matthiesen","year":"2021","journal-title":"JMIR Hum. Factors"},{"key":"B71","doi-asserted-by":"publisher","first-page":"zmac010","DOI":"10.1093\/jcmc\/zmac010","article-title":"When AI moderates online content: effects of human collaboration and interactive transparency on user trust","volume":"27","author":"Molina","year":"2022","journal-title":"J. Comput. Med. Commun"},{"key":"B72","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3579481","article-title":"Evaluating the impact of human explanation strategies on human-AI visual decision-making","volume":"7","author":"Morrison","year":"2023","journal-title":"Proc. ACM Hum"},{"key":"B73","doi-asserted-by":"publisher","first-page":"102941","DOI":"10.1016\/j.ijhcs.2022.102941","article-title":"How the different explanation classes impact trust calibration: the case of clinical decision support systems","volume":"169","author":"Naiseh","year":"2023","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B74","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242666","article-title":"\u201cBelieve it or not: Designing a human-ai partnership for mixed-initiative fact-checking,\u201d","author":"Nguyen","year":"2018","journal-title":"Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology"},{"key":"B75","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v8i1.7469","article-title":"\u201cThe role of domain expertise in user trust and the impact of first impressions with intelligent systems,\u201d","author":"Nourani","year":"2020","journal-title":"Proceedings of the AAAI Conference on Human Computation and Crowdsourcing"},{"key":"B76","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450639","article-title":"\u201cAnchoring bias affects mental model formation and user reliance in explainable AI systems,\u201d","author":"Nourani","year":"2021","journal-title":"Proceedings of the 26th International Conference on Intelligent User Interfaces"},{"key":"B77","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502104","article-title":"\u201cUnderstanding the impact of explanations on advice-taking: a user study for AI-based clinical decision support systems,\u201d","author":"Panigutti","year":"2022","journal-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems"},{"key":"B78","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1109\/3468.844354","article-title":"A model for types and levels of human interaction with automation","volume":"30","author":"Parasuraman","year":"2000","journal-title":"IEEE Trans. Syst. Man Cybern"},{"key":"B79","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3359204","article-title":"A slow algorithm improves users' assessments of the algorithm's accuracy","volume":"3","author":"Park","year":"2019","journal-title":"Proc. ACM Hum"},{"key":"B80","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i11.21468","article-title":"\u201cInvestigations of performance and bias in Human-AI teamwork in hiring,\u201d","author":"Peng","year":"2022","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"B81","doi-asserted-by":"publisher","first-page":"e030385","DOI":"10.1136\/bmjopen-2019-030385","article-title":"Collaborative design of a decision aid for stroke survivors with multimorbidity: a qualitative study in the UK engaging key stakeholders","volume":"9","author":"Porat","year":"2019","journal-title":"BMJ Open"},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584033","article-title":"\u201cUnderstanding uncertainty: how lay decision-makers perceive and interpret uncertainty in Human-AI decision making,\u201d","author":"Prabhudesai","year":"2023","journal-title":"Proceedings of the 28th International Conference on Intelligent User Interfaces"},{"key":"B83","doi-asserted-by":"publisher","first-page":"30","DOI":"10.1109\/TSUSC.2019.2911188","article-title":"A secure and sustainable framework to mitigate hazardous activities in online social networks","volume":"6","author":"Rahman","year":"2021","journal-title":"IEEE Trans. Sustain. Comput"},{"key":"B84","doi-asserted-by":"publisher","DOI":"10.1145\/3512930","article-title":"\u201cDeciding fast and slow: the role of cognitive biases in AI-assisted decision-making,\u201d","author":"Rastogi","year":"2022","journal-title":"Proceedings of the ACM on Human-Computer Interaction, 6(CSCW1)"},{"key":"B85","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501967","article-title":"\u201cWhen confidence meets accuracy: exploring the effects of multiple performance indicators on trust in machine learning models,\u201d","author":"Rechkemmer","year":"2022","journal-title":"Proceedings of the 2022 Chi Conference on Human Factors in Computing Systems"},{"key":"B86","doi-asserted-by":"publisher","first-page":"14952","DOI":"10.1038\/s41598-022-18751-2","article-title":"Experimental evidence of effective human-AI collaboration in medical decision-making","volume":"12","author":"Reverberi","year":"2022","journal-title":"Sci. Rep"},{"key":"B87","doi-asserted-by":"publisher","first-page":"103507","DOI":"10.1016\/j.artint.2021.103507","article-title":"\u201cThat's (not) the output I expected!\u201d on the role of end user expectations in creating explanations of AI systems","volume":"298","author":"Riveiro","year":"2021","journal-title":"Artif. Intell"},{"key":"B88","doi-asserted-by":"publisher","DOI":"10.1145\/3503252.3531306","article-title":"\u201cThe challenges of providing explanations of AI systems when they do NotBehave like users expect,\u201d","author":"Riveiro","year":"2022","journal-title":"Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization"},{"key":"B89","doi-asserted-by":"publisher","DOI":"10.1145\/3503252.3531311","article-title":"\u201cUnderstanding the role of explanation modality in AI-AssistedDecision-Making,\u201d","author":"Robbemond","year":"2022","journal-title":"Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization"},{"key":"B90","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557057","article-title":"\u201cDesign patterns for exploring and prototyping human-robot interactions,\u201d","author":"Saupp\u00e9","year":"2014","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems"},{"key":"B91","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376506","article-title":"\u201cAmbiguity-aware AI assistants for medical data analysis,\u201d","author":"Schaekermann","year":"2020","journal-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems"},{"key":"B92","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584066","article-title":"\u201cAppropriate reliance on AI advice: Conceptualization and the effect of explanations,\u201d","author":"Schemmer","year":"2023","journal-title":"International Conference on Intelligent User Interfaces, inproceedings IUI"},{"key":"B93","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1057\/s41599-023-02060-8","article-title":"The concept of \u201cinteraction\u201d in debates on human-machine interaction","volume":"10","author":"Schleidgen","year":"2023","journal-title":"Human. Soc. Sci. Commun"},{"key":"B94","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1007\/978-3-030-50334-5_8","article-title":"\u201cColor for characters - effects of visual explanations of AI on trust and observability,\u201d","volume-title":"Artificial Intelligence in HCI: First International Conference, AI-HCI 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19\u201324, 2020, Proceedings 22","author":"Schrills","year":"2020"},{"key":"B95","doi-asserted-by":"publisher","first-page":"8068","DOI":"10.3390\/s22208068","article-title":"A survey on medical explainable AI (XAI): recent progress, explainability approach, human interaction and scoring system","volume":"22","author":"Sheu","year":"2022","journal-title":"Sensors"},{"key":"B96","doi-asserted-by":"publisher","first-page":"1390","DOI":"10.1080\/10447318.2022.2101698","article-title":"Explainable artificial intelligence: evaluating the objective and subjective impacts of xAI on Human-Agent","volume":"39","author":"Silva","year":"2023","journal-title":"Interaction"},{"key":"B97","doi-asserted-by":"publisher","first-page":"544","DOI":"10.1049\/iet-sen.2019.0291","article-title":"Classifying design-level requirements using machine learning for a recommender of interaction design patterns","volume":"14","author":"Silva-Rodr\u00edguez","year":"2020","journal-title":"IET Softw"},{"key":"B98","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/S0747-5632(97)00004-6","article-title":"Interactivity: a forgotten art?","volume":"13","author":"Sims","year":"1997","journal-title":"Comput. Human Behav"},{"key":"B99","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376624","article-title":"\u201cNo explainability without accountability: an empirical study of explanations and feedback in interactive ML,\u201d","author":"Smith-Renner","year":"2020","journal-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems"},{"key":"B100","first-page":"269","article-title":"\u201cSage advice? The impacts of explanations for machine learning models on human Decision-Making in spam detection,\u201d","volume-title":"International Conference on Human-Computer Interaction","author":"Stites","year":"2021"},{"key":"B101","doi-asserted-by":"publisher","DOI":"10.1145\/3394231.3397922","article-title":"\u201cMisplaced trust: Measuring the interference of machine learning in human Decision-Making,\u201d","author":"Suresh","year":"2020","journal-title":"Proceedings of the 12th ACM Conference on Web Science"},{"key":"B102","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511160","article-title":"\u201cIntuitively assessing ML model reliability through Example-Based explanations and editing model inputs,\u201d","author":"Suresh","year":"2022","journal-title":"Proceedings of the 27th International Conference on Intelligent User Interfaces"},{"key":"B103","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1007\/s42113-022-00157-y","article-title":"Ai-assisted decision-making: a cognitive modeling approach to infer latent reliance strategies","volume":"5","author":"Tejeda","year":"2022","journal-title":"Comput. Brain Behav"},{"key":"B104","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517732","article-title":"\u201cCapable but amoral? Comparing AI and human expert collaboration in ethical decision making,\u201d","author":"Tolmeijer","year":"2022","journal-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems"},{"key":"B105","doi-asserted-by":"publisher","DOI":"10.1145\/3450613.3456817","article-title":"\u201cSecond chance for a first impression? Trust development in intelligent system interaction,\u201d","author":"Tolmeijer","year":"2021","journal-title":"Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization"},{"key":"B106","doi-asserted-by":"publisher","first-page":"1229","DOI":"10.1038\/s41591-020-0942-0","article-title":"Human-computer collaboration for skin cancer recognition","volume":"26","author":"Tschandl","year":"2020","journal-title":"Nat. Med"},{"key":"B107","doi-asserted-by":"publisher","DOI":"10.1145\/3462244.3479926","article-title":"\u201cInvestigating trust in Human-Machine learning collaboration: a pilot study on estimating public anxiety from speech,\u201d","author":"Tutul","year":"2021","journal-title":"Proceedings of the 2021 International Conference on Multimodal Interaction"},{"key":"B108","doi-asserted-by":"publisher","first-page":"6528","DOI":"10.1007\/s10489-021-02394-3","article-title":"Modular design patterns for hybrid learning and reasoning systems: a taxonomy, patterns and use cases","volume":"51","author":"van Bekkum","year":"2021","journal-title":"Appl. Intell"},{"key":"B109","doi-asserted-by":"publisher","DOI":"10.1145\/3480247","article-title":"\u201cInitial responses to false positives in AI-Supported continuous interactions: a colonoscopy case study,\u201d","author":"Van Berkel","year":"2022","journal-title":"ACM Transactions on Interactive Intelligent Systems"},{"key":"B110","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1145\/3486941","article-title":"Human-AI interaction: intermittent, continuous, and proactive","volume":"28","author":"Van Berkel","year":"2021","journal-title":"Interactions"},{"key":"B111","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1038\/s41746-024-01064-1","article-title":"To warrant clinical adoption AI models require a multi-faceted implementation evaluation","volume":"7","author":"van de Sande","year":"2024","journal-title":"NPJ Digital Med"},{"key":"B112","first-page":"85","article-title":"\u201cGLANCE: visual analytics for monitoring glaucoma progression,\u201d","author":"van den Brandt","year":"2020","journal-title":"VCBM"},{"key":"B113","doi-asserted-by":"publisher","first-page":"640647","DOI":"10.3389\/frobt.2021.640647","article-title":"Moral decision making in human-agent teams: human control and the role of explanations","volume":"8","author":"van der Waa","year":"2021","journal-title":"Front. Robot. AI"},{"key":"B114","doi-asserted-by":"publisher","DOI":"10.1145\/3476068","article-title":"\u201cHow to evaluate trust in ai-assisted decision making? A survey of empirical methodologies,\u201d","author":"Vereschak","year":"2021","journal-title":"Proceedings of the ACM on Human-Computer Interaction"},{"key":"B115","doi-asserted-by":"publisher","DOI":"10.1145\/3514094.3534150","article-title":"\u201cDo humans trust advice more if it comes from AI? An analysis of human-AI interactions,\u201d","author":"Vodrahalli","year":"2022","journal-title":"Proceedings of the 2022 AAAI\/ACM Conference on AI, Ethics, and Society"},{"key":"B116","doi-asserted-by":"publisher","first-page":"877","DOI":"10.1007\/s10796-022-10284-3","article-title":"Designing transparency for effective Human-AI collaboration","volume":"24","author":"V\u00f6ssing","year":"2022","journal-title":"Inf. Syst. Front"},{"key":"B117","doi-asserted-by":"publisher","first-page":"7054","DOI":"10.1002\/mp.15871","article-title":"Diagnosis after zooming in: a multilabel classification model by imitating doctor reading habits to diagnose brain diseases","volume":"49","author":"Wang","year":"2022","journal-title":"Med. Phys"},{"key":"B118","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450650","article-title":"\u201cAre explanations helpful? A comparative study of the effects of explanations in AI-Assisted Decision-Making,\u201d","author":"Wang","year":"2021","journal-title":"Proceedings of the 26th International Conference on Intelligent User Interfaces"},{"key":"B119","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1038\/s44159-022-00030-6","article-title":"The sense of agency in perception, behaviour and human-machine interactions","volume":"1","author":"Wen","year":"2022","journal-title":"Nat. Rev. Psychol"},{"key":"B120","doi-asserted-by":"publisher","first-page":"107714","DOI":"10.1016\/j.chb.2023.107714","article-title":"Decision control and explanations in human-AI collaboration: improving user perceptions and compliance","volume":"144","author":"Westphal","year":"2023","journal-title":"Comput. Human Behav"},{"key":"B121","doi-asserted-by":"publisher","first-page":"5619","DOI":"10.1177\/14614448221138072","article-title":"Minority social influence and moral decision-making in human-AI interaction: the effects of identity and specialization cues","volume":"26","author":"Wu","year":"2022","journal-title":"New Media Soc"},{"key":"B122","doi-asserted-by":"publisher","first-page":"107556","DOI":"10.1016\/j.chb.2022.107556","article-title":"Partner or subordinate? Sequential risky decision-making behaviors under human-machine collaboration contexts","volume":"139","author":"Xiong","year":"2023","journal-title":"Comput. Human Behav"},{"key":"B123","doi-asserted-by":"publisher","first-page":"1224","DOI":"10.1109\/TVCG.2007.70515","article-title":"Toward a deeper understanding of the role of interaction in information visualization","volume":"13","author":"Yi","year":"2007","journal-title":"IEEE Trans. Vis. Comput. Graph"},{"key":"B124","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302277","article-title":"\u201cDo I trust my machine teammate? An investigation from perception to decision,\u201d","author":"Yu","year":"2019","journal-title":"Proceedings of the 24th International Conference on Intelligent User Interfaces"},{"key":"B125","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517791","article-title":"\u201cYou complete me: Human-AI teams and complementary expertise,\u201d","author":"Zhang","year":"2022","journal-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems"},{"key":"B126","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501826","article-title":"\u201cTowards relatable explainable AI with the perceptual process,\u201d","author":"Zhang","year":"2022","journal-title":"Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems"},{"key":"B127","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372852","article-title":"\u201cEffect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making,\u201d","author":"Zhang","year":"2020","journal-title":"Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency"},{"key":"B128","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1007\/978-3-319-68059-0_2","article-title":"\u201cEffects of uncertainty and cognitive load on user trust in predictive decision making,\u201d","volume-title":"Human-Computer Interaction INTERACT 2017: 16th IFIP TC 13 International Conference, Mumbai, India, September 25-29, 2017, Proceedings, Part IV 16","author":"Zhou","year":"2017"},{"key":"B129","doi-asserted-by":"publisher","first-page":"1161","DOI":"10.1109\/TVCG.2021.3114864","article-title":"Sibyl: understanding and addressing the usability challenges of machine learning in High-Stakes decision making","volume":"28","author":"Zytek","year":"2022","journal-title":"IEEE Trans. Vis. Comput. Graph"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1521066\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,6]],"date-time":"2025-01-06T07:04:41Z","timestamp":1736147081000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2024.1521066\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,6]]},"references-count":129,"alternative-id":["10.3389\/fcomp.2024.1521066"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2024.1521066","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,6]]},"article-number":"1521066"}}