{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,2]],"date-time":"2026-03-02T22:50:49Z","timestamp":1772491849951,"version":"3.50.1"},"reference-count":122,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T00:00:00Z","timestamp":1764892800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>As AI decision support systems play a growing role in high-stakes decision making, ensuring effective integration of human intuition with AI recommendations is essential. Despite advances in AI explainability, challenges persist in fostering appropriate reliance. This review explores AI decision support systems that enhance human intuition through the analysis of 84 studies addressing three questions: (1) What design strategies enable AI systems to support humans\u2019 intuitive capabilities while maintaining decision-making autonomy? (2) How do AI presentation and interaction approaches influence trust calibration and reliance behaviors in human\u2013AI collaboration? (3) What ethical and practical implications arise from integrating AI decision support systems into high-risk human decision making, particularly regarding trust calibration, skill degradation, and accountability across different domains? Our findings reveal four key design strategies: complementary role architectures that amplify rather than replace human judgment, adaptive user-centered designs tailoring AI support to individual decision-making styles, context-aware task allocation dynamically assigning responsibilities based on situational factors, and autonomous reliance calibration mechanisms empowering users\u2019 control over AI dependence. We identified that visual presentations, interactive features, and uncertainty communication significantly influence trust calibration, with simple visual highlights proving more effective than complex presentation and interactive methods in preventing over-reliance. However, a concerning performance paradox emerges where human\u2013AI combinations often underperform the best individual agent while surpassing human-only performance. The research demonstrates that successful AI integration in high-risk contexts requires domain-specific calibration, integrated sociotechnical design addressing trust calibration and skill preservation simultaneously, and proactive measures to maintain human agency and competencies essential for safety, accountability, and ethical responsibility.<\/jats:p>","DOI":"10.3390\/informatics12040135","type":"journal-article","created":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T13:17:07Z","timestamp":1764940627000},"page":"135","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Enhancing Intuitive Decision-Making and Reliance Through Human\u2013AI Collaboration: A Review"],"prefix":"10.3390","volume":"12","author":[{"given":"Gerui","family":"Xu","sequence":"first","affiliation":[{"name":"Industrial and Manufacturing Systems Engineering Department, University of Michigan-Dearborn, 4901 Evergreen Rd, Dearborn, MI 48128, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5050-9786","authenticated-orcid":false,"given":"Shruthi Venkatesha","family":"Murthy","sequence":"additional","affiliation":[{"name":"Industrial and Manufacturing Systems Engineering Department, University of Michigan-Dearborn, 4901 Evergreen Rd, Dearborn, MI 48128, USA"}]},{"given":"Bochen","family":"Jia","sequence":"additional","affiliation":[{"name":"Industrial and Manufacturing Systems Engineering Department, University of Michigan-Dearborn, 4901 Evergreen Rd, Dearborn, MI 48128, USA"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Reverberi, C., Tommaso, R., Aldo, S., Cesare, H., Paolo, C., GI Genius CADx Study Group, and Cherubini, A. (2022). Experimental evidence of effective human\u2013AI collaboration in medical decision-making. Sci. Rep., 12.","DOI":"10.1038\/s41598-022-18751-2"},{"key":"ref_2","first-page":"101994","article-title":"Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy","volume":"57","author":"Dwivedi","year":"2021","journal-title":"Int. J. Inf. Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.1038\/s41591-022-01894-0","article-title":"Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis","volume":"28","author":"Adams","year":"2022","journal-title":"Nat. Med."},{"key":"ref_4","unstructured":"Maslej, N., Fattorini, L., Perrault, R., Parli, V., Reuel, A., Brynjolfsson, E., Etchemendy, J., Ligett, K., Lyons, T., and Manyika, J. (2024). Artificial Intelligence Index Report 2024. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"100686","DOI":"10.1016\/j.modpat.2024.100686","article-title":"Ethical and Bias Considerations in Artificial Intelligence\/Machine Learning","volume":"38","author":"Hanna","year":"2025","journal-title":"Mod. Pathol."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gala, D., Behl, H., Shah, M., and Makaryus, A.N. (2024). The Role of Artificial Intelligence in Improving Patient Outcomes and Future of Healthcare Delivery in Cardiology: A Narrative Review of the Literature. Healthcare, 12.","DOI":"10.3390\/healthcare12040481"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1057\/s41599-023-01787-8","article-title":"Impact of artificial intelligence on human loss in decision making, laziness and safety in education","volume":"10","author":"Ahmad","year":"2023","journal-title":"Humanit. Soc. Sci. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1038\/s41746-025-01503-7","article-title":"Bias recognition and mitigation strategies in artificial intelligence healthcare applications","volume":"8","author":"Hasanzadeh","year":"2025","journal-title":"NPJ Digit. Med."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Smith, P.T. (2022). Resolving responsibility gaps for lethal autonomous weapon systems. Front. Big Data, 5.","DOI":"10.3389\/fdata.2022.1038507"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"102322","DOI":"10.1016\/j.techsoc.2023.102322","article-title":"Leveraging autonomous weapon systems: Realism and humanitarianism in modern warfare","volume":"74","author":"Lavazza","year":"2023","journal-title":"Technol. Soc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: The convergence of human and artificial intelligence","volume":"25","author":"Topol","year":"2019","journal-title":"Nat. Med."},{"key":"ref_12","unstructured":"Tatnall, A. (2019). Artificial Intelligence in Education. Encyclopedia of Education and Information Technologies, Springer International Publishing."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"100184","DOI":"10.1016\/j.caeo.2024.100184","article-title":"Combining human and artificial intelligence for enhanced AI literacy in higher education","volume":"6","author":"Tzirides","year":"2024","journal-title":"Comput. Educ. Open"},{"key":"ref_14","first-page":"33","article-title":"Computing machinery and intelligence","volume":"59","author":"Turing","year":"1950","journal-title":"Mind"},{"key":"ref_15","first-page":"12","article-title":"A proposal for the dartmouth summer research project on artificial intelligence","volume":"27","author":"McCarthy","year":"1955","journal-title":"AI Mag."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1829","DOI":"10.1038\/s41562-024-01995-5","article-title":"The case for human\u2013AI interaction as system 0 thinking","volume":"8","author":"Chiriatti","year":"2024","journal-title":"Nat. Hum. Behav."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2293","DOI":"10.1038\/s41562-024-02024-1","article-title":"When combinations of humans and AI are useful: A systematic review and meta-analysis","volume":"8","author":"Vaccaro","year":"2024","journal-title":"Nat. Hum. Behav."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1864","DOI":"10.1038\/s41562-024-02001-8","article-title":"A new sociology of humans and machines","volume":"8","author":"Tsvetkova","year":"2024","journal-title":"Nat. Hum. Behav."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Endsley, M.R. (2017). Toward a theory of situation awareness in dynamic systems. Situational Awareness, Routledge.","DOI":"10.4324\/9781315087924-3"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1207\/s15516709cog1202_4","article-title":"Cognitive load during problem solving: Effects on learning","volume":"12","author":"Sweller","year":"1988","journal-title":"Cogn. Sci."},{"key":"ref_22","unstructured":"Mestre, J.P., and Ross, B.H. (2011). CHAPTER TWO\u2014Cognitive Load Theory. Psychology of Learning and Motivation, Academic Press."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Klein, G.A. (2017). Sources of Power: How People Make Decisions, MIT Press.","DOI":"10.7551\/mitpress\/11307.001.0001"},{"key":"ref_24","first-page":"6","article-title":"The recognition-primed decision model","volume":"74","author":"Ross","year":"2004","journal-title":"Mil. Rev."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bansal, G., Wu, T., Zhou, J., Fok, R., Nushi, B., Kamar, E., Ribeiro, M.T., and Weld, D. (2021, January 8\u201313). Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445717"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1518\/001872008X288385","article-title":"Naturalistic decision making","volume":"50","author":"Klein","year":"2008","journal-title":"Hum. Factors"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Senoner, J., Schallmoser, S., Kratzwald, B., Feuerriegel, S., and Netland, T. (2024). Explainable AI improves task performance in human-AI collaboration. Sci. Rep., 14.","DOI":"10.1038\/s41598-024-82501-9"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Amann, J., Blasimme, A., Vayena, E., Frey, D., and Madai, V.I. (2020). Explainability for artificial intelligence in healthcare: A multidisciplinary perspective. BMC Med. Inform. Decis. Mak., 20.","DOI":"10.1186\/s12911-020-01332-6"},{"key":"ref_29","first-page":"1","article-title":"Understanding the Role of Human Intuition on Reliance in Human-AI Decision-Making with Explanations","volume":"7","author":"Chen","year":"2023","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Poursabzi-Sangdeh, F., Goldstein, D.G., Hofman, J.M., Vaughan, J.W.W., and Wallach, H. (2021, January 8\u201313). Manipulating and Measuring Model Interpretability. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445315"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1518\/hfes.46.1.50.30392","article-title":"Trust in automation: Designing for appropriate reliance","volume":"46","author":"Lee","year":"2004","journal-title":"Hum. Factors"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"24","DOI":"10.2307\/256727","article-title":"Affect-and cognition-based trust as foundations for interpersonal cooperation in organizations","volume":"38","author":"McAllister","year":"1995","journal-title":"Acad. Manag. J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1177\/0018720814547570","article-title":"Trust in automation: Integrating empirical evidence on factors that influence trust","volume":"57","author":"Hoff","year":"2015","journal-title":"Hum. Factors"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1080\/01402390.2023.2241648","article-title":"We\u2019ll never have a model of an AI major-general: Artificial Intelligence, command decisions, and kitsch visions of war","volume":"47","author":"Hunter","year":"2024","journal-title":"J. Strateg. Stud."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"157","DOI":"10.2478\/raft-2021-0022","article-title":"Artificial Intelligence in Military Application\u2014Opportunities and Challenges","volume":"26","year":"2021","journal-title":"Land. Forces Acad. Rev."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kase, S.E., Hung, C.P., Krayzman, T., Hare, J.Z., Rinderspacher, B.C., and Su, S.M. (2022). The Future of Collaborative Human-Artificial Intelligence Decision-Making for Mission Planning. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.850628"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"103216","DOI":"10.1016\/j.ijhcs.2023.103216","article-title":"Towards the design of user-centric strategy recommendation systems for collaborative Human\u2013AI tasks","volume":"184","author":"Dodeja","year":"2024","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Berretta, S., Tausch, A., Ontrup, G., Gilles, B., Peifer, C., and Kluge, A. (2023). Defining human-AI teaming the human-centered way: A scoping review and network analysis. Front. Artif. Intell., 6.","DOI":"10.3389\/frai.2023.1250725"},{"key":"ref_39","unstructured":"Nurkin, T., and Siegel, J. (2023). Battlefield Applications for Human-Machine Teaming: Demonstrating Value, Experimenting with New Capabilities and Accelerating Adoption, Atlantic Council, Scowcroft Center for Strategy and Security."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"102861","DOI":"10.1016\/j.artmed.2024.102861","article-title":"Challenges and strategies for wide-scale artificial intelligence (AI) deployment in healthcare practices: A perspective for healthcare organizations","volume":"151","author":"Esmaeilzadeh","year":"2024","journal-title":"Artif. Intell. Med."},{"key":"ref_41","first-page":"48","article-title":"Exploring the opportunities and challenges of implementing artificial intelligence in healthcare: A systematic literature review","volume":"42","author":"Wubineh","year":"2024","journal-title":"Urol. Oncol. Semin. Orig. Investig."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kelly, C.J., Karthikesalingam, A., Suleyman, M., Corrado, G., and King, D. (2019). Key challenges for delivering clinical impact with artificial intelligence. BMC Med., 17.","DOI":"10.1186\/s12916-019-1426-2"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"e188","DOI":"10.7861\/fhj.2021-0095","article-title":"Artificial intelligence in healthcare: Transforming the practice of medicine","volume":"8","author":"Bajwa","year":"2021","journal-title":"Future Healthc. J."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Nahavandi, S. (2019). Industry 5.0\u2014A Human-Centric Solution. Sustainability, 11.","DOI":"10.3390\/su11164371"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.rcim.2024.102937","article-title":"Reviewing human-robot collaboration in manufacturing: Opportunities and challenges in the context of industry 5.0","volume":"93","author":"Dhanda","year":"2025","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Gomez, C., Cho, S.M., Ke, S., Huang, C.-M., and Unberath, M. (2025). Human-AI collaboration is not very collaborative yet: A taxonomy of interaction patterns in AI-assisted decision making from a systematic review. Front. Comput. Sci., 6.","DOI":"10.3389\/fcomp.2024.1521066"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1038\/s42256-022-00593-2","article-title":"Human\u2013AI collaboration enables more empathic conversations in text-based peer-to-peer mental health support","volume":"5","author":"Sharma","year":"2023","journal-title":"Nat. Mach. Intell."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"103133","DOI":"10.1016\/j.inffus.2025.103133","article-title":"Reflections and attentiveness on eXplainable Artificial Intelligence (XAI). The journey ahead from criticisms to human\u2013AI collaboration","volume":"121","author":"Herrera","year":"2025","journal-title":"Inf. Fusion."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"3369","DOI":"10.1108\/MD-10-2023-2023","article-title":"AI in knowledge sharing, which ethical challenges are raised in decision-making processes for organisations?","volume":"63","author":"Rezaei","year":"2024","journal-title":"Manag. Decis."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: An updated guideline for reporting systematic reviews","volume":"372","author":"Page","year":"2021","journal-title":"BMJ"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Zheng, Q., Tang, Y., Liu, Y., Liu, W., and Huang, Y. (May, January 29). UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA.","DOI":"10.1145\/3491102.3501855"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"e70036","DOI":"10.1002\/cesm.70036","article-title":"Using Artificial Intelligence Tools as Second Reviewers for Data Extraction in Systematic Reviews: A Performance Comparison of Two AI Tools Against Human Reviewers","volume":"3","author":"Marcussen","year":"2025","journal-title":"Cochrane Evid. Synth. Methods"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"2171","DOI":"10.1007\/s00607-023-01181-x","article-title":"Artificial intelligence to automate the systematic review of scientific literature","volume":"105","author":"Romero","year":"2023","journal-title":"Computing"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1007\/s10462-024-10902-3","article-title":"Artificial intelligence for literature reviews: Opportunities and challenges","volume":"57","author":"Bolanos","year":"2024","journal-title":"Artif. Intell. Rev."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1002\/jrsm.1553","article-title":"Using artificial intelligence methods for systematic review in health sciences: A systematic review","volume":"13","author":"Blaizot","year":"2022","journal-title":"Res. Synth. Methods"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"e1638","DOI":"10.1002\/leap.1638","article-title":"Enhancing peer review efficiency: A mixed-methods analysis of artificial intelligence-assisted reviewer selection across academic disciplines","volume":"37","author":"Farber","year":"2024","journal-title":"Learn. Publ."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1016\/j.tree.2024.04.007","article-title":"Leveraging AI to improve evidence synthesis in conservation","volume":"39","author":"Wong","year":"2024","journal-title":"Trends Ecol. Evol."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1655","DOI":"10.1016\/j.jval.2025.08.002","article-title":"A4SLR: An Agentic AI-Assisted Systematic Literature Review Framework to Augment Evidence Synthesis for HEOR and HTA","volume":"28","author":"Lee","year":"2025","journal-title":"Value Health"},{"key":"ref_59","first-page":"1","article-title":"Human-AI Collaboration in Data Science: Exploring Data Scientists\u2019 Perceptions of Automated AI","volume":"3","author":"Wang","year":"2019","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Choudari, S., Sanwal, R., Sharma, N., Shastri, S., Singh, D.A.P., and Deepa, G. (2024, January 15\u201316). Data Science collaboration in Human AI: Decision Optimization using Human-centered Automation. Proceedings of the 2024 Second International Conference Computational and Characterization Techniques in Engineering & Sciences (IC3TES), Lucknow, India.","DOI":"10.1109\/IC3TES62412.2024.10877543"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"100004","DOI":"10.1016\/j.risk.2024.100004","article-title":"Artificial intelligence and uncertainty","volume":"1","author":"Scholes","year":"2025","journal-title":"Risk Sci."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3359206","article-title":"\"Hello AI\": Uncovering the Onboarding Needs of Medical Practitioners for Human-AI Collaborative Decision-Making","volume":"3","author":"Cai","year":"2019","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"ref_63","unstructured":"Xu, B., Song, X., Cai, Z., Professor, A.Y.-L.C., Lim, E., Tan, C.-W., and Yu, J. (2020, January 20\u201324). Artificial Intelligence or Augmented Intelligence: A Case Study of Human-AI Collaboration in Operational Decision Making. Proceedings of the Pacific Asia Conference on Information Systems (PACIS), Dubai, United Arab Emirates."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"110872","DOI":"10.1016\/j.cie.2025.110872","article-title":"A new model for calculating human trust behavior during human-AI collaboration in multiple decision-making tasks: A Bayesian approach","volume":"200","author":"Ding","year":"2025","journal-title":"Comput. Ind. Eng."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"107451","DOI":"10.1016\/j.chb.2022.107451","article-title":"Adapt and overcome: Perceptions of adaptive autonomous agents for human-AI teaming","volume":"138","author":"Hauptman","year":"2023","journal-title":"Comput. Hum. Behav."},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"102977","DOI":"10.1016\/j.ijhcs.2022.102977","article-title":"Mitigating knowledge imbalance in AI-advised decision-making through collaborative user involvement","volume":"172","author":"Gomez","year":"2023","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Muijlwijk, H., Willemsen, M.C., Smyth, B., and IJsselsteijn, W.A. (2024, January 18\u201321). Benefits of Human-AI Interaction for Expert Users Interacting with Prediction Models: A Study on Marathon Running. Proceedings of the IUI \u201824: 29th International Conference on Intelligent User Interfaces, Greenville, SC, USA.","DOI":"10.1145\/3640543.3645205"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Liu, M.X., Wu, T., Chen, T., Li, F.M., Kittur, A., and Myers, B.A. (2024, January 11\u201316). Selenite: Scaffolding Online Sensemaking with Comprehensive Overviews Elicited from Large Language Models. Proceedings of the CHI \u201824: CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3613904.3642149"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Zheng, C., Zhang, Y., Huang, Z., Shi, C., Xu, M., and Ma, X. (2024, January 13\u201316). DiscipLink: Unfolding Interdisciplinary Information Seeking Process via Human-AI Co-Exploration. Proceedings of the UIST \u201824: The 37th Annual ACM Symposium on User Interface Software and Technology, Pittsburgh, PA, USA.","DOI":"10.1145\/3654777.3676366"},{"key":"ref_70","doi-asserted-by":"crossref","unstructured":"Shi, C., Hu, Y., Wang, S., Ma, S., Zheng, C., Ma, X., and Luo, Q. (2023, January 23\u201328). RetroLens: A Human-AI Collaborative System for Multi-step Retrosynthetic Route Planning. Proceedings of the CHI \u201823: CHI Conference on Human Factors in Computing Systems, Hamburg, Germany.","DOI":"10.1145\/3544548.3581469"},{"key":"ref_71","first-page":"801","article-title":"A Conversationally Enabled Decision Support System for Supply Chain Management: A Conceptual Framework","volume":"58","author":"Pinto","year":"2024","journal-title":"IFAC Pap."},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Meske, C., and \u00dcnal, E. (2024, January 1\u20134). Investigating the Impact of Control in AI-Assisted Decision-Making\u2014An Experimental Study. Proceedings of the MuC \u201824: Mensch und Computer, Karlsruhe, Germany.","DOI":"10.1145\/3670653.3677476"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1007\/s00799-023-00375-0","article-title":"PEERRec: An AI-based approach to automatically generate recommendations and predict decisions in peer review","volume":"25","author":"Bharti","year":"2024","journal-title":"Int. J. Digit. Libr."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"100015","DOI":"10.1016\/j.chbah.2023.100015","article-title":"Optimizing human-AI collaboration: Effects of motivation and accuracy information in AI-supported decision-making","volume":"1","author":"Eisbach","year":"2023","journal-title":"Comput. Hum. Behav. Artif. Hum."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"e51921","DOI":"10.2196\/51921","article-title":"Designing Human-Centered AI to Prevent Medication Dispensing Errors: Focus Group Study with Pharmacists","volume":"7","author":"Zheng","year":"2023","journal-title":"JMIR Form. Res."},{"key":"ref_76","unstructured":"Park, G. (2023). The Effect of Level of AI Transparency on Human-AI Teaming Performance Including Trust in Machine Learning Interface. [Ph.D. Thesis, University of Michigan-Dearborn]."},{"key":"ref_77","first-page":"7","article-title":"Human-AI Teams in Aviation: Considerations from Human Factors and Team Science","volume":"33","author":"Korentsides","year":"2024","journal-title":"J. Aviat. Aerosp. Educ. Res."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"102831","DOI":"10.1016\/j.ijhcs.2022.102831","article-title":"Design patterns for human-AI co-learning: A wizard-of-Oz evaluation in an urban-search-and-rescue task","volume":"164","author":"Schoonderwoerd","year":"2022","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3695462","article-title":"Alert Prioritisation in Security Operations Centres: A Systematic Survey on Criteria and Methods","volume":"57","author":"Jalalvand","year":"2025","journal-title":"ACM Comput. Surv."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Chen, J., and Lu, S. (2024, January 1\u20133). An Advanced Driving Agent with the Multimodal Large Language Model for Autonomous Vehicles. Proceedings of the 2024 IEEE International Conference on Mobility, Operations, Services and Technologies (MOST), Dallas, TX, USA.","DOI":"10.1109\/MOST60774.2024.00009"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1162\/tacl_a_00679","article-title":"Decision-Oriented Dialogue for Human-AI Collaboration","volume":"12","author":"Lin","year":"2024","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"101074","DOI":"10.1016\/j.patter.2024.101074","article-title":"AI-enhanced collective intelligence","volume":"5","author":"Cui","year":"2024","journal-title":"Patterns"},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"103061","DOI":"10.1016\/j.ijhcs.2023.103061","article-title":"Examining the impact of varying levels of AI teammate influence on human-AI teams","volume":"177","author":"Flathmann","year":"2023","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"e63109","DOI":"10.2196\/63109","article-title":"Diagnostic Decision-Making Variability Between Novice and Expert Optometrists for Glaucoma: Comparative Analysis to Inform AI System Design","volume":"13","author":"Ghaffar","year":"2025","journal-title":"JMIR Med. Inform."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3512930","article-title":"Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making","volume":"6","author":"Rastogi","year":"2022","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"ref_86","unstructured":"Paleja, R., Munje, M., Chang, K., Jensen, R., and Gombolay, M. (2025). Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems. arXiv."},{"key":"ref_87","unstructured":"Rosenbacke, R. (2025). Cognitive Challenges in Human-AI Collaboration: A Study on Trust, Errors, and Heuristics in Clinical Decision-Making. [Ph.D. Thesis, Copenhagen Business School]."},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"101829","DOI":"10.1016\/j.giq.2023.101829","article-title":"Can AI communication tools increase legislative responsiveness and trust in democratic institutions?","volume":"40","author":"Kreps","year":"2023","journal-title":"Gov. Inf. Q."},{"key":"ref_89","doi-asserted-by":"crossref","unstructured":"Schemmer, M., Kuehl, N., Benz, C., Bartos, A., and Satzger, G. (2023, January 27\u201331). Appropriate Reliance on AI Advice: Conceptualization and the Effect of Explanations. Proceedings of the IUI \u201823: 28th International Conference on Intelligent User Interfaces, Sydney, NSW, Australia.","DOI":"10.1145\/3581641.3584066"},{"key":"ref_90","unstructured":"Chakravorti, T., Singh, V., Rajtmajer, S., McLaughlin, M., Fraleigh, R., Griffin, C., Kwasnica, A., Pennock, D., and Giles, C.L. (2023). Artificial Prediction Markets Present a Novel Opportunity for Human-AI Collaboration. arXiv, pp. 2304\u20132306."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"103455","DOI":"10.1016\/j.ijhcs.2025.103455","article-title":"Confronting verbalized uncertainty: Understanding how LLM\u2019s verbalized uncertainty influences users in AI-assisted decision-making","volume":"197","author":"Xu","year":"2025","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_92","doi-asserted-by":"crossref","unstructured":"Tutul, A.A., Nirjhar, E.H., and Chaspari, T. (2021, January 18\u201322). Investigating Trust in Human-Machine Learning Collaboration: A Pilot Study on Estimating Public Anxiety from Speech. Proceedings of the ICMI \u201821: International Conference on Multimodal Interaction, Montr\u00e9al, QC, Canada.","DOI":"10.1145\/3462244.3479926"},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"103324","DOI":"10.1016\/j.ijhcs.2024.103324","article-title":"Addressing attentional issues in augmented reality with adaptive agents: Possibilities and challenges","volume":"190","author":"Syiem","year":"2024","journal-title":"Int. J. Hum. Comput. Stud."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"101837","DOI":"10.1016\/j.copsyc.2024.101837","article-title":"AI-teaming: Redefining collaboration in the digital era","volume":"58","author":"Schmutz","year":"2024","journal-title":"Curr. Opin. Psychol."},{"key":"ref_95","doi-asserted-by":"crossref","first-page":"1009","DOI":"10.1177\/02666669241249744","article-title":"Human-AI interaction: Augmenting decision-making for IT leader\u2019s project selection","volume":"41","author":"Judkins","year":"2025","journal-title":"Inf. Dev."},{"key":"ref_96","first-page":"101346","article-title":"Sensemaking with AI: How Trust Influences Human-AI Collaboration in Health and Creative Industries","volume":"11","author":"Daly","year":"2025","journal-title":"Soc. Sci. Humanit. Open"},{"key":"ref_97","first-page":"a84","article-title":"Strategic alliance: Navigating challenges in human-ai collaboration for effective business decision-making","volume":"9","author":"Lowell","year":"2024","journal-title":"Int. J. Nov. Res. Dev."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"e33540","DOI":"10.2196\/33540","article-title":"How Clinicians Perceive Artificial Intelligence\u2013Assisted Technologies in Diagnostic Decision Making: Mixed Methods Approach","volume":"23","author":"Hah","year":"2021","journal-title":"J. Med. Internet Res."},{"key":"ref_99","doi-asserted-by":"crossref","unstructured":"Papachristos, E., Skov Johansen, P., M\u00f8berg Jacobsen, R., Bj\u00f8rn Leer Bysted, L., and Skov, M.B. (2021, January 25\u201327). How do People Perceive the Role of AI in Human-AI Collaboration to Solve Everyday Tasks?. Proceedings of the CHI Greece 2021: 1st International Conference of the ACM Greek SIGCHI Chapter, Athens, Greece.","DOI":"10.1145\/3489410.3489420"},{"key":"ref_100","doi-asserted-by":"crossref","unstructured":"Famiglini, L., Campagner, A., Barandas, M., La Maida, G.A., Gallazzi, E., and Cabitza, F. (2024). Evidence-based XAI: An empirical approach to design more effective and explainable decision support systems. Comput. Biol. Med., 170.","DOI":"10.1016\/j.compbiomed.2024.108042"},{"key":"ref_101","doi-asserted-by":"crossref","unstructured":"Chowdhury, A., Nguyen, H., Ashenden, D., and Pogrebna, G. (2023, January 10\u201314). POSTER: A Teacher-Student with Human Feedback Model for Human-AI Collaboration in Cybersecurity. Proceedings of the ASIA CCS \u201823: ACM ASIA Conference on Computer and Communications Security, Melbourne, Australia.","DOI":"10.1145\/3579856.3592829"},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3579605","article-title":"Explanations Can Reduce Overreliance on AI Systems During Decision-Making","volume":"7","author":"Vasconcelos","year":"2023","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"107714","DOI":"10.1016\/j.chb.2023.107714","article-title":"Decision control and explanations in human-AI collaboration: Improving user perceptions and compliance","volume":"144","author":"Westphal","year":"2023","journal-title":"Comput. Hum. Behav."},{"key":"ref_104","first-page":"1","article-title":"The Impact of Imperfect XAI on Human-AI Decision-Making","volume":"8","author":"Morrison","year":"2024","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"ref_105","doi-asserted-by":"crossref","unstructured":"Ma, S., Lei, Y., Wang, X., Zheng, C., Shi, C., Yin, M., and Ma, X. (2023, January 23\u201328). Who Should I Trust: AI or Myself? Leveraging Human and AI Correctness Likelihood to Promote Appropriate Trust in AI-Assisted Decision-Making. Proceedings of the CHI \u201823: CHI Conference on Human Factors in Computing Systems, Hamburg, Germany.","DOI":"10.1145\/3544548.3581058"},{"key":"ref_106","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1080\/1463922X.2022.2061080","article-title":"The role of shared mental models in human-AI teams: A theoretical review","volume":"24","author":"Andrews","year":"2023","journal-title":"Theor. Issues Ergon. Sci."},{"key":"ref_107","unstructured":"Tabrez, A. (June, January 29). Effective Human-Machine Teaming through Communicative Autonomous Agents that Explain, Coach, and Convince. Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems, London, UK."},{"key":"ref_108","doi-asserted-by":"crossref","first-page":"100066","DOI":"10.1016\/j.chbah.2024.100066","article-title":"Confirmation bias in AI-assisted decision-making: AI triage recommendations congruent with expert judgments increase psychologist trust and recommendation acceptance","volume":"2","author":"Bashkirova","year":"2024","journal-title":"Comput. Hum. Behav. Artif. Hum."},{"key":"ref_109","doi-asserted-by":"crossref","unstructured":"Sivaraman, V., Bukowski, L.A., Levin, J., Kahn, J.M., and Perer, A. (2023, January 23\u201328). Ignore, Trust, or Negotiate: Understanding Clinician Acceptance of AI-Based Treatment Recommendations in Health Care. Proceedings of the CHI \u201823: CHI Conference on Human Factors in Computing Systems, Hamburg, Germany.","DOI":"10.1145\/3544548.3581075"},{"key":"ref_110","doi-asserted-by":"crossref","unstructured":"Schoeffer, J., De-Arteaga, M., and K\u00fchl, N. (2024, January 11\u201416). Explanations, Fairness, and Appropriate Reliance in Human-AI Decision-Making. Proceedings of the CHI \u201824: CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3613904.3642621"},{"key":"ref_111","doi-asserted-by":"crossref","unstructured":"Erlei, A., Sharma, A., and Gadiraju, U. (2024, January 11\u201416). Understanding Choice Independence and Error Types in Human-AI Collaboration. Proceedings of the CHI \u201824: CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.","DOI":"10.1145\/3613904.3641946"},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1177\/0018720816634228","article-title":"A meta-analysis of factors influencing the development of trust in automation: Implications for understanding autonomy in future systems","volume":"58","author":"Schaefer","year":"2016","journal-title":"Hum. Factors"},{"key":"ref_113","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1518\/001872097778543886","article-title":"Humans and automation: Use, misuse, disuse, abuse","volume":"39","author":"Parasuraman","year":"1997","journal-title":"Hum. Factors"},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3686969","article-title":"Understanding the Evolvement of Trust Over Time within Human-AI Teams","volume":"8","author":"Duan","year":"2024","journal-title":"Proc. ACM Hum. Comput. Interact."},{"key":"ref_115","first-page":"44","article-title":"DARPA\u2019s explainable artificial intelligence (XAI) program","volume":"40","author":"Gunning","year":"2019","journal-title":"AI Mag."},{"key":"ref_116","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","article-title":"Explanation in artificial intelligence: Insights from the social sciences","volume":"267","author":"Miller","year":"2019","journal-title":"Artif. Intell."},{"key":"ref_117","unstructured":"Tolmeijer, S., Christen, M., Kandul, S., Kneer, M., and Bernstein, A. (May, January 29). Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making. Proceedings of the CHI \u201822: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA."},{"key":"ref_118","unstructured":"Wang, B.Y., Boell, S.K., Riemer, K., and Peter, S. (2023, January 5\u20138). Human Agency in AI Configurations Supporting Organizational Decision-making. Proceedings of the Australasian Conferences on Information Systems, Wellington, New Zealand."},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"102685","DOI":"10.1016\/j.jairtraman.2024.102685","article-title":"An introduction to the current state of standardization and certification on military AI applications","volume":"121","author":"Ye","year":"2024","journal-title":"J. Air Transp. Manag."},{"key":"ref_120","doi-asserted-by":"crossref","first-page":"102662","DOI":"10.1016\/j.techsoc.2024.102662","article-title":"Exploring collaborative decision-making: A quasi-experimental study of human and Generative AI interaction","volume":"78","author":"Hao","year":"2024","journal-title":"Technol. Soc."},{"key":"ref_121","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zong, R., Shang, L., Yue, Z., Zeng, H., Liu, Y., and Wang, D. (2024, January 27\u201328). Tripartite Intelligence: Synergizing Deep Neural Network, Large Language Model, and Human Intelligence for Public Health Misinformation Detection (Archival Full Paper). Proceedings of the CI \u201824: Collective Intelligence Conference, Boston, MA, USA.","DOI":"10.1145\/3643562.3672613"},{"key":"ref_122","doi-asserted-by":"crossref","first-page":"101772","DOI":"10.1016\/j.jsis.2023.101772","article-title":"Ethical management of human-AI interaction: Theory development review","volume":"32","author":"Heyder","year":"2023","journal-title":"J. Strateg. Inf. Syst."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/12\/4\/135\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T14:10:59Z","timestamp":1764943859000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/12\/4\/135"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,5]]},"references-count":122,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["informatics12040135"],"URL":"https:\/\/doi.org\/10.3390\/informatics12040135","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,5]]}}}