{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T19:02:29Z","timestamp":1779217349276,"version":"3.51.4"},"reference-count":54,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,2,7]],"date-time":"2025-02-07T00:00:00Z","timestamp":1738886400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Sci."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Decision-making based on AI can be challenging, especially when considering the uncertainty associated with AI predictions. Visualizing uncertainty in AI refers to techniques that use visual cues to represent the level of confidence or uncertainty in an AI model's outputs, such as predictions or decisions. This study aims to investigate the impact of visualizing uncertainty on decision-making and trust in AI.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We conducted a user study with 147 participants, utilizing static classic gaming scenarios as a proxy for human-AI collaboration in decision-making. The study measured changes in decisions, trust in AI, and decision-making confidence when uncertainty was visualized in a continuous format compared to a binary output of the AI model.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Our findings indicate that visualizing uncertainty significantly enhances trust in AI for 58% of participants with negative attitudes toward AI. Additionally, 31% of these participants found uncertainty visualization to be useful. The size of the uncertainty visualization was identified as the method that had the most impact on participants' trust in AI and their confidence in their decisions. Furthermore, we observed a strong association between participants' gaming experience and changes in decision-making when uncertainty was visualized, as well as a strong link between trust in AI and individual attitudes toward AI.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>These results suggest that visualizing uncertainty can improve trust in AI, particularly among individuals with negative attitudes toward AI. The findings also have important implications for the design of human-AI decision-support systems, offering insights into how uncertainty can be visualized to enhance decision-making and user confidence.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fcomp.2025.1464348","type":"journal-article","created":{"date-parts":[[2025,2,7]],"date-time":"2025-02-07T06:50:52Z","timestamp":1738911052000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Trusting AI: does uncertainty visualization affect decision-making?"],"prefix":"10.3389","volume":"7","author":[{"given":"Jonatan","family":"Reyes","sequence":"first","affiliation":[]},{"given":"Anil Ufuk","family":"Batmaz","sequence":"additional","affiliation":[]},{"given":"Marta","family":"Kersten-Oertel","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2025,2,7]]},"reference":[{"key":"B1","first-page":"445","article-title":"\u201cUser-centered design,\u201d","volume-title":"Encyclopedia of Human-Computer Interaction","author":"Abras","year":"2004"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1057\/s41599-024-04044-8","article-title":"Trust in AI: progress, challenges, and future directions","volume":"11","author":"Afroogh","year":"2024","journal-title":"Humanit. Soc. Sci. Commun"},{"key":"B3","volume-title":"American Psychological Association Dictionary of Psychology","year":"2011"},{"key":"B4","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1007\/s00146-019-00931-w","article-title":"In AI we trust? Perceptions about automated decision-making by artificial intelligence","volume":"35","author":"Araujo","year":"2020","journal-title":"AI Soc"},{"key":"B5","doi-asserted-by":"publisher","first-page":"5015","DOI":"10.47611\/jsrhs.v12i3.5015","article-title":"Investigating students' attitudes & trust in AI during covid-19","volume":"12","author":"Arif","year":"2023","journal-title":"J. Stud. Res"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1912.02675","article-title":"In AI we trust? Factors that influence trustworthiness of AI-infused decision-making processes","author":"Ashoori","year":"2019","journal-title":"arXiv"},{"key":"B7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41235-023-00499-6","article-title":"Humans versus AI: whether and why we prefer human-created compared to AI-created artwork","volume":"8","author":"Bellaiche","year":"2023","journal-title":"Cogn. Res. Princ. Implic"},{"key":"B8","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1109\/MCG.2007.323435","article-title":"Rainbow color map (still) considered harmful","volume":"27","author":"Borland","year":"2007","journal-title":"IEEE Comput. Graph. Appl"},{"key":"B9","doi-asserted-by":"publisher","first-page":"2769","DOI":"10.1109\/TVCG.2012.220","article-title":"Evaluating sketchiness as a visual variable for the depiction of qualitative uncertainty","volume":"18","author":"Boukhelifa","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph"},{"key":"B10","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1177\/0018720809338286","article-title":"Cognitive models of the influence of color scale on data visualization tasks","volume":"51","author":"Breslow","year":"2009","journal-title":"Hum. Factors"},{"key":"B11","first-page":"1","article-title":"\u201cHuman-centered tools for coping with imperfect algorithms during medical decision-making,\u201d","author":"Cai","year":"2019"},{"key":"B12","first-page":"177","article-title":"\u201cRepresenting uncertainty information from AI for human understanding,\u201d","author":"Cassenti","year":"2023"},{"key":"B13","first-page":"74","article-title":"\u201cIncorporating uncertainty into decision-making: an information visualisation approach,\u201d","author":"Daradkeh","year":"2017"},{"key":"B14","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1109\/AIVR56993.2022.00022","article-title":"\u201cVisualization of machine learning uncertainty in AR-based see-through applications,\u201d","author":"Doula","year":"2022"},{"key":"B15","first-page":"145","article-title":"\u201cHuman information interaction and the cognitive predicting theory of trust,\u201d","author":"Fell","year":"2020"},{"key":"B16","first-page":"1","article-title":"\u201cDecision-making under uncertainty: how the amount of presented uncertainty influences user behavior,\u201d","author":"Greis","year":"2016"},{"key":"B17","first-page":"1","article-title":"\u201cVisualizing uncertainty and alternatives in event sequence predictions,\u201d","author":"Guo","year":"2019"},{"key":"B18","first-page":"22","article-title":"\u201cMeasuring and predicting human trust in recommendations from an AI teammate,\u201d","author":"Gurney","year":"2022"},{"key":"B19","first-page":"319","article-title":"\u201cCommon concerns with mturk as a participant pool: evidence and solutions,\u201d","author":"Hauser","year":"2019"},{"key":"B20","doi-asserted-by":"publisher","first-page":"106635","DOI":"10.1016\/j.chb.2020.106635","article-title":"The automation of leadership functions: Would people trust decision algorithms?","volume":"116","author":"H\u00f6ddinghaus","year":"2021","journal-title":"Comput. Human Behav"},{"key":"B21","doi-asserted-by":"publisher","first-page":"3381","DOI":"10.3233\/JIFS-221611","article-title":"Uncertainty-based decision support system for gaming applications","volume":"44","author":"Jagtap","year":"2023","journal-title":"J. Intell. Fuzzy Syst"},{"key":"B22","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1016\/j.bushor.2018.03.007","article-title":"Artificial intelligence and the future of work: human-AI symbiosis in organizational decision making","volume":"61","author":"Jarrahi","year":"2018","journal-title":"Bus. Horiz"},{"key":"B23","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1207\/S15327566IJCE0401_04","article-title":"Foundations for an empirically determined scale of trust in automated systems","volume":"4","author":"Jian","year":"2000","journal-title":"Int. J. Cogn. Ergon"},{"key":"B24","first-page":"1","article-title":"\u201cTell me more? The effects of mental model soundness on personalizing an intelligent agent,\u201d","author":"Kulesza","year":"2012"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12912-022-01048-0","article-title":"Influence of AI ethics awareness, attitude, anxiety, and self-efficacy on nursing students' behavioral intentions","volume":"21","author":"Kwak","year":"2022","journal-title":"BMC Nurs"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2112.11471","article-title":"Towards a science of human-AI decision making: a survey of empirical studies","author":"Lai","year":"2021","journal-title":"arXiv"},{"key":"B27","first-page":"1","article-title":"\u201cWho is included in human perceptions of AI?: trust and perceived fairness around healthcare AI and cultural mistrust,\u201d","author":"Lee","year":"2021"},{"key":"B28","first-page":"1","article-title":"\u201cWill AI console me when I lose my pet? Understanding perceptions of AI-mediated email writing,\u201d","author":"Liu","year":"2022"},{"key":"B29","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1145\/22949.22950","article-title":"Automating the design of graphical presentations of relational information","volume":"5","author":"Mackinlay","year":"1986","journal-title":"ACM Trans. Graph"},{"key":"B30","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1097\/SLA.0000000000004594","article-title":"Artificial intelligence for intraoperative guidance: using semantic segmentation to identify surgical anatomy during laparoscopic cholecystectomy","volume":"276","author":"Madani","year":"2020","journal-title":"Ann. Surg"},{"key":"B31","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1016\/j.neunet.2011.07.002","article-title":"The effect of class imbalance on case selection for case-based classifiers: an empirical study in the context of medical decision support","volume":"25","author":"Malof","year":"2012","journal-title":"Neural Netw"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2309.10852","article-title":"Using AI uncertainty quantification to improve human decision-making","author":"Marusich","year":"2023","journal-title":"arXiv"},{"key":"B33","doi-asserted-by":"publisher","first-page":"709","DOI":"10.2307\/258792","article-title":"An integrative model of organizational trust","volume":"20","author":"Mayer","year":"1995","journal-title":"Acad. Manag. Rev"},{"key":"B34","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1080\/10345329.2019.1658694","article-title":"Predicting risk in criminal procedure: actuarial tools, algorithms, AI and judicial decision-making","volume":"32","author":"McKay","year":"2020","journal-title":"Curr. Issues Crim. Justice"},{"key":"B35","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1287\/isre.13.3.334.81","article-title":"Developing and validating trust measures for e-commerce: an integrative typology","volume":"13","author":"McKnight","year":"2002","journal-title":"Inf. Syst. Res"},{"key":"B36","doi-asserted-by":"publisher","first-page":"532","DOI":"10.1016\/j.dss.2011.02.016","article-title":"Argumentation-based negotiation planning for autonomous agents","volume":"51","author":"Monteserin","year":"2011","journal-title":"Decis. Support Syst"},{"key":"B37","doi-asserted-by":"publisher","first-page":"4048","DOI":"10.3758\/s13428-022-02005-0","article-title":"Is it ethical to use mechanical Turk for behavioral research? Relevant data from a representative survey of MTurk participants and wages","volume":"55","author":"Moss","year":"2023","journal-title":"Behav. Res. Methods"},{"key":"B38","doi-asserted-by":"publisher","first-page":"e0229132","DOI":"10.1371\/journal.pone.0229132","article-title":"Adaptive trust calibration for human-AI collaboration","volume":"15","author":"Okamura","year":"2020","journal-title":"PLoS ONE"},{"key":"B39","first-page":"871","article-title":"\u201cHuman-centered design meets cognitive load theory: designing interfaces that help people think,\u201d","author":"Oviatt","year":"2006"},{"key":"B40","doi-asserted-by":"publisher","first-page":"3643","DOI":"10.1016\/j.asoc.2011.01.036","article-title":"Fuzzy cognitive map based approach for predicting yield in cotton crop production as a basis for decision support system in precision agriculture application","volume":"11","author":"Papageorgiou","year":"2011","journal-title":"Appl. Soft Comput"},{"key":"B41","doi-asserted-by":"publisher","first-page":"1240005","DOI":"10.1142\/S0218213012400052","article-title":"Ai tools in decision making support systems: a review","volume":"21","author":"Phillips-Wren","year":"2012","journal-title":"Int. J. Artif. Intell. Tools"},{"key":"B42","first-page":"379","article-title":"\u201cUnderstanding uncertainty: how lay decision-makers perceive and interpret uncertainty in human-AI decision making,\u201d","author":"Prabhudesai","year":"2023"},{"key":"B43","doi-asserted-by":"publisher","first-page":"100014","DOI":"10.1016\/j.chbr.2020.100014","article-title":"Initial validation of the general attitudes towards artificial intelligence scale","volume":"1","author":"Schepman","year":"2020","journal-title":"Comput. Huma. Behav. Rep"},{"key":"B44","doi-asserted-by":"publisher","first-page":"101802","DOI":"10.1016\/j.ijdrr.2020.101802","article-title":"Using serious gaming to explore how uncertainty affects stakeholder decision-making across the science-policy divide during disasters","volume":"51","author":"Schueller","year":"2020","journal-title":"Int. J. Disaster Risk Reduct"},{"key":"B45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3419764","article-title":"Bridging the gap between ethics and practice: guidelines for reliable, safe, and trustworthy human-centered AI systems","volume":"10","author":"Shneiderman","year":"2020","journal-title":"ACM Trans. Interact. Intell. Syst"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.4135\/9781412983754","author":"Sue","year":"2007","journal-title":"Conducting Online Surveys"},{"key":"B47","doi-asserted-by":"publisher","first-page":"273","DOI":"10.3233\/IDT-2011-0111","article-title":"An agent-based simulation approach in an idss for evaluating performance in flow-shop manufacturing system","volume":"5","author":"Taghezout","year":"2011","journal-title":"Intell. Decis. Technol"},{"key":"B48","first-page":"357","article-title":"\u201cMeasuring algorithm aversion and betrayal aversion to humans and AI using trust games,\u201d","author":"Takagi","year":"2024"},{"key":"B49","doi-asserted-by":"publisher","first-page":"100049","DOI":"10.1016\/j.patter.2020.100049","article-title":"Rapid trust calibration through interpretable and uncertainty-aware AI","volume":"1","author":"Tomsett","year":"2020","journal-title":"Patterns"},{"key":"B50","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1080\/10447318.2022.2041900","article-title":"Transitioning to human interaction with AI systems: New challenges and opportunities for HCI professionals to enable human-centered AI","volume":"39","author":"Xu","year":"2023","journal-title":"Int. J. Hum. Comput. Interact"},{"key":"B51","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1108\/JEBDE-11-2023-0028","article-title":"How to build trust in answers given by generative AI for specific and vague financial questions","volume":"3","author":"Zarifis","year":"2024","journal-title":"J. Electron. Bus. Digit. Econ"},{"key":"B52","doi-asserted-by":"publisher","first-page":"634","DOI":"10.1108\/JSM-05-2020-0162","article-title":"Who do you choose? Comparing perceptions of human vs robo-advisor in the context of financial services","volume":"35","author":"Zhang","year":"","journal-title":"J. Serv. Market"},{"key":"B53","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1007\/s10916-021-01743-6","article-title":"Effect of AI explanations on human perceptions of patient-facing AI-powered healthcare systems","volume":"45","author":"Zhang","year":"","journal-title":"J. Med. Syst"},{"key":"B54","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1631\/FITEE.1700053","article-title":"Hybrid-augmented intelligence: collaboration and cognition","volume":"18","author":"Zheng","year":"2017","journal-title":"Front. Inf. Technol. Electron. Eng"}],"container-title":["Frontiers in Computer Science"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1464348\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,7]],"date-time":"2025-02-07T06:50:56Z","timestamp":1738911056000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fcomp.2025.1464348\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,7]]},"references-count":54,"alternative-id":["10.3389\/fcomp.2025.1464348"],"URL":"https:\/\/doi.org\/10.3389\/fcomp.2025.1464348","relation":{},"ISSN":["2624-9898"],"issn-type":[{"value":"2624-9898","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,7]]},"article-number":"1464348"}}