{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,12]],"date-time":"2026-07-12T03:37:16Z","timestamp":1783827436416,"version":"3.55.0"},"reference-count":55,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2022,5,21]],"date-time":"2022-05-21T00:00:00Z","timestamp":1653091200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"DAAD PROMOS Scholarship"},{"DOI":"10.13039\/100000144","name":"Division of Computer and Network Systems","doi-asserted-by":"publisher","award":["2026324"],"award-info":[{"award-number":["2026324"]}],"id":[{"id":"10.13039\/100000144","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Hum Factors"],"published-print":{"date-parts":[[2024,2]]},"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study manipulates the presence and reliability of AI recommendations for risky decisions to measure the effect on task performance, behavioral consequences of trust, and deviation from a probability matching collaborative decision-making model.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Although AI decision support improves performance, people tend to underutilize AI recommendations, particularly when outcomes are uncertain. As AI reliability increases, task performance improves, largely due to higher rates of compliance (following action recommendations) and reliance (following no-action recommendations).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>In a between-subject design, participants were assigned to a high reliability AI, low reliability AI, or a control condition. Participants decided whether to bet that their team would win in a series of basketball games tying compensation to performance. We evaluated task performance (in accuracy and signal detection terms) and the behavioral consequences of trust (via compliance and reliance).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      AI recommendations improved task performance, had limited impact on risk-taking behavior, and were under-valued by participants. Accuracy, sensitivity (\n                      <jats:italic>d\u2019<\/jats:italic>\n                      ), and reliance increased in the high reliability AI condition, but there was no effect on response bias (\n                      <jats:italic>c<\/jats:italic>\n                      ) or compliance. Participant behavior was only consistent with a probability matching model for compliance in the low reliability condition.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>In a pay-off structure that incentivized risk-taking, the primary value of the AI recommendations was in determining when to perform no action (i.e., pass on bets).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Application<\/jats:title>\n                    <jats:p>In risky contexts, designers need to consider whether action or no-action recommendations will be more influential to design appropriate interventions.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/00187208221100691","type":"journal-article","created":{"date-parts":[[2022,5,21]],"date-time":"2022-05-21T05:22:58Z","timestamp":1653110578000},"page":"348-362","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":26,"title":["Knowing When to Pass: The Effect of AI Reliability in Risky Decision Contexts"],"prefix":"10.1177","volume":"66","author":[{"given":"Hannah","family":"Elder","sequence":"first","affiliation":[{"name":"Technische Universit\u00e4t Berlin, Berlin, Germany, and University of Missouri-Columbia, Columbia, Missouri, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5325-3798","authenticated-orcid":false,"given":"Casey","family":"Canfield","sequence":"additional","affiliation":[{"name":"Missouri University of Science &amp; Technology, Rolla, Missouri, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel B.","family":"Shank","sequence":"additional","affiliation":[{"name":"Missouri University of Science &amp; Technology, Rolla, Missouri, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tobias","family":"Rieger","sequence":"additional","affiliation":[{"name":"Technische Universit\u00e4t Berlin, Berlin, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Casey","family":"Hines","sequence":"additional","affiliation":[{"name":"Missouri University of Science &amp; Technology, Rolla, Missouri, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2022,5,21]]},"reference":[{"key":"e_1_3_4_2_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-629x.2004.00099.x"},{"key":"e_1_3_4_3_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720817700258"},{"key":"e_1_3_4_4_1","first-page":"542","volume-title":"IFIP Conference on Human-Computer Interaction","author":"Beretta A.","year":"2019","unstructured":"Beretta A., Zancanaro M., Lepri B. (2019, September) Following wrong suggestions: self-blame in human and computer scenarios. In IFIP Conference on Human-Computer Interaction (pp. 542\u2013550). Springer, Cham."},{"key":"e_1_3_4_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720820983632"},{"key":"e_1_3_4_6_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720816665025"},{"key":"e_1_3_4_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720816682648"},{"key":"e_1_3_4_8_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2019.00256"},{"key":"e_1_3_4_9_1","doi-asserted-by":"publisher","DOI":"10.1111\/ajt.12206"},{"key":"e_1_3_4_10_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"e_1_3_4_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.econlet.2003.12.006"},{"key":"e_1_3_4_12_1","unstructured":"Dzindolet M. T. Beck H. P. Pierce L. G. (2000). Encouraging human operators to appropriately rely on automated decision aids. In Proceedings of the 2000 Command and Control Research and Technology Symposium."},{"key":"e_1_3_4_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1473018.1473028"},{"key":"e_1_3_4_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2005.04.003"},{"key":"e_1_3_4_15_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1539-6053.2008.00033.x"},{"key":"e_1_3_4_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2014.01.001"},{"key":"e_1_3_4_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/acp.2350080703"},{"key":"e_1_3_4_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720814547570"},{"key":"e_1_3_4_19_1","volume-title":"Goal orientation, task difficulty, and task interest: A multilevel analysis","author":"Horvath M.","year":"2006","unstructured":"Horvath M., Herleman H., McKie R. L. (2006). Goal orientation, task difficulty, and task interest: A multilevel analysis. https:\/\/doi.org\/10.1007\/S11031-006-9029-6"},{"key":"e_1_3_4_20_1","volume-title":"Trust in Artificial Intelligence: Meta-Analytic Findings","author":"Kaplan A. D.","year":"2021","unstructured":"Kaplan A. D., Kessler T. T., Brill J. C., Hancock P. A. (2021). Trust in Artificial Intelligence: Meta-Analytic Findings. Human Factors. https:\/\/doi.org\/10.1177\/00187208211013988"},{"key":"e_1_3_4_21_1","doi-asserted-by":"publisher","DOI":"10.1177\/001872089303500203"},{"key":"e_1_3_4_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/ijsa.12246"},{"key":"e_1_3_4_23_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1994.1007"},{"key":"e_1_3_4_24_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.50_30392"},{"key":"e_1_3_4_25_1","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)AS.1943-5525.0000514"},{"key":"e_1_3_4_26_1","volume-title":"Predicting National Basketball Association Winners","author":"Lin J.","year":"2014","unstructured":"Lin J., Short L., Sundaresan V. (2014). Predicting National Basketball Association Winners Vol. 5."},{"key":"e_1_3_4_27_1","doi-asserted-by":"publisher","DOI":"10.4324\/9781410611147"},{"key":"e_1_3_4_28_1","volume-title":"Measuring Human-Computer Trust","author":"Madsen M.","year":"2000","unstructured":"Madsen M., Gregor S. (2000). Measuring Human-Computer Trust."},{"key":"e_1_3_4_29_1","first-page":"531","article-title":"Exploring the Concept and Measurement of General Risk Aversion","volume":"32","author":"Mandrik C.","year":"2005","unstructured":"Mandrik C., Bao Y. (2005). Exploring the Concept and Measurement of General Risk Aversion. Advances in Consumer Research, 32, 531\u2013539.","journal-title":"Advances in Consumer Research"},{"key":"e_1_3_4_30_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140139.2014.957732"},{"key":"e_1_3_4_31_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-1799-6"},{"key":"e_1_3_4_32_1","doi-asserted-by":"publisher","DOI":"10.1287\/isre.13.3.334.81"},{"key":"e_1_3_4_33_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.2.196.37335"},{"key":"e_1_3_4_34_1","doi-asserted-by":"crossref","unstructured":"Meyer J. Kuchar J. K. (2021). Maximal benefits and possible detrimental effects of binary decision aids. In 2021 IEEE 2nd International Conference on Human-Machine Systems (ICHMS) (pp. 1\u20136). IEEE.","DOI":"10.1109\/ICHMS53169.2021.9582632"},{"key":"e_1_3_4_35_1","doi-asserted-by":"publisher","DOI":"10.1518\/001872097778543886"},{"key":"e_1_3_4_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2017.01.006"},{"key":"e_1_3_4_37_1","doi-asserted-by":"publisher","DOI":"10.1177\/154193121005402502"},{"key":"e_1_3_4_38_1","volume-title":"Exploring the Efficacy of Social Trust Repair in Human-Automation Interactions","author":"Quinn D. B.","year":"2018","unstructured":"Quinn D. B. (2018). Exploring the Efficacy of Social Trust Repair in Human-Automation Interactions. 68."},{"key":"e_1_3_4_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2003.1217624"},{"issue":"1","key":"e_1_3_4_40_1","first-page":"36","article-title":"Automation Reliance Under Time Pressure","volume":"14","author":"Rice S.","year":"2009","unstructured":"Rice S., Keller D. (2009). Automation Reliance Under Time Pressure. Cognitive Technology, 14(1), 36\u201344.","journal-title":"Cognitive Technology"},{"key":"e_1_3_4_41_1","first-page":"1","volume-title":"Human Performance Consequences of Automated Decision Aids: The Impact of Time Pressure","author":"Rieger T.","year":"2020","unstructured":"Rieger T., Manzey D. (2020). Human Performance Consequences of Automated Decision Aids: The Impact of Time Pressure. Human Factors, 1\u201318. https:\/\/doi.org\/10.1177\/0018720820965019"},{"key":"e_1_3_4_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2007.05.004"},{"key":"e_1_3_4_43_1","doi-asserted-by":"publisher","DOI":"10.1518\/155723405783703082"},{"key":"e_1_3_4_44_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.3563507"},{"key":"e_1_3_4_45_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03207704"},{"key":"e_1_3_4_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2905370"},{"issue":"1","key":"e_1_3_4_47_1","first-page":"1","article-title":"UX in AI: trust in algorithm-based investment decisions","volume":"5","author":"Szeli L.","year":"2020","unstructured":"Szeli L. (2020). UX in AI: trust in algorithm-based investment decisions. Junior Management Science, 5(1), 1\u201318. https:\/\/doi.org\/10.5282\/jums\/v5i1pp1-18","journal-title":"Junior Management Science"},{"key":"e_1_3_4_48_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.185.4157.1124"},{"key":"e_1_3_4_49_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.46.2.186.11926"},{"key":"e_1_3_4_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.anbehav.2019.07.001"},{"key":"e_1_3_4_51_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720809338842"},{"key":"e_1_3_4_52_1","doi-asserted-by":"publisher","DOI":"10.1080\/14639220500370105"},{"key":"e_1_3_4_53_1","unstructured":"Wickens C. Xu X. (2002). How Does Automation Reliability Influence Workload ?\/paper\/How-Does-Automation-Reliability-Influence-Workload-Wickens-Xu\/99e3a8dd2a8bf1b7eccf850e63e014da22b5b6d5."},{"key":"e_1_3_4_54_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2019.00519"},{"key":"e_1_3_4_55_1","doi-asserted-by":"publisher","DOI":"10.1177\/1071181312561060"},{"key":"e_1_3_4_56_1","doi-asserted-by":"crossref","unstructured":"Zhang Y. Liao Q. V. Bellamy R. K. E. (2020). Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. In Proceedings of the 2020 Conference on Fairness Accountability and Transparency 295\u2013305. https:\/\/doi.org\/10.1145\/3351095.3372852","DOI":"10.1145\/3351095.3372852"}],"container-title":["Human Factors: The Journal of the Human Factors and Ergonomics Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/00187208221100691","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/00187208221100691","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/00187208221100691","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/00187208221100691","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T07:53:19Z","timestamp":1777449199000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/00187208221100691"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,21]]},"references-count":55,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,2]]}},"alternative-id":["10.1177\/00187208221100691"],"URL":"https:\/\/doi.org\/10.1177\/00187208221100691","relation":{},"ISSN":["0018-7208","1547-8181"],"issn-type":[{"value":"0018-7208","type":"print"},{"value":"1547-8181","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,21]]}}}