{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T18:10:54Z","timestamp":1765303854883},"reference-count":0,"publisher":"IOS Press","license":[{"start":{"date-parts":[[2022,9,19]],"date-time":"2022-09-19T00:00:00Z","timestamp":1663545600000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,9,19]]},"abstract":"<jats:p>Humans use AI-assistance in a wide variety of high- and low-stakes decision-making tasks today. However, human reliance on the AI\u2019s assistance is often sub-optimal \u2014 with people exhibiting under- or over-reliance on the AI. We present an empirical investigation of human-AI assisted decision-making in a noisy image classification task. We analyze the participants\u2019 reliance on AI assistance and the accuracy of human-AI assistance as compared to the human or AI working independently. We demonstrate that participants do not show automation bias which is a widely reported behavior displayed by humans when assisted by AI. In this specific instance of AI-assisted decision-making, people are able to correctly override the AI\u2019s decision when needed and achieve close to the theoretical upper bound on combined performance. We suggest that the reason for this discrepancy from previous research findings is because 1) people are experts at classifying everyday images and have a good understanding of their ability in performing the task, 2) people engage in the metacognitive act of deliberation when asked to indicate confidence in their decision, and 3) people were able to build a good mental model of the AI by incorporating feedback that was provided after each trial. These findings should inform future experiment design.<\/jats:p>","DOI":"10.3233\/faia220201","type":"book-chapter","created":{"date-parts":[[2022,9,22]],"date-time":"2022-09-22T07:47:10Z","timestamp":1663832830000},"source":"Crossref","is-referenced-by-count":2,"title":["An Empirical Investigation of Reliance on AI-Assistance in a Noisy-Image Classification Task"],"prefix":"10.3233","author":[{"given":"Heliodoro","family":"Tejeda Lemus","sequence":"first","affiliation":[{"name":"Department of Cognitive Science, University of California, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aakriti","family":"Kumar","sequence":"additional","affiliation":[{"name":"Department of Cognitive Science, University of California, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Steyvers","sequence":"additional","affiliation":[{"name":"Department of Cognitive Science, University of California, Irvine, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"7437","container-title":["Frontiers in Artificial Intelligence and Applications","HHAI2022: Augmenting Human Intellect"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/FAIA220201","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,22]],"date-time":"2022-09-22T07:47:52Z","timestamp":1663832872000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/FAIA220201"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,19]]},"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/faia220201","relation":{},"ISSN":["0922-6389","1879-8314"],"issn-type":[{"value":"0922-6389","type":"print"},{"value":"1879-8314","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,19]]}}}