{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:05:23Z","timestamp":1776092723846,"version":"3.50.1"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"7","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,10,18]]},"abstract":"<jats:p>Synthetic images, audio, and video can now be generated and edited by Artificial Intelligence (AI). In particular, the malicious use of synthetic data has raised concerns about potential harms to cybersecurity, personal privacy, and public trust. Although AI-based detection tools exist to help identify synthetic content, their limitations often lead to user mistrust and confusion between real and fake content. This study examines the role of AI performance in influencing human trust and decision making in synthetic data identification. Through an online human subject experiment involving 400 participants, we examined how varying AI performance impacts human trust and dependence on AI in deepfake detection. Our findings indicate how participants calibrate their dependence on AI based on their perceived risk and the prediction results provided by AI. These insights contribute to the development of transparent and explainable AI systems that better support everyday users in mitigating the harms of synthetic media.<\/jats:p>","DOI":"10.1145\/3757588","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:32:00Z","timestamp":1760635920000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Effect of AI Performance, Risk Perception, and Trust on Human Dependence in Deepfake Detection AI System"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6185-4099","authenticated-orcid":false,"given":"Yingfan","family":"Zhou","sequence":"first","affiliation":[{"name":"Pennsylvania State University, State College, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-3583-6891","authenticated-orcid":false,"given":"Ester","family":"Chen","sequence":"additional","affiliation":[{"name":"Rochester Institute of Technology, Rochester, New York, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-4122-036X","authenticated-orcid":false,"given":"Manasa","family":"Pisipati","sequence":"additional","affiliation":[{"name":"Pennsylvania State University, State College, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7607-0695","authenticated-orcid":false,"given":"Aiping","family":"Xiong","sequence":"additional","affiliation":[{"name":"Pennsylvania State University, State College, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1464-0848","authenticated-orcid":false,"given":"Sarah","family":"Rajtmajer","sequence":"additional","affiliation":[{"name":"Pennsylvania State University, State College, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,10,16]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"2783","volume-title":"31st USENIX Security Symposium (USENIX Security 22)","author":"Alahmadi Bushra A","year":"2022","unstructured":"Bushra A Alahmadi, Louise Axon, and Ivan Martinovic. 2022. 99% false positives: A qualitative study of {SOC} analysts' perspectives on security alarms. In 31st USENIX Security Symposium (USENIX Security 22). 2783-2800."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5285"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581152"},{"key":"e_1_2_1_4_1","unstructured":"Monika Bickert. 2024. Our Approach to Labeling AI-Generated Content and Manipulated Media. https:\/\/about.fb.com\/news\/2024\/04\/metas-approach-to-labeling-ai-generated-content-and-manipulated-media\/"},{"key":"e_1_2_1_5_1","first-page":"2691","volume-title":"31st USENIX Security Symposium (USENIX Security 22)","author":"Blue Logan","year":"2022","unstructured":"Logan Blue, Kevin Warren, Hadi Abdullah, Cassidy Gibson, Luis Vargas, Jessica O'Dell, Kevin Butler, and Patrick Traynor. 2022. Who are you (i really wanna know)? detecting audio {DeepFakes} through vocal tract reconstruction. In 31st USENIX Security Symposium (USENIX Security 22). 2691-2708."},{"key":"e_1_2_1_6_1","first-page":"1","volume-title":"Proceedings of the ACM on Human-computer Interaction 5, CSCW1","author":"Bu\u00e7inca Zana","year":"2021","unstructured":"Zana Bu\u00e7inca, Maja Barbara Malaya, and Krzysztof Z Gajos. 2021. To trust or to think: cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making. Proceedings of the ACM on Human-computer Interaction 5, CSCW1 (2021), 1-21."},{"key":"e_1_2_1_7_1","first-page":"1","volume-title":"Proceedings of the ACM on Human-Computer Interaction 7, CSCW1","author":"Cabrera \u00c1ngel Alexander","year":"2023","unstructured":"\u00c1ngel Alexander Cabrera, Adam Perer, and Jason I Hong. 2023. Improving human-AI collaboration with descriptions of AI behavior. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023), 1-21."},{"key":"e_1_2_1_8_1","first-page":"1","volume-title":"Proceedings of the ACM on Human-Computer Interaction 6, CSCW2","author":"Cao Shiye","year":"2022","unstructured":"Shiye Cao and Chien-Ming Huang. 2022. Understanding user reliance on AI in assisted decision-making. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1-23."},{"key":"e_1_2_1_9_1","volume-title":"The effects of alarm system errors on dependence: Moderated mediation of trust with and without risk","author":"Chancey Eric T","unstructured":"Eric T Chancey. 2016. The effects of alarm system errors on dependence: Moderated mediation of trust with and without risk. Old Dominion University."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720816682648"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580805"},{"key":"e_1_2_1_12_1","first-page":"1","volume-title":"Proceedings of the ACM on Human-computer Interaction 7, CSCW2","author":"Chen Valerie","year":"2023","unstructured":"Valerie Chen, Q Vera Liao, Jennifer Wortman Vaughan, and Gagan Bansal. 2023. Understanding the role of human intuition on reliance in human-AI decision-making with explanations. Proceedings of the ACM on Human-computer Interaction 7, CSCW2 (2023), 1-32."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581015"},{"key":"e_1_2_1_14_1","volume-title":"Automation reliability in unmanned aerial vehicle control: A reliance-compliance model of automation dependence in high workload. Human factors 48, 3","author":"Dixon Stephen R","year":"2006","unstructured":"Stephen R Dixon and Christopher D Wickens. 2006. Automation reliability in unmanned aerial vehicle control: A reliance-compliance model of automation dependence in high workload. Human factors 48, 3 (2006), 474-486."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3561048"},{"key":"e_1_2_1_16_1","volume-title":"Memo Akten, Hany Farid, Jessica Fjeld, Morgan R Frank, Matthew Groh, Laura Herman, Neil Leach, et al .","author":"Epstein Ziv","year":"2023","unstructured":"Ziv Epstein, Aaron Hertzmann, Investigators of Human Creativity, Memo Akten, Hany Farid, Jessica Fjeld, Morgan R Frank, Matthew Groh, Laura Herman, Neil Leach, et al . 2023. Art and the science of generative AI. Science 380, 6650 (2023), 1110-1111."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517446"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2110013119"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems. 1-14","author":"Han Chaeeun","year":"2024","unstructured":"Chaeeun Han, Prasenjit Mitra, and Syed Masum Billah. 2024. Uncovering Human Traits in Determining Real and Spoofed Audio: Insights from Blind and Sighted Individuals. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1-14."},{"key":"e_1_2_1_20_1","volume-title":"Introduction to mediation, moderation, and conditional process analysis: A regression-based approach","author":"Hayes Andrew F","unstructured":"Andrew F Hayes. 2017. Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. Guilford publications."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581219"},{"key":"e_1_2_1_22_1","volume-title":"Modeling strategic behavior in human-automation interaction: Why an'' aid'' can (and should) go unused. Human factors 35, 2","author":"Kirlik Alex","year":"1993","unstructured":"Alex Kirlik. 1993. Modeling strategic behavior in human-automation interaction: Why an'' aid'' can (and should) go unused. Human factors 35, 2 (1993), 221-242."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594087"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems. 1-19","author":"Lee Hao-Ping","year":"2024","unstructured":"Hao-Ping Lee, Yu-Ju Yang, Thomas Serban Von Davier, Jodi Forlizzi, and Sauvik Das. 2024. Deepfakes, Phrenology, Surveillance, and More! A Taxonomy of AI Privacy Risks. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1-19."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1006\/ijhc.1994.1007"},{"key":"e_1_2_1_26_1","volume-title":"Trust in automation: Designing for appropriate reliance. Human factors 46, 1","author":"Lee John D","year":"2004","unstructured":"John D Lee and Katrina A See. 2004. Trust in automation: Designing for appropriate reliance. Human factors 46, 1 (2004), 50-80."},{"key":"e_1_2_1_27_1","first-page":"7213","volume-title":"32nd USENIX Security Symposium (USENIX Security 23)","author":"Li Zheng","year":"2023","unstructured":"Zheng Li, Ning Yu, Ahmed Salem, Michael Backes, Mario Fritz, and Yang Zhang. 2023. {UnGANable}: Defending against {GAN-based} face manipulation. In 32nd USENIX Security Symposium (USENIX Security 23). 7213-7230."},{"key":"e_1_2_1_28_1","first-page":"1","volume-title":"Proceedings of the ACM on Human-Computer Interaction 5, CSCW2","author":"Liu Han","year":"2021","unstructured":"Han Liu, Vivian Lai, and Chenhao Tan. 2021. Understanding the effect of out-of-distribution examples and interactive explanations on human-ai decision making. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1-45."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445562"},{"key":"e_1_2_1_30_1","volume-title":"Human-human reliance in the context of automation. Human factors 54, 1","author":"Lyons Joseph B","year":"2012","unstructured":"Joseph B Lyons and Charlene K Stokes. 2012. Human-human reliance in the context of automation. Human factors 54, 1 (2012), 112-121."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581058"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642671"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.2307\/258792"},{"key":"e_1_2_1_34_1","volume-title":"Effects of warning validity and proximity on responses to warnings. Human factors 43, 4","author":"Meyer Joachim","year":"2001","unstructured":"Joachim Meyer. 2001. Effects of warning validity and proximity on responses to warnings. Human factors 43, 4 (2001), 563-572."},{"key":"e_1_2_1_35_1","volume-title":"Conceptual issues in the study of dynamic hazard warnings. Human factors 46, 2","author":"Meyer Joachim","year":"2004","unstructured":"Joachim Meyer. 2004. Conceptual issues in the study of dynamic hazard warnings. Human factors 46, 2 (2004), 196-204."},{"key":"e_1_2_1_36_1","first-page":"1669","volume-title":"31st USENIX Security Symposium (USENIX Security 22)","author":"Mink Jaron","year":"2022","unstructured":"Jaron Mink, Licheng Luo, Nat\u00e3 M Barbosa, Olivia Figueira, Yang Wang, and Gang Wang. 2022. {DeepPhish}: Understanding user trust towards artificially generated profiles in online social networks. In 31st USENIX Security Symposium (USENIX Security 22). 1669-1686."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2120481119"},{"key":"e_1_2_1_38_1","first-page":"4409","volume-title":"33rd USENIX Security Symposium (USENIX Security 24)","author":"Paudel Pujan","year":"2024","unstructured":"Pujan Paudel, Mohammad Hammas Saeed, Rebecca Auger, Chris Wells, and Gianluca Stringhini. 2024. Enabling Contextual Soft Moderation on Social Media through Contrastive Textual Deviation. In 33rd USENIX Security Symposium (USENIX Security 24). 4409-4426."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.2019.3478"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501967"},{"key":"e_1_2_1_41_1","doi-asserted-by":"crossref","first-page":"303","DOI":"10.3200\/GENP.136.3.303-322","article-title":"Examining single-and multiple-process theories of trust in automation","volume":"136","author":"Rice Stephen","year":"2009","unstructured":"Stephen Rice. 2009. Examining single-and multiple-process theories of trust in automation. The Journal of general psychology 136, 3 (2009), 303-322.","journal-title":"The Journal of general psychology"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3627043.3659567"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641905"},{"key":"e_1_2_1_44_1","volume-title":"Should I follow AI-based advice? Measuring appropriate reliance in human-AI decision-making. arXiv preprint arXiv:2204.06916","author":"Schemmer Max","year":"2022","unstructured":"Max Schemmer, Patrick Hemmer, Niklas K\u00fchl, Carina Benz, and Gerhard Satzger. 2022. Should I follow AI-based advice? Measuring appropriate reliance in human-AI decision-making. arXiv preprint arXiv:2204.06916 (2022)."},{"key":"e_1_2_1_45_1","unstructured":"Homeland Security. 2024. Increasing Threat of Deepfake Identities. https:\/\/www.dhs.gov\/sites\/default\/files\/ publications\/increasing_threats_of_deepfake_identities_0.pdf"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517646"},{"key":"e_1_2_1_47_1","unstructured":"Henrik Singmann Ben Bolker Jake Westfall Frederik Aust MS Ben-Shachar S H\u00f8jsgaard J Fox MA Lawrence U Mertens J Love et al. 2015. Package 'afex'. URL http:\/\/afex. Singmann. Science\/ https:\/\/github. Com\/singmann\/afex (2015)."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.2307\/258646"},{"key":"e_1_2_1_49_1","unstructured":"Peter Suciu. [n. d.]. 'Created By AI' Warning Labels Are Coming To Social Media. https:\/\/www.forbes.com\/sites\/petersuciu\/2023\/08\/02\/created-by-ai-warning-labels-are-coming-to-social-media\/ Section: Social Media."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445699"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642382"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","unstructured":"Michelle Vaccaro Abdullah Almaatouq and Thomas Malone. 2024. When combinations of humans and AI are useful: A systematic review and meta-analysis. (2024). doi:10.1038\/s41562-024-02024-1","DOI":"10.1038\/s41562-024-02024-1"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642018"},{"key":"e_1_2_1_54_1","volume-title":"The emergence of deepfake technology: A review. Technology innovation management review 9, 11","author":"Westerlund Mika","year":"2019","unstructured":"Mika Westerlund. 2019. The emergence of deepfake technology: A review. Technology innovation management review 9, 11 (2019)."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581197"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11109-018-9443-y"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517791"},{"key":"e_1_2_1_58_1","volume-title":"Evaluating the impact of uncertainty visualization on model reliance","author":"Zhao Jieqiong","year":"2023","unstructured":"Jieqiong Zhao, Yixuan Wang, Michelle V Mancenido, Erin K Chiou, and Ross Maciejewski. 2023. Evaluating the impact of uncertainty visualization on model reliance. IEEE Transactions on Visualization and Computer Graphics (2023)."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581318"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3757588","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:38:09Z","timestamp":1760636289000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3757588"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,16]]},"references-count":59,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,10,18]]}},"alternative-id":["10.1145\/3757588"],"URL":"https:\/\/doi.org\/10.1145\/3757588","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,16]]},"assertion":[{"value":"2025-10-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}