{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T19:02:42Z","timestamp":1776193362172,"version":"3.50.1"},"publisher-location":"Cham","reference-count":43,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783032083326","type":"print"},{"value":"9783032083333","type":"electronic"}],"license":[{"start":{"date-parts":[[2025,10,19]],"date-time":"2025-10-19T00:00:00Z","timestamp":1760832000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,10,19]],"date-time":"2025-10-19T00:00:00Z","timestamp":1760832000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Although the integration of artificial intelligence (AI) into everyday tasks improves efficiency and objectivity, it also risks transmitting bias to human decision-making. In this study, we conducted a controlled experiment that simulated hiring decisions to examine how biased AI recommendations - augmented with or without counterfactual explanations - influence human judgment over time. Participants, acting as hiring managers, completed 60 decision trials divided into a baseline phase without AI, followed by a phase with biased (X)AI recommendations (favoring either male or female candidates), and a final post-interaction phase without AI. Our results indicate that the participants followed the AI recommendations 70% of the time when the qualifications of the given candidates were comparable. Yet, only a fraction of participants detected the gender bias (8 out of 294). Crucially, exposure to biased AI altered participants\u2019 inherent preferences: in the post-interaction phase, participants\u2019 independent decisions aligned with the bias when no counterfactual explanations were provided before, but reversed the bias when explanations were given. Reported trust did not differ significantly across conditions. Confidence varied throughout the study phases after exposure to male-biased AI, indicating nuanced effects of AI bias on decision certainty. Our findings point to the importance of calibrating XAI to avoid unintended behavioral shifts in order to safeguard equitable decision-making and prevent the adoption of algorithmic bias. In the interest of reproducible research, study data is available at: <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/ukuhl\/BiasBackfiresXAI2025\" ext-link-type=\"uri\">https:\/\/github.com\/ukuhl\/BiasBackfiresXAI2025<\/jats:ext-link>.<\/jats:p>","DOI":"10.1007\/978-3-032-08333-3_12","type":"book-chapter","created":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T05:22:31Z","timestamp":1760764951000},"page":"249-273","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["When Bias Backfires: The Modulatory Role of\u00a0Counterfactual Explanations on\u00a0the\u00a0Adoption of\u00a0Algorithmic Bias in\u00a0XAI-Supported Human Decision-Making"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9405-918X","authenticated-orcid":false,"given":"Ulrike","family":"Kuhl","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1475-4260","authenticated-orcid":false,"given":"Annika","family":"Bush","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,10,19]]},"reference":[{"key":"12_CR1","doi-asserted-by":"publisher","unstructured":"Bates, D., M\u00e4chler, M., Bolker, B., Walker, S.: Fitting linear mixed-effects models using lme4. J. Statist. Softw. 67(1) (2015). https:\/\/doi.org\/10.18637\/jss.v067.i01","DOI":"10.18637\/jss.v067.i01"},{"issue":"4\/5","key":"12_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1147\/JRD.2019.2942287","volume":"63","author":"RK Bellamy","year":"2019","unstructured":"Bellamy, R.K., et al.: Ai fairness 360: an extensible toolkit for detecting and mitigating algorithmic bias. IBM J. Res. Dev. 63(4\/5), 1\u20134 (2019)","journal-title":"IBM J. Res. Dev."},{"key":"12_CR3","doi-asserted-by":"publisher","unstructured":"Biloborodova, T., Skarga-Bandurova, I.: Human-ai collaboration in decision making: an initial reliability study and methodology. In: 2023 IEEE 12th International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS), pp. 1151\u20131155. IEEE (2023). https:\/\/doi.org\/10.1109\/IDAACS58523.2023.10348928","DOI":"10.1109\/IDAACS58523.2023.10348928"},{"key":"12_CR4","doi-asserted-by":"crossref","unstructured":"Byrne, R.M.: Counterfactuals in explainable artificial intelligence (xai): evidence from human reasoning. In: IJCAI, California, CA, pp. 6276\u20136282 (2019)","DOI":"10.24963\/ijcai.2019\/876"},{"issue":"3","key":"12_CR5","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1111\/1467-8721.ep10768783","volume":"1","author":"J Cohen","year":"1992","unstructured":"Cohen, J.: Statistical power analysis. Curr. Dir. Psychol. Sci. 1(3), 98\u2013101 (1992)","journal-title":"Curr. Dir. Psychol. Sci."},{"key":"12_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2023.119898","volume":"655","author":"J Del Ser","year":"2024","unstructured":"Del Ser, J., Barredo-Arrieta, A., D\u00edaz-Rodr\u00edguez, N., Herrera, F., Saranti, A., Holzinger, A.: On generating trustworthy counterfactual explanations. Inf. Sci. 655, 119898 (2024). https:\/\/doi.org\/10.1016\/j.ins.2023.119898","journal-title":"Inf. Sci."},{"issue":"4","key":"12_CR7","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1001\/jama.2015.19394","volume":"315","author":"MA Detry","year":"2016","unstructured":"Detry, M.A., Ma, Y.: Analyzing repeated measurements using mixed models. JAMA 315(4), 407 (2016). https:\/\/doi.org\/10.1001\/jama.2015.19394","journal-title":"JAMA"},{"issue":"3","key":"12_CR8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0279720","volume":"18","author":"BD Douglas","year":"2023","unstructured":"Douglas, B.D., Ewell, P.J., Brauer, M.: Data quality in online human-subjects research: comparisons between mturk, prolific, cloudresearch, qualtrics, and sona. PLoS ONE 18(3), e0279720 (2023)","journal-title":"PLoS ONE"},{"issue":"2","key":"12_CR9","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1177\/1073191120957102","volume":"29","author":"G Eisele","year":"2022","unstructured":"Eisele, G., et al.: The effects of sampling frequency and questionnaire length on perceived burden, compliance, and careless responding in experience sampling data in a student population. Assessment 29(2), 136\u2013151 (2022)","journal-title":"Assessment"},{"issue":"2","key":"12_CR10","doi-asserted-by":"publisher","first-page":"175","DOI":"10.3758\/BF03193146","volume":"39","author":"F Faul","year":"2007","unstructured":"Faul, F., Erdfelder, E., Lang, A.G., Buchner, A.: G* power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav. Res. Methods 39(2), 175\u2013191 (2007)","journal-title":"Behav. Res. Methods"},{"key":"12_CR11","doi-asserted-by":"publisher","unstructured":"Hemmer, P., Schemmer, M., K\u00fchl, N., V\u00f6ssing, M., Satzger, G.: Complementarity in human-ai collaboration: concept, sources, and evidence. https:\/\/doi.org\/10.48550\/arXiv.2404.00029","DOI":"10.48550\/arXiv.2404.00029"},{"key":"12_CR12","doi-asserted-by":"publisher","first-page":"1096257","DOI":"10.3389\/fcomp.2023.1096257","volume":"5","author":"RR Hoffman","year":"2023","unstructured":"Hoffman, R.R., Mueller, S.T., Klein, G., Litman, J.: Measures for explainable ai: explanation goodness, user satisfaction, mental models, curiosity, trust, and human-ai performance. Front. Comput. Sci. 5, 1096257 (2023)","journal-title":"Front. Comput. Sci."},{"key":"12_CR13","doi-asserted-by":"crossref","unstructured":"Hooker, S.: Moving beyond \u201calgorithmic bias is a data problem\u201d. Patterns 2(4) (2021)","DOI":"10.1016\/j.patter.2021.100241"},{"key":"12_CR14","doi-asserted-by":"crossref","unstructured":"Huang, G.L., Zaslavsky, A.: Contextual knowledge graph approach to bias-reduced decision support systems. Journal of Decision Systems, pp. 1\u201318 (2024)","DOI":"10.1080\/12460125.2024.2349436"},{"key":"12_CR15","doi-asserted-by":"publisher","unstructured":"Huang, G.L., Zaslavsky, A.: Contextual knowledge graph approach to bias-reduced decision support systems. J. Decision Syst., 1\u201318 (2024). https:\/\/doi.org\/10.1080\/12460125.2024.2349436, https:\/\/typeset.io\/papers\/contextual-knowledge-graph-approach-to-bias-reduced-decision-3kl425nx35","DOI":"10.1080\/12460125.2024.2349436"},{"issue":"3","key":"12_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3665647","volume":"14","author":"C Humer","year":"2024","unstructured":"Humer, C., Hinterreiter, A., Leichtmann, B., Mara, M., Streit, M.: Reassuring, misleading, debunking: comparing effects of xai methods on human decisions. ACM Trans. Interactive Intell. Syst. 14(3), 1\u201336 (2024). https:\/\/doi.org\/10.1145\/3665647","journal-title":"ACM Trans. Interactive Intell. Syst."},{"issue":"3","key":"12_CR17","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1080\/0960085X.2021.1927212","volume":"31","author":"N Kordzadeh","year":"2022","unstructured":"Kordzadeh, N., Ghasemaghaei, M.: Algorithmic bias: review, synthesis, and future research directions. Eur. J. Inf. Syst. 31(3), 388\u2013409 (2022)","journal-title":"Eur. J. Inf. Syst."},{"key":"12_CR18","doi-asserted-by":"crossref","unstructured":"K\u00fccking, F., et al.: Automation bias in ai-decision support: results from an empirical study. In: German Medical Data Sciences 2024, pp. 298\u2013304. IOS Press (2024)","DOI":"10.3233\/SHTI240871"},{"key":"12_CR19","doi-asserted-by":"crossref","unstructured":"Kuhl, U., Artelt, A., Hammer, B.: Keep your friends close and your counterfactuals closer: improved learning from closest rather than plausible counterfactual explanations in an abstract setting. In: Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency, pp. 2125\u20132137 (2022)","DOI":"10.1145\/3531146.3534630"},{"key":"12_CR20","doi-asserted-by":"publisher","unstructured":"Kuhl, U., Artelt, A., Hammer, B.: For better or worse: the impact of counterfactual explanations\u2019 directionality on user behavior in xai. In: World Conference on Explainable Artificial Intelligence, pp. 280\u2013300. Springer (2023). https:\/\/doi.org\/10.1007\/978-3-031-44070-0_14","DOI":"10.1007\/978-3-031-44070-0_14"},{"key":"12_CR21","doi-asserted-by":"publisher","first-page":"1087929","DOI":"10.3389\/fcomp.2023.1087929","volume":"5","author":"U Kuhl","year":"2023","unstructured":"Kuhl, U., Artelt, A., Hammer, B.: Let\u2019s go to the alien zoo: introducing an experimental framework to study usability of counterfactual explanations for machine learning. Front. Comput. Sci. 5, 1087929 (2023)","journal-title":"Front. Comput. Sci."},{"key":"12_CR22","doi-asserted-by":"crossref","unstructured":"Lakkaraju, H., Bastani, O.: \" how do i fool you?\" manipulating user trust via misleading black box explanations. In: Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, pp. 79\u201385 (2020)","DOI":"10.1145\/3375627.3375833"},{"issue":"CSCW2","key":"12_CR23","first-page":"1","volume":"7","author":"MH Lee","year":"2023","unstructured":"Lee, M.H., Chew, C.J.: Understanding the effect of counterfactual explanations on trust and reliance on ai for human-ai collaborative clinical decision making. Proc. ACM Human-Comput. Interact. 7(CSCW2), 1\u201322 (2023)","journal-title":"Proc. ACM Human-Comput. Interact."},{"issue":"CSCW2","key":"12_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3610218","volume":"7","author":"MH Lee","year":"2023","unstructured":"Lee, M.H., Chew, C.J.: Understanding the effect of counterfactual explanations on trust and reliance on ai for human-ai collaborative clinical decision making. Proc. ACM Human-Comput. Interact. 7(CSCW2), 1\u201322 (2023). https:\/\/doi.org\/10.1145\/3610218","journal-title":"Proc. ACM Human-Comput. Interact."},{"key":"12_CR25","doi-asserted-by":"publisher","unstructured":"Militello, L.G., et al.: Using human factors methods to mitigate bias in artificial intelligence-based clinical decision support. J. Am. Med. Inform. Association : JAMIA 32(2), 398\u2013403 (2025). https:\/\/doi.org\/10.1093\/jamia\/ocae291, https:\/\/typeset.io\/papers\/using-human-factors-methods-to-mitigate-bias-in-artificial-fi7chdxvr4yk","DOI":"10.1093\/jamia\/ocae291"},{"issue":"1","key":"12_CR26","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1177\/0013164415580432","volume":"76","author":"C Muth","year":"2016","unstructured":"Muth, C., Bales, K.L., Hinde, K., Maninger, N., Mendoza, S.P., Ferrer, E.: Alternative models for small samples in psychological research: applying linear mixed effects models and generalized estimating equations to repeated measures data. Educ. Psychol. Measur. 76(1), 64\u201387 (2016). https:\/\/doi.org\/10.1177\/0013164415580432","journal-title":"Educ. Psychol. Measur."},{"issue":"4","key":"12_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3495013","volume":"29","author":"A Papenmeier","year":"2022","unstructured":"Papenmeier, A., Kern, D., Englebienne, G., Seifert, C.: It\u2019s complicated: The relationship between user trust, model accuracy and explanations in ai. ACM Trans. Comput.-Human Interact. (TOCHI) 29(4), 1\u201333 (2022)","journal-title":"ACM Trans. Comput.-Human Interact. (TOCHI)"},{"key":"12_CR28","doi-asserted-by":"crossref","unstructured":"Pulivarthy, P., Whig, P.: Bias and fairness addressing discrimination in ai systems. In: Ethical Dimensions of AI Development, pp. 103\u2013126. IGI Global (2025)","DOI":"10.4018\/979-8-3693-4147-6.ch005"},{"key":"12_CR29","doi-asserted-by":"crossref","unstructured":"Rosenthal-von\u00a0der P\u00fctten, A.M., Sach, A.: Michael is better than mehmet: exploring the perils of algorithmic biases and selective adherence to advice from automated decision support systems in hiring. Front. Psychol. 15, 1416504 (2024)","DOI":"10.3389\/fpsyg.2024.1416504"},{"key":"12_CR30","unstructured":"R Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2024), https:\/\/www.R-project.org\/"},{"key":"12_CR31","doi-asserted-by":"publisher","unstructured":"Rasiklal Yadav, B.: The ethics of understanding: exploring moral implications of explainable ai. Inter. J. Sci. Res. (IJSR) 13(6), 1\u20137 (2024). https:\/\/doi.org\/10.21275\/SR24529122811","DOI":"10.21275\/SR24529122811"},{"key":"12_CR32","doi-asserted-by":"crossref","unstructured":"Rombach, R., Blattmann, A., Lorenz, D., Esser, P., Ommer, B.: High-resolution image synthesis with latent diffusion models. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pp. 10684\u201310695 (2022)","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"12_CR33","unstructured":"R\u00fcttgers, S., Kuhl, U., Paa\u00dfen, B.: Automatic matchmaking in two-versus-two sports. In: Proceedings of the 17th International Conference on Educational Data Mining, pp. 458\u2013468 (2024)"},{"key":"12_CR34","doi-asserted-by":"publisher","first-page":"1151150","DOI":"10.3389\/fcomp.2023.1151150","volume":"5","author":"N Scharowski","year":"2023","unstructured":"Scharowski, N., Perrig, S.A., Svab, M., Opwis, K., Br\u00fchlmann, F.: Exploring the effects of human-centered ai explanations on trust and reliance. Front. Comput. Sci. 5, 1151150 (2023)","journal-title":"Front. Comput. Sci."},{"key":"12_CR35","doi-asserted-by":"crossref","unstructured":"Schemmer, M., Kuehl, N., Benz, C., Bartos, A., Satzger, G.: Appropriate reliance on ai advice: conceptualization and the effect of explanations. In: Proceedings of the 28th International Conference on Intelligent User Interfaces, pp. 410\u2013422 (2023)","DOI":"10.1145\/3581641.3584066"},{"key":"12_CR36","doi-asserted-by":"publisher","unstructured":"Suffian, M., Kuhl, U., Alonso-Moral, J.M., Bogliolo, A.: Cl-xai: toward enriched cognitive learning with explainable artificial intelligence. In: International Conference on Software Engineering and Formal Methods, pp. 5\u201327. Springer (2023). https:\/\/doi.org\/10.1007\/978-3-031-66021-4_1","DOI":"10.1007\/978-3-031-66021-4_1"},{"key":"12_CR37","doi-asserted-by":"publisher","unstructured":"Thalpage, N.: Unlocking the black box: Explainable artificial intelligence (xai) for trust and transparency in ai systems. J. Digital Art & Humanities 4(1), 31\u201336 (2023). https:\/\/doi.org\/10.33847\/2712-8148.4.1_4","DOI":"10.33847\/2712-8148.4.1_4"},{"key":"12_CR38","doi-asserted-by":"publisher","unstructured":"VanNostrand, P.M., Hofmann, D.M., Ma, L., Genin, B., Huang, R., Rundensteiner, E.A.: Counterfactual explanation analytics: empowering lay users to take action against consequential automated decisions. Proc. VLDB Endowment 17(12), 4349\u20134352 (2024). https:\/\/doi.org\/10.14778\/3685800.3685872","DOI":"10.14778\/3685800.3685872"},{"issue":"1","key":"12_CR39","doi-asserted-by":"publisher","first-page":"15737","DOI":"10.1038\/s41598-023-42384-8","volume":"13","author":"L Vicente","year":"2023","unstructured":"Vicente, L., Matute, H.: Humans inherit artificial intelligence biases. Sci. Rep. 13(1), 15737 (2023)","journal-title":"Sci. Rep."},{"key":"12_CR40","doi-asserted-by":"crossref","unstructured":"Wang, C., et al.: Counterfactual explanations in explainable ai: a tutorial. In: Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pp. 4080\u20134081 (2021)","DOI":"10.1145\/3447548.3470797"},{"key":"12_CR41","doi-asserted-by":"crossref","unstructured":"Wang, X., Yin, M.: Are explanations helpful? a comparative study of the effects of explanations in ai-assisted decision-making. In: Proceedings of the 26th International Conference on Intelligent User Interfaces, pp. 318\u2013328 (2021)","DOI":"10.1145\/3397481.3450650"},{"issue":"4","key":"12_CR42","doi-asserted-by":"publisher","first-page":"2079","DOI":"10.1007\/s12525-022-00593-5","volume":"32","author":"J Wanner","year":"2022","unstructured":"Wanner, J., Herm, L.V., Heinrich, K., Janiesch, C.: The effect of transparency and trust on intelligent system acceptance: evidence from a user-based study. Electron. Mark. 32(4), 2079\u20132102 (2022)","journal-title":"Electron. Mark."},{"issue":"4","key":"12_CR43","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3673907","volume":"14","author":"G Warren","year":"2024","unstructured":"Warren, G., Byrne, R.M., Keane, M.T.: Categorical and continuous features in counterfactual explanations of ai systems. ACM Trans. Interactive Intell. Syst. 14(4), 1\u201337 (2024)","journal-title":"ACM Trans. Interactive Intell. Syst."}],"container-title":["Communications in Computer and Information Science","Explainable Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-032-08333-3_12","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T05:22:38Z","timestamp":1760764958000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-032-08333-3_12"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,19]]},"ISBN":["9783032083326","9783032083333"],"references-count":43,"URL":"https:\/\/doi.org\/10.1007\/978-3-032-08333-3_12","relation":{},"ISSN":["1865-0929","1865-0937"],"issn-type":[{"value":"1865-0929","type":"print"},{"value":"1865-0937","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,19]]},"assertion":[{"value":"19 October 2025","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Disclosure of Interests"}},{"value":"xAI","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"World Conference on Explainable Artificial Intelligence","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Istanbul","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"T\u00fcrkiye","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2025","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"9 July 2025","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"11 July 2025","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"3","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"xai2025","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/xaiworldconference.com\/2025\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}