{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,5]],"date-time":"2026-01-05T07:31:56Z","timestamp":1767598316512,"version":"3.44.0"},"publisher-location":"New York, NY, USA","reference-count":129,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,4,25]],"date-time":"2025-04-25T00:00:00Z","timestamp":1745539200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2007501"],"award-info":[{"award-number":["2007501"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"The Digital Transformation and Innovation Center at Carnegie Mellon University sponsored by PwC"},{"name":"UL Research Institutes through the Center for Advancing Safety of Machine Intelligence"},{"DOI":"10.13039\/100008047","name":"Carnegie Mellon University President's Postdoctoral Fellowship Program (PPFP)","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008047","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,4,26]]},"DOI":"10.1145\/3706598.3714098","type":"proceedings-article","created":{"date-parts":[[2025,4,23]],"date-time":"2025-04-23T23:30:09Z","timestamp":1745451009000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5566-7409","authenticated-orcid":false,"given":"Devansh","family":"Saxena","sequence":"first","affiliation":[{"name":"The Information School, University of Wisconsin-Madison, Madison, Wisconsin, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9896-1760","authenticated-orcid":false,"given":"Ji-Youn","family":"Jung","sequence":"additional","affiliation":[{"name":"Human Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7161-075X","authenticated-orcid":false,"given":"Jodi","family":"Forlizzi","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6730-922X","authenticated-orcid":false,"given":"Kenneth","family":"Holstein","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5299-8157","authenticated-orcid":false,"given":"John","family":"Zimmerman","sequence":"additional","affiliation":[{"name":"HCI Institute, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,4,25]]},"reference":[{"key":"e_1_3_3_3_2_2","doi-asserted-by":"crossref","unstructured":"Wilhelmina\u00a0Afua Addy Adeola\u00a0Olusola Ajayi-Nifise Binaebi\u00a0Gloria Bello Sunday\u00a0Tubokirifuruar Tula Olubusola Odeyemi and Titilola Falaiye. 2024. Machine learning in financial markets: A critical review of algorithmic trading and risk management. Int. J. Sci. Res. Arch. 11 1 (Feb. 2024) 1853\u20131862.","DOI":"10.30574\/ijsra.2024.11.1.0292"},{"key":"e_1_3_3_3_3_2","unstructured":"Algorithmic AI Automation Incidents and Controversies\u00a0(AIAAIC) database. 2009. Pedestrian following Google Maps hit by motorcyclist. https:\/\/shorturl.at\/bL6NC (2009)."},{"key":"e_1_3_3_3_4_2","unstructured":"Algorithmic AI Automation Incidents and Controversies\u00a0(AIAAIC) database. 2022. US man dies driving off collapsed bridge while following Google Maps. https:\/\/shorturl.at\/7peNd (2022)."},{"key":"e_1_3_3_3_5_2","unstructured":"Vasudeva Akula. 2021. Why Your AI Project Is Failing To Deliver Value. https:\/\/www.forbes.com\/councils\/forbestechcouncil\/2021\/04\/13\/why-your-ai-project-is-failing-to-deliver-value\/. Accessed: 2024-9-12."},{"key":"e_1_3_3_3_6_2","doi-asserted-by":"crossref","unstructured":"Scott\u00a0W Allard Emily\u00a0R Wiegand Colleen Schlecht A\u00a0Rupa Datta Robert\u00a0M Goerge and Elizabeth Weigensberg. 2018. State agencies\u2019 use of administrative data for improved practice: Needs challenges and opportunities: State agencies\u2019 use of administrative data for improved practice: Needs challenges and opportunities. Public Adm. Rev. 78 2 (March 2018) 240\u2013250.","DOI":"10.1111\/puar.12883"},{"key":"e_1_3_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5285"},{"key":"e_1_3_3_3_8_2","first-page":"1","volume-title":"9th Annual conference of the special interest group for computing, information and society","author":"Barocas Solon","year":"2017","unstructured":"Solon Barocas, Kate Crawford, Aaron Shapiro, and Hanna Wallach. 2017. The problem with bias: Allocative versus representational harms in machine learning. In 9th Annual conference of the special interest group for computing, information and society. New York, NY, 1."},{"key":"e_1_3_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581101"},{"key":"e_1_3_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445481"},{"key":"e_1_3_3_3_11_2","unstructured":"Klinton Bicknell. 2020. Learning how to help you learn: Introducing Birdbrain! https:\/\/blog.duolingo.com\/learning-how-to-help-you-learn-introducing-birdbrain\/. Accessed: 2024-8-14."},{"key":"e_1_3_3_3_12_2","doi-asserted-by":"crossref","unstructured":"Su\u00a0Lin Blodgett Solon Barocas Hal Daum\u00e9\u00a0III and Hanna Wallach. 2020. Language (technology) is power: A critical survey of\" bias\" in nlp. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2005.14050 (2020).","DOI":"10.18653\/v1\/2020.acl-main.485"},{"key":"e_1_3_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3516502"},{"key":"e_1_3_3_3_14_2","unstructured":"Taxiarchis Botsis Gunnar Hartvigsen Fei Chen and Chunhua Weng. 2010. Secondary use of EHR: Data quality issues and informatics opportunities. Summit On Translat. Bioinforma. 2010 (March 2010) 1\u20135."},{"key":"e_1_3_3_3_15_2","unstructured":"Margarita Boyarskaya Alexandra Olteanu and Kate Crawford. 2020. Overcoming failures of imagination in AI infused system development and deployment. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2011.13416 (2020)."},{"key":"e_1_3_3_3_16_2","unstructured":"Lydia\u00a0XZ Brown. 2023. Hiring Discrimination by Algorithm: A New Frontier for Civil Rights and Labor Law. Human Rights 49 1-2 (2023) 16\u201316."},{"key":"e_1_3_3_3_17_2","volume-title":"Unmasking AI: My mission to protect what is human in a world of machines","author":"Buolamwini Joy","year":"2023","unstructured":"Joy Buolamwini. 2023. Unmasking AI: My mission to protect what is human in a world of machines. Random House, New York, NY."},{"key":"e_1_3_3_3_18_2","volume-title":"Sketching user experiences: getting the design right and the right design","author":"Buxton Bill","year":"2010","unstructured":"Bill Buxton. 2010. Sketching user experiences: getting the design right and the right design. Morgan kaufmann."},{"key":"e_1_3_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501831"},{"key":"e_1_3_3_3_20_2","doi-asserted-by":"crossref","unstructured":"Alexandra Chouldechova. 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big Data 5 2 (June 2017) 153\u2013163.","DOI":"10.1089\/big.2016.0047"},{"key":"e_1_3_3_3_21_2","unstructured":"Jon Christian. 2023. Magazine Publishes Serious Errors in First AI-Generated Health Article. https:\/\/futurism.com\/neoscope\/magazine-mens-journal-errors-ai-health-article. Accessed: 2024-8-11."},{"key":"e_1_3_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3461702.3462519"},{"key":"e_1_3_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/SaTML54575.2023.00050"},{"key":"e_1_3_3_3_24_2","unstructured":"Kate Crawford. 2017. The trouble with bias. In Conference on Neural Information Processing Systems (NeurIPS) (2017)."},{"key":"e_1_3_3_3_25_2","doi-asserted-by":"crossref","unstructured":"Ernest Davis. 2016. AI amusements: the tragic tale of Tay the chatbot. AI Matters 2 4 (2016) 20\u201324.","DOI":"10.1145\/3008665.3008674"},{"key":"e_1_3_3_3_26_2","doi-asserted-by":"crossref","unstructured":"R\u00a0M Dawes D Faust and P\u00a0E Meehl. 1989. Clinical versus actuarial judgment. Science 243 4899 (March 1989) 1668\u20131674.","DOI":"10.1126\/science.2648573"},{"key":"e_1_3_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376638"},{"key":"e_1_3_3_3_28_2","unstructured":"Gerrit De\u00a0Vynck. [n. d.]. Duolingo cuts workers as it relies more on AI."},{"key":"e_1_3_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3617694.3623261"},{"key":"e_1_3_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581026"},{"key":"e_1_3_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594037"},{"key":"e_1_3_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025739"},{"key":"e_1_3_3_3_33_2","first-page":"2803","volume-title":"International conference on machine learning","author":"Dutta Sanghamitra","year":"2020","unstructured":"Sanghamitra Dutta, Dennis Wei, Hazar Yueksel, Pin-Yu Chen, Sijia Liu, and Kush Varshney. 2020. Is there a trade-off between fairness and accuracy? a perspective using mismatched hypothesis testing. In International conference on machine learning. PMLR, 2803\u20132813."},{"key":"e_1_3_3_3_34_2","unstructured":"M Elisco. 2024. Natural Language Processing Unlocks the DatainCase Notes. Children\u2019s Voice Magazine 33 1 (2024) 22\u201324."},{"key":"e_1_3_3_3_35_2","unstructured":"Madeleine\u00a0Clare Elish and Elizabeth Watkins. 2020. A Study of Integrating AI in Clinical Care. Data and Society (2020)."},{"key":"e_1_3_3_3_36_2","unstructured":"Virginia\u00a0E Eubanks. 2018. Automating Inequality: How high-tech tools profile police and punish the poor. (Jan. 2018)."},{"key":"e_1_3_3_3_37_2","unstructured":"EvidentlyAI. [n. d.]. Evidently AI - ML and LLM system design: 450 case studies."},{"key":"e_1_3_3_3_38_2","doi-asserted-by":"crossref","unstructured":"Hadiyapreview Author Details;\u00a0Dutta Faheem. 2023. Artificial intelligence failure at IBM \u2019Watson for oncology\u2019. IUP Journal of Knowledge Management 21 3 (July 2023) 47\u201375.","DOI":"10.1109\/ICMAIL59311.2023.10347547"},{"key":"e_1_3_3_3_39_2","unstructured":"Grant Fergusson. 2023. Outsourced and Automated: How AI Companies Have Taken Over Government Decision-Making. EPIC.ORG (2023)."},{"key":"e_1_3_3_3_40_2","first-page":"2","volume-title":"Proceedings of The Eleventh International Society for Music Information Retrieval Conference (ISMIR 2010)(Utrecht)","volume":"3","author":"Fiebrink Rebecca","year":"2010","unstructured":"Rebecca Fiebrink and Perry\u00a0R Cook. 2010. The Wekinator: a system for real-time, interactive machine learning in music. In Proceedings of The Eleventh International Society for Music Information Retrieval Conference (ISMIR 2010)(Utrecht) , Vol.\u00a03. Citeseer, 2\u20131."},{"key":"e_1_3_3_3_41_2","doi-asserted-by":"crossref","unstructured":"Ana Cristina\u00a0Bicharra Garcia Marcio Gomes\u00a0Pinto Garcia and Roberto Rigobon. 2024. Algorithmic discrimination in the credit domain: what do we know about it? AI & SOCIETY 39 4 (2024) 2059\u20132098.","DOI":"10.1007\/s00146-023-01676-3"},{"key":"e_1_3_3_3_42_2","doi-asserted-by":"crossref","unstructured":"Timnit Gebru Jamie Morgenstern Briana Vecchione Jennifer\u00a0Wortman Vaughan Hanna Wallach Hal\u00a0Daum\u00e9 Iii and Kate Crawford. 2021. Datasheets for datasets. Commun. ACM 64 12 (2021) 86\u201392.","DOI":"10.1145\/3458723"},{"key":"e_1_3_3_3_43_2","volume-title":"Multi-asset risk modeling: Techniques for a global economy in an electronic and algorithmic trading era","author":"Glantz Morton","year":"2014","unstructured":"Morton Glantz and Robert Kissell. 2014. Multi-asset risk modeling: Techniques for a global economy in an electronic and algorithmic trading era. Academic Press."},{"key":"e_1_3_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594036"},{"key":"e_1_3_3_3_45_2","doi-asserted-by":"crossref","unstructured":"Paul Hager Friederike Jungmann Robbie Holland Kunal Bhagat Inga Hubrecht Manuel Knauer Jakob Vielhauer Marcus Makowski Rickmer Braren Georgios Kaissis et\u00a0al. 2024. Evaluation and mitigation of the limitations of large language models in clinical decision-making. Nature medicine (2024) 1\u201310.","DOI":"10.1101\/2024.01.26.24301810"},{"key":"e_1_3_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642738"},{"key":"e_1_3_3_3_47_2","unstructured":"Will\u00a0Douglas Heaven. 2022. Why Meta\u2019s latest large language model survived only three days online. https:\/\/www.technologyreview.com\/2022\/11\/18\/1063487\/meta-large-language-model-ai-only-survived-three-days-gpt-3-science\/. Accessed: 2024-9-12."},{"key":"e_1_3_3_3_48_2","unstructured":"Parker Henry. 2023. How Duolingo uses AI to create lessons faster. https:\/\/blog.duolingo.com\/large-language-model-duolingo-lessons\/. Accessed: 2024-8-14."},{"key":"e_1_3_3_3_49_2","unstructured":"Sally Ho and Garance Burke. 2022. An algorithm that screens for child neglect raises concerns. https:\/\/apnews.com\/article\/child-welfare-algorithm-investigation-9497ee937e0053ad4144a86c68241ef1. Accessed: 2024-8-8."},{"key":"e_1_3_3_3_50_2","unstructured":"Sally Ho and Garance Burke. 2023. Child welfare algorithm faces Justice Department scrutiny. https:\/\/apnews.com\/article\/justice-scrutinizes-pittsburgh-child-welfare-ai-tool-4f61f45bfc3245fd2556e886c2da988b. Accessed: 2024-8-8."},{"key":"e_1_3_3_3_51_2","doi-asserted-by":"crossref","unstructured":"Lars\u00a0Erik Holmquist. 2017. Intelligence on tap: artificial intelligence as a new design material. interactions 24 4 (2017) 28\u201333.","DOI":"10.1145\/3085571"},{"key":"e_1_3_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_3_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3419249.3420149"},{"key":"e_1_3_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098038"},{"key":"e_1_3_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533233"},{"key":"e_1_3_3_3_56_2","doi-asserted-by":"crossref","unstructured":"Steven\u00a0J Jackson. 2014. Rethinking repair. (2014).","DOI":"10.7551\/mitpress\/9780262525374.003.0011"},{"key":"e_1_3_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445901"},{"key":"e_1_3_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3569009.3572739"},{"key":"e_1_3_3_3_59_2","first-page":"2439","volume-title":"International Conference on Machine Learning","author":"Kallus Nathan","year":"2018","unstructured":"Nathan Kallus and Angela Zhou. 2018. Residual unfairness in fair machine learning from prejudiced data. In International Conference on Machine Learning. PMLR, 2439\u20132448."},{"key":"e_1_3_3_3_60_2","doi-asserted-by":"crossref","unstructured":"Hyeonsu\u00a0B Kang Xin Qian Tom Hope Dafna Shahaf Joel Chan and Aniket Kittur. 2022. Augmenting scientific creativity with an analogical search engine. ACM Transactions on Computer-Human Interaction 29 6 (2022) 1\u201336.","DOI":"10.1145\/3530013"},{"key":"e_1_3_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642849"},{"key":"e_1_3_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517439"},{"key":"e_1_3_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3532106.3533556"},{"key":"e_1_3_3_3_64_2","unstructured":"John Kell. 2024. The CEO and AI: What\u2019s ahead in 2024. https:\/\/fortune.com\/2024\/01\/12\/ai-playbook-c-suite-ceo\/. Accessed: 2024-9-12."},{"key":"e_1_3_3_3_65_2","doi-asserted-by":"crossref","unstructured":"Aniket Kittur Lixiu Yu Tom Hope Joel Chan Hila Lifshitz-Assaf Karni Gilon Felicia Ng Robert\u00a0E Kraut and Dafna Shahaf. 2019. Scaling up analogical innovation with crowds and AI. Proceedings of the National Academy of Sciences 116 6 (2019) 1870\u20131877.","DOI":"10.1073\/pnas.1807185116"},{"key":"e_1_3_3_3_66_2","doi-asserted-by":"crossref","unstructured":"Jon Kleinberg Himabindu Lakkaraju Jure Leskovec Jens Ludwig and Sendhil Mullainathan. 2018. Human decisions and machine predictions. The quarterly journal of economics 133 1 (2018) 237\u2013293.","DOI":"10.1093\/qje\/qjx032"},{"key":"e_1_3_3_3_67_2","unstructured":"Jon Kleinberg Sendhil Mullainathan and Manish Raghavan. 2016. Inherent trade-offs in the fair determination of risk scores. arXiv [cs.LG] (Sept. 2016)."},{"key":"e_1_3_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533207"},{"key":"e_1_3_3_3_69_2","doi-asserted-by":"crossref","unstructured":"Sean Kross and Philip Guo. 2021. Orienting framing bridging magic and counseling: How data scientists navigate the outer loop of client collaborations in industry and academia. Proc. ACM Hum. Comput. Interact. 5 CSCW2 (Oct. 2021) 1\u201328.","DOI":"10.1145\/3476052"},{"key":"e_1_3_3_3_70_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580882"},{"key":"e_1_3_3_3_71_2","unstructured":"Vivian Lai Chacha Chen Q\u00a0Vera Liao Alison Smith-Renner and Chenhao Tan. 2021. Towards a science of human-ai decision making: a survey of empirical studies. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2112.11471 (2021)."},{"key":"e_1_3_3_3_72_2","doi-asserted-by":"crossref","unstructured":"Ana\u00a0Alves Leal. 2024. Algorithms Creditworthiness and Lending Decisions Check for updates. Legal Aspects of Autonomous Systems: A Comparative Approach 4 (2024) 321.","DOI":"10.1007\/978-3-031-47946-5_17"},{"key":"e_1_3_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.5555\/3698900.3699173"},{"key":"e_1_3_3_3_74_2","unstructured":"Wayne\u00a0A Logan A Ferguson and A Ferguson. 2016. Policing Criminal Justice Data. Minnesota Law Review 101 2 (April 2016) 541."},{"key":"e_1_3_3_3_75_2","doi-asserted-by":"crossref","unstructured":"Jens Ludwig and Sendhil Mullainathan. 2021. Fragile algorithms and fallible decision-makers: lessons from the justice system. Journal of Economic Perspectives 35 4 (2021) 71\u201396.","DOI":"10.1257\/jep.35.4.71"},{"key":"e_1_3_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641954"},{"key":"e_1_3_3_3_77_2","unstructured":"L Marconi F Cabitza et\u00a0al. 2024. The Challenges and Promises of Artifcial Intelligence in the Contemporary Society: A Critical Perspective. URBANIANA UNIVERSITY JOURNAL 2 (2024) 83\u2013104."},{"key":"e_1_3_3_3_78_2","doi-asserted-by":"publisher","DOI":"10.1037\/11281-000"},{"key":"e_1_3_3_3_79_2","unstructured":"Sara Merken. 2023. New York lawyers sanctioned for using fake ChatGPT cases in legal brief | Reuters. https:\/\/www.reuters.com\/legal\/new-york-lawyers-sanctioned-using-fake-chatgpt-cases-legal-brief-2023-06-22\/"},{"key":"e_1_3_3_3_80_2","doi-asserted-by":"crossref","unstructured":"Dana\u00eb Metaxa Joon\u00a0Sung Park Ronald\u00a0E Robertson Karrie Karahalios Christo Wilson Jeff Hancock Christian Sandvig et\u00a0al. 2021. Auditing algorithms: Understanding algorithmic systems from the outside in. Foundations and Trends\u00ae in Human\u2013Computer Interaction 14 4 (2021) 272\u2013344.","DOI":"10.1561\/1100000083"},{"key":"e_1_3_3_3_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_3_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642392"},{"key":"e_1_3_3_3_83_2","doi-asserted-by":"crossref","unstructured":"Ziad Obermeyer Brian Powers Christine Vogeli and Sendhil Mullainathan. 2019. Dissecting racial bias in an algorithm used to manage the health of populations. Science 366 6464 (2019) 447\u2013453.","DOI":"10.1126\/science.aax2342"},{"key":"e_1_3_3_3_84_2","unstructured":"Emily Olson. 2023. Google shares drop $100 billion after its new AI chatbot makes a mistake. NPR (Feb. 2023)."},{"key":"e_1_3_3_3_85_2","doi-asserted-by":"crossref","unstructured":"Raja Parasuraman Thomas\u00a0B Sheridan and Christopher\u00a0D Wickens. 2000. A model for types and levels of human interaction with automation. IEEE Transactions on systems man and cybernetics-Part A: Systems and Humans 30 3 (2000) 286\u2013297.","DOI":"10.1109\/3468.844354"},{"key":"e_1_3_3_3_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287567"},{"key":"e_1_3_3_3_87_2","unstructured":"Keely Quinlan. 2024. Nonprofit behind FTC complaint about automated fraud-detection software hopes for more responsible AI use. http:\/\/statescoop.com\/nonprofit-ftc-complaint-automated-benefits-responsible-ai\/. Accessed: 2024-8-12."},{"key":"e_1_3_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533158"},{"key":"e_1_3_3_3_89_2","unstructured":"Rahul Rao. 2022. The Dutch Tax Authority Was Felled by AI\u2014What Comes Next? https:\/\/spectrum.ieee.org\/artificial-intelligence-in-government. Accessed: 2024-8-12."},{"key":"e_1_3_3_3_90_2","unstructured":"Reuters. [n. d.]. Thomson Reuters Risk & Fraud Solutions for financial institutions."},{"key":"e_1_3_3_3_91_2","doi-asserted-by":"crossref","unstructured":"Isadora\u00a0Neroni Rezende. 2020. Facial recognition in police hands: Assessing the \u2018Clearview case\u2019from a European perspective. New Journal of European Criminal Law 11 3 (2020) 375\u2013389.","DOI":"10.1177\/2032284420948161"},{"key":"e_1_3_3_3_92_2","doi-asserted-by":"crossref","unstructured":"Kat Roemmich Tillie Rosenberg Serena Fan and Nazanin Andalibi. 2023. Values in emotion artificial intelligence hiring services: Technosolutions to organizational problems. Proceedings of the ACM on Human-Computer Interaction 7 CSCW1 (2023) 1\u201328.","DOI":"10.1145\/3579543"},{"key":"e_1_3_3_3_93_2","doi-asserted-by":"crossref","unstructured":"Cynthia Rudin Caroline Wang and Beau Coker. 2020. The age of secrecy and unfairness in recidivism prediction. Harvard Data Science Review 2 1 (2020) 1.","DOI":"10.1162\/99608f92.6ed64b30"},{"key":"e_1_3_3_3_94_2","unstructured":"Mia Sato. 2023. CNET is overhauling its AI policy and updating past stories. https:\/\/www.theverge.com\/2023\/6\/6\/23750761\/cnet-ai-generated-stories-policy-update. Accessed: 2024-8-11."},{"key":"e_1_3_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376229"},{"key":"e_1_3_3_3_96_2","doi-asserted-by":"crossref","unstructured":"Devansh Saxena Karla Badillo-Urquiola Pamela\u00a0J Wisniewski and Shion Guha. 2021. A framework of high-stakes algorithmic decision-making for the public sector developed through a case study of child-welfare. Proceedings of the ACM on Human-Computer Interaction 5 CSCW2 (2021) 1\u201341.","DOI":"10.1145\/3476089"},{"key":"e_1_3_3_3_97_2","doi-asserted-by":"crossref","unstructured":"Devansh Saxena and Shion Guha. 2024. Algorithmic harms in child welfare: Uncertainties in practice organization and street-level decision-making. ACM Journal on Responsible Computing 1 1 (2024) 1\u201332.","DOI":"10.1145\/3616473"},{"key":"e_1_3_3_3_98_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581308"},{"key":"e_1_3_3_3_99_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517742"},{"key":"e_1_3_3_3_100_2","first-page":"83","volume-title":"Unity in diversity","author":"Sch\u00e4ffner Christina","year":"2016","unstructured":"Christina Sch\u00e4ffner. 2016. Parallel texts in translation. In Unity in diversity. Routledge, 83\u201390."},{"key":"e_1_3_3_3_101_2","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287598"},{"key":"e_1_3_3_3_102_2","unstructured":"Denton Shanks Tina Shah Taina Hudson Jeffrey Thompson Tanya Filardi Kelli Wright Greg Ator Timothy\u00a0Ryan Smith and Michael Albrecht. 2024. Enhancing clinical documentation workflow with ambient artificial intelligence: Clinician perspectives on work burden burnout and job satisfaction. bioRxiv (Aug. 2024)."},{"key":"e_1_3_3_3_103_2","doi-asserted-by":"publisher","DOI":"10.1145\/3600211.3604673"},{"key":"e_1_3_3_3_104_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533110"},{"key":"e_1_3_3_3_105_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-23223-7_2"},{"key":"e_1_3_3_3_106_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533177"},{"key":"e_1_3_3_3_107_2","doi-asserted-by":"publisher","DOI":"10.1145\/3461778.3462012"},{"key":"e_1_3_3_3_108_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533132"},{"volume-title":"Introducing Duolingo Max, a learning experience powered by GPT-4","author":"Duolingo Team","key":"e_1_3_3_3_109_2","unstructured":"Team Duolingo. [n. d.]. Introducing Duolingo Max, a learning experience powered by GPT-4."},{"key":"e_1_3_3_3_110_2","unstructured":"Zeynep Tufekci. 2015. Algorithmic harms beyond Facebook and Google: Emergent challenges of computational agency. Colo. Tech. LJ 13 (2015) 203."},{"key":"e_1_3_3_3_111_2","unstructured":"Olivia Ujlaki. 2024. How To Watch The Star Wars Movies and Shows in Order. https:\/\/www.wishesandwayfinding.com\/post\/how-to-watch-star-wars-movies-in-order. Accessed: 2024-8-14."},{"key":"e_1_3_3_3_112_2","unstructured":"Rhema Vaithianathan Emily Putnam-Hornstein and Diana Benavides-Prad. [n. d.]. Implementing the Hello Baby Prevention Program in Allegheny County. https:\/\/www.alleghenycountyanalytics.us\/wp-content\/uploads\/2020\/12\/Hello-Baby-Methodology-v6.pdf#page=2.29."},{"key":"e_1_3_3_3_113_2","unstructured":"T Vaithianathan R and Putnam-Hornstein E and Jiang N and Maloney. [n. d.]. Developing predictive models to support child maltreatment hotline screening decisions: Allegheny County methodology and implementation. ([n. d.])."},{"key":"e_1_3_3_3_114_2","unstructured":"Pranshu Verma. 2023. How an AI-written Star Wars story created chaos at Gizmodo. The Washington Post (July 2023)."},{"key":"e_1_3_3_3_115_2","doi-asserted-by":"publisher","DOI":"10.1145\/3616855.3635818"},{"key":"e_1_3_3_3_116_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533099"},{"key":"e_1_3_3_3_117_2","doi-asserted-by":"crossref","unstructured":"Angelina Wang Sayash Kapoor Solon Barocas and Arvind Narayanan. 2024. Against Predictive Optimization: On the Legitimacy of Decision-making Algorithms That Optimize Predictive Accuracy. ACM J. Responsib. Comput. 1 1 (March 2024) 1\u201345.","DOI":"10.1145\/3636509"},{"key":"e_1_3_3_3_118_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581278"},{"key":"e_1_3_3_3_119_2","volume-title":"Why AI\/data science projects fail: how to avoid project pitfalls","author":"Weiner Joyce","year":"2022","unstructured":"Joyce Weiner. 2022. Why AI\/data science projects fail: how to avoid project pitfalls. Springer Nature."},{"key":"e_1_3_3_3_120_2","doi-asserted-by":"crossref","unstructured":"Andrew Wong Erkin Otles John\u00a0P Donnelly Andrew Krumm Jeffrey McCullough Olivia DeTroyer-Cooley Justin Pestrue Marie Phillips Judy Konye Carleen Penoza Muhammad Ghous and Karandeep Singh. 2021. External validation of a widely implemented proprietary sepsis prediction model in hospitalized patients. JAMA Intern. Med. 181 8 (Aug. 2021) 1065\u20131070.","DOI":"10.1001\/jamainternmed.2021.2626"},{"key":"e_1_3_3_3_121_2","doi-asserted-by":"crossref","unstructured":"Richmond\u00a0Y Wong Michael\u00a0A Madaio and Nick Merrill. 2023. Seeing like a toolkit: How toolkits envision the work of AI ethics. Proceedings of the ACM on Human-Computer Interaction 7 CSCW1 (2023) 1\u201327.","DOI":"10.1145\/3579621"},{"key":"e_1_3_3_3_122_2","unstructured":"Rongwu Xu Zehan Qi Zhijiang Guo Cunxiang Wang Hongru Wang Yue Zhang and Wei Xu. 2024. Knowledge conflicts for LLMs: A survey. arXiv [cs.CL] (March 2024)."},{"key":"e_1_3_3_3_123_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300415"},{"key":"e_1_3_3_3_124_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376301"},{"key":"e_1_3_3_3_125_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300468"},{"key":"e_1_3_3_3_126_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517491"},{"key":"e_1_3_3_3_127_2","doi-asserted-by":"publisher","DOI":"10.1145\/3563657.3596058"},{"key":"e_1_3_3_3_128_2","doi-asserted-by":"crossref","unstructured":"Eric Zhou and Dokyun Lee. 2023. Generative AI human creativity and art. SSRN Electron. J. (Oct. 2023).","DOI":"10.2139\/ssrn.4594824"},{"key":"e_1_3_3_3_129_2","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240704"},{"key":"e_1_3_3_3_130_2","doi-asserted-by":"crossref","unstructured":"Stefan\u00eda \u00c6gisd\u00f3ttir Michael\u00a0J White Paul\u00a0M Spengler Alan\u00a0S Maugherman Linda\u00a0A Anderson Robert\u00a0S Cook Cassandra\u00a0N Nichols Georgios\u00a0K Lampropoulos Blain\u00a0S Walker Genna Cohen and Jeffrey\u00a0D Rush. 2006. The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. Couns. Psychol. 34 3 (May 2006) 341\u2013382.","DOI":"10.1177\/0011000005285875"}],"event":{"name":"CHI 2025: CHI Conference on Human Factors in Computing Systems","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"Yokohama Japan","acronym":"CHI '25"},"container-title":["Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706598.3714098","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/abs\/10.1145\/3706598.3714098","content-type":"text\/html","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3706598.3714098","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3706598.3714098","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,22]],"date-time":"2025-09-22T22:35:26Z","timestamp":1758580526000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706598.3714098"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,25]]},"references-count":129,"alternative-id":["10.1145\/3706598.3714098","10.1145\/3706598"],"URL":"https:\/\/doi.org\/10.1145\/3706598.3714098","relation":{},"subject":[],"published":{"date-parts":[[2025,4,25]]},"assertion":[{"value":"2025-04-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}