{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T10:07:54Z","timestamp":1783591674591,"version":"3.55.0"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T00:00:00Z","timestamp":1792108800000},"content-version":"vor","delay-in-days":365,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2333469, 2342438"],"award-info":[{"award-number":["2333469, 2342438"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,10,18]]},"abstract":"<jats:p>This study investigates how high school-aged youth engage in algorithm auditing to identify and understand biases in artificial intelligence and machine learning (AI\/ML) tools they encounter daily. With AI\/ML technologies being increasingly integrated into young people's lives, there is an urgent need to equip teenagers with AI literacies that build both technical knowledge and awareness of social impacts. Algorithm audits (also called AI audits) have traditionally been employed by experts to assess potential harmful biases, but recent research suggests that non-expert users can also participate productively in auditing. We conducted a two-week participatory design workshop with 14 teenagers (ages 14-15), where they audited the generative AI model behind TikTok's Effect House, a tool for creating interactive TikTok filters. We present a case study describing how teenagers approached the audit, from deciding what to audit to analyzing data using diverse strategies and communicating their results. Our findings show that participants were engaged and creative throughout the activities, independently raising and exploring new considerations, such as age-related biases, that are uncommon in professional audits. We drew on our expertise in algorithm auditing to triangulate their findings as a way to examine if the workshop supported participants to reach coherent conclusions in their audit. Although the resulting number of changes in race, gender, and age representation uncovered by the teens were slightly different from ours, we reached similar conclusions. This study highlights the potential for auditing to inspire learning activities to foster AI literacies, empower teenagers to critically examine AI systems, and contribute fresh perspectives to the study of algorithmic harms.<\/jats:p>","DOI":"10.1145\/3757620","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T16:59:10Z","timestamp":1760633950000},"page":"1-29","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Learning AI Auditing: A Case Study of Teenagers Auditing a Generative AI Model"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8777-2374","authenticated-orcid":false,"given":"Luis","family":"Morales-Navarro","sequence":"first","affiliation":[{"name":"University of Pennsylvania, Philadelphia, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6632-0021","authenticated-orcid":false,"given":"Michelle A.","family":"Gan","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-1655-6116","authenticated-orcid":false,"given":"Evelyn","family":"Yu","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2317-2513","authenticated-orcid":false,"given":"Lauren","family":"Vogelstein","sequence":"additional","affiliation":[{"name":"Teachers College, Columbia University, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4018-0491","authenticated-orcid":false,"given":"Yasmin","family":"Kafai","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9359-6090","authenticated-orcid":false,"given":"Dana\u00e9","family":"Metaxa","sequence":"additional","affiliation":[{"name":"University of Pennsylvania, Philadelphia, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,10,16]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Bobby Allyn Sylvia Goodman and Dara Kerr. 2024. TikTok executives know about app's effect on teens lawsuit documents allege. https:\/\/www.npr.org\/2024\/10\/11\/g-s1-27676\/tiktok-redacted-documents-in-teen-safety-lawsuit-revealed."},{"key":"e_1_2_1_2_1","volume-title":"Social Media and Technology","author":"Anderson Monica","year":"2023","unstructured":"Monica Anderson, Michelle Faverio, and Jeffrey Gottfried. 2023. Teens, Social Media and Technology 2023. Pew Research Center. https:\/\/www.pewresearch.org\/internet\/2023\/12\/11\/teens-social-media-and-technology-2023\/."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449148"},{"key":"e_1_2_1_4_1","volume-title":"Design: design matters in Participatory Design","author":"Bannon Liam J","unstructured":"Liam J Bannon and Pelle Ehn. 2012. Design: design matters in Participatory Design. In Routledge international handbook of participatory design. Routledge, New York, 37-63."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594095"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2021.100205"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3611659.3615707"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2940299.2940303"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research","volume":"91","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru. 2018. Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency (Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, 77-91. https:\/\/proceedings.mlr.press\/v81\/buolamwini18a.html"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444821993038"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1108\/ILS-03-2022-0024"},{"key":"e_1_2_1_12_1","volume-title":"The research act: A theoretical introduction to sociological methods","author":"Denzin Norman K","unstructured":"Norman K Denzin. 2017. The research act: A theoretical introduction to sociological methods. Routledge, New York."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517441"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijcci.2023.100599"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3639701.3663636"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3145472"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134680"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658959"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3078072.3079725"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2021.103652"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3476046"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702520"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3424000"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3555625"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610209"},{"key":"e_1_2_1_26_1","volume-title":"Mayra BC Maymone, and George Kroumpouzos","author":"Laughter Melissa R","year":"2023","unstructured":"Melissa R Laughter, Jaclyn B Anderson, Mayra BC Maymone, and George Kroumpouzos. 2023. Psychology of aesthetics: Beauty, social media, and body dysmorphic disorder. Clinics in dermatology, Vol. 41, 1 (2023), 28-32."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3501709.3544279"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392857"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376727"},{"key":"e_1_2_1_30_1","first-page":"56338","volume-title":"Levine (Eds.)","volume":"36","author":"Luccioni Sasha","year":"2023","unstructured":"Sasha Luccioni, Christopher Akiki, Margaret Mitchell, and Yacine Jernite. 2023. Stable Bias: Evaluating Societal Representations in Diffusion Models. In Advances in Neural Information Processing Systems, A. Oh, T. Naumann, A. Globerson, K. Saenko, M. Hardt, and S. Levine (Eds.), Vol. 36. Curran Associates, Inc., New Orleans, 56338-56351. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2023\/file\/b01153e7112b347d8ed54f317840d8af-Paper-Datasets_and_Benchmarks.pdf"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658932"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","unstructured":"Harvey Mannering. 2023. Analysing Gender Bias in Text-to-Image Models Using Object Detection. arXiv:2307.08025 [cs] doi:10.48550\/arXiv.2307.08025.","DOI":"10.48550\/arXiv.2307.08025"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359174"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449100"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1561\/9781680839173"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3628516.3655752"},{"key":"e_1_2_1_37_1","volume-title":"Past, Present and Future of Computing Education Research: A Global Perspective","author":"Morales-Navarro Luis","unstructured":"Luis Morales-Navarro and Yasmin B Kafai. 2023. Conceptualizing approaches to critical computing education: Inquiry, design, and reimagination. In Past, Present and Future of Computing Education Research: A Global Perspective. Springer, Cham, Switzerland, 521-538."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3677619.3678117"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v39i28.35192"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3600211.3604711"},{"key":"e_1_2_1_41_1","unstructured":"Leonardo Nicoletti and Diana Bass. 2023. Humans Are Biased. Generative AI Is Even Worse: Stable Diffusion's text-to-image model amplifies stereotypes about race and gender - here's why that matters. https:\/\/www.bloomberg.com\/graphics\/2023-generative-ai-bias\/."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3687043"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/2056305120965155"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3593013.3594134"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11625-024-01496-4"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3568813.3600110"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3706598.3713565"},{"key":"e_1_2_1_48_1","volume-title":"Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry","author":"Sandvig Christian","year":"2014","unstructured":"Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and discrimination: converting critical concerns into productive inquiry, Vol. 22, 2014 (2014), 4349-4357."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3563657.3596119"},{"key":"e_1_2_1_50_1","volume-title":"The reflective practitioner: How professionals think in action","author":"Sch\u00f6n Donald A","unstructured":"Donald A Sch\u00f6n. 2017. The reflective practitioner: How professionals think in action. Routledge, New York."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3479577"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415224"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.22318\/icls2024.307401"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610213"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2305.10566"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531146.3533132"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2447976.2447990"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3701199"},{"key":"e_1_2_1_59_1","unstructured":"TikTok. 2024. Effect Guidelines. https:\/\/effecthouse.tiktok.com\/learn\/guides\/general\/guidelines\/effect-guidelines."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.22318\/icls2025.630877"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449193"},{"key":"e_1_2_1_62_1","volume-title":"APA Handbook of Research Methods in Psychology","author":"Yin Robert K.","unstructured":"Robert K. Yin. 2012. Case study methods. In APA Handbook of Research Methods in Psychology, Vol. 2. Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological, H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, and K. J. Sher (Eds.). American Psychological Association, Washington, DC, 141-155."},{"key":"e_1_2_1_63_1","unstructured":"Robert K Yin. 2018. Case study research and applications."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/958160.958190"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","unstructured":"Yanzhe Zhang Lu Jiang Greg Turk and Diyi Yang. 2023. Auditing Gender Presentation Differences in Text-to-Image Models. arXiv:2302.03675 [cs] doi:10.48550\/arXiv.2302.03675.","DOI":"10.48550\/arXiv.2302.03675"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICBDSS51270.2020.00012"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3757620","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3757620","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T01:56:33Z","timestamp":1760666193000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3757620"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,16]]},"references-count":66,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,10,18]]}},"alternative-id":["10.1145\/3757620"],"URL":"https:\/\/doi.org\/10.1145\/3757620","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,16]]},"assertion":[{"value":"2025-10-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}