{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T19:34:42Z","timestamp":1781379282167,"version":"3.54.1"},"publisher-location":"New York, NY, USA","reference-count":69,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,27]],"date-time":"2022-04-27T00:00:00Z","timestamp":1651017600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF (National Science Foundation)","doi-asserted-by":"publisher","award":["1939606"],"award-info":[{"award-number":["1939606"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,27]]},"DOI":"10.1145\/3491102.3517439","type":"proceedings-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T16:33:27Z","timestamp":1651163607000},"page":"1-18","source":"Crossref","is-referenced-by-count":122,"title":["Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Support"],"prefix":"10.1145","author":[{"given":"Anna","family":"Kawakami","sequence":"first","affiliation":[{"name":"Human-Computer Interaction Institute, Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Venkatesh","family":"Sivaraman","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute, Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao-Fei","family":"Cheng","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute, Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Logan","family":"Stapleton","sequence":"additional","affiliation":[{"name":"Computer Science, University of Minnesota, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanghuidi","family":"Cheng","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute, Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diana","family":"Qing","sequence":"additional","affiliation":[{"name":"University of California, Berkeley, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam","family":"Perer","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute, Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiwei Steven","family":"Wu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haiyi","family":"Zhu","sequence":"additional","affiliation":[{"name":"Human Computer Interaction Institute, Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kenneth","family":"Holstein","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute, Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,4,28]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445740"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300760"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449114"},{"key":"e_1_3_2_2_4_1","volume-title":"Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 7, 1(2019)","author":"Bansal Gagan","year":"2019","unstructured":"Gagan Bansal , Besmira Nushi , Ece Kamar , Walter\u00a0 S Lasecki , Daniel\u00a0 S Weld , and Eric Horvitz . 2019 . Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance . Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 7, 1(2019) , 19. www.aaai.org Gagan Bansal, Besmira Nushi, Ece Kamar, Walter\u00a0S Lasecki, Daniel\u00a0S Weld, and Eric Horvitz. 2019. Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 7, 1(2019), 19. www.aaai.org"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445717"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979275"},{"key":"e_1_3_2_2_7_1","volume-title":"Contextual design. interactions 6, 1","author":"Beyer Hugh","year":"1999","unstructured":"Hugh Beyer and Karen Holtzblatt . 1999. Contextual design. interactions 6, 1 ( 1999 ), 32\u201342. Hugh Beyer and Karen Holtzblatt. 1999. Contextual design. interactions 6, 1 (1999), 32\u201342."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300271"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449287"},{"key":"e_1_3_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359206"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445308"},{"key":"e_1_3_2_2_12_1","unstructured":"Marc Cherna. [n.d.]. We will use all resources to keep children safe. Pittsburgh Post-Gazette([n. d.]). https:\/\/www.post-gazette.com\/opinion\/letters\/2018\/03\/23\/We-will-use-all-resources-to-keep-children-safe\/stories\/201803230094 Online; accessed 8-September-2021. Marc Cherna. [n.d.]. We will use all resources to keep children safe. Pittsburgh Post-Gazette([n. d.]). https:\/\/www.post-gazette.com\/opinion\/letters\/2018\/03\/23\/We-will-use-all-resources-to-keep-children-safe\/stories\/201803230094 Online; accessed 8-September-2021."},{"key":"e_1_3_2_2_13_1","first-page":"1","article-title":"A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions","volume":"81","author":"Chouldechova Alexandra","year":"2018","unstructured":"Alexandra Chouldechova , Emily Putnam-Hornstein , Suzanne Dworak-Peck , Diana Benavides-Prado , Oleksandr Fialko , Rhema Vaithianathan , Sorelle\u00a0 A Friedler , and Christo Wilson . 2018 . A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions . Proceedings of Machine Learning Research 81 (2018), 1 \u2013 15 . http:\/\/proceedings.mlr.press\/v81\/chouldechova18a.html Alexandra Chouldechova, Emily Putnam-Hornstein, Suzanne Dworak-Peck, Diana Benavides-Prado, Oleksandr Fialko, Rhema Vaithianathan, Sorelle\u00a0A Friedler, and Christo Wilson. 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. Proceedings of Machine Learning Research 81 (2018), 1\u201315. http:\/\/proceedings.mlr.press\/v81\/chouldechova18a.html","journal-title":"Proceedings of Machine Learning Research"},{"key":"e_1_3_2_2_14_1","volume-title":"Leveraging expert consistency to improve algorithmic decision support. arXiv","author":"De-Arteaga Maria","year":"2021","unstructured":"Maria De-Arteaga , Artur Dubrawski , and Alexandra Chouldechova . 2021. Leveraging expert consistency to improve algorithmic decision support. arXiv ( 2021 ), 1\u201333. arxiv:2101.09648http:\/\/arxiv.org\/abs\/2101.09648 Maria De-Arteaga, Artur Dubrawski, and Alexandra Chouldechova. 2021. Leveraging expert consistency to improve algorithmic decision support. arXiv (2021), 1\u201333. arxiv:2101.09648http:\/\/arxiv.org\/abs\/2101.09648"},{"key":"e_1_3_2_2_15_1","volume-title":"A case for humans-in-the-loop: Decisions in the presence of erroneous algorithmic scores. arXiv","author":"De-Arteaga Maria","year":"2020","unstructured":"Maria De-Arteaga , Riccardo Fogliato , and Alexandra Chouldechova . 2020. A case for humans-in-the-loop: Decisions in the presence of erroneous algorithmic scores. arXiv ( 2020 ), 1\u201312. Maria De-Arteaga, Riccardo Fogliato, and Alexandra Chouldechova. 2020. A case for humans-in-the-loop: Decisions in the presence of erroneous algorithmic scores. arXiv (2020), 1\u201312."},{"key":"e_1_3_2_2_16_1","first-page":"114","article-title":"Algorithm aversion: People erroneously avoid algorithms after seeing them err.Journal of Experimental Psychology","volume":"144","author":"Dietvorst J","year":"2015","unstructured":"Berkeley\u00a0 J Dietvorst , Joseph\u00a0 P Simmons , and Cade Massey . 2015 . Algorithm aversion: People erroneously avoid algorithms after seeing them err.Journal of Experimental Psychology : General 144 , 1 (2015), 114 . Berkeley\u00a0J Dietvorst, Joseph\u00a0P Simmons, and Cade Massey. 2015. Algorithm aversion: People erroneously avoid algorithms after seeing them err.Journal of Experimental Psychology: General 144, 1 (2015), 114.","journal-title":"General"},{"key":"e_1_3_2_2_17_1","volume-title":"Automating inequality: How high-tech tools profile, police, and punish the poor","author":"Eubanks Virginia","unstructured":"Virginia Eubanks . 2018. Automating inequality: How high-tech tools profile, police, and punish the poor . St. Martin\u2019s Press . Virginia Eubanks. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin\u2019s Press."},{"key":"e_1_3_2_2_18_1","volume-title":"The flaws of policies requiring human oversight of government algorithms. Available at SSRN","author":"Green Ben","year":"2021","unstructured":"Ben Green . 2021. The flaws of policies requiring human oversight of government algorithms. Available at SSRN ( 2021 ). Ben Green. 2021. The flaws of policies requiring human oversight of government algorithms. Available at SSRN (2021)."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359152"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Ron Haskins. 2020. Child welfare financing: What do we fund how and what could be improved?The ANNALS of the American Academy of Political and Social Science 692 1(2020) 50\u201367. Ron Haskins. 2020. Child welfare financing: What do we fund how and what could be improved?The ANNALS of the American Academy of Political and Social Science 692 1(2020) 50\u201367.","DOI":"10.1177\/0002716220970909"},{"key":"e_1_3_2_2_21_1","unstructured":"Kenneth Holstein and Vincent Aleven. 2021. Designing for human-AI complementarity in K-12 education. arXiv preprint arXiv:2104.01266(2021). Kenneth Holstein and Vincent Aleven. 2021. Designing for human-AI complementarity in K-12 education. arXiv preprint arXiv:2104.01266(2021)."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-52237-7_20"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395427"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93843-1_12"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.18608\/jla.2019.62.3"},{"key":"e_1_3_2_2_26_1","volume-title":"Shifting concepts of value: Designing algorithmic decision-support systems for public services. NordiCHI","author":"M\u00f8ller Naja Holten","year":"2020","unstructured":"Naja Holten M\u00f8ller , Irina Shklovski , and Thomas\u00a0 T. Hildebrandt . 2020. Shifting concepts of value: Designing algorithmic decision-support systems for public services. NordiCHI ( 2020 ), 1\u201312. https:\/\/doi.org\/10.1145\/3419249.3420149 Naja Holten M\u00f8ller, Irina Shklovski, and Thomas\u00a0T. Hildebrandt. 2020. Shifting concepts of value: Designing algorithmic decision-support systems for public services. NordiCHI (2020), 1\u201312. https:\/\/doi.org\/10.1145\/3419249.3420149"},{"key":"e_1_3_2_2_27_1","unstructured":"Dan Hurley. 2018. Can an algorithm tell when kids are in danger. New York Times 2(2018). Dan Hurley. 2018. Can an algorithm tell when kids are in danger. New York Times 2(2018)."},{"key":"e_1_3_2_2_28_1","unstructured":"D. Jackson and G. Marx. 2017. Data mining program designed to predict child abuse proves unreliable DCFS says.http:\/\/www.jstor.org\/stable\/10.7758\/9781610447713 D. Jackson and G. Marx. 2017. Data mining program designed to predict child abuse proves unreliable DCFS says.http:\/\/www.jstor.org\/stable\/10.7758\/9781610447713"},{"key":"e_1_3_2_2_29_1","unstructured":"Will Johnson. 2004. Effectiveness of California\u2019s child welfare Structured Decision-Making (SDM) model: A Prospective study of the validity of the California family risk assessment. Will Johnson. 2004. Effectiveness of California\u2019s child welfare Structured Decision-Making (SDM) model: A Prospective study of the validity of the California family risk assessment."},{"key":"e_1_3_2_2_30_1","volume-title":"Noise: A flaw in human judgment. Little, Brown.","author":"Kahneman Daniel","year":"2021","unstructured":"Daniel Kahneman , Olivier Sibony , and Cass\u00a0 R Sunstein . 2021 . Noise: A flaw in human judgment. Little, Brown. Daniel Kahneman, Olivier Sibony, and Cass\u00a0R Sunstein. 2021. Noise: A flaw in human judgment. Little, Brown."},{"key":"e_1_3_2_2_31_1","volume-title":"International Joint Conference on Artificial Intelligence (IJCAI)","author":"Kamar Ece","year":"2016","unstructured":"Ece Kamar . 2016 . Directions in hybrid intelligence: Complementing AI systems with human intelligence . International Joint Conference on Artificial Intelligence (IJCAI) (2016), 4070\u20134073. Ece Kamar. 2016. Directions in hybrid intelligence: Complementing AI systems with human intelligence. International Joint Conference on Artificial Intelligence (IJCAI) (2016), 4070\u20134073."},{"key":"e_1_3_2_2_32_1","volume-title":"Algorithmic Justice in Child Protection: Statistical Fairness, Social Justice and the Implications for Practice. Social Sciences","author":"Keddell Emily","year":"2019","unstructured":"Emily Keddell . 2019. Algorithmic Justice in Child Protection: Statistical Fairness, Social Justice and the Implications for Practice. Social Sciences ( 2019 ). Emily Keddell. 2019. Algorithmic Justice in Child Protection: Statistical Fairness, Social Justice and the Implications for Practice. Social Sciences (2019)."},{"key":"e_1_3_2_2_33_1","volume-title":"Human decisions and machine predictions. The quarterly journal of economics 133, 1","author":"Kleinberg Jon","year":"2018","unstructured":"Jon Kleinberg , Himabindu Lakkaraju , Jure Leskovec , Jens Ludwig , and Sendhil Mullainathan . 2018. Human decisions and machine predictions. The quarterly journal of economics 133, 1 ( 2018 ), 237\u2013293. Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. 2018. Human decisions and machine predictions. The quarterly journal of economics 133, 1 (2018), 237\u2013293."},{"key":"e_1_3_2_2_34_1","volume-title":"Human and Machine Learning","author":"Koch Janin","unstructured":"Janin Koch and Antti Oulasvirta . 2018. Group cognition and collaborative AI . In Human and Machine Learning . Springer , 293\u2013312. Janin Koch and Antti Oulasvirta. 2018. Group cognition and collaborative AI. In Human and Machine Learning. Springer, 293\u2013312."},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207678"},{"key":"e_1_3_2_2_36_1","unstructured":"Vivian Lai Chacha Chen Q\u00a0Vera Liao Alison Smith-Renner and Chenhao Tan. 2021. Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies. arXiv preprint arXiv:2112.11471(2021). Vivian Lai Chacha Chen Q\u00a0Vera Liao Alison Smith-Renner and Chenhao Tan. 2021. Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies. arXiv preprint arXiv:2112.11471(2021)."},{"key":"e_1_3_2_2_37_1","volume-title":"Building machines that learn and think like people. Behavioral and brain sciences 40","author":"Lake M","year":"2017","unstructured":"Brenden\u00a0 M Lake , Tomer\u00a0 D Ullman , Joshua\u00a0 B Tenenbaum , and Samuel\u00a0 J Gershman . 2017. Building machines that learn and think like people. Behavioral and brain sciences 40 ( 2017 ). Brenden\u00a0M Lake, Tomer\u00a0D Ullman, Joshua\u00a0B Tenenbaum, and Samuel\u00a0J Gershman. 2017. Building machines that learn and think like people. Behavioral and brain sciences 40 (2017)."},{"key":"e_1_3_2_2_38_1","volume-title":"Trust in automation: Designing for appropriate reliance. Human factors 46, 1","author":"Lee D","year":"2004","unstructured":"John\u00a0 D Lee and Katrina\u00a0 A See . 2004. Trust in automation: Designing for appropriate reliance. Human factors 46, 1 ( 2004 ), 50\u201380. John\u00a0D Lee and Katrina\u00a0A See. 2004. Trust in automation: Designing for appropriate reliance. Human factors 46, 1 (2004), 50\u201380."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-lawsocsci-041221-023808"},{"key":"e_1_3_2_2_40_1","volume-title":"Street Level Bureaucracy","author":"Lipsky Michael","unstructured":"Michael Lipsky . 1980. Street Level Bureaucracy . Russell Sage Foundation . http:\/\/www.jstor.org\/stable\/10.7758\/9781610447713 Michael Lipsky. 1980. Street Level Bureaucracy. Russell Sage Foundation. http:\/\/www.jstor.org\/stable\/10.7758\/9781610447713"},{"key":"e_1_3_2_2_41_1","volume-title":"Proceedings of the Workshop on Fair and Responsible AI at CHI 2020","author":"Lurie Emma","year":"2020","unstructured":"Emma Lurie and Deirdre\u00a0 K Mulligan . 2020 . Crowdworkers are not judges: Rethinking crowdsourced vignette studies as a risk assessment evaluation technique . Proceedings of the Workshop on Fair and Responsible AI at CHI 2020 (2020). Emma Lurie and Deirdre\u00a0K Mulligan. 2020. Crowdworkers are not judges: Rethinking crowdsourced vignette studies as a risk assessment evaluation technique. Proceedings of the Workshop on Fair and Responsible AI at CHI 2020 (2020)."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359174"},{"key":"e_1_3_2_2_43_1","unstructured":"Hussein Mozannar Arvind Satyanarayan and David Sontag. 2021. Teaching Humans When To Defer to a Classifier via Examplars. arXiv preprint arXiv:2111.11297(2021). Hussein Mozannar Arvind Satyanarayan and David Sontag. 2021. Teaching Humans When To Defer to a Classifier via Examplars. arXiv preprint arXiv:2111.11297(2021)."},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.childyouth.2010.07.016"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1080\/15228835.2020.1796892"},{"key":"e_1_3_2_2_46_1","volume-title":"The Allegheny Family Screening Tool. https:\/\/www.alleghenycounty.us\/Human-Services\/News-Events\/Accomplishments\/Allegheny-Family-Screening-Tool.aspx. Online","author":"Allegheny County\u00a0Department of Human\u00a0Services. [n.d.].","year":"2021","unstructured":"Allegheny County\u00a0Department of Human\u00a0Services. [n.d.]. The Allegheny Family Screening Tool. https:\/\/www.alleghenycounty.us\/Human-Services\/News-Events\/Accomplishments\/Allegheny-Family-Screening-Tool.aspx. Online ; accessed 7- September - 2021 . Allegheny County\u00a0Department of Human\u00a0Services. [n.d.]. The Allegheny Family Screening Tool. https:\/\/www.alleghenycounty.us\/Human-Services\/News-Events\/Accomplishments\/Allegheny-Family-Screening-Tool.aspx. Online; accessed 7-September-2021."},{"key":"e_1_3_2_2_47_1","volume-title":"Frequently-Asked Questions | Updated","author":"Allegheny County\u00a0Department of Human\u00a0Services. [n.d.].","year":"2018","unstructured":"Allegheny County\u00a0Department of Human\u00a0Services. [n.d.]. Allegheny Family Screening Tool , Frequently-Asked Questions | Updated August 2018 . https:\/\/www.alleghenycountyanalytics.us\/wp-content\/uploads\/2018\/10\/17-ACDHS-11_AFST_102518.pdf. Online; accessed 8-September-2021. Allegheny County\u00a0Department of Human\u00a0Services. [n.d.]. Allegheny Family Screening Tool, Frequently-Asked Questions | Updated August 2018. https:\/\/www.alleghenycountyanalytics.us\/wp-content\/uploads\/2018\/10\/17-ACDHS-11_AFST_102518.pdf. Online; accessed 8-September-2021."},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"crossref","unstructured":"Bhavik\u00a0N Patel Louis Rosenberg Gregg Willcox David Baltaxe Mimi Lyons Jeremy Irvin Pranav Rajpurkar Timothy Amrhein Rajan Gupta Safwan Halabi Curtis Langlotz Edward Lo Joseph Mammarappallil A\u00a0J Mariano Geoffrey Riley Jayne Seekins Luyao Shen Evan Zucker and Matthew\u00a0P Lungren. 2019. Human-machine partnership with artificial intelligence for chest radiograph diagnosis. npj Digital Medicine(2019). https:\/\/doi.org\/10.1038\/s41746-019-0189-7 Bhavik\u00a0N Patel Louis Rosenberg Gregg Willcox David Baltaxe Mimi Lyons Jeremy Irvin Pranav Rajpurkar Timothy Amrhein Rajan Gupta Safwan Halabi Curtis Langlotz Edward Lo Joseph Mammarappallil A\u00a0J Mariano Geoffrey Riley Jayne Seekins Luyao Shen Evan Zucker and Matthew\u00a0P Lungren. 2019. Human-machine partnership with artificial intelligence for chest radiograph diagnosis. npj Digital Medicine(2019). https:\/\/doi.org\/10.1038\/s41746-019-0189-7","DOI":"10.1038\/s41746-019-0189-7"},{"key":"e_1_3_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445103"},{"key":"e_1_3_2_2_50_1","doi-asserted-by":"crossref","unstructured":"Forough Poursabzi-Sangdeh Daniel\u00a0G. Goldstein Jake\u00a0M. Hofman Jennifer\u00a0Wortman Vaughan and Hanna Wallach. 2021. Manipulating and measuring model interpretability. (2021). arxiv:1802.07810 Forough Poursabzi-Sangdeh Daniel\u00a0G. Goldstein Jake\u00a0M. Hofman Jennifer\u00a0Wortman Vaughan and Hanna Wallach. 2021. Manipulating and measuring model interpretability. (2021). arxiv:1802.07810","DOI":"10.1145\/3411764.3445315"},{"key":"e_1_3_2_2_51_1","volume-title":"Family surveillance by algorithm: The rapidly spreading tools few have heard of","author":"Samant Anjana","year":"2021","unstructured":"Anjana Samant , Aaron Horowitz , Kath Xu , and Sophie Beiers . 2021. Family surveillance by algorithm: The rapidly spreading tools few have heard of . American Civil Liberties Union (ACLU)( 2021 ). https:\/\/www.aclu.org\/sites\/default\/files\/field_document\/2021.09.28a_family_surveillance_by_algorithm.pdf Anjana Samant, Aaron Horowitz, Kath Xu, and Sophie Beiers. 2021. Family surveillance by algorithm: The rapidly spreading tools few have heard of. American Civil Liberties Union (ACLU)(2021). https:\/\/www.aclu.org\/sites\/default\/files\/field_document\/2021.09.28a_family_surveillance_by_algorithm.pdf"},{"key":"e_1_3_2_2_52_1","volume-title":"October","author":"Saxena Devansh","year":"2021","unstructured":"Devansh Saxena , Karla Badillo-Urquiola , Pamela Wisniewski , and Shion Guha . 2021. A framework of high-stakes algorithmic decision-making for the public sector developed through a case study of child welfare. arXiv 5 , October ( 2021 ). arxiv:arXiv:2107.03487v2 Devansh Saxena, Karla Badillo-Urquiola, Pamela Wisniewski, and Shion Guha. 2021. A framework of high-stakes algorithmic decision-making for the public sector developed through a case study of child welfare. arXiv 5, October (2021). arxiv:arXiv:2107.03487v2"},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376229"},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1555-2934.2011.01137.x"},{"key":"e_1_3_2_2_55_1","doi-asserted-by":"crossref","unstructured":"Hong Shen Alicia DeVos Motahhare Eslami and Kenneth Holstein. 2021. Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors. arXiv preprint arXiv:2105.02980(2021). Hong Shen Alicia DeVos Motahhare Eslami and Kenneth Holstein. 2021. Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors. arXiv preprint arXiv:2105.02980(2021).","DOI":"10.1145\/3479577"},{"key":"e_1_3_2_2_56_1","volume-title":"Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems. Conference on Human Factors in Computing Systems - Proceedings","author":"Smith Estelle","year":"2020","unstructured":"C.\u00a0 Estelle Smith , Bowen Yu , Anjali Srivastava , Aaron Halfaker , Loren Terveen , and Haiyi Zhu . 2020 . Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems. Conference on Human Factors in Computing Systems - Proceedings (2020), 1\u201314. https:\/\/doi.org\/10.1145\/3313831.3376783 C.\u00a0Estelle Smith, Bowen Yu, Anjali Srivastava, Aaron Halfaker, Loren Terveen, and Haiyi Zhu. 2020. Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems. Conference on Human Factors in Computing Systems - Proceedings (2020), 1\u201314. https:\/\/doi.org\/10.1145\/3313831.3376783"},{"key":"e_1_3_2_2_57_1","doi-asserted-by":"crossref","unstructured":"Hariharan Subramonyam Colleen Seifert and Eytan Adar. 2021. Towards a process model for co-creating AI experiences. arXiv preprint arXiv:2104.07595(2021). Hariharan Subramonyam Colleen Seifert and Eytan Adar. 2021. Towards a process model for co-creating AI experiences. arXiv preprint arXiv:2104.07595(2021).","DOI":"10.1145\/3461778.3462012"},{"key":"e_1_3_2_2_58_1","volume-title":"Investigating human + machine complementarity for recidivism predictions. arXiv","author":"Tan Sarah","year":"2018","unstructured":"Sarah Tan , Julius Adebayo , and Kori Inkpen . 2018. Investigating human + machine complementarity for recidivism predictions. arXiv ( 2018 ). arxiv:arXiv:1808.09123v2 Sarah Tan, Julius Adebayo, and Kori Inkpen. 2018. Investigating human + machine complementarity for recidivism predictions. arXiv (2018). arxiv:arXiv:1808.09123v2"},{"key":"e_1_3_2_2_59_1","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1002\/j.2371-9621.2021.tb00011.x","article-title":"Using a machine learning tool to support high-stakes decisions in child protection","volume":"42","author":"Vaithianathan Rhema","year":"2021","unstructured":"Rhema Vaithianathan , Diana Benavides-Prado , Erin Dalton , Alex Chouldechova , and Emily Putnam-Hornstein . 2021 . Using a machine learning tool to support high-stakes decisions in child protection . AI Magazine 42 , 1 (2021), 53 \u2013 60 . Rhema Vaithianathan, Diana Benavides-Prado, Erin Dalton, Alex Chouldechova, and Emily Putnam-Hornstein. 2021. Using a machine learning tool to support high-stakes decisions in child protection. AI Magazine 42, 1 (2021), 53\u201360.","journal-title":"AI Magazine"},{"key":"e_1_3_2_2_60_1","volume-title":"Developing predictive models to support child maltreatment hotline screening decisions: Allegheny County methodology and implementation","author":"Vaithianathan Rhema","year":"2017","unstructured":"Rhema Vaithianathan , Emily Putnam-Hornstein , Nan Jiang , Parma Nand , and Tim Maloney . 2017. Developing predictive models to support child maltreatment hotline screening decisions: Allegheny County methodology and implementation . Center for Social data Analytics( 2017 ). Rhema Vaithianathan, Emily Putnam-Hornstein, Nan Jiang, Parma Nand, and Tim Maloney. 2017. Developing predictive models to support child maltreatment hotline screening decisions: Allegheny County methodology and implementation. Center for Social data Analytics(2017)."},{"key":"e_1_3_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11251-010-9128-3"},{"key":"e_1_3_2_2_62_1","volume-title":"40th International Conference on Information Systems, ICIS 2019","author":"van\u00a0den Broek Elmira","year":"2020","unstructured":"Elmira van\u00a0den Broek , Anastasia Sergeeva , and Marleen Huysman . 2020 . Hiring algorithms: An ethnography of fairness in practice . 40th International Conference on Information Systems, ICIS 2019 (2020). Elmira van\u00a0den Broek, Anastasia Sergeeva, and Marleen Huysman. 2020. Hiring algorithms: An ethnography of fairness in practice. 40th International Conference on Information Systems, ICIS 2019 (2020)."},{"key":"e_1_3_2_2_63_1","volume-title":"The think aloud method: a practical approach to modelling cognitive","author":"Van\u00a0Someren MW","year":"1994","unstructured":"MW Van\u00a0Someren , YF Barnard , and JAC Sandberg . 1994. The think aloud method: a practical approach to modelling cognitive . London : AcademicPress( 1994 ). MW Van\u00a0Someren, YF Barnard, and JAC Sandberg. 1994. The think aloud method: a practical approach to modelling cognitive. London: AcademicPress(1994)."},{"key":"e_1_3_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174014"},{"key":"e_1_3_2_2_65_1","volume-title":"The what-if tool: Interactive probing of machine learning models","author":"Wexler James","year":"2019","unstructured":"James Wexler , Mahima Pushkarna , Tolga Bolukbasi , Martin Wattenberg , Fernanda Vi\u00e9gas , and Jimbo Wilson . 2019. The what-if tool: Interactive probing of machine learning models . IEEE transactions on visualization and computer graphics 26, 1( 2019 ), 56\u201365. James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Vi\u00e9gas, and Jimbo Wilson. 2019. The what-if tool: Interactive probing of machine learning models. IEEE transactions on visualization and computer graphics 26, 1(2019), 56\u201365."},{"key":"e_1_3_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300468"},{"key":"e_1_3_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858373"},{"key":"e_1_3_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274463"},{"key":"e_1_3_2_2_69_1","volume-title":"Sibyl: Understanding and addressing the usability challenges of machine learning in high-stakes decision making","author":"Zytek Alexandra","year":"2021","unstructured":"Alexandra Zytek , Dongyu Liu , Rhema Vaithianathan , and Kalyan Veeramachaneni . 2021 . Sibyl: Understanding and addressing the usability challenges of machine learning in high-stakes decision making . IEEE Transactions on Visualization and Computer Graphics ( 2021). Alexandra Zytek, Dongyu Liu, Rhema Vaithianathan, and Kalyan Veeramachaneni. 2021. Sibyl: Understanding and addressing the usability challenges of machine learning in high-stakes decision making. IEEE Transactions on Visualization and Computer Graphics (2021)."}],"event":{"name":"CHI '22: CHI Conference on Human Factors in Computing Systems","location":"New Orleans LA USA","acronym":"CHI '22","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3517439","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3491102.3517439","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3491102.3517439","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:23Z","timestamp":1750188683000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491102.3517439"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,27]]},"references-count":69,"alternative-id":["10.1145\/3491102.3517439","10.1145\/3491102"],"URL":"https:\/\/doi.org\/10.1145\/3491102.3517439","relation":{},"subject":[],"published":{"date-parts":[[2022,4,27]]}}}