{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T23:37:58Z","timestamp":1782517078065,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":80,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,5,6]],"date-time":"2021-05-06T00:00:00Z","timestamp":1620259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-2001851, IIS-1952085, IIS-2000782 and IIS-1939606"],"award-info":[{"award-number":["IIS-2001851, IIS-1952085, IIS-2000782 and IIS-1939606"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,5,6]]},"DOI":"10.1145\/3411764.3445308","type":"proceedings-article","created":{"date-parts":[[2021,5,8]],"date-time":"2021-05-08T05:03:13Z","timestamp":1620450193000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":55,"title":["Soliciting Stakeholders\u2019 Fairness Notions in Child Maltreatment Predictive Systems"],"prefix":"10.1145","author":[{"given":"Hao-Fei","family":"Cheng","sequence":"first","affiliation":[{"name":"GroupLens Research University of Minnesota, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Logan","family":"Stapleton","sequence":"additional","affiliation":[{"name":"University of Minnesota, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruiqi","family":"Wang","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paige","family":"Bullock","sequence":"additional","affiliation":[{"name":"Kenyon College, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandra","family":"Chouldechova","sequence":"additional","affiliation":[{"name":"Heinz College Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiwei Steven Steven","family":"Wu","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haiyi","family":"Zhu","sequence":"additional","affiliation":[{"name":"Human Computer Interaction Institute Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,5,7]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan","author":"Agarwal Alekh","year":"2018","unstructured":"Alekh Agarwal , Alina Beygelzimer , Miroslav Dud\u00edk , John Langford , and Hanna\u00a0 M. Wallach . 2018 . A Reductions Approach to Fair Classification . In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan , Stockholm, Sweden , July 10-15, 2018. 60\u201369. http:\/\/proceedings.mlr.press\/v80\/agarwal18a.html Alekh Agarwal, Alina Beygelzimer, Miroslav Dud\u00edk, John Langford, and Hanna\u00a0M. Wallach. 2018. A Reductions Approach to Fair Classification. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10-15, 2018. 60\u201369. http:\/\/proceedings.mlr.press\/v80\/agarwal18a.html"},{"key":"e_1_3_2_1_2_1","volume-title":"Proceedings of the 36th International Conference on Machine Learning, ICML 2019","author":"Agarwal Alekh","year":"2019","unstructured":"Alekh Agarwal , Miroslav Dud\u00edk , and Zhiwei\u00a0Steven Wu . 2019 . Fair Regression: Quantitative Definitions and Reduction-Based Algorithms . In Proceedings of the 36th International Conference on Machine Learning, ICML 2019 , 9-15 June 2019, Long Beach, California, USA. 120\u2013129. http:\/\/proceedings.mlr.press\/v97\/agarwal19d.html Alekh Agarwal, Miroslav Dud\u00edk, and Zhiwei\u00a0Steven Wu. 2019. Fair Regression: Quantitative Definitions and Reduction-Based Algorithms. In Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA. 120\u2013129. http:\/\/proceedings.mlr.press\/v97\/agarwal19d.html"},{"key":"e_1_3_2_1_3_1","volume-title":"Fairsight: Visual analytics for fairness in decision making","author":"Ahn Yongsu","year":"2019","unstructured":"Yongsu Ahn and Yu-Ru Lin . 2019 . Fairsight: Visual analytics for fairness in decision making . IEEE transactions on visualization and computer graphics 26, 1(2019), 1086\u20131095. Yongsu Ahn and Yu-Ru Lin. 2019. Fairsight: Visual analytics for fairness in decision making. IEEE transactions on visualization and computer graphics 26, 1(2019), 1086\u20131095."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797610384741"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-018-0637-6"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/10530789.2019.1622858"},{"key":"e_1_3_2_1_7_1","unstructured":"Geoffrey Barnes and Jordan\u00a0M Hyatt. 2012. Classifying adult probationers by forecasting future offending. (2012).  Geoffrey Barnes and Jordan\u00a0M Hyatt. 2012. Classifying adult probationers by forecasting future offending. (2012)."},{"key":"e_1_3_2_1_8_1","unstructured":"Yahav Bechavod Christopher Jung and Zhiwei\u00a0Steven Wu. 2020. Metric-Free Individual Fairness in Online Learning. CoRR abs\/2002.05474(2020). https:\/\/arxiv.org\/abs\/2002.05474  Yahav Bechavod Christopher Jung and Zhiwei\u00a0Steven Wu. 2020. Metric-Free Individual Fairness in Online Learning. CoRR abs\/2002.05474(2020). https:\/\/arxiv.org\/abs\/2002.05474"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942287"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173951"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300271"},{"key":"e_1_3_2_1_12_1","first-page":"221","article-title":"Factors determining success or failure on parole. In The workings of the indeterminate-sentence law and parole system in Illinois, A.\u00a0A. Bruce, A.\u00a0J. Harno, E.\u00a0W. Burgess, and J.\u00a0Landesco(Eds.)","author":"Burgess W.","year":"1928","unstructured":"Ernest\u00a0 W. Burgess . 1928 . Factors determining success or failure on parole. In The workings of the indeterminate-sentence law and parole system in Illinois, A.\u00a0A. Bruce, A.\u00a0J. Harno, E.\u00a0W. Burgess, and J.\u00a0Landesco(Eds.) . Springfield, IL: State Board of Parole , 221 \u2013 234 . Ernest\u00a0W. Burgess. 1928. Factors determining success or failure on parole. In The workings of the indeterminate-sentence law and parole system in Illinois, A.\u00a0A. Bruce, A.\u00a0J. Harno, E.\u00a0W. Burgess, and J.\u00a0Landesco(Eds.). Springfield, IL: State Board of Parole, 221\u2013234.","journal-title":"Springfield, IL: State Board of Parole"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST47406.2019.8986948"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788613"},{"key":"e_1_3_2_1_15_1","unstructured":"Kathy Charmaz. 2014. Constructing grounded theory. sage.  Kathy Charmaz. 2014. Constructing grounded theory. sage."},{"key":"e_1_3_2_1_16_1","volume-title":"Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data 5, 2","author":"Chouldechova Alexandra","year":"2017","unstructured":"Alexandra Chouldechova . 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data 5, 2 ( 2017 ), 153\u2013163. Alexandra Chouldechova. 2017. Fair prediction with disparate impact: A study of bias in recidivism prediction instruments. Big data 5, 2 (2017), 153\u2013163."},{"key":"e_1_3_2_1_17_1","unstructured":"Sam Corbett-Davies and Sharad Goel. 2018. The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning. CoRR abs\/1808.00023(2018). http:\/\/arxiv.org\/abs\/1808.00023  Sam Corbett-Davies and Sharad Goel. 2018. The Measure and Mismeasure of Fairness: A Critical Review of Fair Machine Learning. CoRR abs\/1808.00023(2018). http:\/\/arxiv.org\/abs\/1808.00023"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376638"},{"key":"e_1_3_2_1_19_1","volume-title":"Designing Recommender Systems with Reachability in Mind. Workshop on Participatory Approaches to Machine Learning","author":"Dean Sarah","year":"2020","unstructured":"Sarah Dean , Mihaela Curmei , and Benjamin Recht . 2020 . Designing Recommender Systems with Reachability in Mind. Workshop on Participatory Approaches to Machine Learning (2020), \u2013. Sarah Dean, Mihaela Curmei, and Benjamin Recht. 2020. Designing Recommender Systems with Reachability in Mind. Workshop on Participatory Approaches to Machine Learning (2020), \u2013."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"crossref","unstructured":"Matthew DeMichele Peter Baumgartner Michael Wenger Kelle Barrick Megan Comfort and Shilpi Misra. 2018. The public safety assessment: A re-validation and assessment of predictive utility and differential prediction by race and gender in kentucky. Available at SSRN 3168452(2018).  Matthew DeMichele Peter Baumgartner Michael Wenger Kelle Barrick Megan Comfort and Shilpi Misra. 2018. The public safety assessment: A re-validation and assessment of predictive utility and differential prediction by race and gender in kentucky. Available at SSRN 3168452(2018).","DOI":"10.2139\/ssrn.3168452"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"crossref","unstructured":"Sarah\u00a0L Desmarais Samantha\u00a0A Zottola Sarah\u00a0E Duhart\u00a0Clarke and Evan\u00a0M Lowder. 2020. Predictive Validity of Pretrial Risk Assessments: A Systematic Review of the Literature. Criminal Justice and Behavior(2020) 0093854820932959.  Sarah\u00a0L Desmarais Samantha\u00a0A Zottola Sarah\u00a0E Duhart\u00a0Clarke and Evan\u00a0M Lowder. 2020. Predictive Validity of Pretrial Risk Assessments: A Systematic Review of the Literature. Criminal Justice and Behavior(2020) 0093854820932959.","DOI":"10.1177\/0093854820932959"},{"key":"e_1_3_2_1_22_1","volume-title":"Handbook of child maltreatment","author":"Dettlaff J","unstructured":"Alan\u00a0 J Dettlaff . 2014. The evolving understanding of disproportionality and disparities in child welfare . In Handbook of child maltreatment . Springer , 149\u2013168. Alan\u00a0J Dettlaff. 2014. The evolving understanding of disproportionality and disparities in child welfare. In Handbook of child maltreatment. Springer, 149\u2013168."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302310"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2090236.2090255"},{"key":"e_1_3_2_1_25_1","volume-title":"Automating inequality: How high-tech tools profile, police, and punish the poor","author":"Eubanks Virginia","unstructured":"Virginia Eubanks . 2018. Automating inequality: How high-tech tools profile, police, and punish the poor . St. Martin\u2019s Press . Virginia Eubanks. 2018. Automating inequality: How high-tech tools profile, police, and punish the poor. St. Martin\u2019s Press."},{"key":"e_1_3_2_1_26_1","unstructured":"Sorelle\u00a0A Friedler Carlos Scheidegger and Suresh Venkatasubramanian. 2016. On the (im) possibility of fairness. (2016). arxiv:1609.07236  Sorelle\u00a0A Friedler Carlos Scheidegger and Suresh Venkatasubramanian. 2016. On the (im) possibility of fairness. (2016). arxiv:1609.07236"},{"key":"e_1_3_2_1_27_1","volume-title":"Impact Evaluation of a Predictive Risk Modeling Tool for Allegheny County\u2019s Child Welfare Office","author":"Goldhaber-Fiebert D","year":"2019","unstructured":"Jeremy\u00a0 D Goldhaber-Fiebert and Lea Prince . 2019. Impact Evaluation of a Predictive Risk Modeling Tool for Allegheny County\u2019s Child Welfare Office . Pittsburgh : Allegheny County( 2019 ). Jeremy\u00a0D Goldhaber-Fiebert and Lea Prince. 2019. Impact Evaluation of a Predictive Risk Modeling Tool for Allegheny County\u2019s Child Welfare Office. Pittsburgh: Allegheny County(2019)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3178876.3186138"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11296"},{"key":"e_1_3_2_1_30_1","volume-title":"Equality of Opportunity in Supervised Learning. In Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016","author":"Hardt Moritz","year":"2016","unstructured":"Moritz Hardt , Eric Price , and Nati Srebro . 2016 . Equality of Opportunity in Supervised Learning. In Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016 , December 5-10, 2016, Barcelona, Spain. 3315\u20133323. http:\/\/papers.nips.cc\/paper\/6374-equality-of-opportunity-in-supervised-learning Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of Opportunity in Supervised Learning. In Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, December 5-10, 2016, Barcelona, Spain. 3315\u20133323. http:\/\/papers.nips.cc\/paper\/6374-equality-of-opportunity-in-supervised-learning"},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan","author":"H\u00e9bert-Johnson \u00darsula","year":"2018","unstructured":"\u00darsula H\u00e9bert-Johnson , Michael\u00a0 P. Kim , Omer Reingold , and Guy\u00a0 N. Rothblum . 2018 . Multicalibration: Calibration for the (Computationally-Identifiable) Masses . In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan , Stockholm, Sweden , July 10-15, 2018. 1944\u20131953. http:\/\/proceedings.mlr.press\/v80\/hebert-johnson18a.html \u00darsula H\u00e9bert-Johnson, Michael\u00a0P. Kim, Omer Reingold, and Guy\u00a0N. Rothblum. 2018. Multicalibration: Calibration for the (Computationally-Identifiable) Masses. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10-15, 2018. 1944\u20131953. http:\/\/proceedings.mlr.press\/v80\/hebert-johnson18a.html"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.4230\/LIPIcs.FORC.2020.2"},{"key":"e_1_3_2_1_34_1","volume-title":"University of Miami Law School: We Robot Conference. https:\/\/robots.law.miami.edu\/2019\/wp-content\/uploads\/2019\/03\/MoralMachineMonster.pdf","author":"Jaques Abby\u00a0Everett","year":"2019","unstructured":"Abby\u00a0Everett Jaques . 2019 . Why the Moral Machine Is a Monster . In University of Miami Law School: We Robot Conference. https:\/\/robots.law.miami.edu\/2019\/wp-content\/uploads\/2019\/03\/MoralMachineMonster.pdf Abby\u00a0Everett Jaques. 2019. Why the Moral Machine Is a Monster. In University of Miami Law School: We Robot Conference. https:\/\/robots.law.miami.edu\/2019\/wp-content\/uploads\/2019\/03\/MoralMachineMonster.pdf"},{"key":"e_1_3_2_1_35_1","volume-title":"USA): Children\u2019s Research Center","author":"Johnson Will","year":"2004","unstructured":"Will Johnson . 2004. Effectiveness of California\u2019s child welfare structured decision making (SDM) model: a prospective study of the validity of the California Family Risk Assessment. Madison (Wisconsin , USA): Children\u2019s Research Center ( 2004 ). Will Johnson. 2004. Effectiveness of California\u2019s child welfare structured decision making (SDM) model: a prospective study of the validity of the California Family Risk Assessment. Madison (Wisconsin, USA): Children\u2019s Research Center (2004)."},{"key":"e_1_3_2_1_36_1","volume-title":"Workshop on Participatory Approaches to Machine Learning ([n.\u00a0d.]).","author":"Johnston M","unstructured":"Caroline\u00a0 M Johnston , Simon Blessenohl , and Phebe Vayanos . [n.d.]. Preference Elicitation and Aggregation to Aid with Patient Triage during the COVID-19 Pandemic . Workshop on Participatory Approaches to Machine Learning ([n.\u00a0d.]). Caroline\u00a0M Johnston, Simon Blessenohl, and Phebe Vayanos. [n.d.]. Preference Elicitation and Aggregation to Aid with Patient Triage during the COVID-19 Pandemic. Workshop on Participatory Approaches to Machine Learning ([n.\u00a0d.])."},{"key":"e_1_3_2_1_37_1","volume-title":"Fairness in Learning: Classic and Contextual Bandits. In Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016","author":"Joseph Matthew","year":"2016","unstructured":"Matthew Joseph , Michael\u00a0 J. Kearns , Jamie\u00a0 H. Morgenstern , and Aaron Roth . 2016 . Fairness in Learning: Classic and Contextual Bandits. In Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016 , December 5-10, 2016, Barcelona, Spain. 325\u2013333. http:\/\/papers.nips.cc\/paper\/6355-fairness-in-learning-classic-and-contextual-bandits Matthew Joseph, Michael\u00a0J. Kearns, Jamie\u00a0H. Morgenstern, and Aaron Roth. 2016. Fairness in Learning: Classic and Contextual Bandits. In Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, December 5-10, 2016, Barcelona, Spain. 325\u2013333. http:\/\/papers.nips.cc\/paper\/6355-fairness-in-learning-classic-and-contextual-bandits"},{"key":"e_1_3_2_1_38_1","unstructured":"Christopher Jung Michael\u00a0J. Kearns Seth Neel Aaron Roth Logan Stapleton and Zhiwei\u00a0Steven Wu. 2021. An Algorithmic Framework for Fairness Elicitation. In Foundations of Responsible Computing (FORC). http:\/\/arxiv.org\/abs\/1905.10660  Christopher Jung Michael\u00a0J. Kearns Seth Neel Aaron Roth Logan Stapleton and Zhiwei\u00a0Steven Wu. 2021. An Algorithmic Framework for Fairness Elicitation. In Foundations of Responsible Computing (FORC). http:\/\/arxiv.org\/abs\/1905.10660"},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of the 36th International Conference on Machine Learning, ICML 2019","author":"Kahng Anson","year":"2019","unstructured":"Anson Kahng , Min\u00a0Kyung Lee , Ritesh Noothigattu , Ariel\u00a0 D. Procaccia , and Christos-Alexandros Psomas . 2019 . Statistical Foundations of Virtual Democracy . In Proceedings of the 36th International Conference on Machine Learning, ICML 2019 , 9-15 June 2019, Long Beach, California, USA. 3173\u20133182. http:\/\/proceedings.mlr.press\/v97\/kahng19a.html Anson Kahng, Min\u00a0Kyung Lee, Ritesh Noothigattu, Ariel\u00a0D. Procaccia, and Christos-Alexandros Psomas. 2019. Statistical Foundations of Virtual Democracy. In Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA. 3173\u20133182. http:\/\/proceedings.mlr.press\/v97\/kahng19a.html"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-011-0463-8"},{"key":"e_1_3_2_1_41_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan","author":"Kearns J.","year":"2018","unstructured":"Michael\u00a0 J. Kearns , Seth Neel , Aaron Roth , and Zhiwei\u00a0Steven Wu . 2018 . Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness . In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan , Stockholm, Sweden , July 10-15, 2018. 2569\u20132577. http:\/\/proceedings.mlr.press\/v80\/kearns18a.html Michael\u00a0J. Kearns, Seth Neel, Aaron Roth, and Zhiwei\u00a0Steven Wu. 2018. Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10-15, 2018. 2569\u20132577. http:\/\/proceedings.mlr.press\/v80\/kearns18a.html"},{"key":"e_1_3_2_1_42_1","unstructured":"Danielle\u00a0Leah Kehl and Samuel\u00a0Ari Kessler. 2017. Algorithms in the criminal justice system: Assessing the use of risk assessments in sentencing. (2017).  Danielle\u00a0Leah Kehl and Samuel\u00a0Ari Kessler. 2017. Algorithms in the criminal justice system: Assessing the use of risk assessments in sentencing. (2017)."},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbankfin.2010.06.001"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.3386\/w23180"},{"key":"e_1_3_2_1_45_1","volume-title":"Inherent Trade-Offs in the Fair Determination of Risk Scores. In 8th Innovations in Theoretical Computer Science Conference, ITCS.","author":"Kleinberg M.","year":"2017","unstructured":"Jon\u00a0 M. Kleinberg , Sendhil Mullainathan , and Manish Raghavan . 2017 . Inherent Trade-Offs in the Fair Determination of Risk Scores. In 8th Innovations in Theoretical Computer Science Conference, ITCS. Jon\u00a0M. Kleinberg, Sendhil Mullainathan, and Manish Raghavan. 2017. Inherent Trade-Offs in the Fair Determination of Risk Scores. In 8th Innovations in Theoretical Computer Science Conference, ITCS."},{"key":"e_1_3_2_1_46_1","volume-title":"Is there an ethics of algorithms?Ethics and Information Technology 13","author":"Kraemer Felicitas","year":"2011","unstructured":"Felicitas Kraemer , Kees van Overveld , and Martin Peterson . 2011. Is there an ethics of algorithms?Ethics and Information Technology 13 ( 2011 ), 251\u2013\u2013260. Felicitas Kraemer, Kees van Overveld, and Martin Peterson. 2011. Is there an ethics of algorithms?Ethics and Information Technology 13 (2011), 251\u2013\u2013260."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287590"},{"key":"e_1_3_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951718756684"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998230"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359284"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025884"},{"key":"e_1_3_2_1_52_1","unstructured":"Min\u00a0Kyung Lee Daniel Kusbit Anson Kahng Ji\u00a0Seong Tae Xinran Yuan A.\u00a0D.\u00a0C. Chan Ritesh Noothigattu Daniel See Siheon Lee Christos-Alexandros Psomas and Ariel\u00a0D. Procaccia. 2018. WeBuildAI : Participatory Framework for Fair and Efficient Algorithmic Governance. In CSCW.  Min\u00a0Kyung Lee Daniel Kusbit Anson Kahng Ji\u00a0Seong Tae Xinran Yuan A.\u00a0D.\u00a0C. Chan Ritesh Noothigattu Daniel See Siheon Lee Christos-Alexandros Psomas and Ariel\u00a0D. Procaccia. 2018. WeBuildAI : Participatory Framework for Fair and Efficient Algorithmic Governance. In CSCW."},{"key":"e_1_3_2_1_53_1","volume-title":"Neural network modeling of risk assessment in child protective services.Psychological Methods 5, 1","author":"Marshall B","year":"2000","unstructured":"David\u00a0 B Marshall and Diana\u00a0 J English . 2000. Neural network modeling of risk assessment in child protective services.Psychological Methods 5, 1 ( 2000 ), 102. David\u00a0B Marshall and Diana\u00a0J English. 2000. Neural network modeling of risk assessment in child protective services.Psychological Methods 5, 1 (2000), 102."},{"key":"e_1_3_2_1_54_1","volume-title":"Risk assessment in sentencing","author":"Monahan John","unstructured":"John Monahan . 2017. Risk assessment in sentencing . Academy for Justice , a Report on Scholarship and Criminal Justice Reform (Erik Luna ed., 2017, Forthcoming)(2017). John Monahan. 2017. Risk assessment in sentencing. Academy for Justice, a Report on Scholarship and Criminal Justice Reform (Erik Luna ed., 2017, Forthcoming)(2017)."},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"crossref","unstructured":"John Monahan Anne Metz and Brandon\u00a0L Garrett. 2018. Judicial Appraisals of Risk Assessment in Sentencing. (2018).  John Monahan Anne Metz and Brandon\u00a0L Garrett. 2018. Judicial Appraisals of Risk Assessment in Sentencing. (2018).","DOI":"10.1002\/bsl.2380"},{"key":"e_1_3_2_1_56_1","volume-title":"Proc. Conf. Fairness Accountability Transp.","author":"Narayanan Arvind","year":"2018","unstructured":"Arvind Narayanan . 2018 . Translation tutorial: 21 fairness definitions and their politics . In Proc. Conf. Fairness Accountability Transp. , New York, USA. Arvind Narayanan. 2018. Translation tutorial: 21 fairness definitions and their politics. In Proc. Conf. Fairness Accountability Transp., New York, USA."},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"crossref","unstructured":"Jakob Nielsen. 1994. Usability engineering. Morgan Kaufmann.  Jakob Nielsen. 1994. Usability engineering. Morgan Kaufmann.","DOI":"10.1016\/B978-0-08-052029-2.50009-7"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401959"},{"key":"e_1_3_2_1_59_1","volume-title":"On Fairness and Calibration. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017","author":"Pleiss Geoff","year":"2017","unstructured":"Geoff Pleiss , Manish Raghavan , Felix Wu , Jon\u00a0 M. Kleinberg , and Kilian\u00a0 Q. Weinberger . 2017 . On Fairness and Calibration. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017 , 4-9 December 2017, Long Beach, CA, USA. 5684\u20135693. http:\/\/papers.nips.cc\/paper\/7151-on-fairness-and-calibration Geoff Pleiss, Manish Raghavan, Felix Wu, Jon\u00a0M. Kleinberg, and Kilian\u00a0Q. Weinberger. 2017. On Fairness and Calibration. In Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 4-9 December 2017, Long Beach, CA, USA. 5684\u20135693. http:\/\/papers.nips.cc\/paper\/7151-on-fairness-and-calibration"},{"key":"e_1_3_2_1_60_1","volume-title":"Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI).","author":"Sohan Dsouza Iyad Rahwan Edmond Awad","unstructured":"Edmond Awad Sohan Dsouza Iyad Rahwan Pradeep\u00a0Ravikumar Ritesh\u00a0Noothigattu , Snehalkumar \u2018Neil\u2019 S.\u00a0 Gaikwadand Ariel\u00a0 D. Procaccia .2018. A voting-based system for ethical decision making . In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI). Edmond Awad Sohan Dsouza Iyad Rahwan Pradeep\u00a0Ravikumar Ritesh\u00a0Noothigattu, Snehalkumar \u2018Neil\u2019 S.\u00a0Gaikwadand Ariel\u00a0D. Procaccia.2018. A voting-based system for ethical decision making. In Proceedings of the 32nd AAAI Conference on Artificial Intelligence (AAAI)."},{"key":"e_1_3_2_1_61_1","unstructured":"Samantha Robertson and Niloufar Salehi. 2020. What If I Don\u2019t Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Design. (2020). arxiv:2007.06718  Samantha Robertson and Niloufar Salehi. 2020. What If I Don\u2019t Like Any Of The Choices? The Limits of Preference Elicitation for Participatory Algorithm Design. (2020). arxiv:2007.06718"},{"key":"e_1_3_2_1_62_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning, ICML 2020","author":"Saha Debjani","year":"2020","unstructured":"Debjani Saha , Candice Schumann , Duncan\u00a0 C. McElfresh , John\u00a0 P. Dickerson , Michelle\u00a0 L. Mazurek , and Michael\u00a0Carl Tschantz . 2020 . Measuring Non-Expert Comprehension of Machine Learning Fairness Metrics . In Proceedings of the 37th International Conference on Machine Learning, ICML 2020 , Vienna, Austria, July 12\u201318 , 2020. Debjani Saha, Candice Schumann, Duncan\u00a0C. McElfresh, John\u00a0P. Dickerson, Michelle\u00a0L. Mazurek, and Michael\u00a0Carl Tschantz. 2020. Measuring Non-Expert Comprehension of Machine Learning Fairness Metrics. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, Vienna, Austria, July 12\u201318, 2020."},{"key":"e_1_3_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306618.3314248"},{"key":"e_1_3_2_1_64_1","volume-title":"Evidence-based sentencing: Public openness and opposition to using gender, age, and race as risk factors for recidivism.Law and Human Behavior 40, 1","author":"Scurich Nicholas","year":"2016","unstructured":"Nicholas Scurich and John Monahan . 2016. Evidence-based sentencing: Public openness and opposition to using gender, age, and race as risk factors for recidivism.Law and Human Behavior 40, 1 ( 2016 ), 36. Nicholas Scurich and John Monahan. 2016. Evidence-based sentencing: Public openness and opposition to using gender, age, and race as risk factors for recidivism.Law and Human Behavior 40, 1 (2016), 36."},{"key":"e_1_3_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2017.0362"},{"key":"e_1_3_2_1_66_1","volume-title":"Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses.Journal of Asynchronous Learning Networks 16, 3","author":"Smith C","year":"2012","unstructured":"Vernon\u00a0 C Smith , Adam Lange , and Daniel\u00a0 R Huston . 2012. Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses.Journal of Asynchronous Learning Networks 16, 3 ( 2012 ), 51\u201361. Vernon\u00a0C Smith, Adam Lange, and Daniel\u00a0R Huston. 2012. Predictive modeling to forecast student outcomes and drive effective interventions in online community college courses.Journal of Asynchronous Learning Networks 16, 3 (2012), 51\u201361."},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330664"},{"key":"e_1_3_2_1_68_1","unstructured":"Rhema Vaithianathan Nan Jiang Tim Maloney Parma Nand and Emily Putnam-Hornstein. 2017. Developing Predictive Risk Models to Support Child Maltreatment Hotline Screening Decisions. https:\/\/www.alleghenycountyanalytics.us\/wp-content\/uploads\/2017\/04\/Developing-Predictive-Risk-Models-package-with-cover-1-to-post-1.pdf  Rhema Vaithianathan Nan Jiang Tim Maloney Parma Nand and Emily Putnam-Hornstein. 2017. Developing Predictive Risk Models to Support Child Maltreatment Hotline Screening Decisions. https:\/\/www.alleghenycountyanalytics.us\/wp-content\/uploads\/2017\/04\/Developing-Predictive-Risk-Models-package-with-cover-1-to-post-1.pdf"},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174014"},{"key":"e_1_3_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3194770.3194776"},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"crossref","unstructured":"AJ Wang. 2018. Procedural Justice and Risk-Assessment Algorithms. (2018).  AJ Wang. 2018. Procedural Justice and Risk-Assessment Algorithms. (2018).","DOI":"10.2139\/ssrn.3170136"},{"key":"e_1_3_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220070"},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376813"},{"key":"e_1_3_2_1_74_1","volume-title":"The what-if tool: Interactive probing of machine learning models","author":"Wexler James","year":"2019","unstructured":"James Wexler , Mahima Pushkarna , Tolga Bolukbasi , Martin Wattenberg , Fernanda Vi\u00e9gas , and Jimbo Wilson . 2019. The what-if tool: Interactive probing of machine learning models . IEEE transactions on visualization and computer graphics 26, 1( 2019 ), 56\u201365. James Wexler, Mahima Pushkarna, Tolga Bolukbasi, Martin Wattenberg, Fernanda Vi\u00e9gas, and Jimbo Wilson. 2019. The what-if tool: Interactive probing of machine learning models. IEEE transactions on visualization and computer graphics 26, 1(2019), 56\u201365."},{"key":"e_1_3_2_1_75_1","volume-title":"AI now report","author":"Whittaker Meredith","year":"2018","unstructured":"Meredith Whittaker , Kate Crawford , Roel Dobbe , Genevieve Fried , Elizabeth Kaziunas , Varoon Mathur , Sarah\u00a0Mysers West , Rashida Richardson , Jason Schultz , and Oscar Schwartz . 2018. AI now report 2018 . AI Now Institute at New York University . Meredith Whittaker, Kate Crawford, Roel Dobbe, Genevieve Fried, Elizabeth Kaziunas, Varoon Mathur, Sarah\u00a0Mysers West, Rashida Richardson, Jason Schultz, and Oscar Schwartz. 2018. AI now report 2018. AI Now Institute at New York University."},{"key":"e_1_3_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300830"},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174230"},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395528"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3038912.3052660"},{"key":"e_1_3_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274463"}],"event":{"name":"CHI '21: CHI Conference on Human Factors in Computing Systems","location":"Yokohama Japan","acronym":"CHI '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445308","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411764.3445308","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3411764.3445308","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:28:33Z","timestamp":1750195713000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3411764.3445308"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,6]]},"references-count":80,"alternative-id":["10.1145\/3411764.3445308","10.1145\/3411764"],"URL":"https:\/\/doi.org\/10.1145\/3411764.3445308","relation":{},"subject":[],"published":{"date-parts":[[2021,5,6]]},"assertion":[{"value":"2021-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}