{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:30:04Z","timestamp":1750221004073,"version":"3.41.0"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,8,5]],"date-time":"2019-08-05T00:00:00Z","timestamp":1564963200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["AI Matters"],"published-print":{"date-parts":[[2019,8,5]]},"abstract":"<jats:p>\n            Every day, governmental and federally funded agencies --- including criminal courts, welfare agencies, and educational institutions --- make decisions about resource allocation using automated decision-making tools (Lecher, 2018; Fishel, Flack, &amp; DeMatteo, 2018). Important factors surrounding the use of these tools are embedded both in their design and in the policies and practices of the various agencies that implement them. As the use of such tools is becoming more common, a number of questions have arisen about whether using these tools is fair, or in some cases, even legal (\n            <jats:italic>K.W. v. Armstrong<\/jats:italic>\n            , 2015; ACLU, Outten &amp; Golden LLP, and the Communications Workers of America, 2019).\n          <\/jats:p>","DOI":"10.1145\/3340470.3340478","type":"journal-article","created":{"date-parts":[[2019,8,6]],"date-time":"2019-08-06T12:20:55Z","timestamp":1565094055000},"page":"30-40","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["The scales of (algorithmic) justice"],"prefix":"10.1145","volume":"5","author":[{"given":"Matthew","family":"Sun","sequence":"first","affiliation":[{"name":"Stanford University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marissa","family":"Gerchick","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,8,5]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"17\/EN. WP 251. (2017). Guidelines on Automated individual decision-making and Profiling for the purposes of Regulation 2016\/679  17\/EN. WP 251. (2017). Guidelines on Automated individual decision-making and Profiling for the purposes of Regulation 2016\/679"},{"key":"e_1_2_1_2_1","unstructured":"ACLU Outten & Golden LLP and the Communications Workers of America. (2019). Facebook EEOC complaints. https:\/\/www.aclu.org\/cases\/facebook-eeoc-complaints. (Online; accessed June 1 2019)  ACLU Outten & Golden LLP and the Communications Workers of America. (2019). Facebook EEOC complaints. https:\/\/www.aclu.org\/cases\/facebook-eeoc-complaints. (Online; accessed June 1 2019)"},{"key":"e_1_2_1_3_1","first-page":"287","volume":"469","author":"Alexander","year":"1985","journal-title":"Choate"},{"key":"e_1_2_1_4_1","unstructured":"Allegheny County. (2019). DHS funding. https:\/\/www.county.allegheny.pa.us\/Human-Services\/About\/Funding-Sources.aspx. (Online; accessed May 18 2019)  Allegheny County. (2019). DHS funding. https:\/\/www.county.allegheny.pa.us\/Human-Services\/About\/Funding-Sources.aspx. (Online; accessed May 18 2019)"},{"key":"e_1_2_1_5_1","unstructured":"Alpaydin E. (2009). Introduction to machine learning. MIT press.   Alpaydin E. (2009). Introduction to machine learning. MIT press."},{"key":"e_1_2_1_6_1","unstructured":"Angwin J. Larson J. Mattu S. & Kirchner L. (2016). Machine bias. ProPublica May 23.  Angwin J. Larson J. Mattu S. & Kirchner L. (2016). Machine bias. ProPublica May 23."},{"key":"e_1_2_1_7_1","first-page":"252","volume":"429","author":"Arlington Heights","year":"1977","journal-title":"Metropolitan Housing Dev. Corp."},{"volume":"104","journal-title":"Rev.","author":"Barocas S.","key":"e_1_2_1_8_1"},{"volume-title":"Conference on fairness, accountability and transparency (pp. 77--91)","year":"2018","author":"Buolamwini J.","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","unstructured":"Casey B. Farhangi A. & Vogl R. (2018). Rethinking explainable machines: The GDPR's \"right to explanation\" debate and the rise of algorithmic audits in enterprise.  Casey B. Farhangi A. & Vogl R. (2018). Rethinking explainable machines: The GDPR's \"right to explanation\" debate and the rise of algorithmic audits in enterprise."},{"volume-title":"Conference on Fairness, Accountability and Transparency (pp. 134--148)","year":"2018","author":"Chouldechova A.","key":"e_1_2_1_11_1"},{"key":"e_1_2_1_12_1","unstructured":"Civil Rights Act of 1964 Title VI 78 Stat. 252 42 U. S. C. &sect; 2000d.  Civil Rights Act of 1964 Title VI 78 Stat. 252 42 U. S. C. &sect; 2000d."},{"key":"e_1_2_1_13_1","unstructured":"Civil Rights Act of 1964 Title VII 42 U.S.C. &sect;2000e et seq.  Civil Rights Act of 1964 Title VII 42 U.S.C. &sect;2000e et seq."},{"key":"e_1_2_1_14_1","unstructured":"Corbett-Davies S. & Goel S. (2018). The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023.  Corbett-Davies S. & Goel S. (2018). The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098095"},{"key":"e_1_2_1_16_1","first-page":"190","volume":"429","author":"Craig","year":"1976","journal-title":"Boren"},{"key":"e_1_2_1_17_1","unstructured":"Desmarais S. L. & Lowder E. M. (2019). Pre-trial risk assessment tools: A primer for judges prosecutors and defense attorneys. MacArthur Foundation Safety and Justice Challenge.  Desmarais S. L. & Lowder E. M. (2019). Pre-trial risk assessment tools: A primer for judges prosecutors and defense attorneys. MacArthur Foundation Safety and Justice Challenge."},{"key":"e_1_2_1_18_1","unstructured":"Draft Title VI Guidance for EPA Assistance Recipients Administering Environmental Permitting Programs (Draft Recipient Guidance) and Draft Revised Guidance for Investigating Title VI Administrative Complaints Challenging Permits (Draft Revised Investigation Guidance); Notice 65 Fed. Reg. 124 (June 27 2000). Federal Register: The Daily Journal of the United States.  Draft Title VI Guidance for EPA Assistance Recipients Administering Environmental Permitting Programs (Draft Recipient Guidance) and Draft Revised Guidance for Investigating Title VI Administrative Complaints Challenging Permits (Draft Revised Investigation Guidance); Notice 65 Fed. Reg. 124 (June 27 2000). Federal Register: The Daily Journal of the United States."},{"key":"e_1_2_1_19_1","unstructured":"Eubanks V. (2018). Automating inequality How high-tech tools profile police and punish the poor. St. Martin's Press.   Eubanks V. (2018). Automating inequality How high-tech tools profile police and punish the poor. St. Martin's Press."},{"key":"e_1_2_1_20_1","unstructured":"Fishel S. Flack D. & DeMatteo D. (2018). Computer risk algorithms and judicial decision-making. Monitor on Psychology.  Fishel S. Flack D. & DeMatteo D. (2018). Computer risk algorithms and judicial decision-making. Monitor on Psychology."},{"key":"e_1_2_1_21_1","unstructured":"Gajane P. & Pechenizkiy M. (2017). On formalizing fairness in prediction with machine learning. arXiv preprint arXiv:1710.03184.  Gajane P. & Pechenizkiy M. (2017). On formalizing fairness in prediction with machine learning. arXiv preprint arXiv:1710.03184."},{"key":"e_1_2_1_22_1","unstructured":"Giammarise K. (2017). Allegheny County DHS using algorithm to assist in child welfare screening. https:\/\/www.post-gazette.com\/local\/region\/2017\/04\/09\/Allegheny-County-using-algorithm-to-assist-in-child-welfare-screening\/stories\/201701290002. (Online; accessed May 18 2019)  Giammarise K. (2017). Allegheny County DHS using algorithm to assist in child welfare screening. https:\/\/www.post-gazette.com\/local\/region\/2017\/04\/09\/Allegheny-County-using-algorithm-to-assist-in-child-welfare-screening\/stories\/201701290002. (Online; accessed May 18 2019)"},{"key":"e_1_2_1_23_1","doi-asserted-by":"crossref","unstructured":"Goodman B. & Flaxman S. (2017). European Union regulations on algorithmic decision-making and a \"right to explanation\". AI Magazine 38(3) 50--57.  Goodman B. & Flaxman S. (2017). European Union regulations on algorithmic decision-making and a \"right to explanation\". AI Magazine 38 (3) 50--57.","DOI":"10.1609\/aimag.v38i3.2741"},{"key":"e_1_2_1_24_1","first-page":"424","volume":"401","author":"Griggs","year":"1971","journal-title":"Duke Power Co."},{"key":"e_1_2_1_25_1","unstructured":"Hawkins D. (2019). The cybersecurity 202 Why a privacy law like gdpr would be a tough sell in the U.S. https:\/\/www.washingtonpost.com\/news\/powerpost\/paloma\/the-cybersecurity-202\/2018\/05\/25\/the-cybersecurity-202-why-a-privacy-law-like-gdpr-would-be-a-tough-sell-in-the-u-s\/5b07038b1b326b492dd07e83\/?utm_term=.1cc41e57f9cf. (Online; accessed May 18 2019)  Hawkins D. (2019). The cybersecurity 202 Why a privacy law like gdpr would be a tough sell in the U.S. https:\/\/www.washingtonpost.com\/news\/powerpost\/paloma\/the-cybersecurity-202\/2018\/05\/25\/the-cybersecurity-202-why-a-privacy-law-like-gdpr-would-be-a-tough-sell-in-the-u-s\/5b07038b1b326b492dd07e83\/?utm_term=.1cc41e57f9cf. (Online; accessed May 18 2019)"},{"key":"e_1_2_1_26_1","unstructured":"Hurley D. (2018). Can an algorithm tell when kids are in danger. New York Times 2.  Hurley D. (2018). Can an algorithm tell when kids are in danger. New York Times 2."},{"key":"e_1_2_1_27_1","unstructured":"Jung J. Corbett-Davies S. Shroff R. & Goel S. (2018). Omitted and included variable bias in tests for disparate impact. arXiv preprint arXiv:1809.05651.  Jung J. Corbett-Davies S. Shroff R. & Goel S. (2018). Omitted and included variable bias in tests for disparate impact. arXiv preprint arXiv:1809.05651."},{"key":"e_1_2_1_28_1","unstructured":"Kleinberg J. Mullainathan S. & Raghavan M. (2016). Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807.  Kleinberg J. Mullainathan S. & Raghavan M. (2016). Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:1609.05807."},{"volume":"165","journal-title":"Rev.","author":"Kroll J. A.","key":"e_1_2_1_29_1"},{"key":"e_1_2_1_30_1","unstructured":"K.W. v. Armstrong No. 14--35296 (9th Cir. 2015)  K.W. v. Armstrong No. 14--35296 (9th Cir. 2015)"},{"key":"e_1_2_1_31_1","unstructured":"Latessa E. Smith P. Lemke R. Makarios M. & Lowenkamp C. (2009). Creation and validation of the Ohio risk assessment system: Final report. Cincinati OH: University of Cincinnati.  Latessa E. Smith P. Lemke R. Makarios M. & Lowenkamp C. (2009). Creation and validation of the Ohio risk assessment system: Final report. Cincinati OH: University of Cincinnati."},{"key":"e_1_2_1_32_1","first-page":"563","volume":"414","author":"Lau","year":"1974","journal-title":"Nichols"},{"key":"e_1_2_1_33_1","unstructured":"Lawson R. P. (2019). GDPR enforcement actions fines pile up. https:\/\/www.manatt.com\/Insights\/Newsletters\/Advertising-Law\/GDPR-Enforcement-Actions-Fines-Pile-Up. (Online; accessed May 18 2019)  Lawson R. P. (2019). GDPR enforcement actions fines pile up. https:\/\/www.manatt.com\/Insights\/Newsletters\/Advertising-Law\/GDPR-Enforcement-Actions-Fines-Pile-Up. (Online; accessed May 18 2019)"},{"key":"e_1_2_1_34_1","unstructured":"Lecher C. (2018). What happens when an algorithm cuts your health care. The Verge.  Lecher C. (2018). What happens when an algorithm cuts your health care. The Verge."},{"key":"e_1_2_1_35_1","unstructured":"Legal Information Institute. (2018a). Equal protection. https:\/\/www.law.cornell.edu\/wex\/equal_protection. (Online; accessed May 18 2019)  Legal Information Institute. (2018a). Equal protection. https:\/\/www.law.cornell.edu\/wex\/equal_protection. (Online; accessed May 18 2019)"},{"key":"e_1_2_1_36_1","unstructured":"Legal Information Institute. (2018b). Intermediate scrutiny. https:\/\/www.law.cornell.edu\/wex\/intermediate.scrutiny. (Online; accessed June 1 2019)  Legal Information Institute. (2018b). Intermediate scrutiny. https:\/\/www.law.cornell.edu\/wex\/intermediate.scrutiny. (Online; accessed June 1 2019)"},{"key":"e_1_2_1_37_1","unstructured":"Lewis N. (2018). Will AI remove hiring bias? https:\/\/www.shrm.org\/resourcesandtools\/hr-topics\/talent-acquisition\/pages\/will-ai-remove-hiring-bias-hr-technology.aspx. (Online; accessed May 18 2019)  Lewis N. (2018). Will AI remove hiring bias? https:\/\/www.shrm.org\/resourcesandtools\/hr-topics\/talent-acquisition\/pages\/will-ai-remove-hiring-bias-hr-technology.aspx. (Online; accessed May 18 2019)"},{"key":"e_1_2_1_38_1","unstructured":"Mank B. C. (2000). The draft recipient guidance and the draft revised investigation guidance: Too much discretion for epa and a more difficult standard for complainants? Environmental Law Reporter 30.  Mank B. C. (2000). The draft recipient guidance and the draft revised investigation guidance: Too much discretion for epa and a more difficult standard for complainants? Environmental Law Reporter 30."},{"key":"e_1_2_1_39_1","unstructured":"Misra T. (2018). When criminalizing the poor goes high-tech. https:\/\/www.citylab.com\/equity\/2018\/02\/the-rise-of-digital-poorhouses\/552161\/?platform=hootsuite. (Online; accessed May 18 2019)  Misra T. (2018). When criminalizing the poor goes high-tech. https:\/\/www.citylab.com\/equity\/2018\/02\/the-rise-of-digital-poorhouses\/552161\/?platform=hootsuite. (Online; accessed May 18 2019)"},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","unstructured":"NJ Rev Stat &sect; 2A:162-25 (2014)  NJ Rev Stat &sect; 2A:162-25 (2014)","DOI":"10.1111\/clr.12458_153"},{"key":"e_1_2_1_41_1","unstructured":"O.J. (L 119) (2016). Reg (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data and repealing Dir 95\/46\/EC (General Data Protection Regulation)  O.J. (L 119) (2016). Reg (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data and repealing Dir 95\/46\/EC (General Data Protection Regulation)"},{"key":"e_1_2_1_42_1","first-page":"256","volume":"442","author":"Personnel Adm'r","year":"1979","journal-title":"Feeney"},{"key":"e_1_2_1_43_1","unstructured":"Reg (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data and repealing Dir 95\/46\/EC (General Data Protection Regulation). (2016). Reg (EU) 2016\/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data and repealing Dir 95\/46\/EC (General Data Protection Regulation). (2016)."},{"key":"e_1_2_1_44_1","first-page":"557","volume":"557","author":"Ricci","year":"2009","journal-title":"DeStefano"},{"volume":"53","journal-title":"Rev.","author":"Selmi M.","key":"e_1_2_1_45_1"},{"key":"e_1_2_1_46_1","doi-asserted-by":"crossref","unstructured":"Skeem J. Monahan J. & Lowenkamp C. (2016). Gender risk assessment and sanctioning: The cost of treating women like men. Law and human behavior 40(5) 580.  Skeem J. Monahan J. & Lowenkamp C. (2016). Gender risk assessment and sanctioning: The cost of treating women like men. Law and human behavior 40 (5) 580.","DOI":"10.1037\/lhb0000206"},{"volume":"66","journal-title":"Rev.","author":"Starr S. B.","key":"e_1_2_1_47_1"},{"key":"e_1_2_1_48_1","first-page":"749","volume":"881","author":"State","year":"2016","journal-title":"Loomis"},{"key":"e_1_2_1_49_1","unstructured":"Steinhardt E. (2018). European regulators are intensifying GDPR enforcement. https:\/\/www.insideprivacy.com\/eu-data-protection\/european-regulators-are-intensifying-gdpr-enforcement\/. (Online; accessed May 18 2019)  Steinhardt E. (2018). European regulators are intensifying GDPR enforcement. https:\/\/www.insideprivacy.com\/eu-data-protection\/european-regulators-are-intensifying-gdpr-enforcement\/. (Online; accessed May 18 2019)"},{"key":"e_1_2_1_50_1","unstructured":"Summers C. & Willis T. (2010). Pre-trial risk assessment research summary. Washington DC: Bureau of Justice Assistance.  Summers C. & Willis T. (2010). Pre-trial risk assessment research summary. Washington DC: Bureau of Justice Assistance."},{"key":"e_1_2_1_51_1","unstructured":"United States. Department of Justice. (2019). Title VI Legal Manual (Updated)  United States. Department of Justice. (2019). Title VI Legal Manual (Updated)"},{"key":"e_1_2_1_52_1","unstructured":"U.S. Government Accountability Office. (2019). Our new science technology assessment and analytics team. https:\/\/blog.gao.gov\/2019\/01\/29\/our-new-science-technology-assessment-and-analytics-team\/. (Online; accessed May 18 2019)  U.S. Government Accountability Office. (2019). Our new science technology assessment and analytics team. https:\/\/blog.gao.gov\/2019\/01\/29\/our-new-science-technology-assessment-and-analytics-team\/. (Online; accessed May 18 2019)"},{"key":"e_1_2_1_53_1","unstructured":"U.S. Const. amend. V.  U.S. Const. amend. V."},{"key":"e_1_2_1_54_1","unstructured":"U.S. Const. amend. XIV.  U.S. Const. amend. XIV."},{"key":"e_1_2_1_55_1","unstructured":"VanNostrand M. etal (2009). Pretrial risk assessment in Virginia.  VanNostrand M. et al. (2009). Pretrial risk assessment in Virginia."},{"key":"e_1_2_1_56_1","unstructured":"Weinzweig M. J. (1983). Discriminatory impact and intent under the equal protection clause: The Supreme Court and the mind-body problem. Law & Ineq. 1 277.  Weinzweig M. J. (1983). Discriminatory impact and intent under the equal protection clause: The Supreme Court and the mind-body problem. Law & Ineq. 1 277."},{"key":"e_1_2_1_57_1","unstructured":"Zliobaite I. (2015). On the relation between accuracy and fairness in binary classification. arXiv preprint arXiv:1505.05723.  Zliobaite I. (2015). On the relation between accuracy and fairness in binary classification. arXiv preprint arXiv:1505.05723."}],"container-title":["AI Matters"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340470.3340478","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3340470.3340478","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:49Z","timestamp":1750206349000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340470.3340478"}},"subtitle":["tradeoffs and remedies"],"short-title":[],"issued":{"date-parts":[[2019,8,5]]},"references-count":57,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,8,5]]}},"alternative-id":["10.1145\/3340470.3340478"],"URL":"https:\/\/doi.org\/10.1145\/3340470.3340478","relation":{},"ISSN":["2372-3483"],"issn-type":[{"type":"electronic","value":"2372-3483"}],"subject":[],"published":{"date-parts":[[2019,8,5]]},"assertion":[{"value":"2019-08-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}