{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,28]],"date-time":"2026-08-28T11:34:25Z","timestamp":1787916865125,"version":"build-2784847793"},"reference-count":76,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW","license":[{"start":{"date-parts":[[2019,11,7]],"date-time":"2019-11-07T00:00:00Z","timestamp":1573084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DGE1745303"],"award-info":[{"award-number":["DGE1745303"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2019,11,7]]},"abstract":"<jats:p>The rise of machine learning has fundamentally altered decision making: rather than being made solely by people, many important decisions are now made through an \"algorithm-in-the-loop'' process where machine learning models inform people. Yet insufficient research has considered how the interactions between people and models actually influence human decisions. Society lacks both clear normative principles regarding how people should collaborate with algorithms as well as robust empirical evidence about how people do collaborate with algorithms. Given research suggesting that people struggle to interpret machine learning models and to incorporate them into their decisions---sometimes leading these models to produce unexpected outcomes---it is essential to consider how different ways of presenting models and structuring human-algorithm interactions affect the quality and type of decisions made. This paper contributes to such research in two ways. First, we posited three principles as essential to ethical and responsible algorithm-in-the-loop decision making. Second, through a controlled experimental study on Amazon Mechanical Turk, we evaluated whether people satisfy these principles when making predictions with the aid of a risk assessment. We studied human predictions in two contexts (pretrial release and financial lending) and under several conditions for risk assessment presentation and structure. Although these conditions did influence participant behaviors and in some cases improved performance, only one desideratum was consistently satisfied. Under all conditions, our study participants 1) were unable to effectively evaluate the accuracy of their own or the risk assessment's predictions, 2) did not calibrate their reliance on the risk assessment based on the risk assessment's performance, and 3) exhibited bias in their interactions with the risk assessment. These results highlight the urgent need to expand our analyses of algorithmic decision making aids beyond evaluating the models themselves to investigating the full sociotechnical contexts in which people and algorithms interact.<\/jats:p>","DOI":"10.1145\/3359152","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T08:40:21Z","timestamp":1573202421000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":317,"title":["The Principles and Limits of Algorithm-in-the-Loop Decision Making"],"prefix":"10.1145","volume":"3","author":[{"given":"Ben","family":"Green","sequence":"first","affiliation":[{"name":"Harvard University, Cambridge, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiling","family":"Chen","sequence":"additional","affiliation":[{"name":"Harvard University, Cambridge, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,7]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"If You Give a Judge a Risk Score: Evidence from Kentucky Bail Decisions","author":"Albright Alex","year":"2019","unstructured":"Alex Albright . 2019. If You Give a Judge a Risk Score: Evidence from Kentucky Bail Decisions . The John M. Olin Center for Law , Economics , and Business Fellows' Discussion Paper Series 85 ( 2019 ). Alex Albright. 2019. If You Give a Judge a Risk Score: Evidence from Kentucky Bail Decisions. The John M. Olin Center for Law, Economics, and Business Fellows' Discussion Paper Series 85 (2019)."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300760"},{"key":"e_1_2_1_3_1","volume-title":"Machine Bias. ProPublica","author":"Angwin Julia","year":"2016","unstructured":"Julia Angwin , Jeff Larson , Surya Mattu , and Lauren Kirchner . 2016. Machine Bias. ProPublica ( 2016 ). https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias. ProPublica (2016). https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173951"},{"key":"e_1_2_1_5_1","volume-title":"Former Uber Backup Driver: 'We Saw This Coming'. CityLab","author":"Bliss Laura","year":"2018","unstructured":"Laura Bliss . 2018. Former Uber Backup Driver: 'We Saw This Coming'. CityLab ( 2018 ). https:\/\/www.citylab.com\/transportation\/2018\/03\/former-uber-backup-driver-we-saw-this-coming\/556427\/ Laura Bliss. 2018. Former Uber Backup Driver: 'We Saw This Coming'. CityLab (2018). https:\/\/www.citylab.com\/transportation\/2018\/03\/former-uber-backup-driver-we-saw-this-coming\/556427\/"},{"key":"e_1_2_1_6_1","volume-title":"All Tomorrow's Crimes: The Future of Policing Looks a Lot Like Good Branding. SF Weekly","author":"Bond-Graham Darwin","year":"2013","unstructured":"Darwin Bond-Graham and Ali Winston . 2013. All Tomorrow's Crimes: The Future of Policing Looks a Lot Like Good Branding. SF Weekly ( 2013 ). http:\/\/archives.sfweekly.com\/sanfrancisco\/all-tomorrows-crimes-the-future-of-policing-looks-a-lot-like-good-branding\/Content?oid=2827968 Darwin Bond-Graham and Ali Winston. 2013. All Tomorrow's Crimes: The Future of Policing Looks a Lot Like Good Branding. SF Weekly (2013). http:\/\/archives.sfweekly.com\/sanfrancisco\/all-tomorrows-crimes-the-future-of-policing-looks-a-lot-like-good-branding\/Content?oid=2827968"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/0003122417725865"},{"key":"e_1_2_1_8_1","volume-title":"Elek","author":"Casey Pamela M.","year":"2011","unstructured":"Pamela M. Casey , Roger K. Warren , and Jennifer K . Elek . 2011 . Using Offender Risk and Needs Assessment Information at Sentencing : Guidance for Courts from a National Working Group .National Center for State Courts . Pamela M. Casey, Roger K. Warren, and Jennifer K. Elek. 2011. Using Offender Risk and Needs Assessment Information at Sentencing: Guidance for Courts from a National Working Group .National Center for State Courts."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174209"},{"key":"e_1_2_1_10_1","volume-title":"Hyatt","author":"Chanenson Steven L.","year":"2016","unstructured":"Steven L. Chanenson and Jordan M . Hyatt . 2016 . The Use of Risk Assessment at Sentencing : Implications for Research and Policy. Bureau of Justice Assistance ( 2016). Steven L. Chanenson and Jordan M. Hyatt. 2016. The Use of Risk Assessment at Sentencing: Implications for Research and Policy. Bureau of Justice Assistance (2016)."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951717718855"},{"key":"e_1_2_1_12_1","volume-title":"23rd International Conference on Intelligent User Interfaces (IUI '18)","author":"Clark Elizabeth","unstructured":"Elizabeth Clark , Anne Spencer Ross , Chenhao Tan , Yangfeng Ji , and Noah A. Smith . 2018. Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories . In 23rd International Conference on Intelligent User Interfaces (IUI '18) . ACM, New York, NY, USA, 329--340. https:\/\/doi.org\/10.1145\/3172944.3172983 10.1145\/3172944.3172983 Elizabeth Clark, Anne Spencer Ross, Chenhao Tan, Yangfeng Ji, and Noah A. Smith. 2018. Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories. In 23rd International Conference on Intelligent User Interfaces (IUI '18). ACM, New York, NY, USA, 329--340. https:\/\/doi.org\/10.1145\/3172944.3172983"},{"key":"e_1_2_1_13_1","first-page":"12","article-title":"Examining overrides of risk classifications for offenders on federal supervision","volume":"80","author":"Cohen Thomas H.","year":"2016","unstructured":"Thomas H. Cohen , Bailey Pendergast , and Scott W. VanBenschoten . 2016 . Examining overrides of risk classifications for offenders on federal supervision . Federal Probation , Vol. 80 , 1 (2016), 12 . Thomas H. Cohen, Bailey Pendergast, and Scott W. VanBenschoten. 2016. Examining overrides of risk classifications for offenders on federal supervision. Federal Probation, Vol. 80, 1 (2016), 12.","journal-title":"Federal Probation"},{"key":"e_1_2_1_14_1","volume-title":"Even Imperfect Algorithms Can Improve the Criminal Justice System. New York Times","author":"Corbett-Davies Sam","year":"2017","unstructured":"Sam Corbett-Davies , Sharad Goel , and Sandra Gonz\u00e1lez-Bail\u00f3n . 2017. Even Imperfect Algorithms Can Improve the Criminal Justice System. New York Times ( 2017 ). https:\/\/www.nytimes.com\/2017\/12\/20\/upshot\/algorithms-bail-criminal-justice-system.html Sam Corbett-Davies, Sharad Goel, and Sandra Gonz\u00e1lez-Bail\u00f3n. 2017. Even Imperfect Algorithms Can Improve the Criminal Justice System. New York Times (2017). https:\/\/www.nytimes.com\/2017\/12\/20\/upshot\/algorithms-bail-criminal-justice-system.html"},{"key":"e_1_2_1_15_1","unstructured":"New Jersey Courts. 2017. One Year Criminal Justice Reform Report to the Governor and the Legislature. (2017). https:\/\/www.njcourts.gov\/courts\/assets\/criminal\/2017cjrannual.pdf  New Jersey Courts. 2017. One Year Criminal Justice Reform Report to the Governor and the Legislature. (2017). https:\/\/www.njcourts.gov\/courts\/assets\/criminal\/2017cjrannual.pdf"},{"key":"e_1_2_1_16_1","unstructured":"Bo Cowgill. 2018. The Impact of Algorithms on Judicial Discretion: Evidence from Regression Discontinuities. (2018).  Bo Cowgill. 2018. The Impact of Algorithms on Judicial Discretion: Evidence from Regression Discontinuities. (2018)."},{"key":"e_1_2_1_17_1","volume-title":"Automation and Accountability in Decision Support System Interface Design. Journal of Technology Studies","author":"Cummings Mary L.","year":"2006","unstructured":"Mary L. Cummings . 2006. Automation and Accountability in Decision Support System Interface Design. Journal of Technology Studies ( 2006 ). Mary L. Cummings. 2006. Automation and Accountability in Decision Support System Interface Design. Journal of Technology Studies (2006)."},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Matthew DeMichele Peter Baumgartner Michael Wenger Kelle Barrick Megan Comfort and Shilpi Misra. 2018. The Public Safety Assessment: A Re-Validation and Assessment of Predictive Utility and Differential Prediction by Race and Gender in Kentucky. (2018).  Matthew DeMichele Peter Baumgartner Michael Wenger Kelle Barrick Megan Comfort and Shilpi Misra. 2018. The Public Safety Assessment: A Re-Validation and Assessment of Predictive Utility and Differential Prediction by Race and Gender in Kentucky. (2018).","DOI":"10.2139\/ssrn.3168452"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1037\/ser0000075"},{"key":"e_1_2_1_20_1","volume-title":"Singh","author":"Desmarais Sarah L.","year":"2013","unstructured":"Sarah L. Desmarais and Jay P . Singh . 2013 . Risk Assessment Instruments Validated and Implemented in Correctional Settings in the United States . (2013). Sarah L. Desmarais and Jay P. Singh. 2013. Risk Assessment Instruments Validated and Implemented in Correctional Settings in the United States. (2013)."},{"key":"e_1_2_1_21_1","volume-title":"COMPAS Risk Scales: Demonstrating Accuracy Equity and Predictive Parity","author":"Dieterich William","year":"2016","unstructured":"William Dieterich , Christina Mendoza , and Tim Brennan . 2016. COMPAS Risk Scales: Demonstrating Accuracy Equity and Predictive Parity . Northpointe Inc . ( 2016 ). William Dieterich, Christina Mendoza, and Tim Brennan. 2016. COMPAS Risk Scales: Demonstrating Accuracy Equity and Predictive Parity. Northpointe Inc. (2016)."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"e_1_2_1_23_1","volume-title":"Accountability of AI Under the Law: The Role of Explanation. arXiv preprint arXiv:1711.01134","author":"Doshi-Velez Finale","year":"2017","unstructured":"Finale Doshi-Velez , Mason Kortz , Ryan Budish , Chris Bavitz , Sam Gershman , David O'Brien , Stuart Schieber , James Waldo , David Weinberger , and Alexandra Wood . 2017. Accountability of AI Under the Law: The Role of Explanation. arXiv preprint arXiv:1711.01134 ( 2017 ). Finale Doshi-Velez, Mason Kortz, Ryan Budish, Chris Bavitz, Sam Gershman, David O'Brien, Stuart Schieber, James Waldo, David Weinberger, and Alexandra Wood. 2017. Accountability of AI Under the Law: The Role of Explanation. arXiv preprint arXiv:1711.01134 (2017)."},{"key":"e_1_2_1_24_1","first-page":"18","article-title":"Slave to the Algorithm? Why a 'Right to an Explanation' Is Probably Not the Remedy You Are Looking For","volume":"16","author":"Edwards Lilian","year":"2017","unstructured":"Lilian Edwards and Michael Veale . 2017 . Slave to the Algorithm? Why a 'Right to an Explanation' Is Probably Not the Remedy You Are Looking For . Duke Law & Technology Review. , Vol. 16 (2017), 18 -- 84 . Lilian Edwards and Michael Veale. 2017. Slave to the Algorithm? Why a 'Right to an Explanation' Is Probably Not the Remedy You Are Looking For. Duke Law & Technology Review., Vol. 16 (2017), 18--84.","journal-title":"Duke Law & Technology Review."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.17351\/ests2019.260"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence. 1313--1319","author":"Elmalech Avshalom","year":"2015","unstructured":"Avshalom Elmalech , David Sarne , Avi Rosenfeld , and Eden Shalom Erez . 2015 . When Suboptimal Rules . In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence. 1313--1319 . Avshalom Elmalech, David Sarne, Avi Rosenfeld, and Eden Shalom Erez. 2015. When Suboptimal Rules. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence. 1313--1319."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1177\/0146167205282152"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702556"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the 8th International Conference on Intelligent User Interfaces (IUI '03)","author":"Fails Jerry Alan","unstructured":"Jerry Alan Fails and Dan R . Olsen, Jr. 2003. Interactive Machine Learning . In Proceedings of the 8th International Conference on Intelligent User Interfaces (IUI '03) . ACM, New York, NY, USA, 39--45. https:\/\/doi.org\/10.1145\/604045.604056 10.1145\/604045.604056 Jerry Alan Fails and Dan R. Olsen, Jr. 2003. Interactive Machine Learning. In Proceedings of the 8th International Conference on Intelligent User Interfaces (IUI '03). ACM, New York, NY, USA, 39--45. https:\/\/doi.org\/10.1145\/604045.604056"},{"key":"e_1_2_1_30_1","volume-title":"NEW R package that makes XGBoost interpretable","author":"Foster David","year":"2017","unstructured":"David Foster . 2017. NEW R package that makes XGBoost interpretable . Medium : Applied Data Science ( 2017 ). https:\/\/medium.com\/applied-data-science\/new-r-package-the-xgboost-explainer-51dd7d1aa211 David Foster. 2017. NEW R package that makes XGBoost interpretable. Medium: Applied Data Science (2017). https:\/\/medium.com\/applied-data-science\/new-r-package-the-xgboost-explainer-51dd7d1aa211"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1198\/016214506000001437"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-0771(199903)12:1<37::AID-BDM319>3.0.CO;2-8"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 5th Workshop on Fairness, Accountability, and Transparency in Machine Learning .","author":"Green Ben","year":"2018","unstructured":"Ben Green . 2018 . \" Fair\" Risk Assessments: A Precarious Approach for Criminal Justice Reform . In Proceedings of the 5th Workshop on Fairness, Accountability, and Transparency in Machine Learning . Ben Green. 2018. \"Fair\" Risk Assessments: A Precarious Approach for Criminal Justice Reform. In Proceedings of the 5th Workshop on Fairness, Accountability, and Transparency in Machine Learning ."},{"key":"e_1_2_1_35_1","volume-title":"Data Science as Political Action: Grounding Data Science in a Politics of Justice. arXiv preprint arXiv:1811.03435","author":"Green Ben","year":"2019","unstructured":"Ben Green . 2019. Data Science as Political Action: Grounding Data Science in a Politics of Justice. arXiv preprint arXiv:1811.03435 ( 2019 ). Ben Green. 2019. Data Science as Political Action: Grounding Data Science in a Politics of Justice. arXiv preprint arXiv:1811.03435 (2019)."},{"key":"e_1_2_1_36_1","volume-title":"The Smart Enough City: Putting Technology in Its Place to Reclaim Our Urban Future","author":"Green Ben","unstructured":"Ben Green . 2019. The Smart Enough City: Putting Technology in Its Place to Reclaim Our Urban Future . MIT Press . Ben Green. 2019. The Smart Enough City: Putting Technology in Its Place to Reclaim Our Urban Future. MIT Press."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287563"},{"key":"e_1_2_1_38_1","first-page":"777","article-title":"Inside the Judicial Mind","volume":"86","author":"Guthrie Chris","year":"2000","unstructured":"Chris Guthrie , Jeffrey J. Rachlinski , and Andrew J. Wistrich . 2000 . Inside the Judicial Mind . Cornell Law Review , Vol. 86 (2000), 777 . Chris Guthrie, Jeffrey J. Rachlinski, and Andrew J. Wistrich. 2000. Inside the Judicial Mind. Cornell Law Review, Vol. 86 (2000), 777.","journal-title":"Cornell Law Review"},{"key":"e_1_2_1_39_1","volume-title":"Deadly Boeing Crashes Raise Questions About Airplane Automation. The Verge","author":"Hawkins Andrew J.","year":"2019","unstructured":"Andrew J. Hawkins . 2019. Deadly Boeing Crashes Raise Questions About Airplane Automation. The Verge ( 2019 ). https:\/\/www.theverge.com\/2019\/3\/15\/18267365\/boeing-737-max-8-crash-autopilot-automation Andrew J. Hawkins. 2019. Deadly Boeing Crashes Raise Questions About Airplane Automation. The Verge (2019). https:\/\/www.theverge.com\/2019\/3\/15\/18267365\/boeing-737-max-8-crash-autopilot-automation"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_2_1_41_1","unstructured":"Human Rights Watch. 2017. \"Not in it for Justice\": How California's Pretrial Detention and Bail System Unfairly Punishes Poor People. (2017). https:\/\/www.hrw.org\/report\/2017\/04\/11\/not-it-justice\/how-californias-pretrial-detention-and-bail-system-unfairly  Human Rights Watch. 2017. \"Not in it for Justice\": How California's Pretrial Detention and Bail System Unfairly Punishes Poor People. (2017). https:\/\/www.hrw.org\/report\/2017\/04\/11\/not-it-justice\/how-californias-pretrial-detention-and-bail-system-unfairly"},{"key":"e_1_2_1_42_1","volume-title":"Hollywood","author":"Hunt Priscillia","year":"2014","unstructured":"Priscillia Hunt , Jessica Saunders , and John S . Hollywood . 2014 . Evaluation of the Shreveport Predictive Policing Experiment .RAND Corporation . https:\/\/www.rand.org\/pubs\/research_reports\/RR531.html Priscillia Hunt, Jessica Saunders, and John S. Hollywood. 2014. Evaluation of the Shreveport Predictive Policing Experiment .RAND Corporation. https:\/\/www.rand.org\/pubs\/research_reports\/RR531.html"},{"key":"e_1_2_1_43_1","unstructured":"Northpointe Inc. 2012. COMPAS Risk & Need Assessment System. (2012). http:\/\/www.northpointeinc.com\/files\/downloads\/FAQ_Document.pdf  Northpointe Inc. 2012. COMPAS Risk & Need Assessment System. (2012). http:\/\/www.northpointeinc.com\/files\/downloads\/FAQ_Document.pdf"},{"key":"e_1_2_1_44_1","unstructured":"Daniel Kahneman. 2011. Thinking Fast and Slow .Farrar Straus and Giroux.  Daniel Kahneman. 2011. Thinking Fast and Slow .Farrar Straus and Giroux."},{"key":"e_1_2_1_45_1","volume-title":"Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems -","volume":"1","author":"Kamar Ece","year":"2012","unstructured":"Ece Kamar , Severin Hacker , and Eric Horvitz . 2012 . Combining Human and Machine Intelligence in Large-scale Crowdsourcing . In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1 (AAMAS '12). International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 467--474. http:\/\/dl.acm.org\/citation.cfm?id=2343576.2343643 Ece Kamar, Severin Hacker, and Eric Horvitz. 2012. Combining Human and Machine Intelligence in Large-scale Crowdsourcing. In Proceedings of the 11th International Conference on Autonomous Agents and Multiagent Systems - Volume 1 (AAMAS '12). International Foundation for Autonomous Agents and Multiagent Systems, Richland, SC, 467--474. http:\/\/dl.acm.org\/citation.cfm?id=2343576.2343643"},{"key":"e_1_2_1_46_1","first-page":"237","article-title":"Human Decisions and Machine Predictions","volume":"133","author":"Kleinberg Jon","year":"2017","unstructured":"Jon Kleinberg , Himabindu Lakkaraju , Jure Leskovec , Jens Ludwig , and Sendhil Mullainathan . 2017 . Human Decisions and Machine Predictions . The Quarterly Journal of Economics , Vol. 133 , 1 (2017), 237 -- 293 . https:\/\/doi.org\/10.1093\/qje\/qjx032 10.1093\/qje Jon Kleinberg, Himabindu Lakkaraju, Jure Leskovec, Jens Ludwig, and Sendhil Mullainathan. 2017. Human Decisions and Machine Predictions. The Quarterly Journal of Economics, Vol. 133, 1 (2017), 237--293. https:\/\/doi.org\/10.1093\/qje\/qjx032","journal-title":"The Quarterly Journal of Economics"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557238"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287590"},{"key":"e_1_2_1_49_1","volume-title":"How We Analyzed the COMPAS Recidivism Algorithm. ProPublica","author":"Larson Jeff","year":"2016","unstructured":"Jeff Larson , Surya Mattu , Lauren Kirchner , and Julia Angwin . 2016. How We Analyzed the COMPAS Recidivism Algorithm. ProPublica ( 2016 ). https:\/\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm Jeff Larson, Surya Mattu, Lauren Kirchner, and Julia Angwin. 2016. How We Analyzed the COMPAS Recidivism Algorithm. ProPublica (2016). https:\/\/www.propublica.org\/article\/how-we-analyzed-the-compas-recidivism-algorithm"},{"key":"e_1_2_1_50_1","unstructured":"Laura and John Arnold Foundation. 2016. Public Safety Assessment: Risk Factors and Formula. (2016). http:\/\/www.arnoldfoundation.org\/wp-content\/uploads\/PSA-Risk-Factors-and-Formula.pdf  Laura and John Arnold Foundation. 2016. Public Safety Assessment: Risk Factors and Formula. (2016). http:\/\/www.arnoldfoundation.org\/wp-content\/uploads\/PSA-Risk-Factors-and-Formula.pdf"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1518\/hfes.46.1.50.30392"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951718756684"},{"key":"e_1_2_1_53_1","unstructured":"Lending Club. 2019. Lending Club Statistics. (2019). https:\/\/www.lendingclub.com\/info\/download-data.action  Lending Club. 2019. Lending Club Statistics. (2019). https:\/\/www.lendingclub.com\/info\/download-data.action"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1111\/peps.12052"},{"key":"e_1_2_1_55_1","volume-title":"What Should Be Done with Equity Theory? In Social Exchange","author":"Leventhal Gerald S.","unstructured":"Gerald S. Leventhal . 1980. What Should Be Done with Equity Theory? In Social Exchange . Springer , 27--55. Gerald S. Leventhal. 1980. What Should Be Done with Equity Theory? In Social Exchange. Springer, 27--55."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1002\/bdm.3960080302"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2018.12.005"},{"key":"e_1_2_1_58_1","volume-title":"Cook County judges not following bail recommendations: study. Chicago Sun-Times","author":"Main Frank","year":"2016","unstructured":"Frank Main . 2016. Cook County judges not following bail recommendations: study. Chicago Sun-Times ( 2016 ). https:\/\/chicago.suntimes.com\/chicago-news\/cook-county-judges-not-following-bail-recommendations-study-find\/ Frank Main. 2016. Cook County judges not following bail recommendations: study. Chicago Sun-Times (2016). https:\/\/chicago.suntimes.com\/chicago-news\/cook-county-judges-not-following-bail-recommendations-study-find\/"},{"key":"e_1_2_1_59_1","volume-title":"Want Less-Biased Decisions? Use Algorithms. Harvard Business Review","author":"Miller Alex P.","year":"2018","unstructured":"Alex P. Miller . 2018. Want Less-Biased Decisions? Use Algorithms. Harvard Business Review ( 2018 ). https:\/\/hbr.org\/2018\/07\/want-less-biased-decisions-use-algorithms Alex P. Miller. 2018. Want Less-Biased Decisions? Use Algorithms. Harvard Business Review (2018). https:\/\/hbr.org\/2018\/07\/want-less-biased-decisions-use-algorithms"},{"key":"e_1_2_1_60_1","unstructured":"myFICO. 2016. Understanding FICO Scores. (2016). https:\/\/www.myfico.com\/Downloads\/Files\/myFICO_UYFS_Booklet.pdf  myFICO. 2016. Understanding FICO Scores. (2016). https:\/\/www.myfico.com\/Downloads\/Files\/myFICO_UYFS_Booklet.pdf"},{"key":"e_1_2_1_61_1","volume-title":"How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation. arXiv preprint arXiv:1802.00682","author":"Narayanan Menaka","year":"2018","unstructured":"Menaka Narayanan , Emily Chen , Jeffrey He , Been Kim , Sam Gershman , and Finale Doshi-Velez . 2018. How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation. arXiv preprint arXiv:1802.00682 ( 2018 ). Menaka Narayanan, Emily Chen, Jeffrey He, Been Kim, Sam Gershman, and Finale Doshi-Velez. 2018. How do Humans Understand Explanations from Machine Learning Systems? An Evaluation of the Human-Interpretability of Explanation. arXiv preprint arXiv:1802.00682 (2018)."},{"key":"e_1_2_1_62_1","volume-title":"Jennifer Wortman Vaughan, and Hanna Wallach","author":"Poursabzi-Sangdeh Forough","year":"2018","unstructured":"Forough Poursabzi-Sangdeh , Daniel G. Goldstein , Jake M. Hofman , Jennifer Wortman Vaughan, and Hanna Wallach . 2018 . Manipulating and Measuring Model Interpretability . arXiv preprint arXiv:1802.07810 (2018). Forough Poursabzi-Sangdeh, Daniel G. Goldstein, Jake M. Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. 2018. Manipulating and Measuring Model Interpretability. arXiv preprint arXiv:1802.07810 (2018)."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_64_1","volume-title":"Credit Risk Scorecards: Developing and Implementing Intelligent Credit Scoring","author":"Siddiqi Naeem","unstructured":"Naeem Siddiqi . 2012. Credit Risk Scorecards: Developing and Implementing Intelligent Credit Scoring . Wiley . Naeem Siddiqi. 2012. Credit Risk Scorecards: Developing and Implementing Intelligent Credit Scoring. Wiley."},{"key":"e_1_2_1_65_1","series-title":"In 2017 AAAI Spring Symposium Series","volume-title":"Dice in the black box: User experiences with an inscrutable algorithm","author":"Springer Aaron","unstructured":"Aaron Springer , Victoria Hollis , and Steve Whittaker . 2017. Dice in the black box: User experiences with an inscrutable algorithm . In 2017 AAAI Spring Symposium Series . Aaron Springer, Victoria Hollis, and Steve Whittaker. 2017. Dice in the black box: User experiences with an inscrutable algorithm. In 2017 AAAI Spring Symposium Series ."},{"key":"e_1_2_1_66_1","first-page":"803","article-title":"Evidence-Based Sentencing and the Scientific Rationalization of Discrimination","volume":"66","author":"Starr Sonja B.","year":"2014","unstructured":"Sonja B. Starr . 2014 . Evidence-Based Sentencing and the Scientific Rationalization of Discrimination . Stanford Law Review , Vol. 66 , 4 (2014), 803 -- 872 . Sonja B. Starr. 2014. Evidence-Based Sentencing and the Scientific Rationalization of Discrimination. Stanford Law Review, Vol. 66, 4 (2014), 803--872.","journal-title":"Stanford Law Review"},{"key":"e_1_2_1_67_1","first-page":"303","article-title":"Assessing Risk Assessment in Action","volume":"103","author":"Stevenson Megan","year":"2018","unstructured":"Megan Stevenson . 2018 . Assessing Risk Assessment in Action . Minnesota Law Review , Vol. 103 (2018), 303 -- 384 . Megan Stevenson. 2018. Assessing Risk Assessment in Action. Minnesota Law Review, Vol. 103 (2018), 303--384.","journal-title":"Minnesota Law Review"},{"key":"e_1_2_1_68_1","volume-title":"Doleac","author":"Stevenson Megan T.","year":"2018","unstructured":"Megan T. Stevenson and Jennifer L . Doleac . 2018 . The Roadblock to Reform. The American Constitution Society ( 2018). https:\/\/www.acslaw.org\/wp-content\/uploads\/2018\/11\/RoadblockToReformReport.pdf Megan T. Stevenson and Jennifer L. Doleac. 2018. The Roadblock to Reform. The American Constitution Society (2018). https:\/\/www.acslaw.org\/wp-content\/uploads\/2018\/11\/RoadblockToReformReport.pdf"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1177\/00027649921955335"},{"key":"e_1_2_1_70_1","volume-title":"arXiv preprint arXiv:1808.09123","author":"Tan Sarah","year":"2018","unstructured":"Sarah Tan , Julius Adebayo , Kori Inkpen , and Ece Kamar . 2018. Investigating Human+ Machine Complementarity for Recidivism Predictions . arXiv preprint arXiv:1808.09123 ( 2018 ). Sarah Tan, Julius Adebayo, Kori Inkpen, and Ece Kamar. 2018. Investigating Human+Machine Complementarity for Recidivism Predictions. arXiv preprint arXiv:1808.09123 (2018)."},{"key":"e_1_2_1_71_1","volume-title":"Office of Justice Programs","author":"United States Department of Justice.","year":"2014","unstructured":"United States Department of Justice. Office of Justice Programs . Bureau of Justice Statistics . 2014 . State Court Processing Statistics, 1990--2009: Felony Defendants in Large Urban Counties. United States Department of Justice. Office of Justice Programs. Bureau of Justice Statistics. 2014. State Court Processing Statistics, 1990--2009: Felony Defendants in Large Urban Counties."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287566"},{"key":"e_1_2_1_73_1","unstructured":"Gina M. Vincent Laura S. Guy and Thomas Grisso. 2012. Risk Assessment in Juvenile Justice: A Guidebook for Implementation. (2012). http:\/\/njjn.org\/uploads\/digital-library\/Risk_Assessment_in_Juvenile_Justice_A_Guidebook_for_Implementation.pdf  Gina M. Vincent Laura S. Guy and Thomas Grisso. 2012. Risk Assessment in Juvenile Justice: A Guidebook for Implementation. (2012). http:\/\/njjn.org\/uploads\/digital-library\/Risk_Assessment_in_Juvenile_Justice_A_Guidebook_for_Implementation.pdf"},{"key":"e_1_2_1_74_1","unstructured":"Wisconsin Supreme Court. 2016. State v. Loomis. 881 Wis. N.W.2d 749.  Wisconsin Supreme Court. 2016. State v. Loomis. 881 Wis. N.W.2d 749."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.obhdp.2003.08.002"},{"key":"e_1_2_1_76_1","volume-title":"Making sense of recommendations. Journal of Behavioral Decision Making","author":"Yeomans Michael","year":"2019","unstructured":"Michael Yeomans , Anuj Shah , Sendhil Mullainathan , and Jon Kleinberg . 2019. Making sense of recommendations. Journal of Behavioral Decision Making ( 2019 ). https:\/\/doi.org\/10.1002\/bdm.2118 10.1002\/bdm.2118 Michael Yeomans, Anuj Shah, Sendhil Mullainathan, and Jon Kleinberg. 2019. Making sense of recommendations. Journal of Behavioral Decision Making (2019). https:\/\/doi.org\/10.1002\/bdm.2118"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359152","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359152","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3359152","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:12:53Z","timestamp":1750187573000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3359152"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,7]]},"references-count":76,"journal-issue":{"issue":"CSCW","published-print":{"date-parts":[[2019,11,7]]}},"alternative-id":["10.1145\/3359152"],"URL":"https:\/\/doi.org\/10.1145\/3359152","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,7]]},"assertion":[{"value":"2019-11-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}