{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,8]],"date-time":"2026-05-08T00:29:30Z","timestamp":1778200170784,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":54,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,5,2]],"date-time":"2019-05-02T00:00:00Z","timestamp":1556755200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,5,2]]},"DOI":"10.1145\/3290605.3300789","type":"proceedings-article","created":{"date-parts":[[2019,4,29]],"date-time":"2019-04-29T17:36:58Z","timestamp":1556559418000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":240,"title":["Explaining Decision-Making Algorithms through UI"],"prefix":"10.1145","author":[{"given":"Hao-Fei","family":"Cheng","sequence":"first","affiliation":[{"name":"University of Minnesota, Minneapolis, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruotong","family":"Wang","sequence":"additional","affiliation":[{"name":"Macalester College, Saint Paul, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zheng","family":"Zhang","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fiona","family":"O'Connell","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Terrance","family":"Gray","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"F. Maxwell","family":"Harper","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haiyi","family":"Zhu","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, MN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,5,2]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702509"},{"key":"e_1_3_2_2_3_1","first-page":"168","article-title":"Make algorithms accountable","volume":"1","author":"Angwin Julia","year":"2016","unstructured":"Julia Angwin . 2016 . Make algorithms accountable . The New York Times 1 (2016), 168 . Julia Angwin. 2016. Make algorithms accountable. The New York Times 1 (2016), 168.","journal-title":"The New York Times"},{"key":"e_1_3_2_2_4_1","unstructured":"Barry Becker Ron Kohavi and Dan Sommerfield. 2002. Visualizing the Simple Bayesian Classifier. In Information visualization in data mining and knowledge discovery. Morgan Kaufmann 237--249.   Barry Becker Ron Kohavi and Dan Sommerfield. 2002. Visualizing the Simple Bayesian Classifier. In Information visualization in data mining and knowledge discovery. Morgan Kaufmann 237--249."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327051HCI16234_05"},{"key":"e_1_3_2_2_6_1","volume-title":"IJCAI-17 Workshop on Explainable AI (XAI). 8. Explaining Decision-Making Algorithms through UI CHI 2019","author":"Biran Or","year":"2017","unstructured":"Or Biran and Courtenay Cotton . 2017 . Explanation and justification in machine learning: A survey . In IJCAI-17 Workshop on Explainable AI (XAI). 8. Explaining Decision-Making Algorithms through UI CHI 2019 , May 4 --9 , 2019, Glasgow, Scotland Uk Or Biran and Courtenay Cotton. 2017. Explanation and justification in machine learning: A survey. In IJCAI-17 Workshop on Explainable AI (XAI). 8. Explaining Decision-Making Algorithms through UI CHI 2019, May 4--9, 2019, Glasgow, Scotland Uk"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715622512"},{"key":"e_1_3_2_2_8_1","volume-title":"Interactive Classification for Deep Learning Interpretation. arXiv preprint arXiv:1806.05660","author":"Cabrera \u00c1ngel","year":"2018","unstructured":"\u00c1ngel Cabrera , Fred Hohman , Jason Lin , and Duen Horng Chau . 2018. Interactive Classification for Deep Learning Interpretation. arXiv preprint arXiv:1806.05660 ( 2018 ). \u00c1ngel Cabrera, Fred Hohman, Jason Lin, and Duen Horng Chau. 2018. Interactive Classification for Deep Learning Interpretation. arXiv preprint arXiv:1806.05660 (2018)."},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/502512.502547"},{"key":"e_1_3_2_2_10_1","volume-title":"Conference on Fairness, Accountability and Transparency. 134--148","author":"Chouldechova Alexandra","year":"2018","unstructured":"Alexandra Chouldechova , Diana Benavides-Prado , Oleksandr Fialko , and Rhema Vaithianathan . 2018 . A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions . In Conference on Fairness, Accountability and Transparency. 134--148 . Alexandra Chouldechova, Diana Benavides-Prado, Oleksandr Fialko, and Rhema Vaithianathan. 2018. A case study of algorithm-assisted decision making in child maltreatment hotline screening decisions. In Conference on Fairness, Accountability and Transparency. 134--148."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098095"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1071-5819(03)00041-7"},{"key":"e_1_3_2_2_13_1","unstructured":"Mark Craven and Jude Shavlik. 1999. Rule extraction: Where do we go from here. University of Wisconsin Machine Learning Research Group working Paper 99 (1999).  Mark Craven and Jude Shavlik. 1999. Rule extraction: Where do we go from here. University of Wisconsin Machine Learning Research Group working Paper 99 (1999)."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998192"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3186320"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2844110"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000033"},{"key":"e_1_3_2_2_18_1","volume-title":"A roadmap for a rigorous science of interpretability. arXiv preprint. arXiv preprint arXiv:1702.08608","author":"Doshi-Velez Finale","year":"2017","unstructured":"Finale Doshi-Velez and Been Kim . 2017. A roadmap for a rigorous science of interpretability. arXiv preprint. arXiv preprint arXiv:1702.08608 ( 2017 ). Finale Doshi-Velez and Been Kim. 2017. A roadmap for a rigorous science of interpretability. arXiv preprint. arXiv preprint arXiv:1702.08608 (2017)."},{"key":"e_1_3_2_2_19_1","volume-title":"The accuracy, fairness, and limits of predicting recidivism. Science advances 4, 1","author":"Dressel Julia","year":"2018","unstructured":"Julia Dressel and Hany Farid . 2018. The accuracy, fairness, and limits of predicting recidivism. Science advances 4, 1 ( 2018 ), eaao5580. Julia Dressel and Hany Farid. 2018. The accuracy, fairness, and limits of predicting recidivism. Science advances 4, 1 (2018), eaao5580."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858494"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Megan French and Jeff Hancock. 2017. What's the folk theory? Reasoning about cyber-social systems. (2017).  Megan French and Jeff Hancock. 2017. What's the folk theory? Reasoning about cyber-social systems. (2017).","DOI":"10.2139\/ssrn.2910571"},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.689662"},{"key":"e_1_3_2_2_23_1","volume-title":"European Union regulations on algorithmic decision-making and a \"right to explanation\". arXiv preprint arXiv:1606.08813","author":"Goodman Bryce","year":"2016","unstructured":"Bryce Goodman and Seth Flaxman . 2016. European Union regulations on algorithmic decision-making and a \"right to explanation\". arXiv preprint arXiv:1606.08813 ( 2016 ). Bryce Goodman and Seth Flaxman. 2016. European Union regulations on algorithmic decision-making and a \"right to explanation\". arXiv preprint arXiv:1606.08813 (2016)."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647408"},{"key":"e_1_3_2_2_25_1","volume-title":"Research in the crowdsourcing age, a case study","author":"Hitlin Paul","year":"2016","unstructured":"Paul Hitlin . 2016. Research in the crowdsourcing age, a case study . Pew Research Center 11 ( 2016 ). Paul Hitlin. 2016. Research in the crowdsourcing age, a case study. Pew Research Center 11 (2016)."},{"key":"e_1_3_2_2_26_1","volume-title":"Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers","author":"Hohman Fred Matthew","year":"2018","unstructured":"Fred Matthew Hohman , Minsuk Kahng , Robert Pienta , and Duen Horng Chau . 2018. Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers . IEEE Transactions on Visualization and Computer Graphics ( 2018 ). Fred Matthew Hohman, Minsuk Kahng, Robert Pienta, and Duen Horng Chau. 2018. Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers. IEEE Transactions on Visualization and Computer Graphics (2018)."},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303030"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1081870.1081886"},{"key":"e_1_3_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025626"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.3386\/w23180"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858529"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140139208967392"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2998181.2998230"},{"key":"e_1_3_2_2_34_1","unstructured":"Brian Y Lim. 2012. Improving understanding and trust with intelligibility in context-aware applications. (2012).  Brian Y Lim. 2012. Improving understanding and trust with intelligibility in context-aware applications. (2012)."},{"key":"e_1_3_2_2_35_1","volume-title":"The mythos of model interpretability. arXiv preprint arXiv:1606.03490","author":"Lipton Zachary C","year":"2016","unstructured":"Zachary C Lipton . 2016. The mythos of model interpretability. arXiv preprint arXiv:1606.03490 ( 2016 ). Zachary C Lipton. 2016. The mythos of model interpretability. arXiv preprint arXiv:1606.03490 (2016)."},{"key":"e_1_3_2_2_36_1","unstructured":"David Martens and Foster Provost. 2013. Explaining data-driven document classifications. (2013).  David Martens and Foster Provost. 2013. Explaining data-driven document classifications. (2013)."},{"key":"e_1_3_2_2_37_1","volume-title":"Identifying careless responses in survey data. Psychological methods 17, 3","author":"Meade Adam W","year":"2012","unstructured":"Adam W Meade and S Bartholomew Craig . 2012. Identifying careless responses in survey data. Psychological methods 17, 3 ( 2012 ), 437. Adam W Meade and S Bartholomew Craig. 2012. Identifying careless responses in survey data. Psychological methods 17, 3 (2012), 437."},{"key":"e_1_3_2_2_38_1","volume-title":"Explanation in artificial intelligence: insights from the social sciences. arXiv preprint arXiv:1706.07269","author":"Miller Tim","year":"2017","unstructured":"Tim Miller . 2017. Explanation in artificial intelligence: insights from the social sciences. arXiv preprint arXiv:1706.07269 ( 2017 ). Tim Miller. 2017. Explanation in artificial intelligence: insights from the social sciences. arXiv preprint arXiv:1706.07269 (2017)."},{"key":"e_1_3_2_2_39_1","volume-title":"Illuminating the \"black box\": a randomization approach for understanding variable contributions in artificial neural networks. Ecological modelling 154, 1--2","author":"Olden Julian D","year":"2002","unstructured":"Julian D Olden and Donald A Jackson . 2002. Illuminating the \"black box\": a randomization approach for understanding variable contributions in artificial neural networks. Ecological modelling 154, 1--2 ( 2002 ), 135--150. Julian D Olden and Donald A Jackson. 2002. Illuminating the \"black box\": a randomization approach for understanding variable contributions in artificial neural networks. Ecological modelling 154, 1--2 (2002), 135--150."},{"key":"e_1_3_2_2_40_1","volume-title":"Weapons of math destruction: How big data increases inequality and threatens democracy","author":"O'Neil Cathy","unstructured":"Cathy O'Neil . 2016. Weapons of math destruction: How big data increases inequality and threatens democracy . Broadway Books . Cathy O'Neil. 2016. Weapons of math destruction: How big data increases inequality and threatens democracy. Broadway Books."},{"key":"e_1_3_2_2_41_1","volume-title":"IJCAI Proceedings-International Joint Conference on Artificial Intelligence","volume":"22","author":"Patel Kayur","year":"2011","unstructured":"Kayur Patel , Steven M Drucker , James Fogarty , Ashish Kapoor , and Desney S Tan . 2011 . Using multiple models to understand data . In IJCAI Proceedings-International Joint Conference on Artificial Intelligence , Vol. 22 . 1723. Kayur Patel, Steven M Drucker, James Fogarty, Ashish Kapoor, and Desney S Tan. 2011. Using multiple models to understand data. In IJCAI Proceedings-International Joint Conference on Artificial Intelligence, Vol. 22. 1723."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2010.11.028"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976600300015394"},{"key":"e_1_3_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598828"},{"key":"e_1_3_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_2_46_1","volume-title":"Direct-manipulation visualization of deep networks. arXiv preprint arXiv:1708.03788","author":"Smilkov Daniel","year":"2017","unstructured":"Daniel Smilkov , Shan Carter , D Sculley , Fernanda B Vi\u00e9gas , and Martin Wattenberg . 2017. Direct-manipulation visualization of deep networks. arXiv preprint arXiv:1708.03788 ( 2017 ). Daniel Smilkov, Shan Carter, D Sculley, Fernanda B Vi\u00e9gas, and Martin Wattenberg. 2017. Direct-manipulation visualization of deep networks. arXiv preprint arXiv:1708.03788 (2017)."},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.03.004"},{"key":"e_1_3_2_2_48_1","unstructured":"Sebastian Thrun. 1995. Extracting rules from artificial neural networks with distributed representations. In Advances in neural information processing systems. 505--512.   Sebastian Thrun. 1995. Extracting rules from artificial neural networks with distributed representations. In Advances in neural information processing systems. 505--512."},{"key":"e_1_3_2_2_49_1","unstructured":"Meng-Jung Tsai Ching-Yeh Wang and Po-Fen Hsu. {n. d.}. Developing the Computer Programming Self-Efficacy Scale for Computer Literacy Education. Journal of Educational Computing Research ({n. d.}) 0735633117746747.  Meng-Jung Tsai Ching-Yeh Wang and Po-Fen Hsu. {n. d.}. Developing the Computer Programming Self-Efficacy Scale for Computer Literacy Education. Journal of Educational Computing Research ({n. d.}) 0735633117746747."},{"key":"e_1_3_2_2_50_1","unstructured":"F-Y Tzeng and K-L Ma. 2002. Opening the black box-data driven visualization of neural networks. 383--390 pages.  F-Y Tzeng and K-L Ma. 2002. Opening the black box-data driven visualization of neural networks. 383--390 pages."},{"key":"e_1_3_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1093\/idpl\/ipx005"},{"key":"e_1_3_2_2_52_1","volume-title":"Your resume vs. oblivion. The Wall Street Journal 24","author":"Weber Lauren","year":"2012","unstructured":"Lauren Weber and RE Silverman . 2012. Your resume vs. oblivion. The Wall Street Journal 24 ( 2012 ). Lauren Weber and RE Silverman. 2012. Your resume vs. oblivion. The Wall Street Journal 24 (2012)."},{"key":"e_1_3_2_2_53_1","volume-title":"Intelligible Artificial Intelligence. arXiv preprint arXiv:1803.04263","author":"Weld Daniel S","year":"2018","unstructured":"Daniel S Weld and Gagan Bansal . 2018. Intelligible Artificial Intelligence. arXiv preprint arXiv:1803.04263 ( 2018 ). Daniel S Weld and Gagan Bansal. 2018. Intelligible Artificial Intelligence. arXiv preprint arXiv:1803.04263 (2018)."},{"key":"e_1_3_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2648.2008.04924.x"}],"event":{"name":"CHI '19: CHI Conference on Human Factors in Computing Systems","location":"Glasgow Scotland Uk","acronym":"CHI '19","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3290605.3300789","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3290605.3300789","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:53:28Z","timestamp":1750204408000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3290605.3300789"}},"subtitle":["Strategies to Help Non-Expert Stakeholders"],"short-title":[],"issued":{"date-parts":[[2019,5,2]]},"references-count":54,"alternative-id":["10.1145\/3290605.3300789","10.1145\/3290605"],"URL":"https:\/\/doi.org\/10.1145\/3290605.3300789","relation":{},"subject":[],"published":{"date-parts":[[2019,5,2]]},"assertion":[{"value":"2019-05-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}