{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T14:08:16Z","timestamp":1787062096565,"version":"3.56.0"},"reference-count":226,"publisher":"Association for Computing Machinery (ACM)","issue":"3-4","license":[{"start":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T00:00:00Z","timestamp":1630627200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"DARPA XAI program","award":["N66001-17-2-4031"],"award-info":[{"award-number":["N66001-17-2-4031"]}]},{"name":"NSF","award":["1900767"],"award-info":[{"award-number":["1900767"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2021,12,31]]},"abstract":"<jats:p>\n                    The need for interpretable and accountable intelligent systems grows along with the prevalence of\n                    <jats:bold>artificial intelligence<\/jats:bold>\n                    (\n                    <jats:bold>AI<\/jats:bold>\n                    ) applications used in everyday life.\n                    <jats:bold>Explainable AI<\/jats:bold>\n                    (\n                    <jats:bold>XAI<\/jats:bold>\n                    ) systems are intended to self-explain the reasoning behind system decisions and predictions. Researchers from different disciplines work together to define, design, and evaluate explainable systems. However, scholars from different disciplines focus on different objectives and fairly independent topics of XAI research, which poses challenges for identifying appropriate design and evaluation methodology and consolidating knowledge across efforts. To this end, this article presents a survey and framework intended to share knowledge and experiences of XAI design and evaluation methods across multiple disciplines. Aiming to support diverse design goals and evaluation methods in XAI research, after a thorough review of XAI related papers in the fields of machine learning, visualization, and human-computer interaction, we present a categorization of XAI design goals and evaluation methods. Our categorization presents the mapping between design goals for different XAI user groups and their evaluation methods. From our findings, we develop a framework with step-by-step design guidelines paired with evaluation methods to close the iterative design and evaluation cycles in multidisciplinary XAI teams. Further, we provide summarized ready-to-use tables of evaluation methods and recommendations for different goals in XAI research.\n                  <\/jats:p>","DOI":"10.1145\/3387166","type":"journal-article","created":{"date-parts":[[2021,9,3]],"date-time":"2021-09-03T15:30:07Z","timestamp":1630683007000},"page":"1-45","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":523,"title":["A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems"],"prefix":"10.1145","volume":"11","author":[{"given":"Sina","family":"Mohseni","sequence":"first","affiliation":[{"name":"Texas A&amp;M University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niloofar","family":"Zarei","sequence":"additional","affiliation":[{"name":"Texas A&amp;M University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric D.","family":"Ragan","sequence":"additional","affiliation":[{"name":"University of Florida, Gainesville, FL, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,9,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2870052"},{"key":"e_1_2_1_3_1","unstructured":"Julius Adebayo Justin Gilmer Michael Muelly Ian Goodfellow Moritz Hardt and Been Kim. 2018. Sanity checks for saliency maps. In Advances in Neural Information Processing Systems. 9505\u20139515.  Julius Adebayo Justin Gilmer Michael Muelly Ian Goodfellow Moritz Hardt and Been Kim. 2018. Sanity checks for saliency maps. In Advances in Neural Information Processing Systems. 9505\u20139515."},{"key":"e_1_2_1_4_1","first-page":"1086","article-title":"FairSight: Visual analytics for fairness in decision making","volume":"26","author":"Ahn Yongsu","year":"2019","unstructured":"Yongsu Ahn and Yu-Ru Lin . 2019 . FairSight: Visual analytics for fairness in decision making . IEEE Transactions on Visualization and Computer Graphics 26 , 1 (2019), 1086 \u2013 1095 . Yongsu Ahn and Yu-Ru Lin. 2019. FairSight: Visual analytics for fairness in decision making. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2019), 1086\u20131095.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467618"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v35i4.2513"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"e_1_2_1_8_1","unstructured":"Dario Amodei Chris Olah Jacob Steinhardt Paul Christiano John Schulman and Dan Man\u00e9. 2016. Concrete problems in AI safety. arxiv:1606.06565. http:\/\/arxiv.org\/abs\/1606.06565.  Dario Amodei Chris Olah Jacob Steinhardt Paul Christiano John Schulman and Dan Man\u00e9. 2016. Concrete problems in AI safety. arxiv:1606.06565. http:\/\/arxiv.org\/abs\/1606.06565."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/1461444816676645"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1085777.1085780"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2019.12.012"},{"key":"e_1_2_1_12_1","unstructured":"Jimmy Ba Volodymyr Mnih and Koray Kavukcuoglu. 2014. Multiple object recognition with visual attention. arXiv:1412.7755.  Jimmy Ba Volodymyr Mnih and Koray Kavukcuoglu. 2014. Multiple object recognition with visual attention. arXiv:1412.7755."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0130140"},{"key":"e_1_2_1_14_1","article-title":"How to explain individual classification decisions","author":"Baehrens David","year":"2010","unstructured":"David Baehrens , Timon Schroeter , Stefan Harmeling , Motoaki Kawanabe , Katja Hansen , and Klaus-Robert M\u00fcller . 2010 . How to explain individual classification decisions . Journal of Machine Learning Research 11 , ( June 2010), 1803\u20131831. David Baehrens, Timon Schroeter, Stefan Harmeling, Motoaki Kawanabe, Katja Hansen, and Klaus-Robert M\u00fcller. 2010. How to explain individual classification decisions. Journal of Machine Learning Research 11, (June 2010), 1803\u20131831.","journal-title":"Journal of Machine Learning Research 11"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5285"},{"key":"e_1_2_1_16_1","volume-title":"Intelligibility and accountability: Human considerations in context-aware systems. Human\u2013Computer Interaction 16, 2-4","author":"Bellotti Victoria","year":"2001","unstructured":"Victoria Bellotti and Keith Edwards . 2001. Intelligibility and accountability: Human considerations in context-aware systems. Human\u2013Computer Interaction 16, 2-4 ( 2001 ), 193\u2013212. Victoria Bellotti and Keith Edwards. 2001. Intelligibility and accountability: Human considerations in context-aware systems. Human\u2013Computer Interaction 16, 2-4 (2001), 193\u2013212."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025171.3025209"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2671491.2671497"},{"key":"e_1_2_1_19_1","volume-title":"Beyond Personalization Workshop, IUI","volume":"5","author":"Bilgic Mustafa","unstructured":"Mustafa Bilgic and Raymond J. Mooney . 2005. Explaining recommendations: Satisfaction vs. promotion . In Beyond Personalization Workshop, IUI , Vol. 5 . 153. Mustafa Bilgic and Raymond J. Mooney. 2005. Explaining recommendations: Satisfaction vs. promotion. In Beyond Personalization Workshop, IUI, Vol. 5. 153."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173951"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720813497052"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2018.8461053"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-015-9380-y"},{"key":"e_1_2_1_24_1","volume-title":"International Conference on Machine Learning. 208\u2013216","author":"Bryan Nicholas","year":"2013","unstructured":"Nicholas Bryan and Gautham Mysore . 2013 . An efficient posterior regularized latent variable model for interactive sound source separation . In International Conference on Machine Learning. 208\u2013216 . Nicholas Bryan and Gautham Mysore. 2013. An efficient posterior regularized latent variable model for interactive sound source separation. In International Conference on Machine Learning. 208\u2013216."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2166966.2166996"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICHI.2015.26"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST47406.2019.8986948"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ssci.2009.03.015"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302289"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300234"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788613"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287594"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2010.5652443"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2018.042731661"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1089\/big.2016.0047"},{"key":"e_1_2_1_36_1","volume-title":"IUI Workshops.","author":"Chromik Michael","year":"2019","unstructured":"Michael Chromik , Malin Eiband , Sarah Theres V\u00f6lkel , and Daniel Buschek . 2019 . Dark patterns of explainability, transparency, and user control for intelligent systems .. In IUI Workshops. Michael Chromik, Malin Eiband, Sarah Theres V\u00f6lkel, and Daniel Buschek. 2019. Dark patterns of explainability, transparency, and user control for intelligent systems.. In IUI Workshops."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220063"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-8403"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174098"},{"key":"e_1_2_1_40_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 813\u2013822","author":"Costanza Enrico","unstructured":"Enrico Costanza , Joel E. Fischer , James A. Colley , Tom Rodden , Sarvapali D. Ramchurn , and Nicholas R. Jennings . 2014. Doing the laundry with agents: A field trial of a future smart energy system in the home . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 813\u2013822 . Enrico Costanza, Joel E. Fischer, James A. Colley, Tom Rodden, Sarvapali D. Ramchurn, and Nicholas R. Jennings. 2014. Doing the laundry with agents: A field trial of a future smart energy system in the home. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 813\u2013822."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2166966.2167019"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1092"},{"key":"e_1_2_1_43_1","volume-title":"Human attention in visual question answering: Do humans and deep networks look at the same regions?Computer Vision and Image Understanding 163","author":"Das Abhishek","year":"2017","unstructured":"Abhishek Das , Harsh Agrawal , Larry Zitnick , Devi Parikh , and Dhruv Batra . 2017. Human attention in visual question answering: Do humans and deep networks look at the same regions?Computer Vision and Image Understanding 163 ( 2017 ), 90\u2013100. Abhishek Das, Harsh Agrawal, Larry Zitnick, Devi Parikh, and Dhruv Batra. 2017. Human attention in visual question answering: Do humans and deep networks look at the same regions?Computer Vision and Image Understanding 163 (2017), 90\u2013100."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1515\/popets-2015-0007"},{"key":"e_1_2_1_45_1","volume-title":"Algorithmic-accountability: The investigation of black boxes","author":"Diakopoulos Nicholas","year":"2014","unstructured":"Nicholas Diakopoulos . 2014 . Algorithmic-accountability: The investigation of black boxes . Tow Center for Digital Journalism ( 2014). Nicholas Diakopoulos. 2014. Algorithmic-accountability: The investigation of black boxes. Tow Center for Digital Journalism (2014)."},{"key":"e_1_2_1_46_1","volume-title":"Transparent Data Mining for Big and Small Data","author":"Diakopoulos Nicholas","unstructured":"Nicholas Diakopoulos . 2017. Enabling accountability of algorithmic media: Transparency as a constructive and critical lens . In Transparent Data Mining for Big and Small Data . Springer , 25\u201343. Nicholas Diakopoulos. 2017. Enabling accountability of algorithmic media: Transparency as a constructive and critical lens. In Transparent Data Mining for Big and Small Data. Springer, 25\u201343."},{"key":"e_1_2_1_47_1","volume-title":"IUI Workshops.","author":"Dodge Jonathan","unstructured":"Jonathan Dodge , Sean Penney , Andrew Anderson , and Margaret M. Burnett . 2018. What should be in an XAI explanation? What IFT reveals . In IUI Workshops. Jonathan Dodge, Sean Penney, Andrew Anderson, and Margaret M. Burnett. 2018. What should be in an XAI explanation? What IFT reveals. In IUI Workshops."},{"key":"e_1_2_1_48_1","unstructured":"Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arxiv:1702.08608. http:\/\/arxiv.org\/abs\/1702.08608.  Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arxiv:1702.08608. http:\/\/arxiv.org\/abs\/1702.08608."},{"key":"e_1_2_1_49_1","volume-title":"Accountability of AI under the law: The role of explanation","author":"Doshi-Velez Finale","year":"2017","unstructured":"Finale Doshi-Velez , Mason Kortz , Ryan Budish , Christopher Bavitz , Samuel J. Gershman , David O\u2019Brien , Stuart Shieber , Jim Waldo , David Weinberger , and Alexandra Wood . 2017. Accountability of AI under the law: The role of explanation . Berkman Center Research Publication Forthcoming ( 2017 ), 18\u201307. Finale Doshi-Velez, Mason Kortz, Ryan Budish, Christopher Bavitz, Samuel J. Gershman, David O\u2019Brien, Stuart Shieber, Jim Waldo, David Weinberger, and Alexandra Wood. 2017. Accountability of AI under the law: The role of explanation. Berkman Center Research Publication Forthcoming (2017), 18\u201307."},{"key":"e_1_2_1_50_1","volume-title":"Complex Decision Making","author":"Doyle James K.","unstructured":"James K. Doyle , Michael J. Radzicki , and W. Scott Trees . 2008. Measuring change in mental models of complex dynamic systems . In Complex Decision Making . Springer , 269\u2013294. James K. Doyle, Michael J. Radzicki, and W. Scott Trees. 2008. Measuring change in mental models of complex dynamic systems. In Complex Decision Making. Springer, 269\u2013294."},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301402"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3219819.3220099"},{"key":"e_1_2_1_53_1","volume-title":"2019 IEEE International Conference on Data Mining (ICDM\u201919)","author":"Du M.","unstructured":"M. Du , N. Liu , F. Yang , and X. Hu . 2019. Learning credible deep neural networks with rationale regularization . In 2019 IEEE International Conference on Data Mining (ICDM\u201919) . 150\u2013159. M. Du, N. Liu, F. Yang, and X. Hu. 2019. Learning credible deep neural networks with rationale regularization. In 2019 IEEE International Conference on Data Mining (ICDM\u201919). 150\u2013159."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185517"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3312787"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172961"},{"key":"e_1_2_1_57_1","volume-title":"Computer Graphics Forum","volume":"36","author":"Endert A.","unstructured":"A. Endert , W. Ribarsky , C. Turkay , B. L. Wong , Ian Nabney , I. D\u00edaz Blanco , and F. Rossi . 2017. The state of the art in integrating machine learning into visual analytics . In Computer Graphics Forum , Vol. 36 . Wiley Online Library, 458\u2013486. A. Endert, W. Ribarsky, C. Turkay, B. L. Wong, Ian Nabney, I. D\u00edaz Blanco, and F. Rossi. 2017. The state of the art in integrating machine learning into visual analytics. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 458\u2013486."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702556"},{"key":"e_1_2_1_59_1","volume-title":"11th International AAAI Conference on Web and Social Media.","author":"Eslami Motahhare","year":"2017","unstructured":"Motahhare Eslami , Kristen Vaccaro , Karrie Karahalios , and Kevin Hamilton . 2017 . \u201c Be careful; things can be worse than they appear\u201d: Understanding biased algorithms and users\u2019 behavior around them in rating platforms . In 11th International AAAI Conference on Web and Social Media. Motahhare Eslami, Kristen Vaccaro, Karrie Karahalios, and Kevin Hamilton. 2017. \u201cBe careful; things can be worse than they appear\u201d: Understanding biased algorithms and users\u2019 behavior around them in rating platforms. In 11th International AAAI Conference on Web and Social Media."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2015.02.042"},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 3429\u20133437","author":"Ruth","unstructured":"Ruth C. Fong and Andrea Vedaldi. 2017. Interpretable explanations of black boxes by meaningful perturbation . In Proceedings of the IEEE International Conference on Computer Vision. 3429\u20133437 . Ruth C. Fong and Andrea Vedaldi. 2017. Interpretable explanations of black boxes by meaningful perturbation. In Proceedings of the IEEE International Conference on Computer Vision. 3429\u20133437."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2013.12.007"},{"key":"e_1_2_1_63_1","unstructured":"Amirata Ghorbani James Wexler James Y. Zou and Been Kim. 2019. Towards automatic concept-based explanations. In Advances in Neural Information Processing Systems. 9273\u20139282.  Amirata Ghorbani James Wexler James Y. Zou and Been Kim. 2019. Towards automatic concept-based explanations. In Advances in Neural Information Processing Systems. 9273\u20139282."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA.2018.00018"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1378773.1378804"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2865029"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v38i3.2741"},{"key":"e_1_2_1_68_1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 534","author":"Gray Colin M.","unstructured":"Colin M. Gray , Yubo Kou , Bryan Battles , Joseph Hoggatt , and Austin L. Toombs . 2018. The dark (patterns) side of UX design . In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 534 . Colin M. Gray, Yubo Kou, Bryan Battles, Joseph Hoggatt, and Austin L. Toombs. 2018. The dark (patterns) side of UX design. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 534."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.2307\/249487"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.2013.59"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236009"},{"key":"e_1_2_1_72_1","volume-title":"Explainable artificial intelligence (XAI)","author":"Gunning David","year":"2017","unstructured":"David Gunning . 2017. Explainable artificial intelligence (XAI) . Defense Advanced Research Projects Agency (DARPA) ( 2017 ). David Gunning. 2017. Explainable artificial intelligence (XAI). Defense Advanced Research Projects Agency (DARPA) (2017)."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/2488388.2488435"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2008.09.008"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1807184115"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01219-9_47"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/358916.358995"},{"key":"e_1_2_1_78_1","unstructured":"Bernease Herman. 2017. The promise and peril of human evaluation for model interpretability. arxiv:1711.07414. https:\/\/arxiv.org\/abs\/1711.07414.  Bernease Herman. 2017. The promise and peril of human evaluation for model interpretability. arxiv:1711.07414. https:\/\/arxiv.org\/abs\/1711.07414."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2018.033001421"},{"key":"e_1_2_1_80_1","volume-title":"Macrocognition Metrics and Scenarios","author":"Hoffman Robert R.","unstructured":"Robert R. Hoffman . 2017. Theory concepts measures but policies metrics . In Macrocognition Metrics and Scenarios . CRC Press , 35\u201342. Robert R. Hoffman. 2017. Theory concepts measures but policies metrics. In Macrocognition Metrics and Scenarios. CRC Press, 35\u201342."},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2014.25"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2013.24"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2017.54"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2017.3121544"},{"key":"e_1_2_1_85_1","unstructured":"Robert R. Hoffman Shane T. Mueller Gary Klein and Jordan Litman. 2018. Metrics for explainable AI: Challenges and prospects. arxiv:1812.04608. https:\/\/arxiv.org\/abs\/1812.04608.  Robert R. Hoffman Shane T. Mueller Gary Klein and Jordan Litman. 2018. Metrics for explainable AI: Challenges and prospects. arxiv:1812.04608. https:\/\/arxiv.org\/abs\/1812.04608."},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2934659"},{"key":"e_1_2_1_87_1","volume-title":"IEEE Visualization Conference (VIS\u201919)","author":"Hohman Fred","unstructured":"Fred Hohman , Arjun Srinivasan , and Steven M. Drucker . 2019. TeleGam: Combining visualization and verbalization for interpretable machine learning . IEEE Visualization Conference (VIS\u201919) . Fred Hohman, Arjun Srinivasan, and Steven M. Drucker. 2019. TeleGam: Combining visualization and verbalization for interpretable machine learning. IEEE Visualization Conference (VIS\u201919)."},{"key":"e_1_2_1_88_1","first-page":"8","article-title":"Visual analytics in deep learning: An interrogative survey for the next frontiers","volume":"25","author":"Hohman Fred Matthew","year":"2018","unstructured":"Fred Matthew Hohman , Minsuk Kahng , Robert Pienta , and Duen Horng Chau . 2018 . Visual analytics in deep learning: An interrogative survey for the next frontiers . IEEE Transactions on Visualization and Computer Graphics 25 , 8 (Aug. 2018), 2674\u20132693. Fred Matthew Hohman, Minsuk Kahng, Robert Pienta, and Duen Horng Chau. 2018. Visual analytics in deep learning: An interrogative survey for the next frontiers. IEEE Transactions on Visualization and Computer Graphics 25, 8 (Aug. 2018), 2674\u20132693.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/2856767.2856811"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0953-5438(99)00006-5"},{"key":"e_1_2_1_91_1","volume-title":"Howard and Bence Kollanyi","author":"Philip","year":"2016","unstructured":"Philip N. Howard and Bence Kollanyi . 2016 . Bots, #StrongerIn, and #Brexit: Computational propaganda during the UK-EU referendum. Philip N. Howard and Bence Kollanyi. 2016. Bots, #StrongerIn, and #Brexit: Computational propaganda during the UK-EU referendum."},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-013-5413-0"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173995"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327566IJCE0401_04"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744718"},{"key":"e_1_2_1_96_1","volume-title":"Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5092\u20135103","author":"Kay Matthew","unstructured":"Matthew Kay , Tara Kola , Jessica R. Hullman , and Sean A. Munson . 2016. When (ish) is my bus?: User-centered visualizations of uncertainty in everyday, mobile predictive systems . In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5092\u20135103 . Matthew Kay, Tara Kola, Jessica R. Hullman, and Sean A. Munson. 2016. When (ish) is my bus?: User-centered visualizations of uncertainty in everyday, mobile predictive systems. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5092\u20135103."},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.57.102904.190100"},{"key":"e_1_2_1_98_1","volume-title":"Koyejo","author":"Kim Been","year":"2016","unstructured":"Been Kim , Rajiv Khanna , and Oluwasanmi O . Koyejo . 2016 . Examples are not enough, learn to criticize! criticism for interpretability. In Advances in Neural Information Processing Systems . 2280\u20132288. Been Kim, Rajiv Khanna, and Oluwasanmi O. Koyejo. 2016. Examples are not enough, learn to criticize! criticism for interpretability. In Advances in Neural Information Processing Systems. 2280\u20132288."},{"key":"e_1_2_1_99_1","volume-title":"International Conference on Machine Learning. 2673\u20132682","author":"Kim Been","year":"2018","unstructured":"Been Kim , Martin Wattenberg , Justin Gilmer , Carrie Cai , James Wexler , Fernanda Viegas , et\u00a0al. 2018 . Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (TCAV) . In International Conference on Machine Learning. 2673\u20132682 . Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viegas, et\u00a0al. 2018. Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (TCAV). In International Conference on Machine Learning. 2673\u20132682."},{"key":"e_1_2_1_100_1","unstructured":"Jaedeok Kim and Jingoo Seo. 2017. Human understandable explanation extraction for black-box classification models based on matrix factorization. arxiv:1709.06201. https:\/\/arxiv.org\/abs\/1709.06201.  Jaedeok Kim and Jingoo Seo. 2017. Human understandable explanation extraction for black-box classification models based on matrix factorization. arxiv:1709.06201. https:\/\/arxiv.org\/abs\/1709.06201."},{"key":"e_1_2_1_101_1","volume-title":"Explainable AI: Interpreting, Explaining and Visualizing Deep Learning","author":"Kindermans Pieter-Jan","unstructured":"Pieter-Jan Kindermans , Sara Hooker , Julius Adebayo , Maximilian Alber , Kristof T. Sch\u00fctt , Sven D\u00e4hne , Dumitru Erhan , and Been Kim . 2019. The (un) reliability of saliency methods . In Explainable AI: Interpreting, Explaining and Visualizing Deep Learning . Springer , 267\u2013280. Pieter-Jan Kindermans, Sara Hooker, Julius Adebayo, Maximilian Alber, Kristof T. Sch\u00fctt, Sven D\u00e4hne, Dumitru Erhan, and Been Kim. 2019. The (un) reliability of saliency methods. In Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Springer, 267\u2013280."},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2018.022441353"},{"key":"e_1_2_1_103_1","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u201314","author":"Kocielnik Rafal","unstructured":"Rafal Kocielnik , Saleema Amershi , and Paul N. Bennett . 2019. Will you accept an imperfect AI? Exploring designs for adjusting end-user expectations of AI systems . In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u201314 . Rafal Kocielnik, Saleema Amershi, and Paul N. Bennett. 2019. Will you accept an imperfect AI? Exploring designs for adjusting end-user expectations of AI systems. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u201314."},{"key":"e_1_2_1_104_1","volume-title":"The more you know: Trust dynamics and calibration in highly automated driving and the effects of take-overs, system malfunction, and system transparency. Human Factors","author":"Kraus Johannes","year":"2019","unstructured":"Johannes Kraus , David Scholz , Dina Stiegemeier , and Martin Baumann . 2019. The more you know: Trust dynamics and calibration in highly automated driving and the effects of take-overs, system malfunction, and system transparency. Human Factors ( 2019 ), 0018720819853686. Johannes Kraus, David Scholz, Dina Stiegemeier, and Martin Baumann. 2019. The more you know: Trust dynamics and calibration in highly automated driving and the effects of take-overs, system malfunction, and system transparency. Human Factors (2019), 0018720819853686."},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2017.8585720"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2014.2346482"},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858529"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1145\/2678025.2701399"},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207678"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2010.15"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2013.6645235"},{"key":"e_1_2_1_112_1","volume-title":"Proceedings of the AAAI Conference on Human Computation and Crowdsourcing","volume":"7","author":"Lage Isaac","year":"2019","unstructured":"Isaac Lage , Emily Chen , Jeffrey He , Menaka Narayanan , Been Kim , Samuel J. Gershman , and Finale Doshi-Velez . 2019 . Human evaluation of models built for interpretability . In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , Vol. 7 . 59\u201367. Isaac Lage, Emily Chen, Jeffrey He, Menaka Narayanan, Been Kim, Samuel J. Gershman, and Finale Doshi-Velez. 2019. Human evaluation of models built for interpretability. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 7. 59\u201367."},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939874"},{"key":"e_1_2_1_114_1","volume-title":"\u201cplacebic","author":"Langer Ellen J.","year":"1978","unstructured":"Ellen J. Langer , Arthur Blank , and Benzion Chanowitz . 1978. The mindlessness of ostensibly thoughtful action: The role of \u201cplacebic \u201d information in interpersonal interaction.Journal of Personality and Social Psychology 36, 6 ( 1978 ), 635. Ellen J. Langer, Arthur Blank, and Benzion Chanowitz. 1978. The mindlessness of ostensibly thoughtful action: The role of \u201cplacebic\u201d information in interpersonal interaction.Journal of Personality and Social Psychology 36, 6 (1978), 635."},{"key":"e_1_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359284"},{"key":"e_1_2_1_116_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702548"},{"key":"e_1_2_1_117_1","volume-title":"transparent, and accountable algorithmic decision-making processes. Philosophy & Technology","author":"Lepri Bruno","year":"2017","unstructured":"Bruno Lepri , Nuria Oliver , Emmanuel Letouz\u00e9 , Alex Pentland , and Patrick Vinck . 2017. Fair , transparent, and accountable algorithmic decision-making processes. Philosophy & Technology ( 2017 ), 1\u201317. Bruno Lepri, Nuria Oliver, Emmanuel Letouz\u00e9, Alex Pentland, and Patrick Vinck. 2017. Fair, transparent, and accountable algorithmic decision-making processes. Philosophy & Technology (2017), 1\u201317."},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1523"},{"key":"e_1_2_1_119_1","doi-asserted-by":"publisher","DOI":"10.1214\/15-AOAS848"},{"key":"e_1_2_1_120_1","volume-title":"Computer Graphics Forum","author":"Lex Alexander","unstructured":"Alexander Lex , Marc Streit , H.-J. Schulz , Christian Partl , Dieter Schmalstieg , Peter J. Park , and Nils Gehlenborg . 2012. StratomeX: Visual analysis of large-scale heterogeneous genomics data for cancer subtype characterization . In Computer Graphics Forum , Vol. 31 . Wiley Online Library , 1175\u20131184. Alexander Lex, Marc Streit, H.-J. Schulz, Christian Partl, Dieter Schmalstieg, Peter J. Park, and Nils Gehlenborg. 2012. StratomeX: Visual analysis of large-scale heterogeneous genomics data for cancer subtype characterization. In Computer Graphics Forum, Vol. 31. Wiley Online Library, 1175\u20131184."},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00960"},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00530"},{"key":"e_1_2_1_123_1","volume-title":"Improving understanding, trust, and control with intelligibility in context-aware applications","author":"Lim Brian","unstructured":"Brian Lim . 2011. Improving understanding, trust, and control with intelligibility in context-aware applications . Carnegie Mellon University . Brian Lim. 2011. Improving understanding, trust, and control with intelligibility in context-aware applications. Carnegie Mellon University."},{"key":"e_1_2_1_124_1","volume-title":"Proceedings of the 11th International Conference on Ubiquitous Computing. ACM, 195\u2013204","author":"Brian","unstructured":"Brian Y. Lim and Anind K. Dey. 2009. Assessing demand for intelligibility in context-aware applications . In Proceedings of the 11th International Conference on Ubiquitous Computing. ACM, 195\u2013204 . Brian Y. Lim and Anind K. Dey. 2009. Assessing demand for intelligibility in context-aware applications. In Proceedings of the 11th International Conference on Ubiquitous Computing. ACM, 195\u2013204."},{"key":"e_1_2_1_125_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519023"},{"key":"e_1_2_1_126_1","volume-title":"IUI Workshops.","author":"Lim Brian Y.","year":"2019","unstructured":"Brian Y. Lim , Qian Yang , Ashraf M. Abdul , and Danding Wang . 2019 . Why these explanations? Selecting intelligibility types for explanation Goals . In IUI Workshops. Brian Y. Lim, Qian Yang, Ashraf M. Abdul, and Danding Wang. 2019. Why these explanations? Selecting intelligibility types for explanation Goals. In IUI Workshops."},{"key":"e_1_2_1_127_1","unstructured":"Zachary C. Lipton. 2016. The mythos of model interpretability. arxiv:1606.03490. https:\/\/arxiv.org\/abs\/1606.03490.  Zachary C. Lipton. 2016. The mythos of model interpretability. arxiv:1606.03490. https:\/\/arxiv.org\/abs\/1606.03490."},{"key":"e_1_2_1_128_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467554"},{"key":"e_1_2_1_129_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744938"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2016.2598831"},{"key":"e_1_2_1_131_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2014.7042494"},{"key":"e_1_2_1_132_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2006.08.004"},{"key":"e_1_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cognition.2008.10.007"},{"key":"e_1_2_1_134_1","volume-title":"Lundberg and Su-In Lee","author":"Scott","year":"2017","unstructured":"Scott M. Lundberg and Su-In Lee . 2017 . A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems . 4765\u20134774. Scott M. Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems. 4765\u20134774."},{"key":"e_1_2_1_135_1","article-title":"Visualizing data using t-SNE","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton . 2008 . Visualizing data using t-SNE . Journal of Machine Learning Research 9 , ( Nov. 2008), 2579\u20132605. Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, (Nov. 2008), 2579\u20132605.","journal-title":"Journal of Machine Learning Research 9"},{"key":"e_1_2_1_136_1","volume-title":"11th Australasian Conference on Information Systems","volume":"53","author":"Madsen Maria","year":"2000","unstructured":"Maria Madsen and Shirley Gregor . 2000 . Measuring human-computer trust . In 11th Australasian Conference on Information Systems , Vol. 53 . Citeseer, 6\u20138. Maria Madsen and Shirley Gregor. 2000. Measuring human-computer trust. In 11th Australasian Conference on Information Systems, Vol. 53. Citeseer, 6\u20138."},{"key":"e_1_2_1_137_1","unstructured":"Ninareh Mehrabi Fred Morstatter Nripsuta Saxena Kristina Lerman and Aram Galstyan. 2019. A survey on bias and fairness in machine learning. arxiv:1908.09635. https:\/\/arxiv.org\/abs\/1908.09635.  Ninareh Mehrabi Fred Morstatter Nripsuta Saxena Kristina Lerman and Aram Galstyan. 2019. A survey on bias and fairness in machine learning. arxiv:1908.09635. https:\/\/arxiv.org\/abs\/1908.09635."},{"key":"e_1_2_1_138_1","volume-title":"Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 105\u2013115","author":"Mennicken Sarah","unstructured":"Sarah Mennicken , Jo Vermeulen , and Elaine M. Huang . 2014. From today\u2019s augmented houses to tomorrow\u2019s smart homes: New directions for home automation research . In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 105\u2013115 . Sarah Mennicken, Jo Vermeulen, and Elaine M. Huang. 2014. From today\u2019s augmented houses to tomorrow\u2019s smart homes: New directions for home automation research. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 105\u2013115."},{"key":"e_1_2_1_139_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720812465081"},{"key":"e_1_2_1_140_1","doi-asserted-by":"publisher","DOI":"10.1177\/1473871613510429"},{"key":"e_1_2_1_141_1","first-page":"195","article-title":"Swift trust and temporary groups","volume":"166","author":"Meyerson Debra","year":"1996","unstructured":"Debra Meyerson , Karl E. Weick , and Roderick M. Kramer . 1996 . Swift trust and temporary groups . Trust in Organizations: Frontiers of Theory and Research 166 (1996), 195 . Debra Meyerson, Karl E. Weick, and Roderick M. Kramer. 1996. Swift trust and temporary groups. Trust in Organizations: Frontiers of Theory and Research 166 (1996), 195.","journal-title":"Trust in Organizations: Frontiers of Theory and Research"},{"key":"e_1_2_1_142_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2018.07.007"},{"key":"e_1_2_1_143_1","doi-asserted-by":"publisher","DOI":"10.1109\/VAST.2017.8585721"},{"key":"e_1_2_1_144_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2018.2864812"},{"key":"e_1_2_1_145_1","first-page":"12","article-title":"Automation, algorithms, and politics: Auditing for transparency in content personalization systems","volume":"10","author":"Mittelstadt Brent","year":"2016","unstructured":"Brent Mittelstadt . 2016 . Automation, algorithms, and politics: Auditing for transparency in content personalization systems . International Journal of Communication 10 (2016), 12 . Brent Mittelstadt. 2016. Automation, algorithms, and politics: Auditing for transparency in content personalization systems. International Journal of Communication 10 (2016), 12.","journal-title":"International Journal of Communication"},{"key":"e_1_2_1_146_1","volume-title":"ICML Workshop on Uncertainty & Robustness in Deep Learning.","author":"Mohseni Sina","year":"2019","unstructured":"Sina Mohseni , Akshay Jagadeesh , and Zhangyang Wang . 2019 . Predicting model failure using saliency maps in autonomous driving systems . ICML Workshop on Uncertainty & Robustness in Deep Learning. Sina Mohseni, Akshay Jagadeesh, and Zhangyang Wang. 2019. Predicting model failure using saliency maps in autonomous driving systems. ICML Workshop on Uncertainty & Robustness in Deep Learning."},{"key":"e_1_2_1_147_1","volume-title":"The AAAI Workshop on Artificial Intelligence Safety (Safe AI\u201920)","author":"Mohseni Sina","year":"2020","unstructured":"Sina Mohseni , Mandar Pitale , Vasu Singh , and Zhangyang Wang . 2020 . Practical solutions for machine learning safety in autonomous vehicles . In The AAAI Workshop on Artificial Intelligence Safety (Safe AI\u201920) . Sina Mohseni, Mandar Pitale, Vasu Singh, and Zhangyang Wang. 2020. Practical solutions for machine learning safety in autonomous vehicles. In The AAAI Workshop on Artificial Intelligence Safety (Safe AI\u201920)."},{"key":"e_1_2_1_148_1","unstructured":"Sina Mohseni Eric Ragan and Xia Hu. 2019. Open issues in combating fake news: Interpretability as an opportunity. arxiv:1904.03016. https:\/\/arxiv.org\/abs\/1904.03016.  Sina Mohseni Eric Ragan and Xia Hu. 2019. Open issues in combating fake news: Interpretability as an opportunity. arxiv:1904.03016. https:\/\/arxiv.org\/abs\/1904.03016."},{"key":"e_1_2_1_149_1","volume-title":"Ragan","author":"Mohseni Sina","year":"2018","unstructured":"Sina Mohseni and Eric D . Ragan . 2018 . A human-grounded evaluation benchmark for local explanations of machine learning. arxiv:1801.05075. https:\/\/arxiv.org\/abs\/1801.05075. Sina Mohseni and Eric D. Ragan. 2018. A human-grounded evaluation benchmark for local explanations of machine learning. arxiv:1801.05075. https:\/\/arxiv.org\/abs\/1801.05075."},{"key":"e_1_2_1_150_1","volume-title":"Fair & Responsible AI Workshop at CHI","author":"Mohseni Sina","year":"2020","unstructured":"Sina Mohseni , Fan Yang , Shiva Pentyala , Mengnan Du , Yi Liu , Nic Lupfer , Xia Hu , Shuiwang Ji , and Eric Ragan . 2020 . Trust evolution over time in explainable AI for fake news detection . Fair & Responsible AI Workshop at CHI 2020. Sina Mohseni, Fan Yang, Shiva Pentyala, Mengnan Du, Yi Liu, Nic Lupfer, Xia Hu, Shuiwang Ji, and Eric Ragan. 2020. Trust evolution over time in explainable AI for fake news detection. Fair & Responsible AI Workshop at CHI 2020."},{"key":"e_1_2_1_151_1","unstructured":"Christoph Molnar. 2019. Interpretable Machine Learning. Lulu.com.  Christoph Molnar. 2019. Interpretable Machine Learning. Lulu.com."},{"key":"e_1_2_1_152_1","volume-title":"Methods for interpreting and understanding deep neural networks. Digital Signal Processing 73 (Feb","author":"Montavon Gr\u00e9goire","year":"2018","unstructured":"Gr\u00e9goire Montavon , Wojciech Samek , and Klaus-Robert M\u00fcller . 2017. Methods for interpreting and understanding deep neural networks. Digital Signal Processing 73 (Feb . 2018 ), 1\u201315. Gr\u00e9goire Montavon, Wojciech Samek, and Klaus-Robert M\u00fcller. 2017. Methods for interpreting and understanding deep neural networks. Digital Signal Processing 73 (Feb. 2018), 1\u201315."},{"key":"e_1_2_1_153_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2011.32"},{"key":"e_1_2_1_154_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(87)80013-5"},{"key":"e_1_2_1_155_1","volume-title":"A nested process model for visualization design and validation","author":"Munzner Tamara","year":"2009","unstructured":"Tamara Munzner . 2009. A nested process model for visualization design and validation . IEEE Transactions on Visualization and Computer Graphics 6 ( 2009 ), 921\u2013928. Tamara Munzner. 2009. A nested process model for visualization design and validation. IEEE Transactions on Visualization and Computer Graphics6 (2009), 921\u2013928."},{"key":"e_1_2_1_156_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 397\u2013406","author":"Myers Brad A.","unstructured":"Brad A. Myers , David A. Weitzman , Andrew J. Ko , and Duen H. Chau . 2006. Answering why and why not questions in user interfaces . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 397\u2013406 . Brad A. Myers, David A. Weitzman, Andrew J. Ko, and Duen H. Chau. 2006. Answering why and why not questions in user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 397\u2013406."},{"key":"e_1_2_1_157_1","volume-title":"2017 IEEE Symposium on Visualization for Cyber Security (VizSec\u201917)","author":"Andrew","unstructured":"Andrew P. Norton and Yanjun Qi. 2017. Adversarial-playground: A visualization suite showing how adversarial examples fool deep learning . In 2017 IEEE Symposium on Visualization for Cyber Security (VizSec\u201917) . IEEE, 1\u20134. Andrew P. Norton and Yanjun Qi. 2017. Adversarial-playground: A visualization suite showing how adversarial examples fool deep learning. In 2017 IEEE Symposium on Visualization for Cyber Security (VizSec\u201917). IEEE, 1\u20134."},{"key":"e_1_2_1_158_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-4307"},{"key":"e_1_2_1_159_1","volume-title":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM.","author":"Nourani Mahsan","year":"2020","unstructured":"Mahsan Nourani , Dondald Honeycutt , Jeremy Block , Chiradeep Roy , Tahrima Rahman , Eric D. Ragan , and Vibhav Gogate . 2020 . Investigating the importance of first impressions and explainable AI with interactive video analysis . In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM. Mahsan Nourani, Dondald Honeycutt, Jeremy Block, Chiradeep Roy, Tahrima Rahman, Eric D. Ragan, and Vibhav Gogate. 2020. Investigating the importance of first impressions and explainable AI with interactive video analysis. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM."},{"key":"e_1_2_1_160_1","volume-title":"Proceedings of the AAAI Conference on Human Computation and Crowdsourcing","volume":"7","author":"Nourani Mahsan","unstructured":"Mahsan Nourani , Samia Kabir , Sina Mohseni , and Eric D. Ragan . 2019. The effects of meaningful and meaningless explanations on trust and perceived system accuracy in intelligent systems . In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing , Vol. 7 . 97\u2013105. Mahsan Nourani, Samia Kabir, Sina Mohseni, and Eric D. Ragan. 2019. The effects of meaningful and meaningless explanations on trust and perceived system accuracy in intelligent systems. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 7. 97\u2013105."},{"key":"e_1_2_1_161_1","volume-title":"6th AAAI Conference on Human Computation and Crowdsourcing.","author":"Nushi Besmira","year":"2018","unstructured":"Besmira Nushi , Ece Kamar , and Eric Horvitz . 2018 . Towards accountable AI: Hybrid human-machine analyses for characterizing system failure . In 6th AAAI Conference on Human Computation and Crowdsourcing. Besmira Nushi, Ece Kamar, and Eric Horvitz. 2018. Towards accountable AI: Hybrid human-machine analyses for characterizing system failure. In 6th AAAI Conference on Human Computation and Crowdsourcing."},{"key":"e_1_2_1_162_1","volume-title":"The building blocks of interpretability. Distill","author":"Olah Chris","year":"2018","unstructured":"Chris Olah , Arvind Satyanarayan , Ian Johnson , Shan Carter , Ludwig Schubert , Katherine Ye , and Alexander Mordvintsev . 2018. The building blocks of interpretability. Distill ( 2018 ). DOI:https:\/\/doi.org\/10.23915\/distill.00010 https:\/\/distill.pub\/2018\/building-blocks. Chris Olah, Arvind Satyanarayan, Ian Johnson, Shan Carter, Ludwig Schubert, Katherine Ye, and Alexander Mordvintsev. 2018. The building blocks of interpretability. Distill (2018). DOI:https:\/\/doi.org\/10.23915\/distill.00010 https:\/\/distill.pub\/2018\/building-blocks."},{"key":"e_1_2_1_163_1","volume-title":"Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy","author":"O\u2019Neil Cathy","unstructured":"Cathy O\u2019Neil . 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy . Broadway Books . Cathy O\u2019Neil. 2016. Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy. Broadway Books."},{"key":"e_1_2_1_164_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172946"},{"key":"e_1_2_1_165_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744358"},{"key":"e_1_2_1_166_1","volume-title":"56th Annual Meeting of the Association for Computational Linguistics (ACL\u201918)","author":"Poerner Nina","year":"2018","unstructured":"Nina Poerner , Hinrich Sch\u00fctze , and Benjamin Roth . 2018 . Evaluating neural network explanation methods using hybrid documents and morphological prediction . In 56th Annual Meeting of the Association for Computational Linguistics (ACL\u201918) . Nina Poerner, Hinrich Sch\u00fctze, and Benjamin Roth. 2018. Evaluating neural network explanation methods using hybrid documents and morphological prediction. In 56th Annual Meeting of the Association for Computational Linguistics (ACL\u201918)."},{"key":"e_1_2_1_167_1","volume-title":"Proceedings of the 18th Conference on Innovative Applications of Artificial Intelligence","volume":"2","author":"Poulin Brett","year":"2006","unstructured":"Brett Poulin , Roman Eisner , Duane Szafron , Paul Lu , Russell Greiner , David S. Wishart , Alona Fyshe , Brandon Pearcy , Cam MacDonell , and John Anvik . 2006 . Visual explanation of evidence with additive classifiers . In Proceedings of the 18th Conference on Innovative Applications of Artificial Intelligence , Vol. 2 . AAAI Press , 1822\u20131829. Brett Poulin, Roman Eisner, Duane Szafron, Paul Lu, Russell Greiner, David S. Wishart, Alona Fyshe, Brandon Pearcy, Cam MacDonell, and John Anvik. 2006. Visual explanation of evidence with additive classifiers. In Proceedings of the 18th Conference on Innovative Applications of Artificial Intelligence, Vol. 2. AAAI Press, 1822\u20131829."},{"key":"e_1_2_1_168_1","volume-title":"Jennifer Wortman Vaughan, and Hanna Wallach","author":"Poursabzi-Sangdeh Forough","year":"2018","unstructured":"Forough Poursabzi-Sangdeh , Daniel G. Goldstein , Jake M. Hofman , Jennifer Wortman Vaughan, and Hanna Wallach . 2018 . Manipulating and measuring model interpretability. arxiv:1802.07810. https:\/\/arxiv.org\/abs\/1802.07810. Forough Poursabzi-Sangdeh, Daniel G. Goldstein, Jake M. Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. 2018. Manipulating and measuring model interpretability. arxiv:1802.07810. https:\/\/arxiv.org\/abs\/1802.07810."},{"key":"e_1_2_1_169_1","doi-asserted-by":"publisher","DOI":"10.1145\/1111449.1111475"},{"key":"e_1_2_1_170_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173677"},{"key":"e_1_2_1_171_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702174"},{"key":"e_1_2_1_172_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_173_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11491"},{"key":"e_1_2_1_174_1","doi-asserted-by":"publisher","DOI":"10.1145\/3149858.3149863"},{"key":"e_1_2_1_175_1","volume-title":"Human and Machine Learning","author":"Robnik-\u0160ikonja Marko","unstructured":"Marko Robnik-\u0160ikonja and Marko Bohanec . 2018. Perturbation-based explanations of prediction models . In Human and Machine Learning . Springer , 159\u2013175. Marko Robnik-\u0160ikonja and Marko Bohanec. 2018. Perturbation-based explanations of prediction models. In Human and Machine Learning. Springer, 159\u2013175."},{"key":"e_1_2_1_176_1","volume-title":"Proceedings of the 25th International Joint Conference on Artificial Intelligence. 862\u2013868","author":"Rosenthal Stephanie","year":"2016","unstructured":"Stephanie Rosenthal , Sai P. Selvaraj , and Manuela Veloso . 2016 . Verbalization: Narration of autonomous robot experience . In Proceedings of the 25th International Joint Conference on Artificial Intelligence. 862\u2013868 . Stephanie Rosenthal, Sai P. Selvaraj, and Manuela Veloso. 2016. Verbalization: Narration of autonomous robot experience. In Proceedings of the 25th International Joint Conference on Artificial Intelligence. 862\u2013868."},{"key":"e_1_2_1_177_1","volume-title":"32nd AAAI Conference on Artificial Intelligence.","author":"Ross Andrew Slavin","year":"2018","unstructured":"Andrew Slavin Ross and Finale Doshi-Velez . 2018 . Improving the adversarial robustness and interpretability of deep neural networks by regularizing their input gradients . In 32nd AAAI Conference on Artificial Intelligence. Andrew Slavin Ross and Finale Doshi-Velez. 2018. Improving the adversarial robustness and interpretability of deep neural networks by regularizing their input gradients. In 32nd AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_178_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/371"},{"key":"e_1_2_1_179_1","volume-title":"IEEE Symposium on Visual Analytics Science and Technology","author":"Rudolph Stephen","year":"2009","unstructured":"Stephen Rudolph , Anya Savikhin , and David S. Ebert . 2009. FinVis: Applied visual analytics for personal financial planning . In IEEE Symposium on Visual Analytics Science and Technology , 2009 . Citeseer, 195\u2013202. Stephen Rudolph, Anya Savikhin, and David S. Ebert. 2009. FinVis: Applied visual analytics for personal financial planning. In IEEE Symposium on Visual Analytics Science and Technology, 2009. Citeseer, 195\u2013202."},{"key":"e_1_2_1_180_1","volume-title":"24th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. 641\u2013646","author":"Sacha Dominik","year":"2016","unstructured":"Dominik Sacha , Michael Sedlmair , Leishi Zhang , John Aldo Lee , Daniel Weiskopf , Stephen North , and Daniel Keim . 2016 . Human-centered machine learning through interactive visualization . In 24th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. 641\u2013646 . Dominik Sacha, Michael Sedlmair, Leishi Zhang, John Aldo Lee, Daniel Weiskopf, Stephen North, and Daniel Keim. 2016. Human-centered machine learning through interactive visualization. In 24th European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning. 641\u2013646."},{"key":"e_1_2_1_181_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2467591"},{"key":"e_1_2_1_182_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2680452"},{"key":"e_1_2_1_183_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2016.2599820"},{"key":"e_1_2_1_184_1","volume-title":"Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and Discrimination: Converting Critical Concerns Into Productive Inquiry","author":"Sandvig Christian","year":"2014","unstructured":"Christian Sandvig , Kevin Hamilton , Karrie Karahalios , and Cedric Langbort . 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and Discrimination: Converting Critical Concerns Into Productive Inquiry ( 2014 ), 1\u201323. Christian Sandvig, Kevin Hamilton, Karrie Karahalios, and Cedric Langbort. 2014. Auditing algorithms: Research methods for detecting discrimination on internet platforms. Data and Discrimination: Converting Critical Concerns Into Productive Inquiry (2014), 1\u201323."},{"key":"e_1_2_1_185_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2010.09.003"},{"key":"e_1_2_1_186_1","volume-title":"International Conference on Inductive Logic Programming. Springer, 52\u201367","author":"Schmid Ute","year":"2016","unstructured":"Ute Schmid , Christina Zeller , Tarek Besold , Alireza Tamaddoni-Nezhad , and Stephen Muggleton . 2016 . How does predicate invention affect human comprehensibility? . In International Conference on Inductive Logic Programming. Springer, 52\u201367 . Ute Schmid, Christina Zeller, Tarek Besold, Alireza Tamaddoni-Nezhad, and Stephen Muggleton. 2016. How does predicate invention affect human comprehensibility?. In International Conference on Inductive Logic Programming. Springer, 52\u201367."},{"key":"e_1_2_1_187_1","unstructured":"Philipp Schmidt and Felix Biessmann. 2019. Quantifying interpretability and trust in machine learning systems. arxiv:1901.08558. https:\/\/arxiv.org\/abs\/1901.08558.  Philipp Schmidt and Felix Biessmann. 2019. Quantifying interpretability and trust in machine learning systems. arxiv:1901.08558. https:\/\/arxiv.org\/abs\/1901.08558."},{"key":"e_1_2_1_188_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_2_1_189_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305890.3306006"},{"key":"e_1_2_1_190_1","unstructured":"Karen Simonyan Andrea Vedaldi and Andrew Zisserman. 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arxiv:1312.6034. https:\/\/arxiv.org\/abs\/1312.6034.  Karen Simonyan Andrea Vedaldi and Andrew Zisserman. 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arxiv:1312.6034. https:\/\/arxiv.org\/abs\/1312.6034."},{"key":"e_1_2_1_191_1","unstructured":"Daniel Smilkov Shan Carter D. Sculley Fernanda B. Vi\u00e9gas and Martin Wattenberg. 2017. Direct-manipulation visualization of deep networks. arxiv:1708.03788. http:\/\/arxiv.org\/abs\/1708.03788.  Daniel Smilkov Shan Carter D. Sculley Fernanda B. Vi\u00e9gas and Martin Wattenberg. 2017. Direct-manipulation visualization of deep networks. arxiv:1708.03788. http:\/\/arxiv.org\/abs\/1708.03788."},{"key":"e_1_2_1_192_1","first-page":"1064","article-title":"explAIner: A visual analytics framework for interactive and explainable machine learning","volume":"26","author":"Spinner Thilo","year":"2019","unstructured":"Thilo Spinner , Udo Schlegel , Hanna Sch\u00e4fer , and Mennatallah El-Assady . 2019 . explAIner: A visual analytics framework for interactive and explainable machine learning . IEEE Transactions on Visualization and Computer Graphics 26 , 1 (2020), 1064 \u2013 1074 . Thilo Spinner, Udo Schlegel, Hanna Sch\u00e4fer, and Mennatallah El-Assady. 2019. explAIner: A visual analytics framework for interactive and explainable machine learning. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2020), 1064\u20131074.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_2_1_193_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744158"},{"key":"e_1_2_1_194_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2009.03.004"},{"key":"e_1_2_1_195_1","unstructured":"Simone Stumpf Simonas Skrebe Graeme Aymer and Julie Hobson. 2018. Explaining smart heating systems to discourage fiddling with optimized behavior.  Simone Stumpf Simonas Skrebe Graeme Aymer and Julie Hobson. 2018. Explaining smart heating systems to discourage fiddling with optimized behavior."},{"key":"e_1_2_1_196_1","doi-asserted-by":"publisher","DOI":"10.1145\/2447976.2447990"},{"key":"e_1_2_1_197_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339574"},{"key":"e_1_2_1_198_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.clsr.2017.05.015"},{"key":"e_1_2_1_199_1","volume-title":"Recommender Systems Handbook","author":"Tintarev Nava","unstructured":"Nava Tintarev and Judith Masthoff . 2011. Designing and evaluating explanations for recommender systems . In Recommender Systems Handbook . Springer , 479\u2013510. Nava Tintarev and Judith Masthoff. 2011. Designing and evaluating explanations for recommender systems. In Recommender Systems Handbook. Springer, 479\u2013510."},{"key":"e_1_2_1_200_1","unstructured":"Richard Tomsett Dave Braines Dan Harborne Alun Preece and Supriyo Chakraborty. 2018. Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. arxiv:1806.07552. https:\/\/arxiv.org\/abs\/1806.07552.  Richard Tomsett Dave Braines Dan Harborne Alun Preece and Supriyo Chakraborty. 2018. Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. arxiv:1806.07552. https:\/\/arxiv.org\/abs\/1806.07552."},{"key":"e_1_2_1_201_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10676-009-9187-9"},{"key":"e_1_2_1_202_1","doi-asserted-by":"publisher","DOI":"10.1109\/IE.2010.56"},{"key":"e_1_2_1_203_1","first-page":"841","article-title":"Counterfactual explanations without opening the black box: Automated decisions and the GDPR","volume":"31","author":"Wachter Sandra","year":"2017","unstructured":"Sandra Wachter , Brent Mittelstadt , and Chris Russell . 2017 . Counterfactual explanations without opening the black box: Automated decisions and the GDPR . Harvard Journal of Law & Technology 31 (2017), 841 . Sandra Wachter, Brent Mittelstadt, and Chris Russell. 2017. Counterfactual explanations without opening the black box: Automated decisions and the GDPR. Harvard Journal of Law & Technology 31 (2017), 841.","journal-title":"Harvard Journal of Law & Technology"},{"key":"e_1_2_1_204_1","volume-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI\u201919)","author":"Wang Danding","unstructured":"Danding Wang , Qian Yang , Ashraf Abdul , and Brian Y. Lim . 2019. Designing theory-driven user-centric explainable AI . In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI\u201919) . ACM, New York, NY, Article 601, 15 pages. Danding Wang, Qian Yang, Ashraf Abdul, and Brian Y. Lim. 2019. Designing theory-driven user-centric explainable AI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI\u201919). ACM, New York, NY, Article 601, 15 pages."},{"key":"e_1_2_1_205_1","unstructured":"Fulton Wang and Cynthia Rudin. 2015. Falling rule lists. In Artificial Intelligence and Statistics. 1013\u20131022.  Fulton Wang and Cynthia Rudin. 2015. Falling rule lists. In Artificial Intelligence and Statistics. 1013\u20131022."},{"key":"e_1_2_1_206_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2921323"},{"key":"e_1_2_1_207_1","doi-asserted-by":"publisher","DOI":"10.1145\/3282486"},{"key":"e_1_2_1_208_1","unstructured":"Adrian Weller. 2017. Challenges for transparency. arxiv:1708.01870. https:\/\/arxiv.org\/abs\/1708.01870.  Adrian Weller. 2017. Challenges for transparency. arxiv:1708.01870. https:\/\/arxiv.org\/abs\/1708.01870."},{"key":"e_1_2_1_209_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3312817"},{"key":"e_1_2_1_210_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFVIS.1995.528686"},{"key":"e_1_2_1_211_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2744878"},{"key":"e_1_2_1_212_1","volume-title":"Automating power: Social bot interference in global politics. First Monday 21, 4","author":"Woolley Samuel C.","year":"2016","unstructured":"Samuel C. Woolley . 2016. Automating power: Social bot interference in global politics. First Monday 21, 4 ( 2016 ). Samuel C. Woolley. 2016. Automating power: Social bot interference in global politics. First Monday 21, 4 (2016)."},{"key":"e_1_2_1_213_1","volume-title":"32nd AAAI Conference on Artificial Intelligence.","author":"Wu Mike","year":"2018","unstructured":"Mike Wu , Michael C. Hughes , Sonali Parbhoo , Maurizio Zazzi , Volker Roth , and Finale Doshi-Velez . 2018 . Beyond sparsity: Tree regularization of deep models for interpretability . In 32nd AAAI Conference on Artificial Intelligence. Mike Wu, Michael C. Hughes, Sonali Parbhoo, Maurizio Zazzi, Volker Roth, and Finale Doshi-Velez. 2018. Beyond sparsity: Tree regularization of deep models for interpretability. In 32nd AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_214_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300509"},{"key":"e_1_2_1_215_1","volume-title":"ICML Deep Learning Workshop","author":"Yosinski Jason","year":"2015","unstructured":"Jason Yosinski , Jeff Clune , Anh Nguyen , Thomas Fuchs , and Hod Lipson . 2015 . Understanding neural networks through deep visualization . In ICML Deep Learning Workshop 2015. Jason Yosinski, Jeff Clune, Anh Nguyen, Thomas Fuchs, and Hod Lipson. 2015. Understanding neural networks through deep visualization. In ICML Deep Learning Workshop 2015."},{"key":"e_1_2_1_216_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.visinf.2018.09.001"},{"key":"e_1_2_1_217_1","volume-title":"International Conference on Machine Learning. 1899\u20131908","author":"Zahavy Tom","year":"2016","unstructured":"Tom Zahavy , Nir Ben-Zrihem , and Shie Mannor . 2016 . Graying the black box: Understanding DQNs . In International Conference on Machine Learning. 1899\u20131908 . Tom Zahavy, Nir Ben-Zrihem, and Shie Mannor. 2016. Graying the black box: Understanding DQNs. In International Conference on Machine Learning. 1899\u20131908."},{"key":"e_1_2_1_218_1","doi-asserted-by":"publisher","DOI":"10.1177\/0162243915605575"},{"key":"e_1_2_1_219_1","volume-title":"Zeiler and Rob Fergus","author":"Matthew","year":"2014","unstructured":"Matthew D. Zeiler and Rob Fergus . 2014 . Visualizing and understanding convolutional networks. In European Conference on Computer Vision. Springer , 818\u2013833. Matthew D. Zeiler and Rob Fergus. 2014. Visualizing and understanding convolutional networks. In European Conference on Computer Vision. Springer, 818\u2013833."},{"key":"e_1_2_1_220_1","volume-title":"32nd AAAI Conference on Artificial Intelligence.","author":"Zhang Quanshi","year":"2018","unstructured":"Quanshi Zhang , Wenguan Wang , and Song-Chun Zhu . 2018 . Examining CNN representations with respect to dataset bias . In 32nd AAAI Conference on Artificial Intelligence. Quanshi Zhang, Wenguan Wang, and Song-Chun Zhu. 2018. Examining CNN representations with respect to dataset bias. In 32nd AAAI Conference on Artificial Intelligence."},{"key":"e_1_2_1_221_1","doi-asserted-by":"publisher","DOI":"10.1631\/FITEE.1700808"},{"key":"e_1_2_1_222_1","volume-title":"Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (FAT*\u201920)","author":"Zhang Yunfeng","unstructured":"Yunfeng Zhang , Q. Vera Liao , and Rachel K. E. Bellamy . 2020. Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making . In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (FAT*\u201920) . Yunfeng Zhang, Q. Vera Liao, and Rachel K. E. Bellamy. 2020. Effect of confidence and explanation on accuracy and trust calibration in AI-assisted decision making. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency (FAT*\u201920)."},{"key":"e_1_2_1_223_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359158"},{"key":"e_1_2_1_224_1","volume-title":"ICML Workshop on Visualization for Deep Learning.","author":"Zhong Wen","year":"2017","unstructured":"Wen Zhong , Cong Xie , Yuan Zhong , Yang Wang , Wei Xu , Shenghui Cheng , and Klaus Mueller . 2017 . Evolutionary visual analysis of deep neural networks . In ICML Workshop on Visualization for Deep Learning. Wen Zhong, Cong Xie, Yuan Zhong, Yang Wang, Wei Xu, Shenghui Cheng, and Klaus Mueller. 2017. Evolutionary visual analysis of deep neural networks. In ICML Workshop on Visualization for Deep Learning."},{"key":"e_1_2_1_225_1","volume-title":"2018 IEEE Conference on Computational Intelligence and Games (CIG\u201918)","author":"Zhu Jichen","unstructured":"Jichen Zhu , Antonios Liapis , Sebastian Risi , Rafael Bidarra , and G. Michael Youngblood . 2018. Explainable AI for designers: A human-centered perspective on mixed-initiative co-creation . In 2018 IEEE Conference on Computational Intelligence and Games (CIG\u201918) . IEEE, 1\u20138. Jichen Zhu, Antonios Liapis, Sebastian Risi, Rafael Bidarra, and G. Michael Youngblood. 2018. Explainable AI for designers: A human-centered perspective on mixed-initiative co-creation. In 2018 IEEE Conference on Computational Intelligence and Games (CIG\u201918). IEEE, 1\u20138."},{"key":"e_1_2_1_226_1","unstructured":"Luisa M. Zintgraf Taco S. Cohen Tameem Adel and Max Welling. 2017. Visualizing deep neural network decisions: Prediction difference analysis. arxiv:1702.04595. http:\/\/arxiv.org\/abs\/1702.04595.  Luisa M. Zintgraf Taco S. Cohen Tameem Adel and Max Welling. 2017. Visualizing deep neural network decisions: Prediction difference analysis. arxiv:1702.04595. http:\/\/arxiv.org\/abs\/1702.04595."}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3387166","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3387166","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3387166","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:33:26Z","timestamp":1750185206000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3387166"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,3]]},"references-count":226,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2021,12,31]]}},"alternative-id":["10.1145\/3387166"],"URL":"https:\/\/doi.org\/10.1145\/3387166","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,3]]},"assertion":[{"value":"2019-11-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-07-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}