{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,10]],"date-time":"2026-05-10T10:21:24Z","timestamp":1778408484044,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":57,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,28]],"date-time":"2021-06-28T00:00:00Z","timestamp":1624838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,28]]},"DOI":"10.1145\/3461778.3462131","type":"proceedings-article","created":{"date-parts":[[2021,6,28]],"date-time":"2021-06-28T20:27:20Z","timestamp":1624912040000},"page":"1591-1602","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":99,"title":["Who needs to know what, when?: Broadening the Explainable AI (XAI) Design Space by Looking at Explanations Across the AI Lifecycle"],"prefix":"10.1145","author":[{"given":"Shipi","family":"Dhanorkar","sequence":"first","affiliation":[{"name":"Pennsylvania State University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christine T.","family":"Wolf","sequence":"additional","affiliation":[{"name":"Independent Researcher, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kun","family":"Qian","sequence":"additional","affiliation":[{"name":"Amazon.com, Inc., United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anbang","family":"Xu","sequence":"additional","affiliation":[{"name":"IBM Research - Almaden, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lucian","family":"Popa","sequence":"additional","affiliation":[{"name":"IBM Research - Almaden, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yunyao","family":"Li","sequence":"additional","affiliation":[{"name":"Almaden Research Lab IBM Research, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,6,28]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376615"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2870052"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D16-1216"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1080\/1369118X.2016.1154086"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1177\/2053951715622512"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359206"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2783258.2788613"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.5555\/1597122.1597135"},{"key":"e_1_3_2_1_10_1","volume-title":"Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 447\u2013459","author":"Danilevsky Marina","year":"2020","unstructured":"Marina Danilevsky , Kun Qian , Ranit Aharonov , Yannis Katsis , Ban Kawas , and Prithviraj Sen . 2020 . A Survey of the State of Explainable AI for Natural Language Processing . In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 447\u2013459 . Marina Danilevsky, Kun Qian, Ranit Aharonov, Yannis Katsis, Ban Kawas, and Prithviraj Sen. 2020. A Survey of the State of Explainable AI for Natural Language Processing. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 447\u2013459."},{"key":"e_1_3_2_1_11_1","volume-title":"Tutorial on Explainability for Natural Language Processing. Proceedings of the 1st Conference of the Asia-Pacific","author":"Dhanorkar Shipi","unstructured":"Shipi Dhanorkar , Christine\u00a0 T Wolf , Kun Qian , Anbang Xu , Lucian Popa , and Yunyao Li. 2020. Tutorial on Explainability for Natural Language Processing. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing(2020). Shipi Dhanorkar, Christine\u00a0T Wolf, Kun Qian, Anbang Xu, Lucian Popa, and Yunyao Li. 2020. Tutorial on Explainability for Natural Language Processing. Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing(2020)."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376275"},{"key":"e_1_3_2_1_13_1","volume-title":"HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence, Constantine Stephanidis, Masaaki Kurosu, Helmut Degen, and Lauren Reinerman-Jones (Eds.)","author":"Ehsan Upol","unstructured":"Upol Ehsan and Mark\u00a0 O. Riedl . 2020. Human-Centered Explainable AI: Towards a Reflective Sociotechnical Approach . In HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence, Constantine Stephanidis, Masaaki Kurosu, Helmut Degen, and Lauren Reinerman-Jones (Eds.) . Springer International Publishing , Cham , 449\u2013466. Upol Ehsan and Mark\u00a0O. Riedl. 2020. Human-Centered Explainable AI: Towards a Reflective Sociotechnical Approach. In HCI International 2020 - Late Breaking Papers: Multimodality and Intelligence, Constantine Stephanidis, Masaaki Kurosu, Helmut Degen, and Lauren Reinerman-Jones (Eds.). Springer International Publishing, Cham, 449\u2013466."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302316"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300724"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.2307\/3033230"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9531.2010.01223.x"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSAA.2018.00018"},{"key":"e_1_3_2_1_19_1","volume-title":"A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5","author":"Guidotti Riccardo","year":"2018","unstructured":"Riccardo Guidotti , Anna Monreale , Salvatore Ruggieri , Franco Turini , Fosca Giannotti , and Dino Pedreschi . 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 ( 2018 ), 1\u201342. Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 (2018), 1\u201342."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/358916.358995"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313096"},{"key":"e_1_3_2_1_22_1","unstructured":"Karen Holtzblatt Jessamyn Wendell and Shelley Wood. 2004. Rapid Contextual Design. Morgan Kaufmann. https:\/\/www.elsevier.com\/books\/rapid-contextual-design\/holtzblatt\/978-0-12-354051-5 Karen Holtzblatt Jessamyn Wendell and Shelley Wood. 2004. Rapid Contextual Design. Morgan Kaufmann. https:\/\/www.elsevier.com\/books\/rapid-contextual-design\/holtzblatt\/978-0-12-354051-5"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3392878"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/1881.001.0001","volume-title":"Cognition in the Wild. Number","author":"Hutchins Edwin","year":"1995","unstructured":"Edwin Hutchins . 1995. Cognition in the Wild. Number 1995 . MIT press . Edwin Hutchins. 1995. Cognition in the Wild. Number 1995. MIT press."},{"key":"e_1_3_2_1_25_1","volume-title":"Text analytics in industry: Challenges, desiderata and trends. Computers in Industry 78 (May","author":"Ittoo Ashwin","year":"2016","unstructured":"Ashwin Ittoo , Le\u00a0Minh Nguyen , and Antal van\u00a0den Bosch . 2016. Text analytics in industry: Challenges, desiderata and trends. Computers in Industry 78 (May 2016 ), 96\u2013107. https:\/\/doi.org\/10.1016\/j.compind.2015.12.001 10.1016\/j.compind.2015.12.001 Ashwin Ittoo, Le\u00a0Minh Nguyen, and Antal van\u00a0den Bosch. 2016. Text analytics in industry: Challenges, desiderata and trends. Computers in Industry 78 (May 2016), 96\u2013107. https:\/\/doi.org\/10.1016\/j.compind.2015.12.001"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.5555\/2891730.2891924"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445481"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N16-1082"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376590"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376727"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395491"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3322276.3322351"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2018.07.007"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287574"},{"key":"e_1_3_2_1_36_1","volume-title":"Context and Consciousness: Activity Theory and Human-Computer Interaction","author":"Nardi A","unstructured":"Bonnie\u00a0 A Nardi . 1996. Context and Consciousness: Activity Theory and Human-Computer Interaction . MIT Press . Bonnie\u00a0A Nardi. 1996. Context and Consciousness: Activity Theory and Human-Computer Interaction. MIT Press."},{"key":"e_1_3_2_1_37_1","volume-title":"Ways of Knowing in HCI","author":"Olson S.","unstructured":"Judith\u00a0 S. Olson and Wendy\u00a0 A. Kellogg . 2014. Ways of Knowing in HCI . Springer , New York, NY , New York, NY, USA. https:\/\/doi.org\/10.1007\/978-1-4939-0378-8 10.1007\/978-1-4939-0378-8 Judith\u00a0S. Olson and Wendy\u00a0A. Kellogg. 2014. Ways of Knowing in HCI. Springer, New York, NY, New York, NY, USA. https:\/\/doi.org\/10.1007\/978-1-4939-0378-8"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445315"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702174"},{"key":"e_1_3_2_1_40_1","volume-title":"Encountering ethics through design: a workshop with nonhuman participants. AI & SOCIETY","author":"Reddy Anuradha","year":"2020","unstructured":"Anuradha Reddy , Iohanna Nicenboim , James Pierce , and Elisa Giaccardi . 2020. Encountering ethics through design: a workshop with nonhuman participants. AI & SOCIETY ( 2020 ), 1\u20139. https:\/\/doi.org\/10.1007\/s00146-020-01088-7 10.1007\/s00146-020-01088-7 Anuradha Reddy, Iohanna Nicenboim, James Pierce, and Elisa Giaccardi. 2020. Encountering ethics through design: a workshop with nonhuman participants. AI & SOCIETY (2020), 1\u20139. https:\/\/doi.org\/10.1007\/s00146-020-01088-7"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2017\/371"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0048-x"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302322"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1177\/016224399502000205"},{"key":"e_1_3_2_1_46_1","volume-title":"Plans and Situated Actions: The Problem of Human-Machine Communication","author":"Suchman A.","unstructured":"Lucy\u00a0 A. Suchman . 1987. Plans and Situated Actions: The Problem of Human-Machine Communication . Cambridge University Press , USA. Lucy\u00a0A. Suchman. 1987. Plans and Situated Actions: The Problem of Human-Machine Communication. Cambridge University Press, USA."},{"key":"e_1_3_2_1_47_1","volume-title":"Human-Machine Reconfigurations: Plans and Situated Actions","author":"Suchman A","unstructured":"Lucy\u00a0 A Suchman . 2007. Human-Machine Reconfigurations: Plans and Situated Actions . Cambridge University Press . Lucy\u00a0A Suchman. 2007. Human-Machine Reconfigurations: Plans and Situated Actions. Cambridge University Press."},{"key":"e_1_3_2_1_48_1","volume-title":"XPLAIN: A system for creating and explaining expert consulting programs. Artificial intelligence 21, 3","author":"Swartout R","year":"1983","unstructured":"William\u00a0 R Swartout . 1983 . XPLAIN: A system for creating and explaining expert consulting programs. Artificial intelligence 21, 3 (1983), 285\u2013325. William\u00a0R Swartout. 1983. XPLAIN: A system for creating and explaining expert consulting programs. Artificial intelligence 21, 3 (1983), 285\u2013325."},{"key":"e_1_3_2_1_49_1","first-page":"2579","article-title":"Visualizing Data using t-SNE","volume":"9","author":"van\u00a0der Maaten Laurens","year":"2008","unstructured":"Laurens van\u00a0der Maaten and Geoffrey Hinton . 2008 . Visualizing Data using t-SNE . Journal of Machine Learning Research 9 , 86 (2008), 2579 \u2013 2605 . http:\/\/jmlr.org\/papers\/v9\/vandermaaten08a.html Laurens van\u00a0der Maaten and Geoffrey Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research 9, 86 (2008), 2579\u20132605. http:\/\/jmlr.org\/papers\/v9\/vandermaaten08a.html","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174014"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300831"},{"key":"e_1_3_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302317"},{"key":"e_1_3_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272973.3273005"},{"key":"e_1_3_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173704"},{"key":"e_1_3_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196730"},{"key":"e_1_3_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300509"},{"key":"e_1_3_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395528"}],"event":{"name":"DIS '21: Designing Interactive Systems Conference 2021","location":"Virtual Event USA","acronym":"DIS '21","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Designing Interactive Systems Conference 2021"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461778.3462131","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3461778.3462131","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:33Z","timestamp":1750191453000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3461778.3462131"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,28]]},"references-count":57,"alternative-id":["10.1145\/3461778.3462131","10.1145\/3461778"],"URL":"https:\/\/doi.org\/10.1145\/3461778.3462131","relation":{},"subject":[],"published":{"date-parts":[[2021,6,28]]},"assertion":[{"value":"2021-06-28","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}