{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T06:27:37Z","timestamp":1782282457341,"version":"3.54.5"},"reference-count":169,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2023,4,14]],"date-time":"2023-04-14T00:00:00Z","timestamp":1681430400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1928586"],"award-info":[{"award-number":["1928586"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,4,14]]},"abstract":"<jats:p>Explainable AI (XAI) systems are sociotechnical in nature; thus, they are subject to the sociotechnical gap-divide between the technical affordances and the social needs. However, charting this gap is challenging. In the context of XAI, we argue that charting the gap improves our problem understanding, which can reflexively provide actionable insights to improve explainability. Utilizing two case studies in distinct domains, we empirically derive a framework that facilitates systematic charting of the sociotechnical gap by connecting AI guidelines in the context of XAI and elucidating how to use them to address the gap. We apply the framework to a third case in a new domain, showcasing its affordances. Finally, we discuss conceptual implications of the framework, share practical considerations in its operationalization, and offer guidance on transferring it to new contexts. By making conceptual and practical contributions to understanding the sociotechnical gap in XAI, the framework expands the XAI design space.<\/jats:p>","DOI":"10.1145\/3579467","type":"journal-article","created":{"date-parts":[[2023,4,16]],"date-time":"2023-04-16T17:23:07Z","timestamp":1681665787000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":79,"title":["Charting the Sociotechnical Gap in Explainable AI: A Framework to Address the Gap in XAI"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4911-0409","authenticated-orcid":false,"given":"Upol","family":"Ehsan","sequence":"first","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8872-2934","authenticated-orcid":false,"given":"Koustuv","family":"Saha","sequence":"additional","affiliation":[{"name":"Microsoft Research, Montreal, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8939-264X","authenticated-orcid":false,"given":"Munmun","family":"De Choudhury","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5283-6588","authenticated-orcid":false,"given":"Mark O.","family":"Riedl","sequence":"additional","affiliation":[{"name":"Georgia Tech, Altanta, GA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,4,16]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Value co-creation in knowledge intensive business services: A dyadic perspective on the joint problem solving process. Industrial marketing management","author":"Aarikka-Stenroos Leena","year":"2012","unstructured":"Leena Aarikka-Stenroos and Elina Jaakkola. 2012. Value co-creation in knowledge intensive business services: A dyadic perspective on the joint problem solving process. Industrial marketing management, Vol. 41, 1 (2012), 15--26."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156"},{"key":"e_1_2_1_3_1","volume-title":"The intellectual challenge of CSCW: the gap between social requirements and technical feasibility. Human-Computer Interaction","author":"Ackerman Mark S","year":"2000","unstructured":"Mark S Ackerman. 2000. The intellectual challenge of CSCW: the gap between social requirements and technical feasibility. Human-Computer Interaction (2000)."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2870052"},{"key":"e_1_2_1_5_1","volume-title":"1997 a. Toward a critical technical practice: Lessons learned in trying to reform AI in Bowker. Social science, technical systems, and cooperative work: Beyond the Great Divide","author":"Agre P","year":"1997","unstructured":"P Agre. 1997 a. Toward a critical technical practice: Lessons learned in trying to reform AI in Bowker. Social science, technical systems, and cooperative work: Beyond the Great Divide (1997)."},{"key":"e_1_2_1_6_1","volume-title":"1997 b. Computation and human experience","author":"Agre Philip E","unstructured":"Philip E Agre. 1997 b. Computation and human experience. Cambridge University Press."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377519"},{"key":"e_1_2_1_8_1","unstructured":"Steven Alter. 2010. Design spaces for sociotechnical systems. (2010)."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300233"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISTAS50296.2020.9462193"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2019.2942288"},{"key":"e_1_2_1_12_1","volume-title":"Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador Garc'ia, Sergio Gil-L\u00f3pez, Daniel Molina, Richard Benjamins, et al.","author":"Arrieta Alejandro Barredo","year":"2020","unstructured":"Alejandro Barredo Arrieta, Natalia D'iaz-Rodr'iguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador Garc'ia, Sergio Gil-L\u00f3pez, Daniel Molina, Richard Benjamins, et al. 2020. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, Vol. 58 (2020)."},{"key":"e_1_2_1_13_1","volume-title":"Pin-Yu Chen, Amit Dhurandhar, Michael Hind, Samuel C Hoffman, Stephanie Houde, Q Vera Liao, Ronny Luss, Aleksandra Mojsilovi\u0107, et al.","author":"Arya Vijay","year":"2019","unstructured":"Vijay Arya, Rachel KE Bellamy, Pin-Yu Chen, Amit Dhurandhar, Michael Hind, Samuel C Hoffman, Stephanie Houde, Q Vera Liao, Ronny Luss, Aleksandra Mojsilovi\u0107, et al. 2019. One explanation does not fit all: A toolkit and taxonomy of ai explainability techniques. arXiv preprint arXiv:1909.03012 (2019)."},{"key":"e_1_2_1_14_1","unstructured":"Maryam Ashoori and Justin D Weisz. 2019. In AI we trust? Factors that influence trustworthiness of AI-infused decision-making processes. arXiv preprint arXiv:1912.02675 (2019)."},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"American Psychiatric Association et al. 2015. The American Psychiatric Association practice guidelines for the psychiatric evaluation of adults. American Psychiatric Pub.","DOI":"10.1176\/appi.books.9780890426760"},{"key":"e_1_2_1_16_1","volume-title":"Contemporary Psychotherapy","volume":"6","author":"Balick Aaron","year":"2014","unstructured":"Aaron Balick. 2014. Technology, social media, and psychotherapy: Getting with the programme. Contemporary Psychotherapy, Vol. 6, 2 (2014)."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675297"},{"key":"e_1_2_1_18_1","volume-title":"Agricultural Experiment Station)","author":"Beal GM","year":"1957","unstructured":"GM Beal and JM Bohlen. 1957. The diffusion process (Special Report N\u0718 18, Agricultural Experiment Station). Iowa State College (1957)."},{"key":"e_1_2_1_19_1","volume-title":"Universal methods of design","author":"Bella Martin","year":"2012","unstructured":"Martin Bella and Bruce Hanington. 2012. Universal methods of design. Beverly, MA: Rockport Publishers (2012), 204."},{"key":"e_1_2_1_20_1","unstructured":"Rachel KE Bellamy Kuntal Dey Michael Hind Samuel C Hoffman Stephanie Houde Kalapriya Kannan Pranay Lohia Jacquelyn Martino Sameep Mehta Aleksandra Mojsilovic et al. 2018. AI Fairness 360: An extensible toolkit for detecting understanding and mitigating unwanted algorithmic bias. arXiv preprint arXiv:1810.01943 (2018)."},{"key":"e_1_2_1_21_1","volume-title":"Contextual techniques starter kit. interactions","author":"Beyer Hugh R","year":"1996","unstructured":"Hugh R Beyer and Karen Holtzblatt. 1996. Contextual techniques starter kit. interactions, Vol. 3, 6 (1996), 44--50."},{"key":"e_1_2_1_22_1","volume-title":"Using thematic analysis in psychology. Qualitative research in psychology","author":"Braun Virginia","year":"2006","unstructured":"Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology, Vol. 3, 2 (2006), 77--101."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the 25th International Conference on Intelligent User Interfaces.","author":"Zana Bucc","year":"2020","unstructured":"Zana Bucc inca, Phoebe Lin, Krzysztof Z Gajos, and Elena L Glassman. 2020. Proxy tasks and subjective measures can be misleading in evaluating explainable ai systems. In Proceedings of the 25th International Conference on Intelligent User Interfaces."},{"key":"e_1_2_1_24_1","volume-title":"Conference on fairness, accountability and transparency. PMLR, 77--91","author":"Buolamwini Joy","year":"2018","unstructured":"Joy Buolamwini and Timnit Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. In Conference on fairness, accountability and transparency. PMLR, 77--91."},{"key":"e_1_2_1_25_1","volume-title":"Nine Potential Pitfalls when Designing Human-AI Co-Creative Systems. arXiv preprint arXiv:2104.00358","author":"Buschek Daniel","year":"2021","unstructured":"Daniel Buschek, Lukas Mecke, Florian Lehmann, and Hai Dang. 2021. Nine Potential Pitfalls when Designing Human-AI Co-Creative Systems. arXiv preprint arXiv:2104.00358 (2021)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302289"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3390\/electronics8080832"},{"key":"e_1_2_1_28_1","volume-title":"Methods in predictive techniques for mental health status on social media: a critical review. NPJ digital medicine","author":"Chancellor Stevie","year":"2020","unstructured":"Stevie Chancellor and Munmun De Choudhury. 2020. Methods in predictive techniques for mental health status on social media: a critical review. NPJ digital medicine (2020)."},{"key":"e_1_2_1_29_1","volume-title":"AMIA Annual Symposium Proceedings","volume":"2016","author":"Che Zhengping","year":"2016","unstructured":"Zhengping Che, Sanjay Purushotham, Robinder Khemani, and Yan Liu. 2016. Interpretable deep models for ICU outcome prediction. In AMIA Annual Symposium Proceedings, Vol. 2016."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300789"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2016.7451775"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3171221.3171244"},{"key":"e_1_2_1_33_1","volume-title":"Technological Transformation","author":"Christians Clifford","unstructured":"Clifford Christians. 1989. A theory of normative technology. In Technological Transformation. Springer, 123--139."},{"key":"e_1_2_1_34_1","volume-title":"The observer effect. Foundations of science","author":"de Bianchi Massimiliano Sassoli","year":"2013","unstructured":"Massimiliano Sassoli de Bianchi. 2013. The observer effect. Foundations of science, Vol. 18, 2 (2013), 213--243."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466447"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2531602.2531675"},{"key":"e_1_2_1_37_1","volume-title":"Haiyi Zhu, and David A Shamma.","author":"Choudhury Munmun De","year":"2020","unstructured":"Munmun De Choudhury, Min Kyung Lee, Haiyi Zhu, and David A Shamma. 2020. Introduction to this special issue on unifying human computer interaction and artificial intelligence. Human-Computer Interaction (2020)."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461778.3462131"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302310"},{"key":"e_1_2_1_40_1","volume-title":"Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608","author":"Doshi-Velez Finale","year":"2017","unstructured":"Finale Doshi-Velez and Been Kim. 2017. Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608 (2017)."},{"key":"e_1_2_1_41_1","volume-title":"Divining a digital future: Mess and mythology in ubiquitous computing","author":"Dourish Paul","unstructured":"Paul Dourish and Genevieve Bell. 2011. Divining a digital future: Mess and mythology in ubiquitous computing. Mit Press."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025739"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445188"},{"key":"e_1_2_1_44_1","unstructured":"Upol Ehsan Samir Passi Q Vera Liao Larry Chan I Lee Michael Muller Mark O Riedl et al. 2021b. The who in explainable ai: How ai background shapes perceptions of ai explanations. arXiv preprint arXiv:2107.13509 (2021)."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-60117-1_33"},{"key":"e_1_2_1_46_1","volume-title":"Explainability pitfalls: Beyond dark patterns in explainable AI. arXiv preprint arXiv:2109.12480","author":"Ehsan Upol","year":"2021","unstructured":"Upol Ehsan and Mark O Riedl. 2021. Explainability pitfalls: Beyond dark patterns in explainable AI. arXiv preprint arXiv:2109.12480 (2021)."},{"key":"e_1_2_1_47_1","volume-title":"Social Construction of XAI: Do We Need One Definition to Rule Them All? arXiv preprint arXiv:2211.06499","author":"Ehsan Upol","year":"2022","unstructured":"Upol Ehsan and Mark O Riedl. 2022. Social Construction of XAI: Do We Need One Definition to Rule Them All? arXiv preprint arXiv:2211.06499 (2022)."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302316"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3503727"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450694"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3172944.3172961"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of CHI conference on human factors in computing systems.","author":"Eslami Motahhare","year":"2015","unstructured":"Motahhare Eslami, Aimee Rickman, Kristen Vaccaro, Amirhossein Aleyasen, Andy Vuong, Karrie Karahalios, Kevin Hamilton, and Christian Sandvig. 2015. \"I always assumed that I wasn't really that close to [her]\" Reasoning about Invisible Algorithms in News Feeds. In Proceedings of CHI conference on human factors in computing systems."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2648.2009.05250.x"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1097\/hrp.0000000000000145"},{"key":"e_1_2_1_55_1","volume-title":"understanding, and supporting open collaboration: Lessons from the literature. American behavioral scientist","author":"Forte Andrea","year":"2013","unstructured":"Andrea Forte and Cliff Lampe. 2013. Defining, understanding, and supporting open collaboration: Lessons from the literature. American behavioral scientist, Vol. 57, 5 (2013), 535--547."},{"key":"e_1_2_1_56_1","volume-title":"Value-sensitive design. interactions","author":"Friedman Batya","year":"1996","unstructured":"Batya Friedman. 1996. Value-sensitive design. interactions, Vol. 3, 6 (1996), 16--23."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208562"},{"key":"e_1_2_1_58_1","unstructured":"Batya Friedman Peter Kahn and Alan Borning. 2002. Value sensitive design: Theory and methods. University of Washington technical report 2--12 (2002)."},{"key":"e_1_2_1_59_1","volume-title":"Hanna Wallach, Hal Daum\u00e9 III, and Kate Crawford.","author":"Gebru Timnit","year":"2018","unstructured":"Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daum\u00e9 III, and Kate Crawford. 2018. Datasheets for datasets. arXiv preprint arXiv:1803.09010 (2018)."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376316"},{"key":"e_1_2_1_61_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction","volume":"4","author":"Ghai Bhavya","year":"2021","unstructured":"Bhavya Ghai, Q Vera Liao, Yunfeng Zhang, Rachel Bellamy, and Klaus Mueller. 2021. Explainable Active Learning (XAL) Toward AI Explanations as Interfaces for Machine Teachers. Proceedings of the ACM on Human-Computer Interaction, Vol. 4, CSCW3 (2021)."},{"key":"e_1_2_1_62_1","volume-title":"Explaining explanations: An approach to evaluating interpretability of machine learning. arXiv preprint arXiv:1806.00069","author":"Gilpin Leilani H","year":"2018","unstructured":"Leilani H Gilpin, David Bau, Ben Z Yuan, Ayesha Bajwa, Michael Specter, and Lalana Kagal. 2018. Explaining explanations: An approach to evaluating interpretability of machine learning. arXiv preprint arXiv:1806.00069 (2018)."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372840"},{"key":"e_1_2_1_64_1","volume-title":"Local rule-based explanations of black box decision systems. arXiv preprint arXiv:1805.10820","author":"Guidotti Riccardo","year":"2018","unstructured":"Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Dino Pedreschi, Franco Turini, and Fosca Giannotti. 2018a. Local rule-based explanations of black box decision systems. arXiv preprint arXiv:1805.10820 (2018)."},{"key":"e_1_2_1_65_1","volume-title":"A survey of methods for explaining black box models. ACM computing surveys (CSUR)","author":"Guidotti Riccardo","year":"2018","unstructured":"Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018b. A survey of methods for explaining black box models. ACM computing surveys (CSUR), Vol. 51, 5 (2018), 1--42."},{"key":"e_1_2_1_66_1","volume-title":"Explainable artificial intelligence (xai)","author":"Gunning David","year":"2017","unstructured":"David Gunning. 2017. Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA), nd Web, Vol. 2 (2017), 2."},{"key":"e_1_2_1_67_1","volume-title":"Detecting depression and mental illness on social media: an integrative review. Current Opinion in Behavioral Sciences","author":"Guntuku Sharath Chandra","year":"2017","unstructured":"Sharath Chandra Guntuku, David B Yaden, Margaret L Kern, Lyle H Ungar, and Johannes C Eichstaedt. 2017. Detecting depression and mental illness on social media: an integrative review. Current Opinion in Behavioral Sciences (2017)."},{"key":"e_1_2_1_68_1","volume-title":"AI is sending people to jail -- and getting it wrong. MIT Technology Review (21","author":"Hao Karen","year":"2019","unstructured":"Karen Hao. 2019. AI is sending people to jail -- and getting it wrong. MIT Technology Review (21 January 2019). https:\/\/www.technologyreview.com\/s\/612775\/algorithms- criminal-justice-ai\/ Retrieved 26-August-2019 from"},{"key":"e_1_2_1_69_1","doi-asserted-by":"crossref","unstructured":"MD Romael Haque Katherine Weathington Joseph Chudzik and Shion Guha. 2020. Understanding Law Enforcement and Common Peoples' Perspectives on Designing Explainable Crime Mapping Algorithms. In Conference Companion Publication of the 2020 on Computer Supported Cooperative Work and Social Computing. 269--273.","DOI":"10.1145\/3406865.3418330"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/1993060.1993065"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313096"},{"key":"e_1_2_1_72_1","volume-title":"Alexandra Olteanu, and Kush R Varshney.","author":"Hind Michael","year":"2018","unstructured":"Michael Hind, Sameep Mehta, Aleksandra Mojsilovic, Ravi Nair, Karthikeyan Natesan Ramamurthy, Alexandra Olteanu, and Kush R Varshney. 2018. Increasing trust in AI services through supplier's declarations of conformity. arXiv preprint arXiv:1808.07261, Vol. 18 (2018), 2813--2869."},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1177\/0018720814547570"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300809"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.5040\/9781509932771.ch-001"},{"key":"e_1_2_1_76_1","volume-title":"What do we need to build explainable AI systems for the medical domain? arXiv preprint arXiv:1712.09923","author":"Holzinger Andreas","year":"2017","unstructured":"Andreas Holzinger, Chris Biemann, Constantinos S Pattichis, and Douglas B Kell. 2017. What do we need to build explainable AI systems for the medical domain? arXiv preprint arXiv:1712.09923 (2017)."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.5555\/2440640.2440707"},{"key":"e_1_2_1_78_1","volume-title":"Machine learning model interpretability for precision medicine. arXiv preprint arXiv:1610.09045","author":"Katuwal Gajendra Jung","year":"2016","unstructured":"Gajendra Jung Katuwal and Robert Chen. 2016. Machine learning model interpretability for precision medicine. arXiv preprint arXiv:1610.09045 (2016)."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376219"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1093\/qje"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445890"},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cad.2010.09.009"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2013.6645235"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376873"},{"key":"e_1_2_1_85_1","volume-title":"Colin A Depp, Sarah A Graham, Ho-Cheol Kim, Martin P Paulus, John H Krystal, and Dilip V Jeste.","author":"Lee Ellen E","year":"2021","unstructured":"Ellen E Lee, John Torous, Munmun De Choudhury, Colin A Depp, Sarah A Graham, Ho-Cheol Kim, Martin P Paulus, John H Krystal, and Dilip V Jeste. 2021. Artificial Intelligence for Mental Healthcare: Clinical Applications, Barriers, Facilitators, and Artificial Wisdom. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging (2021)."},{"key":"e_1_2_1_86_1","volume-title":"Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, et al.","author":"Lee Min Kyung","year":"2019","unstructured":"Min Kyung Lee, Daniel Kusbit, Anson Kahng, Ji Tae Kim, Xinran Yuan, Allissa Chan, Daniel See, Ritesh Noothigattu, Siheon Lee, Alexandros Psomas, et al. 2019. WeBuildAI: Participatory framework for algorithmic governance. Proceedings of the ACM on Human-Computer Interaction, Vol. 3, CSCW (2019), 1--35."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376590"},{"key":"e_1_2_1_88_1","volume-title":"Question-Driven Design Process for Explainable AI User Experiences. arXiv:2104.03483 [cs] (Sept","author":"Liao Q. Vera","year":"2021","unstructured":"Q. Vera Liao, Milena Pribi\u0107, Jaesik Han, Sarah Miller, and Daby Sow. 2021. Question-Driven Design Process for Explainable AI User Experiences. arXiv:2104.03483 [cs] (Sept. 2021). http:\/\/arxiv.org\/abs\/2104.03483 arXiv: 2104.03483."},{"key":"e_1_2_1_89_1","volume-title":"Human-centered explainable ai (xai): From algorithms to user experiences. arXiv preprint arXiv:2110.10790","author":"Vera Liao Q","year":"2021","unstructured":"Q Vera Liao and Kush R Varshney. 2021. Human-centered explainable ai (xai): From algorithms to user experiences. arXiv preprint arXiv:2110.10790 (2021)."},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/1620545.1620576"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/1864349.1864353"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1145\/2030112.2030168"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519023"},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519023"},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1145\/3236386.3241340"},{"key":"e_1_2_1_96_1","volume-title":"Artificial Intelligence and Surgical Decision-making. JAMA Surgery","author":"Loftus Tyler J.","year":"2020","unstructured":"Tyler J. Loftus, Patrick J. Tighe, Amanda C. Filiberto, Philip A. Efron, Scott C. Brakenridge, Alicia M. Mohr, Parisa Rashidi, Jr Upchurch, Gilbert R., and Azra Bihorac. 2020. Artificial Intelligence and Surgical Decision-making. JAMA Surgery (2020)."},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1747-9991.2011.00413.x"},{"key":"e_1_2_1_98_1","volume-title":"Explanation and abductive inference. Oxford handbook of thinking and reasoning","author":"Lombrozo Tania","year":"2012","unstructured":"Tania Lombrozo. 2012. Explanation and abductive inference. Oxford handbook of thinking and reasoning (2012)."},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376727"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858288"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449180"},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1086\/697318"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376445"},{"key":"e_1_2_1_104_1","unstructured":"Jonathan Magnusson. [n.d.]. Improving Dark Pattern Literacy of End Users. ( [n. d.])."},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2020.07.045"},{"key":"e_1_2_1_106_1","volume-title":"Sune Von Solms, and Annliz\u00e9 Marnewick","author":"Malatji Masike","year":"2019","unstructured":"Masike Malatji, Sune Von Solms, and Annliz\u00e9 Marnewick. 2019. Socio-technical systems cybersecurity framework. Information & Computer Security (2019)."},{"key":"e_1_2_1_107_1","volume-title":"Generative Design: A Paradigm for Design Research.","author":"McCormack Jon","year":"2004","unstructured":"Jon McCormack, Alan Dorin, and Troy Innocent. 2004. Generative Design: A Paradigm for Design Research. (2004)."},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2018.07.007"},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287596"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287574"},{"key":"e_1_2_1_111_1","volume-title":"Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence. Philosophy & Technology","author":"Mohamed Shakir","year":"2020","unstructured":"Shakir Mohamed, Marie-Therese Png, and William Isaac. 2020. Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence. Philosophy & Technology (2020), 1--26."},{"key":"e_1_2_1_112_1","volume-title":"A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems. arXiv","author":"Mohseni Sina","year":"2018","unstructured":"Sina Mohseni, Niloofar Zarei, and Eric D Ragan. 2018. A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems. arXiv (2018), arXiv--1811."},{"key":"e_1_2_1_113_1","unstructured":"Geoffrey A Moore and Regis McKenna. 1999. Crossing the chasm. (1999)."},{"key":"e_1_2_1_114_1","unstructured":"Evgeny Morozov. 2013. To save everything click here: The folly of technological solutionism. Public Affairs."},{"key":"e_1_2_1_115_1","unstructured":"Michael Muller and Q Vera Liao. [n.d.]. Exploring AI Ethics and Values through Participatory Design Fictions. ( [n. d.])."},{"key":"e_1_2_1_116_1","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2792"},{"key":"e_1_2_1_117_1","volume-title":"Mortgage Providers Look to AI to Process Home Loans Faster. Wall Street Journal (18","author":"Murawski John","year":"2019","unstructured":"John Murawski. 2019. Mortgage Providers Look to AI to Process Home Loans Faster. Wall Street Journal (18 March 2019). https:\/\/www.wsj.com\/articles\/mortgage-providers-look-to-ai-to-process-home-loans-faster-11552899212 Retrieved 16-September-2020 from"},{"key":"e_1_2_1_118_1","volume-title":"The social construction of facts and artefacts: Or how the sociology of science and the sociology of technology might benefit each other. Social studies of science","author":"Pinch Trevor J","year":"1984","unstructured":"Trevor J Pinch and Wiebe E Bijker. 1984. The social construction of facts and artefacts: Or how the sociology of science and the sociology of technology might benefit each other. Social studies of science, Vol. 14, 3 (1984), 399--441."},{"key":"e_1_2_1_119_1","volume-title":"Jennifer Wortman Vaughan, and Hanna Wallach","author":"Poursabzi-Sangdeh Forough","year":"2018","unstructured":"Forough Poursabzi-Sangdeh, Daniel G Goldstein, Jake M Hofman, Jennifer Wortman Vaughan, and Hanna Wallach. 2018. Manipulating and measuring model interpretability. arXiv preprint arXiv:1802.07810 (2018)."},{"key":"e_1_2_1_120_1","volume-title":"Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AI. arXiv preprint arXiv:2204.01075","author":"Pushkarna Mahima","year":"2022","unstructured":"Mahima Pushkarna, Andrew Zaldivar, and Oddur Kjartansson. 2022. Data Cards: Purposeful and Transparent Dataset Documentation for Responsible AI. arXiv preprint arXiv:2204.01075 (2022)."},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173677"},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702174"},{"key":"e_1_2_1_123_1","volume-title":"Explainable and Interpretable Models in Computer Vision and Machine Learning","author":"Ras Gabri\u00eblle","unstructured":"Gabri\u00eblle Ras, Marcel van Gerven, and Pim Haselager. 2018. Explanation methods in deep learning: Users, values, concerns and challenges. In Explainable and Interpretable Models in Computer Vision and Machine Learning. Springer."},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_125_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11491"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1162\/99608f92.6ed64b30"},{"key":"e_1_2_1_127_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-010-0066-7"},{"key":"e_1_2_1_128_1","doi-asserted-by":"crossref","unstructured":"Koustuv Saha Pranshu Gupta Gloria Mark Emre Kiciman and Munmun De Choudhury. 2023. Observer Effect in Social Media Use. (2023).","DOI":"10.21203\/rs.3.rs-2492994\/v1"},{"key":"e_1_2_1_129_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445405"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1609\/icwsm.v13i01.3242"},{"key":"e_1_2_1_131_1","volume-title":"Social media discussions predict mental health consultations on college campuses. Scientific reports","author":"Saha Koustuv","year":"2022","unstructured":"Koustuv Saha, Asra Yousuf, Ryan L Boyd, James W Pennebaker, and Munmun De Choudhury. 2022. Social media discussions predict mental health consultations on college campuses. Scientific reports (2022)."},{"key":"e_1_2_1_132_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372849"},{"key":"e_1_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-51924-7_6"},{"key":"e_1_2_1_134_1","volume-title":"Saturation in qualitative research: exploring its conceptualization and operationalization. Quality & quantity","author":"Saunders Benjamin","year":"2018","unstructured":"Benjamin Saunders, Julius Sim, Tom Kingstone, Shula Baker, Jackie Waterfield, Bernadette Bartlam, Heather Burroughs, and Clare Jinks. 2018. Saturation in qualitative research: exploring its conceptualization and operationalization. Quality & quantity, Vol. 52, 4 (2018), 1893--1907."},{"key":"e_1_2_1_135_1","doi-asserted-by":"publisher","DOI":"10.1145\/3462204.3481742"},{"key":"e_1_2_1_136_1","volume-title":"Participatory design: Principles and practices","author":"Schuler Douglas","unstructured":"Douglas Schuler and Aki Namioka. 1993. Participatory design: Principles and practices. CRC Press."},{"key":"e_1_2_1_137_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287560.3287598"},{"key":"e_1_2_1_138_1","doi-asserted-by":"publisher","DOI":"10.1145\/1094562.1094569"},{"key":"e_1_2_1_139_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2020.1741118"},{"key":"e_1_2_1_140_1","volume-title":"Building trust in artificial intelligence, machine learning, and robotics. Cutter business technology journal","author":"Siau Keng","year":"2018","unstructured":"Keng Siau and Weiyu Wang. 2018. Building trust in artificial intelligence, machine learning, and robotics. Cutter business technology journal, Vol. 31, 2 (2018), 47--53."},{"key":"e_1_2_1_141_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240759"},{"key":"e_1_2_1_142_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376624"},{"key":"e_1_2_1_143_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372870"},{"key":"e_1_2_1_144_1","volume-title":"Action research","author":"Stringer Ernest T","year":"2007","unstructured":"Ernest T Stringer. 2007. Action research third edition. (2007)."},{"key":"e_1_2_1_145_1","volume-title":"ACM SIGCHI Workshop on Human-Centered Machine Learning.","author":"Stumpf Simone","year":"2016","unstructured":"Simone Stumpf, Adrian Bussone, and Dympna O'sullivan. 2016. Explanations considered harmful? user interactions with machine learning systems. In ACM SIGCHI Workshop on Human-Centered Machine Learning."},{"key":"e_1_2_1_146_1","doi-asserted-by":"publisher","DOI":"10.1145\/3490099.3511119"},{"key":"e_1_2_1_147_1","volume-title":"A framework for understanding unintended consequences of machine learning. arXiv preprint arXiv:1901.10002","author":"Suresh Harini","year":"2019","unstructured":"Harini Suresh and John V Guttag. 2019. A framework for understanding unintended consequences of machine learning. arXiv preprint arXiv:1901.10002 (2019)."},{"key":"e_1_2_1_148_1","volume-title":"Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. arXiv preprint arXiv:1806.07552","author":"Tomsett Richard","year":"2018","unstructured":"Richard Tomsett, Dave Braines, Dan Harborne, Alun Preece, and Supriyo Chakraborty. 2018. Interpretable to whom? A role-based model for analyzing interpretable machine learning systems. arXiv preprint arXiv:1806.07552 (2018)."},{"key":"e_1_2_1_149_1","unstructured":"Jennifer Wortman Vaughan and Hanna Wallach. [n.d.]. 1 A Human-Centered Agenda for Intelligible Machine Learning. ( [n. d.])."},{"key":"e_1_2_1_150_1","volume-title":"A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science","author":"Venkatesh Viswanath","year":"2000","unstructured":"Viswanath Venkatesh and Fred D Davis. 2000. A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management science, Vol. 46, 2 (2000), 186--204."},{"key":"e_1_2_1_151_1","volume-title":"User acceptance of information technology: Toward a unified view. MIS quarterly","author":"Venkatesh Viswanath","year":"2003","unstructured":"Viswanath Venkatesh, Michael G Morris, Gordon B Davis, and Fred D Davis. 2003. User acceptance of information technology: Toward a unified view. MIS quarterly (2003), 425--478."},{"key":"e_1_2_1_152_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2215-0366(15)00505-2"},{"key":"e_1_2_1_153_1","volume-title":"A review of sociotechnical systems theory: a classic concept for new command and control paradigms. Theoretical issues in ergonomics science","author":"Walker Guy H","year":"2008","unstructured":"Guy H Walker, Neville A Stanton, Paul M Salmon, and Daniel P Jenkins. 2008. A review of sociotechnical systems theory: a classic concept for new command and control paradigms. Theoretical issues in ergonomics science, Vol. 9, 6 (2008)."},{"key":"e_1_2_1_154_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300831"},{"key":"e_1_2_1_155_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445645"},{"key":"e_1_2_1_156_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11191-015-9784-4"},{"key":"e_1_2_1_157_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359245"},{"key":"e_1_2_1_158_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302317"},{"key":"e_1_2_1_159_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376807"},{"key":"e_1_2_1_160_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377480"},{"key":"e_1_2_1_162_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376301"},{"key":"e_1_2_1_163_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300468"},{"key":"e_1_2_1_164_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858373"},{"key":"e_1_2_1_165_1","volume-title":"Asra F Ali, Elizabeth Arenare, Gregory D Abowd, and Munmun De Choudhury.","author":"Yoo Dong Whi","year":"2020","unstructured":"Dong Whi Yoo, Michael L Birnbaum, Anna R Van Meter, Asra F Ali, Elizabeth Arenare, Gregory D Abowd, and Munmun De Choudhury. 2020. Designing a clinician-facing tool for using insights from patients' social media activity: Iterative co-design approach. JMIR Mental Health (2020)."},{"key":"e_1_2_1_166_1","doi-asserted-by":"publisher","DOI":"10.2196\/25455"},{"key":"e_1_2_1_167_1","volume-title":"Understanding neural networks through deep visualization. arXiv preprint arXiv:1506.06579","author":"Yosinski Jason","year":"2015","unstructured":"Jason Yosinski, Jeff Clune, Anh Nguyen, Thomas Fuchs, and Hod Lipson. 2015. Understanding neural networks through deep visualization. arXiv preprint arXiv:1506.06579 (2015)."},{"key":"e_1_2_1_168_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00642"},{"key":"e_1_2_1_169_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351095.3372852"},{"key":"e_1_2_1_170_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274463"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579467","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579467","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579467","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:24Z","timestamp":1750182684000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579467"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,14]]},"references-count":169,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2023,4,14]]}},"alternative-id":["10.1145\/3579467"],"URL":"https:\/\/doi.org\/10.1145\/3579467","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,14]]},"assertion":[{"value":"2023-04-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}