{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T09:38:06Z","timestamp":1780565886209,"version":"3.54.1"},"reference-count":131,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,4,13]],"date-time":"2023-04-13T00:00:00Z","timestamp":1681344000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Alan Turing Institute for Data Science and AI","award":["EP\/N510129\/1"],"award-info":[{"award-number":["EP\/N510129\/1"]}]},{"DOI":"10.13039\/501100006041","name":"Innovate UK","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006041","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2023,4,30]]},"abstract":"<jats:p>The need for AI systems to provide explanations for their behaviour is now widely recognised as key to their adoption. In this article, we examine the problem of trustworthy AI and explore what delivering this means in practice, with a focus on healthcare applications. Work in this area typically treats trustworthy AI as a problem of Human\u2013Computer Interaction involving the individual user and an AI system. However, we argue here that this overlooks the important part played by organisational accountability in how people reason about and trust AI in socio-technical settings. To illustrate the importance of organisational accountability, we present findings from ethnographic studies of breast cancer screening and cancer treatment planning in multidisciplinary team meetings to show how participants made themselves accountable both to each other and to the organisations of which they are members. We use these findings to enrich existing understandings of the requirements for trustworthy AI and to outline some candidate solutions to the problems of making AI accountable both to individual users and organisationally. We conclude by outlining the implications of this for future work on the development of trustworthy AI, including ways in which our proposed solutions may be re-used in different application settings.<\/jats:p>","DOI":"10.1145\/3577009","type":"journal-article","created":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T12:27:52Z","timestamp":1671712072000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":59,"title":["Holding AI to Account: Challenges for the Delivery of Trustworthy AI in Healthcare"],"prefix":"10.1145","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8059-5224","authenticated-orcid":false,"given":"Rob","family":"Procter","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Warwick &amp; Alan Turing Institute for Data Science and AI, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2548-2125","authenticated-orcid":false,"given":"Peter","family":"Tolmie","sequence":"additional","affiliation":[{"name":"Information Systems and New Media, University of Siegen, Siegen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4301-8393","authenticated-orcid":false,"given":"Mark","family":"Rouncefield","sequence":"additional","affiliation":[{"name":"Information Systems and New Media, University of Siegen, Siegen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,4,13]]},"reference":[{"key":"e_1_3_2_2_1","first-page":"1","article-title":"Trends and trajectories for explainable, accountable and intelligible systems: An HCI research agenda","author":"Abdul A.","year":"2018","unstructured":"A. Abdul, J. Vermeulen, D. Wang, B. Y. Lim, and M. Kankanhalli. 2018. Trends and trajectories for explainable, accountable and intelligible systems: An HCI research agenda. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1\u201318.","journal-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems"},{"key":"e_1_3_2_3_1","article-title":"Detection of data drift and outliers affecting machine learning model performance over time","author":"Ackerman S.","year":"2020","unstructured":"S. Ackerman, E. Farchi, O. Raz, M. Zalmanovici, and P. Dube. 2020. Detection of data drift and outliers affecting machine learning model performance over time. arXiv:2012.09258. Retrieved from https:\/\/arxiv.org\/abs\/2012.09258.","journal-title":"arXiv:2012.09258"},{"key":"e_1_3_2_4_1","doi-asserted-by":"crossref","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","article-title":"Peeking inside the black-box: A survey on explainable artificial intelligence (XAI)","volume":"6","author":"Adadi A.","year":"2018","unstructured":"A. Adadi and M. Berrada. 2018. Peeking inside the black-box: A survey on explainable artificial intelligence (XAI). IEEE Access 6 (2018), 52138\u201352160.","journal-title":"IEEE Access"},{"issue":"9","key":"e_1_3_2_5_1","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1080\/10447318.2018.1491665","article-title":"Investigating the effect of system reliability, risk, and role on U\u201drs\u2019 emotions and attitudes toward a safety-critical drone system","volume":"35","author":"Albayram Y.","year":"2019","unstructured":"Y. Albayram, T. Jensen, M. M. H. Khan, R. Buck, and E. Coman. 2019. Investigating the effect of system reliability, risk, and role on U\u201drs\u2019 emotions and attitudes toward a safety-critical drone system. International Journal of Human\u2013Computer Interaction 35, 9 (2019), 761\u2013772.","journal-title":"International Journal of Human\u2013Computer Interaction"},{"issue":"1","key":"e_1_3_2_6_1","doi-asserted-by":"crossref","first-page":"S31","DOI":"10.1259\/bjr\/37646417","article-title":"Use of computer-aided detection (CAD) tools in screening mammography: a multidisciplinary investigation","volume":"78","author":"Alberdi E.","year":"2005","unstructured":"E. Alberdi, A. A. Povyakalo, L. Strigini, P. Ayton, M. Hartswood, R. Procter, and R. Slack. 2005. Use of computer-aided detection (CAD) tools in screening mammography: a multidisciplinary investigation. The British Journal of Radiology 78, suppl_1 (2005), S31\u2013S40.","journal-title":"The British Journal of Radiology"},{"key":"e_1_3_2_7_1","unstructured":"ALI (Ada Lovelace Institute) ANI (AI Now Institute) and OGP (Open Government Partnership). 2021. Algorithmic Accountability for Public Sector: Learning from the First Wave of Policy Implementation."},{"issue":"2","key":"e_1_3_2_8_1","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1207\/s15327051hci0902_1","article-title":"Representations and requirements: The value of ethnography in system design","volume":"9","author":"Anderson R.","year":"1994","unstructured":"R. Anderson. 1994. Representations and requirements: The value of ethnography in system design. Human\u2013Computer Interaction 9, 2 (1994), 151\u2013182.","journal-title":"Human\u2013Computer Interaction"},{"key":"e_1_3_2_9_1","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1109\/DEXA.2003.1232106","article-title":"Making autonomic computing systems accountable: the problem of human computer interaction","author":"Anderson S.","year":"2003","unstructured":"S. Anderson, M. Hartswood, R. Procter, M. Rouncefield, R. Slack, J. Soutter, and A. Voss. 2003. Making autonomic computing systems accountable: the problem of human computer interaction. In Proceedings of the 14th International Workshop on Database and Expert Systems Applications, 2003. IEEE, 718\u2013724.","journal-title":"Proceedings of the 14th International Workshop on Database and Expert Systems Applications"},{"key":"e_1_3_2_10_1","volume-title":"How North Sea Oil & Gas Workers Make Sense of Safety","author":"Anderson T.","year":"2017","unstructured":"T. Anderson. 2017. How North Sea Oil & Gas Workers Make Sense of Safety, PhD Thesis, Lancaster University Management School."},{"issue":"11","key":"e_1_3_2_11_1","doi-asserted-by":"crossref","first-page":"5088","DOI":"10.3390\/app11115088","article-title":"Current challenges and future opportunities for XAI in machine learning-based clinical decision support systems: A systematic review","volume":"11","author":"Antoniadi A. M.","year":"2021","unstructured":"A. M. Antoniadi, Y. Du, Y. Guendouz, L. Wei, C. Mazo, B. A. Becker, and C. Mooney. 2021. Current challenges and future opportunities for XAI in machine learning-based clinical decision support systems: A systematic review. Applied Sciences 11, 11 (2021), 5088.","journal-title":"Applied Sciences"},{"key":"e_1_3_2_12_1","article-title":"Conceptualising artificial intelligence as a digital healthcare innovation: An introductory review","author":"Arora A.","year":"2020","unstructured":"A. Arora. 2020. Conceptualising artificial intelligence as a digital healthcare innovation: An introductory review. Medical Devices (Auckland, NZ) 13 (2020), 223--230.","journal-title":"Medical Devices (Auckland, NZ)"},{"issue":"3","key":"e_1_3_2_13_1","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.jsis.2018.03.002","article-title":"When decision support systems fail: Insights for strategic information systems from Formula 1","volume":"27","author":"Aversa P.","year":"2018","unstructured":"P. Aversa, L. Cabantous, and S. Haefliger. 2018. When decision support systems fail: Insights for strategic information systems from Formula 1. The Journal of Strategic Information Systems 27, 3 (2018), 221\u2013236.","journal-title":"The Journal of Strategic Information Systems"},{"key":"e_1_3_2_14_1","first-page":"1","article-title":"A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy","author":"Beede E.","year":"2020","unstructured":"E. Beede, E. Baylor, F. Hersch, A. Iurchenko, L. Wilcox, P. Ruamviboonsuk, and L. M. Vardoulakis. 2020. A human-centered evaluation of a deep learning system deployed in clinics for the detection of diabetic retinopathy. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u201312.","journal-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems"},{"issue":"2","key":"e_1_3_2_15_1","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1207\/S15327051HCI16234_05","article-title":"Intelligibility and accountability: human considerations in context-aware systems","volume":"16","author":"Bellotti V.","year":"2001","unstructured":"V. Bellotti and K. Edwards. 2001. Intelligibility and accountability: human considerations in context-aware systems. Human\u2013Computer Interaction 16, 2-4 (2001), 193\u2013212.","journal-title":"Human\u2013Computer Interaction"},{"key":"e_1_3_2_16_1","article-title":"The concept of organization","author":"Bittner E.","year":"1965","unstructured":"E. Bittner. 1965. The concept of organization. Social Research. 32, 3 (1965), 239--55.","journal-title":"Social Research"},{"issue":"1","key":"e_1_3_2_17_1","doi-asserted-by":"crossref","first-page":"e1000387","DOI":"10.1371\/journal.pmed.1000387","article-title":"The impact of eHealth on the quality and safety of health care: a systematic overview","volume":"8","author":"Black A. D.","year":"2011","unstructured":"A. D. Black, J. Car, C. Pagliari, C. Anandan, K. Cresswell, T. Bokun, \u2026 and A. Sheikh. 2011. The impact of eHealth on the quality and safety of health care: a systematic overview. PLoS Medicine 8, 1 (2011), e1000387.","journal-title":"PLoS Medicine"},{"key":"e_1_3_2_18_1","author":"Bohr A.","year":"2020","unstructured":"A. Bohr and K. Memarzadeh. 2020. The rise of artificial intelligence in healthcare applications. In Artificial Intelligence in healthcare. Academic Press, 25--60.","journal-title":"Artificial Intelligence in healthcare"},{"issue":"4","key":"e_1_3_2_19_1","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/BF01846695","article-title":"The relevance of \u2018work-practice\u2019 for design","volume":"4","author":"Button G.","year":"1995","unstructured":"G. Button and R. Harper. 1995. The relevance of \u2018work-practice\u2019 for design. Computer Supported Cooperative Work (CSCW) 4, 4 (1995), 263\u2013280.","journal-title":"Computer Supported Cooperative Work (CSCW)"},{"key":"e_1_3_2_20_1","first-page":"19","article-title":"Technomethodology: Paradoxes and possibilities","volume":"96","author":"Button G.","year":"1996","unstructured":"G. Button and P. Dourish. 1996. Technomethodology: Paradoxes and possibilities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 96, 19\u201326.","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems"},{"key":"e_1_3_2_21_1","first-page":"1","article-title":"The production of order and the order of production: possibilities for distributed organisations, work and technology in the print industry","author":"Button G.","year":"1997","unstructured":"G. Button and W. Sharrock. 1997. The production of order and the order of production: possibilities for distributed organisations, work and technology in the print industry. In Proceedings of the 5th European Conference on Computer Supported Cooperative Work. Springer, 1\u201316.","journal-title":"Proceedings of the 5th European Conference on Computer Supported Cooperative Work"},{"key":"e_1_3_2_22_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-21954-7","author":"Button G.","year":"2015","unstructured":"G. Button, A. Crabtree, M. Rouncefield, and P. Tolmie. 2015. Deconstructing ethnography. Towards a Social Methodology for Ubiquitous Computing and Interactive Systems Design. Springer.","journal-title":"Deconstructing ethnography. Towards a Social Methodology for Ubiquitous Computing and Interactive Systems Design"},{"key":"e_1_3_2_23_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3359206","article-title":"\u201cHello AI\u201d: Uncovering the onboarding needs of medical practitioners for human-AI collaborative decision-making","volume":"3","author":"Cai C. J.","unstructured":"C. J. Cai, S. Winter, D. Steiner, L. Wilcox, and M. Terry. 2019a. \u201cHello AI\u201d: Uncovering the onboarding needs of medical practitioners for human-AI collaborative decision-making. Proceedings of the ACM on Human\u2013Computer Interaction 3, CSCW, (2019a) 1\u201324.","journal-title":"Proceedings of the ACM on Human\u2013Computer Interaction"},{"key":"e_1_3_2_24_1","first-page":"1","article-title":"Human-centered tools for coping with imperfect algorithms during medical decision-making","author":"Cai C. J.","unstructured":"C. J. Cai, E. Reif, N. Hegde, J. Hipp, B. Kim, D. Smilkov, ... and M. Terry. 2019b. Human-centered tools for coping with imperfect algorithms during medical decision-making. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u201314.","journal-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems"},{"issue":"8","key":"e_1_3_2_25_1","doi-asserted-by":"crossref","first-page":"832","DOI":"10.3390\/electronics8080832","article-title":"Machine learning interpretability: A survey on methods and metrics","volume":"8","author":"Carvalho D. V.","year":"2019","unstructured":"D. V. Carvalho, E. M. Pereira, and J. S. Cardoso. 2019. Machine learning interpretability: A survey on methods and metrics. Electronics 8, 8 (2019), 832.","journal-title":"Electronics"},{"key":"e_1_3_2_26_1","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/978-3-030-69128-8_2","article-title":"Trustworthy ai","author":"Chatila R.","year":"2021","unstructured":"R. Chatila, V. Dignum, M. Fisher, F. Giannotti, K. Morik, S. Russell, and K. Yeung. 2021. Trustworthy ai. In Proceedings of the Reflections on Artificial Intelligence for Humanity. Springer, Cham, 13\u201339.","journal-title":"Proceedings of the Reflections on Artificial Intelligence for Humanity"},{"key":"e_1_3_2_27_1","doi-asserted-by":"crossref","DOI":"10.1007\/1-4020-4258-2","volume-title":"Trust in Technology: A Socio-Technical Perspective","author":"Clarke K.","year":"2006","unstructured":"K. Clarke, G. Hardstone, M. Rouncefield, and I. Sommerville. (Eds.). 2006. Trust in Technology: A Socio-Technical Perspective (Vol. 36). Springer Science & Business Media."},{"issue":"4","key":"e_1_3_2_28_1","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.crad.2017.12.012","article-title":"Role of performance metrics in breast screening imaging\u2013where are we and where should we be?","volume":"73","author":"Cohen S. L.","year":"2018","unstructured":"S. L. Cohen, R. G. Blanks, J. Jenkins, and O. Kearins. 2018. Role of performance metrics in breast screening imaging\u2013where are we and where should we be? Clinical Radiology 73, 4 (2018), 381\u2013388.","journal-title":"Clinical Radiology"},{"issue":"5","key":"e_1_3_2_29_1","doi-asserted-by":"crossref","first-page":"e330","DOI":"10.1016\/S2589-7500(22)00021-8","article-title":"Validation of artificial intelligence prediction models for skin cancer diagnosis using dermoscopy images: The 2019 International Skin Imaging Collaboration Grand Challenge","volume":"4","author":"Combalia M.","year":"2022","unstructured":"M. Combalia, N. Codella, V. Rotemberg, C. Carrera, S. Dusza, D. Gutman, \u2026 and J. Malvehy. 2022. Validation of artificial intelligence prediction models for skin cancer diagnosis using dermoscopy images: The 2019 International Skin Imaging Collaboration Grand Challenge. The Lancet Digital Health 4, 5 (2022), e330\u2013e339.","journal-title":"The Lancet Digital Health"},{"key":"e_1_3_2_30_1","first-page":"3343--3443","article-title":"Impacts of user interface complexity on user acceptance in safety-critical systems","author":"Coskun E.","year":"2004","unstructured":"E. Coskun and M. Grabowski. 2004. Impacts of user interface complexity on user acceptance in safety-critical systems. AMCIS 2004 Proceedings (2004), 3343--3443.","journal-title":"AMCIS 2004 Proceedings"},{"key":"e_1_3_2_31_1","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/BF02127769","article-title":"Contingent and a priori structures in sequential analysis","author":"Coulter J.","year":"1983","unstructured":"J. Coulter. 1983. Contingent and a priori structures in sequential analysis. Human Studies 6 (1983), 361\u2013376.","journal-title":"Human Studies"},{"key":"e_1_3_2_32_1","volume-title":"Mind in Action","author":"Coulter J.","year":"1989","unstructured":"J. Coulter. 1989. Mind in Action. Humanities Press International."},{"key":"e_1_3_2_33_1","first-page":"254","article-title":"Multiple instance learning for heterogeneous images: Training a cnn for histopathology","author":"Couture H. D.","year":"2018","unstructured":"H. D. Couture, J. S. Marron, C. M. Perou, M. A. Troester, and M. Niethammer. 2018. Multiple instance learning for heterogeneous images: Training a cnn for histopathology. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, 254\u2013262.","journal-title":"Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention"},{"issue":"2","key":"e_1_3_2_34_1","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1023\/B:COSU.0000045712.26840.a4","article-title":"Domestic routines and design for the home","volume":"13","author":"Crabtree A.","year":"2004","unstructured":"A. Crabtree and T. Rodden. 2004. Domestic routines and design for the home. Computer Supported Cooperative Work 13, 2 (2004), 191\u2013220.","journal-title":"Computer Supported Cooperative Work"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.21061\/jots.v32i1.a.4"},{"key":"e_1_3_2_36_1","unstructured":"A. Das and P. Rad. 2020. Opportunities and challenges in explainable artificial intelligence (xai): A survey. arXiv:2006.11371. Retrieved from https:\/\/arxiv.org\/abs\/2006.11371."},{"issue":"6","key":"e_1_3_2_37_1","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1093\/jamia\/ocx030","article-title":"Calibration drift in regression and machine learning models for acute kidney injury","volume":"24","author":"Davis S. E.","unstructured":"S. E. Davis, T. A. Lasko, G. Chen, E. D. Siew, and M. E. Matheny. 2017a. Calibration drift in regression and machine learning models for acute kidney injury. Journal of the American Medical Informatics Association 24, 6 (2017a), 1052\u20131061.","journal-title":"Journal of the American Medical Informatics Association"},{"key":"e_1_3_2_38_1","first-page":"625","article-title":"Calibration drift among regression and machine learning models for hospital mortality","author":"Davis S. E.","unstructured":"S. E. Davis, T. A. Lasko, G. Chen, and M. E. Matheny. 2017b. Calibration drift among regression and machine learning models for hospital mortality. In Proceedings of the AMIA Annual Symposium. American Medical Informatics Association 2017, 625.","journal-title":"Proceedings of the AMIA Annual Symposium"},{"issue":"12","key":"e_1_3_2_39_1","doi-asserted-by":"crossref","first-page":"1448","DOI":"10.1093\/jamia\/ocz127","article-title":"A nonparametric updating method to correct clinical prediction model drift","volume":"26","author":"Davis S. E.","year":"2019","unstructured":"S. E. Davis, R. A. Greevy Jr, C. Fonnesbeck, T. A. Lasko, C. G. Walsh, and M. E. Matheny. 2019. A nonparametric updating method to correct clinical prediction model drift. Journal of the American Medical Informatics Association 26, 12 (2019), 1448\u20131457.","journal-title":"Journal of the American Medical Informatics Association"},{"key":"e_1_3_2_40_1","article-title":"Culture and control in a media space","author":"Dourish P.","year":"1993","unstructured":"P. Dourish. 1993. Culture and control in a media space. In Proceedings of the European Conference on Computer-Supported Cooperative Work, ECSCW 93. Amsterdam: Kluwer.","journal-title":"Proceedings of the European Conference on Computer-Supported Cooperative Work, ECSCW 93"},{"key":"e_1_3_2_41_1","doi-asserted-by":"crossref","first-page":"145","DOI":"10.7551\/mitpress\/1966.003.0007","volume-title":"Computers and Design in Con- text","author":"Dourish P.","year":"1997","unstructured":"P. Dourish. 1997. Accounting for system behaviour: Representation, reflection and Resourceful action. In Computers and Design in Con- text. M. Kyng & L. Mathiassen (Eds.). Cambridge, MA: MIT Press, 145\u2013170."},{"key":"e_1_3_2_42_1","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1207\/S15327051HCI16234_07","article-title":"Seeking a foundation for context-aware computing","volume":"16","author":"Dourish P.","unstructured":"P. Dourish. 2001a. Seeking a foundation for context-aware computing. Human\u2013Computer Interaction 16, 2--4 (2001a), 229\u2013241.","journal-title":"Human\u2013Computer Interaction"},{"key":"e_1_3_2_43_1","first-page":"52","article-title":"Process descriptions as organisational accounting devices: The dual use of workflow technologies","author":"Dourish P.","unstructured":"P. Dourish. 2001b. Process descriptions as organisational accounting devices: The dual use of workflow technologies. In Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work. 52\u201360.","journal-title":"Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work"},{"key":"e_1_3_2_44_1","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1145\/1124772.1124855","article-title":"Implications for design","author":"Dourish P.","year":"2006","unstructured":"P. Dourish. 2006. Implications for design. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 541\u2013550.","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems"},{"issue":"1","key":"e_1_3_2_45_1","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1145\/3359786","article-title":"Techniques for interpretable machine learning","volume":"63","author":"Du M.","year":"2019","unstructured":"M. Du, N. Liu, and X. Hu. 2019. Techniques for interpretable machine learning. Communications of the ACM 63, 1 (2019), 68\u201377.","journal-title":"Communications of the ACM"},{"key":"e_1_3_2_46_1","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202200056"},{"key":"e_1_3_2_47_1","first-page":"1","article-title":"Expanding explainability: Towards social transparency in AI systems","author":"Ehsan U.","year":"2021","unstructured":"U. Ehsan, Q. V. Liao, M. Muller, M. O. Riedl, and J. D. Weisz. 2021. Expanding explainability: Towards social transparency in AI systems. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1\u201319.","journal-title":"Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems"},{"key":"e_1_3_2_48_1","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1145\/572020.572041","article-title":"Designing for accountability","author":"Eriks\u00e9n S.","year":"2002","unstructured":"S. Eriks\u00e9n. 2002. Designing for accountability. In Proceedings of the Second Nordic Conference on Human\u2013Computer Interaction. 177\u2013186.","journal-title":"Proceedings of the Second Nordic Conference on Human\u2013Computer Interaction"},{"issue":"1","key":"e_1_3_2_49_1","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1049\/ip-sen:19984895","article-title":"Assessing dependability of safety critical systems using diverse evidence","volume":"145","author":"Fenton N.","year":"1998","unstructured":"N. Fenton, B. Littlewood, M. Neil, L. Strigini, A. Sutcliffe, and D. Wright. 1998. Assessing dependability of safety critical systems using diverse evidence. IEEE Proceedings-Software 145, 1 (1998), 35\u201339.","journal-title":"IEEE Proceedings-Software"},{"issue":"1","key":"e_1_3_2_50_1","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/j.patrec.2008.08.010","article-title":"An experimental comparison of performance measures for classification","volume":"30","author":"Ferri C.","year":"2009","unstructured":"C. Ferri, J. Hern\u00e1ndez-Orallo, and R. Modroiu. 2009. An experimental comparison of performance measures for classification. Pattern Recognition Letters 30, 1 (2009), 27\u201338.","journal-title":"Pattern Recognition Letters"},{"key":"e_1_3_2_51_1","volume-title":"Studies in Ethnomethodology","author":"Garfinkel H.","year":"1967","unstructured":"H. Garfinkel. 1967. Studies in Ethnomethodology, Englewood Cliffs, Prentice-Hall."},{"key":"e_1_3_2_52_1","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1177\/004839318101100202","article-title":"The work of a discovering science construed with materials from the optically discovered pulsar","volume":"11","author":"Garfinkel H.","year":"1981","unstructured":"H. Garfinkel, M. Lynch, and E. Livingston. 1981. The work of a discovering science construed with materials from the optically discovered pulsar, Philosophy of Social Science 11, 2 (1981), 131\u2013158.","journal-title":"Philosophy of Social Science"},{"key":"e_1_3_2_53_1","doi-asserted-by":"crossref","unstructured":"L. H. Gilpin D. Bau B. Z. Yuan A. Bajwa M. Specter and L. Kagal. 2018. Explaining Explanations: An Approach to Evaluating Interpretability of Machine Learning. arXiv:1806.00069. Retrieved from https:\/\/arxiv.org\/abs\/1806.00069.","DOI":"10.1109\/DSAA.2018.00018"},{"issue":"2","key":"e_1_3_2_54_1","doi-asserted-by":"crossref","first-page":"263178772110046","DOI":"10.1177\/26317877211004609","article-title":"The biography of an algorithm: Performing algorithmic technologies in organizations","volume":"2","author":"Glaser V. L.","year":"2021","unstructured":"V. L. Glaser, N. Pollock, and L. D'Adderio. 2021. The biography of an algorithm: Performing algorithmic technologies in organizations. Organization Theory 2, 2 (2021), 26317877211004609.","journal-title":"Organization Theory"},{"issue":"3","key":"e_1_3_2_55_1","doi-asserted-by":"crossref","DOI":"10.1525\/aa.1994.96.3.02a00100","article-title":"Professional vision","volume":"96","author":"Goodwin C.","year":"1994","unstructured":"C. Goodwin. 1994. Professional vision. American Anthropologist 96, 3 (1994), 606.","journal-title":"American Anthropologist"},{"key":"e_1_3_2_56_1","article-title":"Screening of normal endoscopic large bowel biopsies with artificial intelligence: a retrospective study","author":"Graham S.","year":"2022","unstructured":"S. Graham, F. Minhas, M. Bilal, M. Ali, Y. W. Tsang, M. Eastwood, ... and N. Rajpoot. 2022. Screening of normal endoscopic large bowel biopsies with artificial intelligence: a retrospective study. medRxiv.","journal-title":"medRxiv"},{"issue":"11","key":"e_1_3_2_57_1","doi-asserted-by":"crossref","first-page":"e8775","DOI":"10.2196\/jmir.8775","article-title":"Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies","volume":"19","author":"Greenhalgh T.","year":"2017","unstructured":"T. Greenhalgh, J. Wherton, C. Papoutsi, J. Lynch, G. Hughes, S. Hinder, \u2026 and S. Shaw. 2017. Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. Journal of Medical Internet Research, 19, 11 (2017), e8775.","journal-title":"Journal of Medical Internet Research"},{"issue":"2","key":"e_1_3_2_58_1","first-page":"76","article-title":"Artificial intelligence in healthcare and medicine: promises, ethical challenges and governance","volume":"34","author":"Guan J.","year":"2019","unstructured":"J. Guan. 2019. Artificial intelligence in healthcare and medicine: promises, ethical challenges and governance. Chinese Medical Sciences Journal 34, 2 (2019), 76\u201383.","journal-title":"Chinese Medical Sciences Journal"},{"issue":"5","key":"e_1_3_2_59_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3236009","article-title":"A survey of methods for explaining black box models","volume":"51","author":"Guidotti R.","year":"2018","unstructured":"R. Guidotti, A. Monreale, S. Ruggieri, F. Turini, F. Giannotti, and D. Pedreschi. 2018. A survey of methods for explaining black box models. ACM Computing Surveys (CSUR) 51, 5 (2018), 1\u201342.","journal-title":"ACM Computing Surveys (CSUR)"},{"issue":"2","key":"e_1_3_2_60_1","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/s101110200008","article-title":"Performance management in breast screening: A case study of professional vision","volume":"4","author":"Hartswood M.","unstructured":"M. Hartswood, R. Procter, M. Rouncefield, and R. Slack. 2002a. Performance management in breast screening: A case study of professional vision. Cognition, Technology & Work 4, 2 (2002a), 91\u2013100.","journal-title":"Cognition, Technology & Work"},{"issue":"2","key":"e_1_3_2_61_1","first-page":"2","article-title":"Co-realisation: Towards a principled synthesis of ethnomethodology and participatory design","volume":"14","author":"Hartswood M.","unstructured":"M. Hartswood, R. Procter, R. Slack, A. Vob, M. Buscher, M. Rouncefield, and P. Rouchy. 2002b. Co-realisation: Towards a principled synthesis of ethnomethodology and participatory design. Scandinavian Journal of Information Systems 14, 2 (2002b), 2.","journal-title":"Scandinavian Journal of Information Systems"},{"key":"e_1_3_2_62_1","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1007\/978-94-010-0068-0_20","article-title":"\u2018Repairing\u2019 the Machine: A case study of the evaluation of computer-aided detection tools in breast screening","author":"Hartswood M.","year":"2003","unstructured":"M. Hartswood, R. Procter, M. Rouncefield, R. Slack, J. Soutter, and A. Voss. 2003. \u2018Repairing\u2019 the Machine: A case study of the evaluation of computer-aided detection tools in breast screening. In Proceedings of the ECSCW 2003. Springer, Dordrecht, 375\u2013394.","journal-title":"Proceedings of the ECSCW 2003"},{"key":"e_1_3_2_63_1","article-title":"Cultures of reading in mammography","author":"Hartswood M.","year":"2007","unstructured":"M. Hartswood, R. Procter, M. Rouncefield, and R. Slack. 2007. Cultures of reading in mammography. In Orders of Ordinary Action: Respecifying Sociological Knowledge. D. Francis, & S. Hester, (Eds.), Ashgate Publishing.","journal-title":"Orders of Ordinary Action: Respecifying Sociological Knowledge"},{"key":"e_1_3_2_64_1","first-page":"65","article-title":"Collaborative activity and technological design: Task coordination in London Underground control rooms","author":"Heath C.","year":"1991","unstructured":"C. Heath and P. Luff. 1991. Collaborative activity and technological design: Task coordination in London Underground control rooms. In Proceedings of the Second European Conference on Computer-Supported Cooperative Work (ECSCW\u201991). Springer, 65\u201380.","journal-title":"Proceedings of the Second European Conference on Computer-Supported Cooperative Work (ECSCW\u201991)"},{"issue":"01","key":"e_1_3_2_65_1","doi-asserted-by":"crossref","first-page":"01","DOI":"10.1055\/s-0038-1634896","article-title":"Philosophies for the design and development of clinical decision-support systems","volume":"32","author":"Heathfield H. A.","year":"1993","unstructured":"H. A. Heathfield and J. Wyatt. 1993. Philosophies for the design and development of clinical decision-support systems. Methods of Information in Medicine 32, 01 (1993), 01\u201308.","journal-title":"Methods of Information in Medicine"},{"key":"e_1_3_2_66_1","article-title":"Holding artificial intelligence to account","author":"Health T. L. D.","year":"2022","unstructured":"T. L. D. Health. 2022. Holding artificial intelligence to account. The Lancet. Digital Health. 4, (2022), S2589--7500.","journal-title":"The Lancet. Digital Health"},{"key":"e_1_3_2_67_1","author":"Henderson J.","year":"2021","unstructured":"J. Henderson, S. Sharma, A. Gee, V. Alexiev, S. Draper, C. Marin, Y. Hinojosa, C. Draper, M. Perng, L. Aguirre, and M. Li. 2021. Certifai: a toolkit for building trust in AI systems. In Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence. 5249--5251.","journal-title":"Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence"},{"key":"e_1_3_2_68_1","first-page":"83","article-title":"Benchmarking uncertainty estimation methods for deep learning with safety-related metrics","author":"Henne M.","year":"2020","unstructured":"M. Henne, A. Schwaiger, K. Roscher, and G. Weiss. 2020. Benchmarking uncertainty estimation methods for deep learning with safety-related metrics. In Proceedings of the SafeAI@ AAAI. 83\u201390.","journal-title":"Proceedings of the SafeAI@ AAAI"},{"key":"e_1_3_2_69_1","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1145\/3461702.3462564","article-title":"Situated accountability: Ethical principles, certification standards, and explanation methods in applied AI","author":"Henriksen A.","year":"2021","unstructured":"A. Henriksen, S. Enni, and A. Bechmann. 2021. Situated accountability: Ethical principles, certification standards, and explanation methods in applied AI. In Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society. 574\u2013585.","journal-title":"Proceedings of the 2021 AAAI\/ACM Conference on AI, Ethics, and Society"},{"key":"e_1_3_2_70_1","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1145\/192844.193065","article-title":"Moving out from the control room: Ethnography in system design","author":"Hughes J.","year":"1994","unstructured":"J. Hughes, V. King, T. Rodden, and H. Andersen. 1994. Moving out from the control room: Ethnography in system design. In Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work. 429\u2013439.","journal-title":"Proceedings of the 1994 ACM Conference on Computer Supported Cooperative Work"},{"issue":"4","key":"e_1_3_2_71_1","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1007\/s10606-005-9001-0","article-title":"Collaboration and trust in healthcare innovation: The eDiaMoND case study","volume":"14","author":"Jirotka M.","year":"2005","unstructured":"M. Jirotka, R. Procter, M. Hartswood, R. Slack, A. Simpson, C. Coopmans, C. Hinds, and A. Voss. 2005. Collaboration and trust in healthcare innovation: The eDiaMoND case study. Computer Supported Cooperative Work (CSCW) 14, 4 (2005), 369\u2013398.","journal-title":"Computer Supported Cooperative Work (CSCW)"},{"issue":"9","key":"e_1_3_2_72_1","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1016\/S0925-7535(01)00085-6","article-title":"Software tools to support incident reporting in safety-critical systems","volume":"40","author":"Johnson C.","year":"2002","unstructured":"C. Johnson. 2002. Software tools to support incident reporting in safety-critical systems. Safety Science 40, 9 (2002), 765\u2013780.","journal-title":"Safety Science"},{"issue":"2","key":"e_1_3_2_73_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3491209","article-title":"Trustworthy artificial intelligence: A review","volume":"55","author":"Kaur D.","year":"2022","unstructured":"D. Kaur, S. Uslu, K. J. Rittichier, and A. Durresi. 2022. Trustworthy artificial intelligence: A review. ACM Computing Surveys (CSUR) 55, 2 (2022), 1\u201338.","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"e_1_3_2_74_1","article-title":"With an eye to AI and autonomous diagnosis","author":"Keane P. A.","year":"2018","unstructured":"P. A. Keane and E. J. Topol. 2018. With an eye to AI and autonomous diagnosis. NPJ Digit Med 1, 1 (2018), 1--3.","journal-title":"NPJ Digit Med"},{"key":"e_1_3_2_75_1","first-page":"1060","article-title":"Trustworthy by design","author":"Knowles B.","year":"2014","unstructured":"B. Knowles, M. Harding, L. Blair, N. Davies, J. Hannon, M. Rouncefield, and J. Walden. 2014. Trustworthy by design. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing. 1060\u20131071.","journal-title":"Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing"},{"key":"e_1_3_2_76_1","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1145\/2675133.2675154","article-title":"Models and patterns of trust","author":"Knowles B.","year":"2015","unstructured":"B. Knowles, M. Rouncefield, M. Harding, N. Davies, L. Blair, J. Hannon, J. Walden, and D. Wang. 2015. Models and patterns of trust. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. 328\u2013338.","journal-title":"Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing"},{"key":"e_1_3_2_77_1","doi-asserted-by":"crossref","unstructured":"D. Leslie. 2019. Understanding artificial intelligence ethics and safety: A guide for the responsible design and implementation of AI systems in the public sector. The Alan Turing Institute. 10.5281\/zenodo.3240529","DOI":"10.2139\/ssrn.3403301"},{"key":"e_1_3_2_78_1","first-page":"1","article-title":"Questioning the AI: informing design practices for explainable AI user experiences","author":"Liao Q. V.","year":"2020","unstructured":"Q. V. Liao, D. Gruen, and S. Miller. 2020. Questioning the AI: informing design practices for explainable AI user experiences. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1\u201315.","journal-title":"Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems"},{"key":"e_1_3_2_79_1","article-title":"AI model development and validation","author":"Liu H.","year":"2019","unstructured":"H. Liu, H. Estiri, J. Wiens, A. Goldenberg, S. Saria, and N. Shah. 2019. AI model development and validation. In Artificial Intelligence in Healthcare: The Hope, the Hype, the Promise, the Peril, M. S. Matheny, Thadaney Israni, M. Ahmed, and D. Whicher (Eds.). NAM Special Publication, Washington, DC: National Academy of Medicine, 119--144.","journal-title":"Artificial Intelligence in Healthcare: The Hope, the Hype, the Promise, the Peril"},{"key":"e_1_3_2_80_1","article-title":"The medical algorithmic audit","author":"Liu X.","year":"2022","unstructured":"X. Liu, B. Glocker, M. M. McCradden, M. Ghassemi, A. K. Denniston, and L. Oakden-Rayner. 2022. The medical algorithmic audit. The Lancet Digital Health 4, (2022), e384--97.","journal-title":"The Lancet Digital Health"},{"issue":"1","key":"e_1_3_2_81_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3390\/biomedinformatics2010001","article-title":"Explainable artificial intelligence (XAI) in biomedicine: Making AI decisions trustworthy for physicians and patients","volume":"2","author":"L\u00f6tsch J.","year":"2021","unstructured":"J. L\u00f6tsch, D. Kringel, and A. Ultsch. 2021. Explainable artificial intelligence (XAI) in biomedicine: Making AI decisions trustworthy for physicians and patients. BioMedInformatics 2, 1 (2021), 1\u201317.","journal-title":"BioMedInformatics"},{"key":"e_1_3_2_82_1","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511628122","volume-title":"Workplace Studies: Recovering Work Practice and Informing System Design","author":"Luff P.","year":"2000","unstructured":"P. Luff, J. Hindmarsh, and C. Heath. (Eds.). 2000. Workplace Studies: Recovering Work Practice and Informing System Design. Cambridge University Press."},{"key":"e_1_3_2_83_1","volume-title":"Trust and power","author":"Luhmann N.","year":"2018","unstructured":"N. Luhmann. 2018. Trust and power. John Wiley & Sons."},{"key":"e_1_3_2_84_1","doi-asserted-by":"crossref","first-page":"100169","DOI":"10.1016\/j.egyai.2022.100169","article-title":"Explainable Artificial Intelligence (XAI) techniques for energy and power systems: Review, challenges and opportunities","author":"Machlev R.","year":"2022","unstructured":"R. Machlev, L. Heistrene, M. Perl, K. Y. Levy, J. Belikov, S. Mannor, and Y. Levron. 2022. Explainable Artificial Intelligence (XAI) techniques for energy and power systems: Review, challenges and opportunities. Energy and AI. 9 (2022), 100169.","journal-title":"Energy and AI"},{"key":"e_1_3_2_85_1","doi-asserted-by":"crossref","first-page":"103655","DOI":"10.1016\/j.jbi.2020.103655","article-title":"The role of explainability in creating trustworthy artificial intelligence for health care: A comprehensive survey of the terminology, design choices, and evaluation strategies","volume":"113","author":"Markus A. F.","year":"2021","unstructured":"A. F. Markus, J. A. Kors, and P. R. Rijnbeek. 2021. The role of explainability in creating trustworthy artificial intelligence for health care: A comprehensive survey of the terminology, design choices, and evaluation strategies. Journal of Biomedical Informatics 113 (2021), 103655.","journal-title":"Journal of Biomedical Informatics"},{"key":"e_1_3_2_86_1","volume-title":"Configuring User-Designer Relations","author":"Martin D.","year":"2009","unstructured":"D. Martin, J. Mariani, and M. Rouncefield. 2009. Practicalities of participation: Stakeholder involvement in an electronic patient records project. In Configuring User-Designer Relations, A. Voss, M. Hartswood, R. Procter, R. Slack, M. Rouncefield, and M. B\u00fcscher, (Eds.). Springer, 133--155."},{"issue":"1","key":"e_1_3_2_87_1","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1145\/972648.972651","article-title":"Patterns of cooperative interaction: Linking ethnomethodology and design","volume":"11","author":"Martin D.","year":"2004","unstructured":"D. Martin and I. Sommerville. 2004. Patterns of cooperative interaction: Linking ethnomethodology and design. ACM Transactions on Computer-Human Interaction (TOCHI) 11, 1 (2004), 59\u201389.","journal-title":"ACM Transactions on Computer-Human Interaction (TOCHI)"},{"key":"e_1_3_2_88_1","first-page":"147","article-title":"Patterns for dependable design","author":"Martin D.","year":"2006","unstructured":"D. Martin, M. Rouncefield, and I. Sommerville. 2006. Patterns for dependable design. In Proceedings of the Trust in Technology: A Socio-Technical Perspective. Springer, Dordrecht, 147\u2013168.","journal-title":"Proceedings of the Trust in Technology: A Socio-Technical Perspective"},{"issue":"7788","key":"e_1_3_2_89_1","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1038\/s41586-019-1799-6","article-title":"International evaluation of an AI system for breast cancer screening","volume":"577","author":"McKinney S. M.","year":"2020","unstructured":"S. M. McKinney, M. Sieniek, V. Godbole, J. Godwin, N. Antropova, H. Ashrafian, T. Back, M. Chesus, G. S. Corrado, A. Darzi, and M. Etemadi. 2020. International evaluation of an AI system for breast cancer screening. Nature 577, 7788 (2020), 89\u201394.","journal-title":"Nature"},{"issue":"3","key":"e_1_3_2_90_1","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1515\/icom-2016-0037","article-title":"Introduction to this Special Issue on \u201cHuman-Machine Interaction and Cooperation in Safety-Critical Systems\u201d","volume":"15","author":"Mentler T.","year":"2016","unstructured":"T. Mentler, C. Reuter, and S. Geisler. 2016. Introduction to this Special Issue on \u201cHuman-Machine Interaction and Cooperation in Safety-Critical Systems\u201d. I-com 15, 3 (2016), 219\u2013226.","journal-title":"I-com"},{"key":"e_1_3_2_91_1","first-page":"32","article-title":"Workshop on explainable AI in automated driving: A user-centered interaction approach","author":"Meteier Q.","year":"2019","unstructured":"Q. Meteier, M. Capallera, L. Angelini, E. Mugellini, O. A. Khaled, S. Carrino, E. De Salis, S. Galland, and S. Boll. 2019. Workshop on explainable AI in automated driving: A user-centered interaction approach. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. 32\u201337.","journal-title":"Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings"},{"key":"e_1_3_2_92_1","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1145\/3287560.3287574","article-title":"Explaining explanations in AI","author":"Mittelstadt B.","year":"2019","unstructured":"B. Mittelstadt, C. Russell, and S. Wachter. 2019. Explaining explanations in AI. In Proceedings of the Conference on Fairness, Accountability, and Transparency. 279\u2013288.","journal-title":"Proceedings of the Conference on Fairness, Accountability, and Transparency"},{"key":"e_1_3_2_93_1","first-page":"1","article-title":"Human-centered study of data science work practices","author":"Muller M.","year":"2019","unstructured":"M. Muller, M. Feinberg, T. George, S. J. Jackson, B. E. John, M. B. Kery, and S. Passi. 2019. Human-centered study of data science work practices. In Proceedings of the Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u20138.","journal-title":"Proceedings of the Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems"},{"key":"e_1_3_2_94_1","first-page":"795","article-title":"Clinical decision-support systems","author":"Musen M. A.","year":"2014","unstructured":"M. A. Musen, B. Middleton, and R. A. Greenes. 2014. Clinical decision-support systems. In Proceedings of the Biomedical Informatics. Springer, Cham, 795\u2013840.","journal-title":"Proceedings of the Biomedical Informatics"},{"key":"e_1_3_2_95_1","article-title":"Understanding healthcare workers confidence in AI","author":"Nix M.","year":"2022","unstructured":"M. Nix, G. Onisiforou, and S. Painter. 2022. Understanding healthcare workers confidence in AI. NHS AI Lab & Health Education England. Retrieved from https:\/\/digital-transformation.hee.nhs.uk\/binaries\/content\/assets\/digital-transformation\/dart-ed\/understandingconfidenceinai-may22.pdf.","journal-title":"NHS AI Lab & Health Education England"},{"issue":"5","key":"e_1_3_2_96_1","doi-asserted-by":"crossref","first-page":"e351","DOI":"10.1016\/S2589-7500(22)00004-8","article-title":"Validation and algorithmic audit of a deep learning system for the detection of proximal femoral fractures in patients in the emergency department: A diagnostic accuracy study","volume":"4","author":"Oakden-Rayner L.","year":"2022","unstructured":"L. Oakden-Rayner, W. Gale, T. A. Bonham, M. P. Lungren, G. Carneiro, A. P. Bradley, and L. J. Palmer. 2022. Validation and algorithmic audit of a deep learning system for the detection of proximal femoral fractures in patients in the emergency department: A diagnostic accuracy study. The Lancet Digital Health 4, 5 (2022), e351\u2013e358.","journal-title":"The Lancet Digital Health"},{"key":"e_1_3_2_97_1","article-title":"Open the black box data-driven explanation of black box decision systems","author":"Pedreschi D.","year":"2018","unstructured":"D. Pedreschi, F. Giannotti, R. Guidotti, A. Monreale, L. Pappalardo, S. Ruggieri, and F. Turini. 2018. Open the black box data-driven explanation of black box decision systems. arXiv:1806.09936. Retrieved from https:\/\/arxiv.org\/abs\/1806.09936.","journal-title":"arXiv:1806.09936"},{"key":"e_1_3_2_98_1","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1007\/978-3-030-50402-1_4","article-title":"Survey of XAI in digital pathology","author":"Pocevi\u010di\u016bt\u0117 M.","year":"2020","unstructured":"M. Pocevi\u010di\u016bt\u0117, G. Eilertsen, and C. Lundstr\u00f6m. 2020. Survey of XAI in digital pathology. In Proceedings of the Artificial Intelligence and Machine Learning for Digital Pathology. Springer, Cham, 56\u201388.","journal-title":"Proceedings of the Artificial Intelligence and Machine Learning for Digital Pathology"},{"issue":"5","key":"e_1_3_2_99_1","first-page":"413","article-title":"CSCW and dependable healthcare systems","volume":"15","author":"Procter R.","year":"2006","unstructured":"R. Procter, M. Rouncefield, E. Balka, and M. Berg. 2006. CSCW and dependable healthcare systems. Computer Supported Cooperative Work (CSCW) 15, 5-6 (2006), 413\u2013418.","journal-title":"Computer Supported Cooperative Work (CSCW)"},{"key":"e_1_3_2_100_1","volume-title":"Exploring Human-Centered AI in Healthcare: A Workshop Report","author":"Procter R.","year":"2022","unstructured":"R. Procter, P. Tolmie, and M. Rouncefield. 2022. Trust, Professional vision and diagnostic work. In Exploring Human-Centered AI in Healthcare: A Workshop Report. N. Ontika, S. M. Sasmannshausen, H. A. Syed, and A. F. P. de Carvalho, (Eds.), International Reports on Socio-Informatics 19, 2 (2022)."},{"key":"e_1_3_2_101_1","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1145\/3351095.3372873","article-title":"Closing the AI accountability gap: Defining an end-to-end framework for internal algorithmic auditing","author":"Raji I. D.","year":"2020","unstructured":"I. D. Raji, A. Smart, R. N. White, M. Mitchell, T. Gebru, B. Hutchinson, \u2026 and P. Barnes. 2020. Closing the AI accountability gap: Defining an end-to-end framework for internal algorithmic auditing. In Proceedings of the 2020 conference on Fairness, Accountability, and Transparency. 33\u201344.","journal-title":"Proceedings of the 2020 conference on Fairness, Accountability, and Transparency"},{"issue":"7","key":"e_1_3_2_102_1","doi-asserted-by":"crossref","first-page":"1688","DOI":"10.1038\/bjc.2014.120","article-title":"Nottingham Prognostic Index Plus (NPI+): A modern clinical decision making tool in breast cancer","volume":"110","author":"Rakha E. A.","year":"2014","unstructured":"E. A. Rakha, D. Soria, A. R. Green, C. Lemetre, D. G. Powe, C. C. Nolan, ... and I. O. Ellis. 2014. Nottingham Prognostic Index Plus (NPI+): A modern clinical decision making tool in breast cancer. British Journal of Cancer 110, 7 (2014), 1688\u20131697.","journal-title":"British Journal of Cancer"},{"issue":"1","key":"e_1_3_2_103_1","first-page":"81","article-title":"Fieldwork and Ethnography: A perspective from CSCW","volume":"2005","author":"Randall D.","year":"2005","unstructured":"D. Randall, R. Harper, M. Rouncefield. 2005. Fieldwork and Ethnography: A perspective from CSCW. In Proceedings of the EPIC 2005: Ethnographic Praxis in Industry. Oxford Blackwell Publishing Ltd. 2005, 1, 81\u201399.","journal-title":"Proceedings of the EPIC 2005: Ethnographic Praxis in Industry"},{"key":"e_1_3_2_104_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-84628-768-8","volume-title":"Fieldwork for Design: Theory and Practice","author":"Randall D.","year":"2007","unstructured":"D. Randall, R. Harper, and M. Rouncefield. 2007. Fieldwork for Design: Theory and Practice. Springer Science & Business Media."},{"key":"e_1_3_2_105_1","first-page":"221","volume-title":"Socio-Informatics: A practice-based Perspective on the Design and use of IT Artifacts","author":"Randall D.","year":"2018","unstructured":"D. Randall. 2018. Investigation and design. Socio-Informatics: A practice-based Perspective on the Design and use of IT Artifacts (1st ed). Oxford University Press, Oxford, 221\u2013241.","edition":"1"},{"issue":"1","key":"e_1_3_2_106_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-021-00509-1","article-title":"Patient apprehensions about the use of artificial intelligence in healthcare","volume":"4","author":"Richardson J. P.","year":"2021","unstructured":"J. P. Richardson, C. Smith, S. Curtis, S. Watson, X. Zhu, B. Barry, and R. Sharp. 2021. Patient apprehensions about the use of artificial intelligence in healthcare. NPJ Digital Medicine 4, 1 (2021), 1\u20136.","journal-title":"NPJ Digital Medicine"},{"issue":"3","key":"e_1_3_2_107_1","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.ijhcs.2005.01.001","article-title":"The mechanics of trust: A framework for research and design","volume":"62","author":"Riegelsberger J.","year":"2005","unstructured":"J. Riegelsberger, M. A. Sasse, and J. D. McCarthy. 2005. The mechanics of trust: A framework for research and design. International Journal of Human-Computer Studies 62, 3 (2005), 381\u2013422.","journal-title":"International Journal of Human-Computer Studies"},{"key":"e_1_3_2_108_1","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/B978-0-12-623550-0.50008-2","volume-title":"Studies in the Organization of Conversational Interaction","author":"Sacks H.","year":"1978","unstructured":"H. Sacks, E. Schegloff, and G. Jefferson. 1978. A simplest systematics for the organization of turn taking for conversation. Studies in the Organization of Conversational Interaction. Academic Press, 7\u201355."},{"key":"e_1_3_2_109_1","volume-title":"Lectures on Conversation, Volumes I & II","author":"Sacks H.","year":"1992","unstructured":"H. Sacks. 1992. Lectures on Conversation, Volumes I & II, (edited by G. Jefferson), Malden, MA: Blackwell."},{"key":"e_1_3_2_110_1","doi-asserted-by":"crossref","DOI":"10.1080\/10447318.2022.2081282","article-title":"The situation awareness framework for explainable AI (SAFE-AI) and human factors considerations for XAI systems","author":"Sanneman L.","year":"2022","unstructured":"L. Sanneman and J. A. Shah. 2022. The situation awareness framework for explainable AI (SAFE-AI) and human factors considerations for XAI systems. International Journal of Human\u2013Computer Interaction. 38, 18--20 (2022), 1772--1788.","journal-title":"International Journal of Human\u2013Computer Interaction"},{"issue":"19","key":"e_1_3_2_111_1","doi-asserted-by":"crossref","first-page":"9545","DOI":"10.3390\/app12199545","article-title":"Robustness, stability, and fidelity of explanations for a deep skin cancer classification model","volume":"12","author":"Saarela M.","year":"2022","unstructured":"M. Saarela and L. Geogieva. 2022. Robustness, stability, and fidelity of explanations for a deep skin cancer classification model. Applied Sciences 12, 19 (2022), 9545.","journal-title":"Applied Sciences"},{"key":"e_1_3_2_112_1","volume-title":"The Myth of the Paperless Office","author":"Sellen A.","year":"2003","unstructured":"A. Sellen and R. Harper. 2003. The Myth of the Paperless Office. MIT press."},{"issue":"4","key":"e_1_3_2_113_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3419764","article-title":"Bridging the gap between ethics and practice: guidelines for reliable, safe, and trustworthy human-centered AI systems","volume":"10","author":"Shneiderman B.","year":"2020","unstructured":"B. Shneiderman. 2020. Bridging the gap between ethics and practice: guidelines for reliable, safe, and trustworthy human-centered AI systems. ACM Transactions on Interactive Intelligent Systems (TiiS) 10, 4 (2020), 1\u201331.","journal-title":"ACM Transactions on Interactive Intelligent Systems (TiiS)"},{"issue":"6","key":"e_1_3_2_114_1","doi-asserted-by":"crossref","first-page":"52","DOI":"10.3390\/jimaging6060052","article-title":"Explainable deep learning models in medical image analysis","volume":"6","author":"Singh A.","year":"2020","unstructured":"A. Singh, S. Sengupta, and V. Lakshminarayanan. 2020. Explainable deep learning models in medical image analysis. Journal of Imaging 6, 6 (2020), 52.","journal-title":"Journal of Imaging"},{"key":"e_1_3_2_115_1","volume-title":"Ethnographies of Diagnostic Work","author":"Slack R. S.","year":"2010","unstructured":"R. S. Slack, R. Procter, M. Hartswood, A. Voss, and M. Rouncefield. 2010. Suspicious minds? In Ethnographies of Diagnostic Work. M. Buscher, D. Goodwin, and J. Mesman. (Eds.), Palgrave Press."},{"issue":"2","key":"e_1_3_2_116_1","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1007\/s00146-020-01019-6","article-title":"Clinical AI: opacity, accountability, responsibility and liability","volume":"36","author":"Smith H.","year":"2021","unstructured":"H. Smith. 2021. Clinical AI: opacity, accountability, responsibility and liability. AI & SOCIETY 36, 2 (2021), 535\u2013545.","journal-title":"AI & SOCIETY"},{"issue":"3","key":"e_1_3_2_117_1","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.compbiomed.2010.01.003","article-title":"A methodology to identify consensus classes from clustering algorithms applied to immunohistochemical data from breast cancer patients","volume":"40","author":"Soria D.","year":"2010","unstructured":"D. Soria, J. M. Garibaldi, F. Ambrogi, A. R. Green, D. Powe, E. Rakha, ... and I. O. Ellis. 2010. A methodology to identify consensus classes from clustering algorithms applied to immunohistochemical data from breast cancer patients. Computers in Biology and Medicine 40, 3 (2010), 318\u2013330.","journal-title":"Computers in Biology and Medicine"},{"key":"e_1_3_2_118_1","volume-title":"Plans and Situated Actions: The Problem of Human\u2013Machine Communication","author":"Suchman Lucy A.","year":"1987","unstructured":"Lucy A. Suchman. 1987. Plans and Situated Actions: The Problem of Human\u2013Machine Communication. Cambridge University Press."},{"issue":"2","key":"e_1_3_2_119_1","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1080\/00071310220133287","article-title":"Working artefacts: Ethnomethods of the prototype","volume":"53","author":"Suchman L.","year":"2002","unstructured":"L. Suchman, R. Trigg, and J. Blomberg. 2002. Working artefacts: Ethnomethods of the prototype. The British Journal of Sociology 53, 2 (2022), 163\u2013179.","journal-title":"The British Journal of Sociology"},{"key":"e_1_3_2_120_1","author":"Taylor P.","year":"2005","unstructured":"P. Taylor, J. Champness, R. Given-Wilson, K. Johnston, and H. Potts. 2005. Impact of computer-aided detection prompts on the sensitivity and specificity of screening mammography. Health Technol Assess 9, 6 (2005), iii--58.","journal-title":"Health Technol Assess"},{"key":"e_1_3_2_121_1","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1145\/503376.503448","article-title":"Unremarkable computing","author":"Tolmie P.","year":"2002","unstructured":"P. Tolmie, J. Pycock, T. Diggins, A. MacLean, and A. Karsenty. 2002. Unremarkable computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 399\u2013406.","journal-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems"},{"key":"e_1_3_2_122_1","first-page":"63","article-title":"Organizational acumen","author":"Tolmie P.","year":"2016","unstructured":"P. Tolmie and M. Rouncefield. 2016. Organizational acumen. In Proceedings of the Ethnomethodology at Work. Routledge, 63\u201382.","journal-title":"Proceedings of the Ethnomethodology at Work"},{"key":"e_1_3_2_123_1","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.ijhcs.2019.09.004","article-title":"Understanding human-data interaction: Literature review and recommendations for design","volume":"134","author":"Victorelli E. Z.","year":"2020","unstructured":"E. Z. Victorelli, J. C. Dos Reis, H. Hornung, and A. B. Prado. 2020. Understanding human-data interaction: Literature review and recommendations for design. International Journal of Human\u2013Computer Studies 134 (2020), 13\u201332.","journal-title":"International Journal of Human\u2013Computer Studies"},{"key":"e_1_3_2_124_1","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/978-1-84628-925-5_3","article-title":"Design as and for collaboration: Making sense of and supporting practical action","author":"Voss A.","year":"2009","unstructured":"A. Voss, R. Procter, R. Slack, M. Hartswood, and M. Rouncefield. 2009. Design as and for collaboration: Making sense of and supporting practical action. In Proceedings of the Configuring User-Designer Relations. Springer, 31\u201358.","journal-title":"Proceedings of the Configuring User-Designer Relations"},{"key":"e_1_3_2_125_1","first-page":"1","article-title":"Designing theory-driven user-centric explainable AI","author":"Wang D.","year":"2019","unstructured":"D. Wang, Q. Yang, A. Abdul, and B. Y. Lim. 2019. Designing theory-driven user-centric explainable AI. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u201315.","journal-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems"},{"issue":"4","key":"e_1_3_2_126_1","doi-asserted-by":"crossref","first-page":"475","DOI":"10.1177\/1468795X09344453","article-title":"Constitutive practices and Garfinkel's notion of trust: Revisited","volume":"9","author":"Watson R.","year":"2009","unstructured":"R. Watson. 2009. Constitutive practices and Garfinkel's notion of trust: Revisited. Journal of Classical Sociology 9, 4 (2009), 475\u2013499.","journal-title":"Journal of Classical Sociology"},{"key":"e_1_3_2_127_1","volume-title":"Social Learning in Technological Innovation: Experimenting with Information and Communication Technologies","author":"Williams R.","year":"2005","unstructured":"R. Williams, J. Stewart, and R. Slack. 2005. Social Learning in Technological Innovation: Experimenting with Information and Communication Technologies. Edward Elgar Publishing."},{"key":"e_1_3_2_128_1","first-page":"1942","article-title":"Counterfactual supporting facts extraction for explainable medical record based diagnosis with graph network","author":"Wu H.","year":"2021","unstructured":"H. Wu, W. Chen, S. Xu, and B. Xu. 2021. Counterfactual supporting facts extraction for explainable medical record based diagnosis with graph network. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 1942\u20131955.","journal-title":"Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies"},{"key":"e_1_3_2_129_1","first-page":"1","article-title":"Unremarkable ai: Fitting intelligent decision support into critical, clinical decision-making processes","author":"Yang Q.","year":"2019","unstructured":"Q. Yang, A. Steinfeld, and J. Zimmerman. 2019. Unremarkable ai: Fitting intelligent decision support into critical, clinical decision-making processes. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1\u201311.","journal-title":"Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems"},{"key":"e_1_3_2_130_1","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.inffus.2021.07.016","article-title":"Unbox the black-box for the medical explainable ai via multi-modal and multi-centre data fusion: A mini-review, two showcases and beyond","volume":"77","author":"Yang G.","year":"2022","unstructured":"G. Yang, Q. Ye, and J. Xia. 2022. Unbox the black-box for the medical explainable ai via multi-modal and multi-centre data fusion: A mini-review, two showcases and beyond. Information Fusion 77 (2022), 29\u201352.","journal-title":"Information Fusion"},{"issue":"2","key":"e_1_3_2_131_1","doi-asserted-by":"crossref","first-page":"237","DOI":"10.3390\/diagnostics12020237","article-title":"Applications of explainable artificial intelligence in diagnosis and surgery","volume":"12","author":"Zhang Y.","year":"2022","unstructured":"Y. Zhang, Y. Weng, and J. Lund. 2022. Applications of explainable artificial intelligence in diagnosis and surgery. Diagnostics 12, 2 (2022), 237.","journal-title":"Diagnostics"},{"key":"e_1_3_2_132_1","volume-title":"Understanding Everyday Life: Toward the Reconstruction of Sociological Knowledge","author":"Zimmerman D.","year":"1971","unstructured":"D. Zimmerman. 1971. The Practicalities of Rule Use. In Understanding Everyday Life: Toward the Reconstruction of Sociological Knowledge. J. D. Douglas (Ed.), Routledge and Kegan Paul."}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3577009","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3577009","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:24Z","timestamp":1750178184000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3577009"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,13]]},"references-count":131,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4,30]]}},"alternative-id":["10.1145\/3577009"],"URL":"https:\/\/doi.org\/10.1145\/3577009","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,13]]},"assertion":[{"value":"2021-11-12","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-11-08","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-04-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}