{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T23:33:16Z","timestamp":1784590396984,"version":"3.55.0"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2020,1,21]],"date-time":"2020-01-21T00:00:00Z","timestamp":1579564800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,1,21]],"date-time":"2020-01-21T00:00:00Z","timestamp":1579564800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002428","name":"Austrian Science Fund","doi-asserted-by":"publisher","award":["P-32554"],"award-info":[{"award-number":["P-32554"]}],"id":[{"id":"10.13039\/501100002428","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["K\u00fcnstl Intell"],"published-print":{"date-parts":[[2020,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Recent success in Artificial Intelligence (AI) and Machine Learning (ML) allow problem solving automatically without any human intervention. Autonomous approaches can be very convenient. However, in certain domains, e.g., in the medical domain, it is necessary to enable a domain expert to understand, <jats:italic>why<\/jats:italic> an algorithm came up with a certain result. Consequently, the field of Explainable AI (xAI) rapidly gained interest worldwide in various domains, particularly in medicine. Explainable AI studies transparency and traceability of opaque AI\/ML and there are already a huge variety of methods. For example with layer-wise relevance propagation relevant parts of inputs to, and representations in, a neural network which caused a result, can be highlighted. This is a first important step to ensure that end users, e.g., medical professionals, assume responsibility for decision making with AI\/ML and of interest to professionals and regulators. Interactive ML adds the component of human expertise to AI\/ML processes by enabling them to re-enact and retrace AI\/ML results, e.g. let them check it for plausibility. This requires new human\u2013AI interfaces for explainable AI. In order to build effective and efficient interactive human\u2013AI interfaces we have to deal with the question of <jats:italic>how to evaluate the quality of explanations<\/jats:italic> given by an explainable AI system. In this paper we introduce our System Causability Scale to measure the quality of explanations. It is based on our notion of Causability (Holzinger et al. in Wiley Interdiscip Rev Data Min Knowl Discov 9(4), 2019) combined with concepts adapted from a widely-accepted usability scale.<\/jats:p>","DOI":"10.1007\/s13218-020-00636-z","type":"journal-article","created":{"date-parts":[[2020,1,21]],"date-time":"2020-01-21T15:03:25Z","timestamp":1579619005000},"page":"193-198","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":325,"title":["Measuring the Quality of Explanations: The System Causability Scale (SCS)"],"prefix":"10.1007","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6786-5194","authenticated-orcid":false,"given":"Andreas","family":"Holzinger","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andr\u00e9","family":"Carrington","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Heimo","family":"M\u00fcller","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,1,21]]},"reference":[{"key":"636_CR1","doi-asserted-by":"crossref","unstructured":"Holzinger A, Langs G, Denk H, Zatloukal K, Mueller H (2019) Causability and explainability of AI in medicine. Wiley Interdiscip Rev Data Min Knowl Discov 9(4)","DOI":"10.1002\/widm.1312"},{"issue":"7553","key":"636_CR2","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436\u2013444","journal-title":"Nature"},{"issue":"6","key":"636_CR3","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","volume":"29","author":"G Hinton","year":"2012","unstructured":"Hinton G, Deng L, Dong Y, Dahl GE, Mohamed A, Jaitly N, Senior A, Vanhoucke V, Nguyen P, Sainath TN, Kingsbury B (2012) Deep neural networks for acoustic modeling in speech recognition: the shared views of four research groups. IEEE Signal Process Mag 29(6):82\u201397","journal-title":"IEEE Signal Process Mag"},{"issue":"7676","key":"636_CR4","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1038\/nature24270","volume":"550","author":"D Silver","year":"2017","unstructured":"Silver D, Schrittwieser J, Simonyan K, Antonoglou I, Huang A, Guez A, Hubert T, Baker L, Lai M, Bolton A, Chen Y, Lillicrap T, Hui F, Sifre L, van den Driessche G, Graepel T, Hassabis D (2017) Mastering the game of go without human knowledge. Nature 550(7676):354\u2013359","journal-title":"Nature"},{"issue":"1","key":"636_CR5","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1023\/A:1008224732364","volume":"8","author":"N Richards","year":"1998","unstructured":"Richards N, Moriarty DE, Miikkulainen R (1998) Evolving neural networks to play go. Appl Intell 8(1):85\u201396","journal-title":"Appl Intell"},{"issue":"7639","key":"636_CR6","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115\u2013118","journal-title":"Nature"},{"key":"636_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.media.2017.06.015","volume":"42","author":"AAA Setio","year":"2017","unstructured":"Setio AAA, Traverso A, De Bel T, Berens MSN, van den Bogaard C, Cerello P, Chen H, Dou Q, Fantacci ME, Geurts B (2017) Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge. Med Image Anal 42:1\u201313","journal-title":"Med Image Anal"},{"issue":"1","key":"636_CR8","doi-asserted-by":"publisher","first-page":"5110","DOI":"10.1038\/s41598-017-05300-5","volume":"7","author":"M Ghafoorian","year":"2017","unstructured":"Ghafoorian M, Karssemeijer N, Heskes T, van Uden IWM, Sanchez CI, Litjens G, de Leeuw F-E, van Ginneken B, Marchiori E, Platel B (2017) Location sensitive deep convolutional neural networks for segmentation of white matter hyperintensities. Sci Rep 7(1):5110","journal-title":"Sci Rep"},{"key":"636_CR9","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","volume":"42","author":"G Litjens","year":"2017","unstructured":"Litjens G, Kooi T, Bejnordi BE, Setio AAA, Ciompi F, Ghafoorian M, van der Laak JAWM, van Ginneken B, Snchez CI (2017) A survey on deep learning in medical image analysis. Med Image Anal 42:60\u201388","journal-title":"Med Image Anal"},{"issue":"9","key":"636_CR10","doi-asserted-by":"publisher","first-page":"1337","DOI":"10.1038\/s41591-019-0548-6","volume":"25","author":"J Wiens","year":"2019","unstructured":"Wiens J, Saria S, Sendak M, Ghassemi M, Liu VX, Doshi-Velez F, Jung K, Heller K, Kale D, Saeed M, Ossorio PN, Thadaney-Israni S, Goldenberg A (2019) Do no harm: a roadmap for responsible machine learning for health care. Nat Med 25(9):1337\u20131340","journal-title":"Nat Med"},{"key":"636_CR11","unstructured":"Carrington AM (2018) Kernel methods and measures for classification with transparency, interpretability and accuracy in health care. PhD thesis, The University of Waterloo"},{"issue":"4","key":"636_CR12","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1515\/jaiscr-2017-0019","volume":"7","author":"G Bologna","year":"2017","unstructured":"Bologna G, Hayashi Y (2017) Characterization of symbolic rules embedded in deep dimlp networks: a challenge to transparency of deep learning. J Artif Intell Soft Comput Res 7(4):265\u2013286","journal-title":"J Artif Intell Soft Comput Res"},{"issue":"2","key":"636_CR13","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1007\/s40708-016-0042-6","volume":"3","author":"A Holzinger","year":"2016","unstructured":"Holzinger A (2016) Interactive machine learning for health informatics: when do we need the human-in-the-loop? Brain Inform 3(2):119\u2013131","journal-title":"Brain Inform"},{"key":"636_CR14","series-title":"Lecture Notes in Artificial Intelligence LNAI","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1007\/978-3-319-50478-0_20","volume-title":"Machine learning for health informatics","author":"AC Valdez","year":"2016","unstructured":"Valdez AC, Ziefle M, Verbert K, Felfernig A, Andreas H (2016) Recommender systems for health informatics: state-of-the-art and future perspectives. In: Andreas H (ed) Machine learning for health informatics, vol 9605. Lecture Notes in Artificial Intelligence LNAI. Springer, Berlin, pp 391\u2013414"},{"key":"636_CR15","doi-asserted-by":"crossref","unstructured":"Teso S, Kersting K (2019) Explanatory interactive machine learning. In: AIES19 Proceedings of the 2019 AAAI\/ACM conference on AI, ethics, and society. AAAI","DOI":"10.1145\/3306618.3314293"},{"issue":"7","key":"636_CR16","doi-asserted-by":"publisher","first-page":"2401","DOI":"10.1007\/s10489-018-1361-5","volume":"49","author":"A Holzinger","year":"2019","unstructured":"Holzinger A, Plass M, Kickmeier-Rust M, Holzinger K, Crian GC, Pintea C-M, Palade V (2019) Interactive machine learning: experimental evidence for the human in the algorithmic loop. Appl Intell 49(7):2401\u20132414","journal-title":"Appl Intell"},{"key":"636_CR17","doi-asserted-by":"crossref","unstructured":"Holzinger A, Kickmeier-Rust M, M\u00fcller H (2019) Kandinsky patterns as IQ-test for machine learning. In International cross-domain conference for machine learning and knowledge extraction, Lecture Notes in Computer Science LNCS 11713. Springer, pp 1\u201314","DOI":"10.1007\/978-3-030-29726-8_1"},{"issue":"1","key":"636_CR18","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1186\/s12911-019-0747-6","volume":"19","author":"AP Hassler","year":"2019","unstructured":"Hassler AP, Menasalvas E, Garcia-Garcia FJ, Rodriguez-Manas L, Holzinger A (2019) Importance of medical data preprocessing in predictive modeling and risk factor discovery for the frailty syndrome. Springer\/Nature BMC Med Inform Decis Making 19(1):33","journal-title":"Springer\/Nature BMC Med Inform Decis Making"},{"key":"636_CR19","doi-asserted-by":"crossref","unstructured":"Holzinger A, Kieseberg P, Weippl E, Tjoa AM (2018) Current advances, trends and challenges of machine learning and knowledge extraction: from machine learning to explainable AI. In: Springer Lecture Notes in Computer Science LNCS 11015. Springer, pp 1\u20138","DOI":"10.1007\/978-3-319-99740-7_1"},{"key":"636_CR20","unstructured":"Doshi-Velez F, Kim B (2017) Towards a rigorous science of interpretable machine learning. arXiv preprint arXiv:1702.08608"},{"key":"636_CR21","doi-asserted-by":"crossref","unstructured":"Chander A, Srinivasan R (2018) Evaluating explanations by cognitive value. In: International cross-domain conference for machine learning and knowledge extraction. Springer, Berlin, pp 314\u2013328","DOI":"10.1007\/978-3-319-99740-7_23"},{"key":"636_CR22","doi-asserted-by":"crossref","unstructured":"Lou Y, Caruana R, Gehrke J (2012) Intelligible models for classification and regression. In: Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, pp 150\u2013158","DOI":"10.1145\/2339530.2339556"},{"key":"636_CR23","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C (2016) Why should i trust you? Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 1135\u20131144","DOI":"10.1145\/2939672.2939778"},{"key":"636_CR24","unstructured":"Narayanan M, Chen E, He J, Kim B, Gershman S, Doshi-Velez F (2018) How do humans understand explanations from machine learning systems? An evaluation of the human-interpretability of explanation. arXiv preprint arXiv:1802.00682"},{"key":"636_CR25","first-page":"189","volume-title":"Usability evaluation in industry","author":"J Brooke","year":"1996","unstructured":"Brooke J (1996) SUS : a quick and dirty usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland IL (eds) Usability evaluation in industry. Taylor and Francis, London, pp 189\u2013194"},{"key":"636_CR26","unstructured":"Gelman A, Carlin JB, Stern HS, Dunson DB, Rubin DB (2013) Fundamentals of Bayesian data analysis: chapter 5 Hierarchical models. CRC Press, ISBN 978-1-58488-388"},{"key":"636_CR27","volume-title":"Statistical image processing and multidimensional modeling","author":"P Fieguth","year":"2010","unstructured":"Fieguth P (2010) Statistical image processing and multidimensional modeling. Springer Science and Business Media, New York"},{"key":"636_CR28","doi-asserted-by":"crossref","unstructured":"Shashanka M, Raj B, Smaragdis P (2008) Probabilistic latent variable models as nonnegative factorizations. Comput Intell Neurosci","DOI":"10.1155\/2008\/947438"},{"issue":"6","key":"636_CR29","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1080\/10447310802205776","volume":"24","author":"A Bangor","year":"2008","unstructured":"Bangor A, Kortum PT, Miller JT (2008) An empirical evaluation of the system usability scale. Int J Hum Comput Interact 24(6):574\u2013594","journal-title":"Int J Hum Comput Interact"},{"key":"636_CR30","doi-asserted-by":"crossref","unstructured":"Holzinger A (2002) User-centered interface design for disabled and elderly people: First experiences with designing a patient communication system (PACOSY). In: Computer helping people with special needs, ICCHP 2002, Lecture Notes in Computer Science (LNCS 2398). Springer, pp 34\u201341","DOI":"10.1007\/3-540-45491-8_8"},{"key":"636_CR31","unstructured":"Lewis JR, Sauro J (2009) The factor structure of the system usability scale. In: International conference on human centered design, pp 94\u2013103"},{"key":"636_CR32","first-page":"1","volume":"140","author":"R Likert","year":"1932","unstructured":"Likert R (1932) A technique for the measurement of attitudes. Arch Psychol 140:1\u201355","journal-title":"Arch Psychol"},{"issue":"9","key":"636_CR33","first-page":"921","volume":"169","author":"J Genest","year":"2003","unstructured":"Genest J, Frohlich J, Fodor G, McPherson R (2003) Recommendations for the management of dyslipidemia and the prevention of cardiovascular disease: summary of the 2003 update. CMAJ 169(9):921\u2013924","journal-title":"CMAJ"},{"issue":"4","key":"636_CR34","doi-asserted-by":"publisher","first-page":"1348","DOI":"10.1016\/S0735-1097(99)00387-3","volume":"34","author":"SM Grundy","year":"1999","unstructured":"Grundy SM, Pasternak R, Greenland P, Smith S, Fuster V (1999) Assessment of cardiovascular risk by use of multiple-risk-factor assessment equations: a statement for healthcare professionals from the american heart association and the american college of cardiology. J Am Coll Cardiol 34(4):1348\u20131359","journal-title":"J Am Coll Cardiol"},{"issue":"12","key":"636_CR35","doi-asserted-by":"publisher","first-page":"1217","DOI":"10.1111\/j.1365-2929.2004.02012.x","volume":"38","author":"S Jamieson","year":"2004","unstructured":"Jamieson S (2004) Likert scales: how to (ab)use them. Med Educ 38(12):1217\u20131218","journal-title":"Med Educ"}],"container-title":["KI - K\u00fcnstliche Intelligenz"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s13218-020-00636-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s13218-020-00636-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s13218-020-00636-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,1,20]],"date-time":"2021-01-20T00:46:14Z","timestamp":1611103574000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s13218-020-00636-z"}},"subtitle":["Comparing Human and Machine Explanations"],"short-title":[],"issued":{"date-parts":[[2020,1,21]]},"references-count":35,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,6]]}},"alternative-id":["636"],"URL":"https:\/\/doi.org\/10.1007\/s13218-020-00636-z","relation":{},"ISSN":["0933-1875","1610-1987"],"issn-type":[{"value":"0933-1875","type":"print"},{"value":"1610-1987","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,21]]},"assertion":[{"value":"3 October 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 January 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 January 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}