{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T20:13:00Z","timestamp":1780517580630,"version":"3.54.1"},"reference-count":128,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,12,1]],"date-time":"2022-12-01T00:00:00Z","timestamp":1669852800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,12,12]],"date-time":"2022-12-12T00:00:00Z","timestamp":1670803200000},"content-version":"vor","delay-in-days":11,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100020639","name":"Bayerische Staatsministerium f\u00fcr Wirtschaft, Landesentwicklung und Energie","doi-asserted-by":"publisher","award":["DIK0143\/02"],"award-info":[{"award-number":["DIK0143\/02"]}],"id":[{"id":"10.13039\/501100020639","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100008769","name":"Julius-Maximilians-Universit\u00e4t W\u00fcrzburg","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100008769","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Electron Markets"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Due to computational advances in the past decades, so-called intelligent systems can learn from increasingly complex data, analyze situations, and support users in their decision-making to address them. However, in practice, the complexity of these intelligent systems renders the user hardly able to comprehend the inherent decision logic of the underlying machine learning model. As a result, the adoption of this technology, especially for high-stake scenarios, is hampered. In this context, explainable artificial intelligence offers numerous starting points for making the inherent logic explainable to people. While research manifests the necessity for incorporating explainable artificial intelligence into intelligent systems, there is still a lack of knowledge about how to socio-technically design these systems to address acceptance barriers among different user groups. In response, we have derived and evaluated a nascent design theory for explainable intelligent systems based on a structured literature review, two qualitative expert studies, a real-world use case application, and quantitative research. Our design theory includes design requirements, design principles, and design features covering the topics of global explainability, local explainability, personalized interface design, as well as psychological\/emotional factors.<\/jats:p>","DOI":"10.1007\/s12525-022-00606-3","type":"journal-article","created":{"date-parts":[[2022,12,12]],"date-time":"2022-12-12T09:03:21Z","timestamp":1670835801000},"page":"2185-2205","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["A nascent design theory for explainable intelligent systems"],"prefix":"10.1007","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0101-5429","authenticated-orcid":false,"given":"Lukas-Valentin","family":"Herm","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Theresa","family":"Steinbach","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0118-7757","authenticated-orcid":false,"given":"Jonas","family":"Wanner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8050-123X","authenticated-orcid":false,"given":"Christian","family":"Janiesch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,12,12]]},"reference":[{"key":"606_CR1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174156","volume-title":"CHI Conference on Human Factors in Computing Systems","author":"A Abdul","year":"2018","unstructured":"Abdul, A., Vermeulen, J., Wang, D., Lim, B. Y., & Kankanhalli, M. (2018). Trends and trajectories for explainable, accountable and intelligible systems: An HCI research agenda. CHI Conference on Human Factors in Computing Systems,\u00a0582, pp. 1\u201318. https:\/\/doi.org\/10.1145\/3173574.3174156"},{"key":"606_CR2","doi-asserted-by":"publisher","unstructured":"Abedin, B., Meske, C., Junglas, I., Rabhi, F., & Motahari-Nezhad, H. R. (2022). Designing and managing human-AI interactions. Information Systems Frontiers, 1-7. https:\/\/doi.org\/10.1007\/s10796-022-10313-1","DOI":"10.1007\/s10796-022-10313-1"},{"key":"606_CR3","doi-asserted-by":"publisher","first-page":"52138","DOI":"10.1109\/ACCESS.2018.2870052","volume":"6","author":"A Adadi","year":"2018","unstructured":"Adadi, A., & Berrada, M. (2018). Peeking inside the black-box: A survey on explainable artificial intelligence (XAI). IEEE access, 6, 52138\u201352160. https:\/\/doi.org\/10.1109\/ACCESS.2018.2870052","journal-title":"IEEE access"},{"key":"606_CR4","doi-asserted-by":"publisher","unstructured":"Amershi, S., Weld, D., Vorvoreanu, M., Fourney, A., Nushi, B., Collisson, P., Suh, J., Iqbal, S., Bennett, P. N., Inkpen, K., Teevan, J., Kikin-Gil, R., & Horvitz, E. (2019). Guidelines for human-AI interaction. Proceedings of the 2019 CHI conference on human factors in computing systems (pp. 1\u201313). https:\/\/doi.org\/10.1145\/3290605.3300233","DOI":"10.1145\/3290605.3300233"},{"key":"606_CR5","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.inffus.2019.12.012","volume":"58","author":"AB Arrieta","year":"2020","unstructured":"Arrieta, A. B., D\u00edaz-Rodr\u00edguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garc\u00eda, S., Gil-L\u00f3pez, S., Molina, D., & Benjamins, R. (2020). Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI. Information Fusion, 58, 82\u2013115. https:\/\/doi.org\/10.1016\/j.inffus.2019.12.012","journal-title":"Information Fusion"},{"key":"606_CR6","doi-asserted-by":"publisher","first-page":"103387","DOI":"10.1016\/j.artint.2020.103387","volume":"289","author":"K Atkinson","year":"2020","unstructured":"Atkinson, K., Bench-Capon, T., & Bollegala, D. (2020). Explanation in AI and law: Past, present and future. Artificial intelligence, 289, 103387. https:\/\/doi.org\/10.1016\/j.artint.2020.103387","journal-title":"Artificial intelligence"},{"issue":"1","key":"606_CR7","first-page":"53","volume":"20","author":"RL Baskerville","year":"2019","unstructured":"Baskerville, R. L., & Pries-Heje, J. (2019). Projectability in design science research. Journal of Information Technology Theory And Application, 20(1), 53\u201376.\u00a0https:\/\/aisel.aisnet.org\/jitta\/vol20\/iss1\/3","journal-title":"Journal of Information Technology Theory And Application"},{"issue":"3","key":"606_CR8","doi-asserted-by":"publisher","first-page":"1433","DOI":"10.25300\/MISQ\/2021\/16274","volume":"45","author":"N Berente","year":"2021","unstructured":"Berente, N., Gu, B., Recker, J., & Santhanam, R. (2021). Managing artificial intelligence. MIS Quarterly, 45(3), 1433\u20131450. https:\/\/doi.org\/10.25300\/MISQ\/2021\/16274","journal-title":"MIS Quarterly"},{"issue":"1","key":"606_CR9","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s12599-020-00678-5","volume":"63","author":"B Berger","year":"2021","unstructured":"Berger, B., Adam, M., R\u00fchr, A., & Benlian, A. (2021). Watch me improve\u2014Algorithm aversion and demonstrating the ability to learn. Business & Information Systems Engineering, 63(1), 55\u201368. https:\/\/doi.org\/10.1007\/s12599-020-00678-5","journal-title":"Business & Information Systems Engineering"},{"key":"606_CR10","doi-asserted-by":"publisher","unstructured":"Bhatt, U., Andrus, M., Weller, A., & Xiang, A. (2020). Machine learning explainability for external stakeholders. ArXiv Preprint. https:\/\/doi.org\/10.48550\/arXiv.2007.05408","DOI":"10.48550\/arXiv.2007.05408"},{"key":"606_CR11","doi-asserted-by":"crossref","unstructured":"Boone, H. N., & Boone, D. A. (2012). Analyzing Likert data. Journal of Extension, 50(2), 1\u20135. https:\/\/tigerprints.clemson.edu\/joe\/vol50\/iss2\/48","DOI":"10.34068\/joe.50.02.48"},{"key":"606_CR12","doi-asserted-by":"publisher","unstructured":"Bove, C., Aigrain, J., Lesot, M. J., Tijus, C., & Detyniecki, M. (2022). Contextualization and exploration of local feature importance explanations to improve understanding and satisfaction of non-expert users. 27th International Conference on Intelligent User Interfaces (pp. 807\u2013819). https:\/\/doi.org\/10.1145\/3490099.3511139","DOI":"10.1145\/3490099.3511139"},{"key":"606_CR13","doi-asserted-by":"crossref","unstructured":"Bunde, E. (2021). AI-Assisted and explainable hate speech detection for social media moderators\u2013A design science approach. Proceedings of the 54th Hawaii International Conference on System Sciences (pp. 1264\u20131274). http:\/\/hdl.handle.net\/10125\/70766","DOI":"10.24251\/HICSS.2021.154"},{"issue":"832","key":"606_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3390\/electronics8080832","volume":"8","author":"DV Carvalho","year":"2019","unstructured":"Carvalho, D. V., Pereira, E. M., & Cardoso, J. S. (2019). Machine learning interpretability: A survey on methods and metrics. Electronics, 8(832), 1\u201334. https:\/\/doi.org\/10.3390\/electronics8080832","journal-title":"Electronics"},{"key":"606_CR15","unstructured":"Chander, A., Srinivasan, R., Chelian, S., Wang, J., & Uchino, K. (2018). Working with beliefs: AI transparency in the enterprise. CEUR-WS IUI Workshops. https:\/\/www.researchgate.net\/publication\/331970789_Working_with_Beliefs_AI_Transparency_in_the_Enterprise"},{"key":"606_CR16","doi-asserted-by":"publisher","unstructured":"Chandra Kruse, L., Purao, S., & Seidel, S. (2022). How designers use design principles: Design behaviors and application modes. Journal of the Association for Information Systems (forthcoming). https:\/\/doi.org\/10.17705\/1jais.00759","DOI":"10.17705\/1jais.00759"},{"issue":"4","key":"606_CR17","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1007\/s00766-020-00333-1","volume":"25","author":"L Chazette","year":"2020","unstructured":"Chazette, L., & Schneider, K. (2020). Explainability as a non-functional requirement: challenges and recommendations. Requirements Engineering, 25(4), 493\u2013514. https:\/\/doi.org\/10.1007\/s00766-020-00333-1","journal-title":"Requirements Engineering"},{"key":"606_CR18","doi-asserted-by":"crossref","unstructured":"Cheng, H.-F., Wang, R., Zhang, Z., O'Connell, F., Gray, T., Harper, F. M., & Zhu, H. (2019). Explaining decision-making algorithms through UI: Strategies to help non-expert stakeholders. CHI conference on human factors in computing systems, New York, USA.","DOI":"10.1145\/3290605.3300789"},{"issue":"10","key":"606_CR19","doi-asserted-by":"publisher","first-page":"692","DOI":"10.1080\/10447318.2015.1070549","volume":"31","author":"JK Choi","year":"2015","unstructured":"Choi, J. K., & Ji, Y. G. (2015). Investigating the importance of trust on adopting an autonomous vehicle. International Journal of Human-Computer Interaction, 31(10), 692\u2013702. https:\/\/doi.org\/10.1080\/10447318.2015.1070549","journal-title":"International Journal of Human-Computer Interaction"},{"key":"606_CR20","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1016\/j.inffus.2021.11.003","volume":"81","author":"Y-L Chou","year":"2022","unstructured":"Chou, Y.-L., Moreira, C., Bruza, P., Ouyang, C., & Jorge, J. (2022). Counterfactuals and causability in explainable artificial intelligence: Theory, algorithms, and applications. Information Fusion, 81, 59\u201383. https:\/\/doi.org\/10.1016\/j.inffus.2021.11.003","journal-title":"Information Fusion"},{"key":"606_CR21","doi-asserted-by":"crossref","unstructured":"Chromik, M., & Butz, A. (2021). Human-xai interaction: A review and design principles for explanation user interfaces. IFIP Conference on Human-Computer Interaction, Dublin, Ireland.","DOI":"10.1007\/978-3-030-85616-8_36"},{"key":"606_CR22","doi-asserted-by":"crossref","unstructured":"Cirqueira, D., Helfert, M., & Bezbradica, M. (2021). Towards design principles for user-centric explainable AI in fraud detection. International Conference on Human-Computer Interaction.","DOI":"10.1007\/978-3-030-77772-2_2"},{"key":"606_CR23","doi-asserted-by":"publisher","first-page":"103503","DOI":"10.1016\/j.artint.2021.103503","volume":"298","author":"C Conati","year":"2021","unstructured":"Conati, C., Barral, O., Putnam, V., & Rieger, L. (2021). Toward personalized XAI: A case study in intelligent tutoring systems. Artificial intelligence, 298, 103503. https:\/\/doi.org\/10.1016\/j.artint.2021.103503","journal-title":"Artificial intelligence"},{"issue":"5","key":"606_CR24","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1007\/s11257-008-9051-3","volume":"18","author":"H Cramer","year":"2008","unstructured":"Cramer, H., Evers, V., Ramlal, S., Van Someren, M., Rutledge, L., Stash, N., Aroyo, L., & Wielinga, B. (2008). The effects of transparency on trust in and acceptance of a content-based art recommender. User Modeling and User-Adapted Interaction, 18(5), 455. https:\/\/doi.org\/10.1007\/s11257-008-9051-3","journal-title":"User Modeling and User-Adapted Interaction"},{"key":"606_CR25","doi-asserted-by":"publisher","unstructured":"Das, A., & Rad, P. (2020). Opportunities and challenges in explainable artificial intelligence (XAI): A survey. arXiv preprint. https:\/\/doi.org\/10.48550\/arXiv.2006.11371","DOI":"10.48550\/arXiv.2006.11371"},{"issue":"5","key":"606_CR26","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1007\/s12599-019-00595-2","volume":"61","author":"D Dellermann","year":"2019","unstructured":"Dellermann, D., Ebel, P., S\u00f6llner, M., & Leimeister, J. M. (2019). Hybrid intelligence. Business & Information Systems Engineering, 61(5), 637\u2013643. https:\/\/doi.org\/10.1007\/s12599-019-00595-2","journal-title":"Business & Information Systems Engineering"},{"key":"606_CR27","doi-asserted-by":"publisher","first-page":"102792","DOI":"10.1016\/j.ijhcs.2022.102792","volume":"162","author":"M Dikmen","year":"2022","unstructured":"Dikmen, M., & Burns, C. (2022). The effects of domain knowledge on trust in explainable AI and task performance: A case of peer-to-peer lending. International Journal of Human-Computer Studies, 162, 102792. https:\/\/doi.org\/10.1016\/j.ijhcs.2022.102792","journal-title":"International Journal of Human-Computer Studies"},{"key":"606_CR28","doi-asserted-by":"crossref","unstructured":"Drechsler, A., & Hevner, A. R. (2018). Utilizing, producing, and contributing design knowledge in DSR projects. International Conference on Design Science Research in Information Systems and Technology, Chennai, India.","DOI":"10.1007\/978-3-319-91800-6_6"},{"issue":"4","key":"606_CR29","doi-asserted-by":"publisher","first-page":"864","DOI":"10.1037\/0033-295X.114.4.864","volume":"114","author":"N Epley","year":"2007","unstructured":"Epley, N., Waytz, A., & Cacioppo, J. T. (2007). On seeing human: a three-factor theory of anthropomorphism. Psychological review, 114(4), 864. https:\/\/doi.org\/10.1037\/0033-295X.114.4.864","journal-title":"Psychological review"},{"key":"606_CR30","doi-asserted-by":"publisher","unstructured":"Evans, T., Retzlaff, C. O., Gei\u00dfler, C., Kargl, M., Plass, M., M\u00fcller, H., Kiehl, T.-R., Zerbe, N., & Holzinger, A. (2022). The explainability paradox: Challenges for xAI in digital pathology. Future Generation Computer Systems. https:\/\/doi.org\/10.1016\/j.future.2022.03.009","DOI":"10.1016\/j.future.2022.03.009"},{"key":"606_CR31","doi-asserted-by":"publisher","unstructured":"Ferreira, J. J., & Monteiro, M. S. (2020). What are people doing about XAI user experience? A survey on AI explainability research and practice. International conference on human-computer interaction. https:\/\/doi.org\/10.1007\/978-3-030-49760-6_4","DOI":"10.1007\/978-3-030-49760-6_4"},{"key":"606_CR32","doi-asserted-by":"publisher","unstructured":"Flick, U. (2020). G\u00fctekriterien qualitativer Forschung. In Handbuch qualitative Forschung in der Psychologie (pp. 247\u2013263). Springer. https:\/\/doi.org\/10.1007\/978-3-531-92052-8_28","DOI":"10.1007\/978-3-531-92052-8_28"},{"key":"606_CR33","unstructured":"Forster, M., Klier, M., Kluge, K., & Sigler, I. (2020). Fostering human agency: A process for the design of usercentric XAI systems. International conference on information systems, Virtual conference proceedings (p. 12) https:\/\/aisel.aisnet.org\/icis2020\/hci_artintel\/hci_artintel\/12"},{"key":"606_CR34","doi-asserted-by":"publisher","unstructured":"Fu, K. K., Yang, M. C., & Wood, K. L. (2015). Design principles: The foundation of design.\u00a0International design engineering technical conferences and computers and information in engineering conference. https:\/\/doi.org\/10.1115\/DETC2015-46157","DOI":"10.1115\/DETC2015-46157"},{"issue":"4","key":"606_CR35","doi-asserted-by":"publisher","first-page":"853","DOI":"10.1007\/s10994-019-05856-5","volume":"109","author":"J F\u00fcrnkranz","year":"2020","unstructured":"F\u00fcrnkranz, J., Kliegr, T., & Paulheim, H. (2020). On cognitive preferences and the plausibility of rule-based models. Machine Learning, 109(4), 853\u2013898. https:\/\/doi.org\/10.1007\/s10994-019-05856-5","journal-title":"Machine Learning"},{"key":"606_CR36","first-page":"27","volume":"12","author":"B Glaser","year":"1967","unstructured":"Glaser, B., & Strauss, A. (1967). Grounded theory: The discovery of grounded theory. Sociology The Journal of the British Sociological Association, 12, 27\u201349.","journal-title":"Sociology The Journal of the British Sociological Association"},{"key":"606_CR37","unstructured":"Glomsrud, J. A., \u00d8deg\u00e5rdstuen, A., Clair, A. L. S., & Smogeli, \u00d8. (2019). Trustworthy versus explainable AI in autonomous vessels. International Seminar on Safety and Security of Autonomous Vessels (ISSAV) and European STAMP Workshop and Conference (ESWC). https:\/\/library.oapen.org\/handle\/20.500.12657\/41230"},{"key":"606_CR38","unstructured":"Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep learning. MIT Press."},{"issue":"3","key":"606_CR39","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1609\/aimag.v38i3.2741","volume":"38","author":"B Goodman","year":"2017","unstructured":"Goodman, B., & Flaxman, S. (2017). European Union regulations on algorithmic decision-making and a \u201cright to explanation\u201d. AI magazine, 38(3), 50\u201357. https:\/\/doi.org\/10.1609\/aimag.v38i3.2741","journal-title":"AI magazine"},{"issue":"6","key":"606_CR40","doi-asserted-by":"publisher","first-page":"0.17705\/1jais.0","DOI":"10.17705\/1jais.00649","volume":"21","author":"S Gregor","year":"2020","unstructured":"Gregor, S., Chandra Kruse, L., & Seidel, S. (2020). Research perspectives: The anatomy of a design principle. Journal of the Association for Information Systems, 21(6). https:\/\/doi.org\/10.17705\/1jais.00649","journal-title":"Journal of the Association for Information Systems"},{"issue":"2","key":"606_CR41","doi-asserted-by":"publisher","first-page":"337","DOI":"10.25300\/MISQ\/2013\/37.2.01","volume":"37","author":"S Gregor","year":"2013","unstructured":"Gregor, S., & Hevner, A. R. (2013). Positioning and presenting design science research for maximum impact. MIS Quarterly, 37(2), 337\u2013355. https:\/\/doi.org\/10.25300\/MISQ\/2013\/37.2.01","journal-title":"MIS quarterly"},{"key":"606_CR42","doi-asserted-by":"publisher","unstructured":"Gunning, D., Stefik, M., Choi, J., Miller, T., Stumpf, S., & Yang, G.-Z. (2019). XAI\u2014Explainable artificial intelligence. Science Robotics, 4(37). https:\/\/doi.org\/10.1126\/scirobotics.aay7120","DOI":"10.1126\/scirobotics.aay7120"},{"issue":"1","key":"606_CR43","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1016\/j.ijhcs.2008.09.008","volume":"67","author":"SR Haynes","year":"2009","unstructured":"Haynes, S. R., Cohen, M. A., & Ritter, F. E. (2009). Designs for explaining intelligent agents. International Journal of Human-Computer Studies, 67(1), 90\u2013110. https:\/\/doi.org\/10.1016\/j.ijhcs.2008.09.008","journal-title":"International Journal of Human-Computer Studies"},{"key":"606_CR44","doi-asserted-by":"publisher","unstructured":"Hepenstal, S., & McNeish, D. (2020). Explainable artificial intelligence: What do you need to know? In D. D. Schmorrow & C. M. Fidopiastis (Eds.), Augmented cognition. Theoretical and technological approaches. HCII 2020. Lecture notes in computer science (Vol. 12196). Springer. https:\/\/doi.org\/10.1007\/978-3-030-50353-6_20","DOI":"10.1007\/978-3-030-50353-6_20"},{"key":"606_CR45","doi-asserted-by":"publisher","unstructured":"Herm, L.-V., Heinrich, K., Wanner, J., & Janiesch, C. (2022a). Stop ordering machine learning algorithms by their explainability! A user-centered investigation of performance and explainability. International Journal of Information Management, 102538. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2022.102538","DOI":"10.1016\/j.ijinfomgt.2022.102538"},{"key":"606_CR46","unstructured":"Herm, L.-V., Wanner, J., & Janiesch, C. (2022b). A taxonomy of user-centered explainable AI studies (p. 9). PACIS 2022 Proceedings. https:\/\/aisel.aisnet.org\/pacis2022\/9"},{"key":"606_CR47","unstructured":"Herm, L.-V., Wanner, J., Seubert, F., & Janiesch, C. (2021). I don\u2019t get it, but it seems valid! The connection between explainability and comprehensibility in (X)AI research (p. 82). ECIS 2021 Research Papers. https:\/\/aisel.aisnet.org\/ecis2021_rp\/82"},{"issue":"1","key":"606_CR48","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1177\/0268396220945714","volume":"36","author":"AR Hevner","year":"2021","unstructured":"Hevner, A. R. (2021). The duality of science: Knowledge in information systems research. Journal of Information Technology, 36(1), 72\u201376. https:\/\/doi.org\/10.1177\/0268396220945714","journal-title":"Journal of Information Technology"},{"issue":"1","key":"606_CR49","doi-asserted-by":"publisher","first-page":"75","DOI":"10.2307\/25148625","volume":"28","author":"AR Hevner","year":"2004","unstructured":"Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004). Design science in information systems research. MIS Quarterly, 28(1), 75\u2013105. https:\/\/doi.org\/10.2307\/25148625","journal-title":"MIS Quarterly"},{"issue":"4","key":"606_CR50","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1080\/135467896394447","volume":"2","author":"DJ Hilton","year":"1996","unstructured":"Hilton, D. J. (1996). Mental models and causal explanation: Judgements of probable cause and explanatory relevance. Thinking & Reasoning, 2(4), 273\u2013308. https:\/\/doi.org\/10.1080\/135467896394447","journal-title":"Thinking & Reasoning"},{"key":"606_CR51","doi-asserted-by":"crossref","unstructured":"Hohman, F., Head, A., Caruana, R., DeLine, R., & Drucker, S. M. (2019). Gamut: A design probe to understand how data scientists understand machine learning models. CHI conference on human factors in computing systems, New York, USA.","DOI":"10.1145\/3290605.3300809"},{"key":"606_CR52","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1016\/j.inffus.2021.10.007","volume":"79","author":"A Holzinger","year":"2022","unstructured":"Holzinger, A., Dehmer, M., Emmert-Streib, F., Cucchiara, R., Augenstein, I., Del Ser, J., Samek, W., Jurisica, I., & D\u00edaz-Rodr\u00edguez, N. (2022). Information fusion as an integrative cross-cutting enabler to achieve robust, explainable, and trustworthy medical artificial intelligence. Information Fusion, 79, 263\u2013278. https:\/\/doi.org\/10.1016\/j.inffus.2021.10.007","journal-title":"Information Fusion"},{"key":"606_CR53","doi-asserted-by":"publisher","first-page":"102497","DOI":"10.1016\/j.ijinfomgt.2022.102497","volume":"65","author":"D Hradecky","year":"2022","unstructured":"Hradecky, D., Kennell, J., Cai, W., & Davidson, R. (2022). Organizational readiness to adopt artificial intelligence in the exhibition sector in Western Europe. International Journal of Information Management, 65, 102497. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2022.102497","journal-title":"International Journal of Information Management"},{"issue":"6346","key":"606_CR54","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1126\/science.357.6346.19","volume":"357","author":"M Hutson","year":"2017","unstructured":"Hutson, M. (2017). AI Glossary: Artificial intelligence, in so many words. Science, 357(6346), 19\u201319. https:\/\/doi.org\/10.1126\/science.357.6346.19","journal-title":"Science"},{"issue":"3","key":"606_CR55","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1080\/0960085X.2020.1793697","volume":"30","author":"J Iivari","year":"2021","unstructured":"Iivari, J., Hansen, M. R. P., & Haj-Bolouri, A. (2021). A proposal for minimum reusability evaluation of design principles. European Journal of Information Systems, 30(3), 286\u2013303. https:\/\/doi.org\/10.1080\/0960085X.2020.1793697","journal-title":"European Journal of Information Systems"},{"issue":"6","key":"606_CR56","doi-asserted-by":"publisher","first-page":"1402","DOI":"10.17705\/1jais.00642","volume":"21","author":"C Janiesch","year":"2020","unstructured":"Janiesch, C., Rosenkranz, C., & Scholten, U. (2020). An information systems design theory for service network effects. Journal of the Association for Information Systems: Forthcoming, 21(6), 1402\u20131460. https:\/\/doi.org\/10.17705\/1jais.00642","journal-title":"Journal of the Association for Information Systems: Forthcoming"},{"key":"606_CR57","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1007\/s12525-021-00475-2","volume":"31","author":"C Janiesch","year":"2021","unstructured":"Janiesch, C., Zschech, P., & Heinrich, K. (2021). Machine learning and deep learning. Electronic Markets, 31(3), 685\u2013695. https:\/\/doi.org\/10.1007\/s12525-021-00475-2","journal-title":"Electronic Markets"},{"key":"606_CR58","doi-asserted-by":"crossref","unstructured":"Jesus, S., Bel\u00e9m, C., Balayan, V., Bento, J., Saleiro, P., Bizarro, P., & Gama, J. (2021). How can I choose an explainer? An application-grounded evaluation of post-hoc explanations. Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, New York, NY.","DOI":"10.1145\/3442188.3445941"},{"key":"606_CR59","doi-asserted-by":"publisher","unstructured":"Kaiser, R. (2014). Qualitative Experteninterviews: Konzeptionelle Grundlagen und praktische Durchf\u00fchrung. Springer. https:\/\/doi.org\/10.1007\/978-3-658-02479-6","DOI":"10.1007\/978-3-658-02479-6"},{"issue":"2","key":"606_CR60","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3491209","volume":"55","author":"D Kaur","year":"2022","unstructured":"Kaur, D., Uslu, S., Rittichier, K. J., & Durresi, A. (2022). Trustworthy artificial intelligence: A review. ACM Computing Surveys (CSUR), 55(2), 1\u201338. https:\/\/doi.org\/10.1145\/3491209","journal-title":"ACM Computing Surveys (CSUR)"},{"key":"606_CR61","doi-asserted-by":"publisher","unstructured":"Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G., & King, D. (2019). Key challenges for delivering clinical impact with artificial intelligence. BMC medicine, 17(195). https:\/\/doi.org\/10.1186\/s12916-019-1426-2","DOI":"10.1186\/s12916-019-1426-2"},{"issue":"1","key":"606_CR62","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3487065","volume":"12","author":"R Khanna","year":"2022","unstructured":"Khanna, R., Dodge, J., Anderson, A., Dikkala, R., Irvine, J., Shureih, Z., Lam, K.-H., Matthews, C. R., Lin, Z., & Kahng, M. (2022). Finding AI\u2019s faults with AAR\/AI: An empirical study. ACM Transactions on Interactive Intelligent Systems (TiiS), 12(1), 1\u201333. https:\/\/doi.org\/10.1145\/3487065","journal-title":"ACM Transactions on Interactive Intelligent Systems (TiiS)"},{"key":"606_CR63","volume-title":"CHI Conference on Human Factors in Computing Systems","author":"R Kocielnik","year":"2019","unstructured":"Kocielnik, R., Amershi, S., & Bennett, P. N. (2019). Will you accept an imperfect AI? Exploring designs for adjusting end-user expectations of ai systems. CHI Conference on Human Factors in Computing Systems."},{"key":"606_CR64","doi-asserted-by":"publisher","unstructured":"Lambers, J., & Balzer, C. (2022). Plastic welding process data. B2Share EUDAT. https:\/\/doi.org\/10.23728\/b2share.657bb2383ce946dcb4cab9419e1645d3","DOI":"10.23728\/b2share.657bb2383ce946dcb4cab9419e1645d3"},{"key":"606_CR65","doi-asserted-by":"publisher","unstructured":"Landwehr, J. P., K\u00fchl, N., Walk, J., & Gn\u00e4dig, M. (2022). Design knowledge for deep-learning-enabled image-based decision support systems. Business & Information Systems Engineering, 1\u201322. https:\/\/doi.org\/10.1007\/s12599-022-00745-z","DOI":"10.1007\/s12599-022-00745-z"},{"issue":"3b","key":"606_CR66","doi-asserted-by":"publisher","first-page":"1501","DOI":"10.25300\/MISQ\/2021\/16564","volume":"45","author":"S Lebovitz","year":"2021","unstructured":"Lebovitz, S., Levina, N., & Lifshitz-Assaf, H. (2021). Is AI ground truth really \u201ctrue\u201d? The dangers of training and evaluating AI tools based on experts\u2019 know-what. Management Information Systems Quarterly, 45(3b), 1501\u20131525. https:\/\/doi.org\/10.25300\/MISQ\/2021\/16564","journal-title":"Management Information Systems Quarterly"},{"issue":"7553","key":"606_CR67","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436\u2013444. https:\/\/doi.org\/10.1038\/nature14539","journal-title":"Nature"},{"issue":"3","key":"606_CR68","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1287\/isre.14.3.221.16560","volume":"14","author":"AS Lee","year":"2003","unstructured":"Lee, A. S., & Baskerville, R. L. (2003). Generalizing generalizability in information systems research. Information Systems Research, 14(3), 221\u2013243. https:\/\/doi.org\/10.1287\/isre.14.3.221.16560","journal-title":"Information Systems Research"},{"key":"606_CR69","first-page":"214","volume":"2","author":"DK Lewis","year":"1986","unstructured":"Lewis, D. K. (1986). Causal explanation. Philosophical Papers, 2, 214\u2013240.","journal-title":"Philosophical Papers"},{"key":"606_CR70","doi-asserted-by":"publisher","unstructured":"Liao, Q. V., Gruen, D., & Miller, S. (2020). CHI Conference on Human Factors in Computing Systems. CHI Conference on Human Factors in Computing Systems. https:\/\/doi.org\/10.1145\/3313831.3376590","DOI":"10.1145\/3313831.3376590"},{"key":"606_CR71","doi-asserted-by":"publisher","unstructured":"Liao, Q. V., & Varshney, K. R. (2021). Human-centered explainable AI (XAI): From algorithms to user experiences. arXiv preprint. https:\/\/doi.org\/10.48550\/arXiv.2110.10790","DOI":"10.48550\/arXiv.2110.10790"},{"issue":"3","key":"606_CR72","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1145\/3236386.3241340","volume":"16","author":"ZC Lipton","year":"2018","unstructured":"Lipton, Z. C. (2018). The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery. Queue, 16(3), 31\u201357. https:\/\/doi.org\/10.1145\/3236386.3241340","journal-title":"Queue"},{"key":"606_CR73","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1007\/s10115-009-0192-4","volume":"22","author":"S Liu","year":"2008","unstructured":"Liu, S., Duffy, A., Whitfield, R., & Boyle, I. (2008). Integration of decision support systems to improve decision support performance. Knowledge Information Systems, 22, 261\u2013286. https:\/\/doi.org\/10.1007\/s10115-009-0192-4","journal-title":"Knowledge Information Systems"},{"key":"606_CR74","doi-asserted-by":"crossref","unstructured":"Longo, L., Goebel, R., Lecue, F., Kieseberg, P., & Holzinger, A. (2020). Explainable artificial intelligence: Concepts, applications, research challenges and visions. International Cross-Domain Conference for Machine Learning and Knowledge Extraction, Cham.","DOI":"10.1007\/978-3-030-57321-8_1"},{"issue":"1","key":"606_CR75","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1038\/s42256-019-0138-9","volume":"2","author":"SM Lundberg","year":"2020","unstructured":"Lundberg, S. M., Erion, G., Chen, H., DeGrave, A., Prutkin, J. M., Nair, B., Katz, R., Himmelfarb, J., Bansal, N., & Lee, S.-I. (2020). From local explanations to global understanding with explainable AI for trees. Nature Machine Intelligence, 2(1), 56\u201367. https:\/\/doi.org\/10.1038\/s42256-019-0138-9","journal-title":"Nature Machine Intelligence"},{"key":"606_CR76","doi-asserted-by":"publisher","first-page":"121390","DOI":"10.1016\/j.techfore.2021.121390","volume":"175","author":"H Mahmud","year":"2022","unstructured":"Mahmud, H., Islam, A. K. M. N., Ahmed, S. I., & Smolander, K. (2022). What influences algorithmic decision-making? A systematic literature review on algorithm aversion. Technological Forecasting and Social Change, 175, 121390. https:\/\/doi.org\/10.1016\/j.techfore.2021.121390","journal-title":"Technological Forecasting and Social Change"},{"key":"606_CR77","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-51924-7_8","volume-title":"Explainable agents for less bias in human-agent decision making","author":"A Malhi","year":"2020","unstructured":"Malhi, A., Knapic, S., & Fr\u00e4mling, K. (2020). Explainable agents for less bias in human-agent decision making. In: Calvaresi, D., Najjar, A., Winikoff, M., Fr\u00e4mling, K. (eds) Explainable, Transparent Autonomous Agents and Multi-Agent Systems. EXTRAAMAS 2020. Lecture Notes in Computer Science(), vol 12175. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-030-51924-7_8"},{"issue":"7788","key":"606_CR78","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1038\/s41586-019-1799-6","volume":"577","author":"SM McKinney","year":"2020","unstructured":"McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., Etemadi, M., Garcia-Vicente, F., Gilbert, F. J., Halling-Brown, M., Hassabis, D., Jansen, S., Karthikesalingam, A., Kelly, C. J., King, D.,\u00a0Ledsam, J. R., Melnick, D., Mostofi, H., Peng, L., Reicher, J. J., Romera-Paredes, B., Sidebottom, R., Suleyman, M., Tse, D., Young, K. C., De Fauw, J., & Shetty, S. (2020). International evaluation of an AI system for breast cancer screening. Nature, 577(7788), 89\u201394.\u00a0https:\/\/doi.org\/10.1038\/s41586-019-1799-6","journal-title":"Nature"},{"issue":"2","key":"606_CR79","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1985347.1985353","volume":"2","author":"DH McKnight","year":"2011","unstructured":"McKnight, D. H., Carter, M., Thatcher, J. B., & Clay, P. F. (2011). Trust in a specific technology: An investigation of its components and measures. ACM Transactions on management information systems (TMIS), 2(2), 1\u201325. https:\/\/doi.org\/10.1145\/1985347.1985353","journal-title":"ACM Transactions on management information systems (TMIS)"},{"key":"606_CR80","doi-asserted-by":"publisher","unstructured":"Meske, C., & Bunde, E. (2022). Design principles for user interfaces in AI-based decision support systems: The case of explainable hate speech detection. Information Systems Frontiers, 1-31. https:\/\/doi.org\/10.1007\/s10796-021-10234-5","DOI":"10.1007\/s10796-021-10234-5"},{"issue":"1","key":"606_CR81","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1080\/10580530.2020.1849465","volume":"39","author":"C Meske","year":"2022","unstructured":"Meske, C., Bunde, E., Schneider, J., & Gersch, M. (2022). Explainable artificial intelligence: objectives, stakeholders, and future research opportunities. Information Systems Management, 39(1), 53\u201363. https:\/\/doi.org\/10.1080\/10580530.2020.1849465","journal-title":"Information Systems Management"},{"issue":"9","key":"606_CR82","doi-asserted-by":"publisher","first-page":"799","DOI":"10.17705\/1jais.00408","volume":"16","author":"H Meth","year":"2015","unstructured":"Meth, H., Mueller, B., & Maedche, A. (2015). Designing a requirement mining system. Journal of the Association for Information Systems, 16(9), 799\u2013837. https:\/\/doi.org\/10.17705\/1jais.00408","journal-title":"Journal of the Association for Information Systems"},{"key":"606_CR83","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.artint.2018.07.007","volume":"267","author":"T Miller","year":"2019","unstructured":"Miller, T. (2019). Explanation in artificial intelligence: Insights from the social sciences. Artificial intelligence, 267, 1\u201338. https:\/\/doi.org\/10.1016\/j.artint.2018.07.007","journal-title":"Artificial intelligence"},{"issue":"3\u20134","key":"606_CR84","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3387166","volume":"11","author":"S Mohseni","year":"2021","unstructured":"Mohseni, S., Zarei, N., & Ragan, E. D. (2021). A multidisciplinary survey and framework for design and evaluation of explainable AI systems. ACM Transactions on Interactive Intelligent Systems, 11(3\u20134), 1\u201345. https:\/\/doi.org\/10.1145\/3387166","journal-title":"ACM Transactions on Interactive Intelligent Systems"},{"key":"606_CR85","doi-asserted-by":"crossref","unstructured":"M\u00f6ller, F., Guggenberger, T. M., & Otto, B. (2020). Towards a method for design principle development in information systems. International Conference on Design Science Research in Information Systems and Technology, Kristiansand, Norway.","DOI":"10.1007\/978-3-030-64823-7_20"},{"key":"606_CR86","doi-asserted-by":"publisher","first-page":"103573","DOI":"10.1016\/j.artint.2021.103573","volume":"302","author":"Y Mualla","year":"2022","unstructured":"Mualla, Y., Tchappi, I., Kampik, T., Najjar, A., Calvaresi, D., Abbas-Turki, A., Galland, S., & Nicolle, C. (2022). The quest of parsimonious XAI: A human-agent architecture for explanation formulation. Artificial intelligence, 302, 103573. https:\/\/doi.org\/10.1016\/j.artint.2021.103573","journal-title":"Artificial intelligence"},{"key":"606_CR87","unstructured":"Nilsson, N. J. (2014). Principles of artificial intelligence. Morgan Kaufmann."},{"issue":"4","key":"606_CR88","doi-asserted-by":"publisher","first-page":"554","DOI":"10.3390\/math10040554","volume":"10","author":"AKM Nor","year":"2022","unstructured":"Nor, A. K. M., Pedapati, S. R., Muhammad, M., & Leiva, V. (2022). Abnormality detection and failure prediction using explainable Bayesian deep learning: Methodology and case study with industrial data. Mathematics, 10(4), 554. https:\/\/doi.org\/10.3390\/math10040554","journal-title":"Mathematics"},{"issue":"3","key":"606_CR89","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1007\/s11257-017-9195-0","volume":"27","author":"I Nunes","year":"2017","unstructured":"Nunes, I., & Jannach, D. (2017). A systematic review and taxonomy of explanations in decision support and recommender systems. User Modeling and User-Adapted Interaction, 27(3), 393\u2013444. https:\/\/doi.org\/10.1007\/s11257-017-9195-0","journal-title":"User Modeling and User-Adapted Interaction"},{"key":"606_CR90","doi-asserted-by":"publisher","first-page":"160940691989922","DOI":"10.1177\/1609406919899220","volume":"19","author":"C O\u2019Connor","year":"2020","unstructured":"O\u2019Connor, C., & Joffe, H. (2020). Intercoder reliability in qualitative research: debates and practical guidelines. International journal of qualitative methods, 19. https:\/\/doi.org\/10.1177\/1609406919899220","journal-title":"International journal of qualitative methods"},{"key":"606_CR91","volume-title":"ACM International Conference on Multimedia","author":"S Oviatt","year":"2006","unstructured":"Oviatt, S. (2006). Human-centered design meets cognitive load theory: Designing interfaces that help people think. ACM International Conference on Multimedia."},{"issue":"3","key":"606_CR92","doi-asserted-by":"publisher","first-page":"45","DOI":"10.2753\/MIS0742-1222240302","volume":"24","author":"K Peffers","year":"2007","unstructured":"Peffers, K., Tuunanen, T., Rothenberger, M. A., & Chatterjee, S. (2007). A design science research methodology for information systems research. Journal of management information systems, 24(3), 45\u201377. https:\/\/doi.org\/10.2753\/MIS0742-1222240302","journal-title":"Journal of management information systems"},{"key":"606_CR93","unstructured":"Poole, D., Mackworth, A., & Goebel, R. (1998). Computational intelligence. Oxford University Press."},{"key":"606_CR94","doi-asserted-by":"publisher","unstructured":"Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). \"Why should I trust you?\" Explaining the predictions of any classifier. Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 1135\u20131144). https:\/\/doi.org\/10.1145\/2939672.2939778","DOI":"10.1145\/2939672.2939778"},{"issue":"5","key":"606_CR95","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","volume":"1","author":"C Rudin","year":"2019","unstructured":"Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206\u2013215. https:\/\/doi.org\/10.1038\/s42256-019-0048-x","journal-title":"Nature Machine Intelligence"},{"key":"606_CR96","unstructured":"Samek, W., Wiegand, T., & M\u00fcller, K.-R. (2017). Explainable artificial intelligence: Understanding, visualizing and interpreting deep learning models. arXiv preprint. https:\/\/doi.org\/10.48550\/arXiv.1708.08296"},{"issue":"2","key":"606_CR97","doi-asserted-by":"publisher","first-page":"656","DOI":"10.1002\/int.22314","volume":"36","author":"C Sardianos","year":"2021","unstructured":"Sardianos, C., Varlamis, I., Chronis, C., Dimitrakopoulos, G., Alsalemi, A., Himeur, Y., Bensaali, F., & Amira, A. (2021). The emergence of explainability of intelligent systems: Delivering explainable and personalized recommendations for energy efficiency. International Journal of Intelligent Systems, 36(2), 656\u2013680. https:\/\/doi.org\/10.1002\/int.22314","journal-title":"International Journal of Intelligent Systems"},{"key":"606_CR98","volume-title":"Designing Resilient AI-based Robo-Advisors: A Prototype for Real Estate Appraisal Conference on Design Science Research in Information Systems and Technology","author":"M Schemmer","year":"2022","unstructured":"Schemmer, M., Hemmer, P., K\u00fchl, N., & Sch\u00e4fer, S. (2022). Designing resilient AI-based robo-advisors: A prototype for real estate appraisal. 17th International Conference on Design Science Research in Information Systems and Technology, St. Petersburg, FL, USA."},{"issue":"4","key":"606_CR99","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1080\/12460125.2020.1819094","volume":"29","author":"P Schmidt","year":"2020","unstructured":"Schmidt, P., Biessmann, F., & Teubner, T. (2020). Transparency and trust in artificial intelligence systems. Journal of Decision Systems, 29(4), 260\u2013278. https:\/\/doi.org\/10.1080\/12460125.2020.1819094","journal-title":"Journal of Decision Systems"},{"key":"606_CR100","doi-asserted-by":"publisher","unstructured":"Schneider, J., & Handali, J. (2019). Personalized explanation in machine learning: A conceptualization. arXiv, 1901.00770. https:\/\/doi.org\/10.48550\/arXiv.1901.00770","DOI":"10.48550\/arXiv.1901.00770"},{"issue":"2","key":"606_CR101","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1057\/s41303-017-0039-0","volume":"27","author":"S Seidel","year":"2018","unstructured":"Seidel, S., Chandra Kruse, L., Sz\u00e9kely, N., Gau, M., & Stieger, D. (2018). Design principles for sensemaking support systems in environmental sustainability transformations. European Journal of Information Systems, 27(2), 221\u2013247. https:\/\/doi.org\/10.1057\/s41303-017-0039-0","journal-title":"European Journal of Information Systems"},{"issue":"2","key":"606_CR102","doi-asserted-by":"publisher","first-page":"100050","DOI":"10.1016\/j.jjimei.2021.100050","volume":"1","author":"R Sharma","year":"2021","unstructured":"Sharma, R., Kumar, A., & Chuah, C. (2021). Turning the blackbox into a glassbox: An explainable machine learning approach for understanding hospitality customer. International Journal of Information Management Data Insights, 1(2), 100050. https:\/\/doi.org\/10.1016\/j.jjimei.2021.100050","journal-title":"International Journal of Information Management Data Insights"},{"key":"606_CR103","doi-asserted-by":"publisher","first-page":"102551","DOI":"10.1016\/j.ijhcs.2020.102551","volume":"146","author":"D Shin","year":"2021","unstructured":"Shin, D. (2021). The effects of explainability and causability on perception, trust, and acceptance: Implications for explainable AI. International Journal of Human-Computer Studies, 146, 102551. https:\/\/doi.org\/10.1016\/j.ijhcs.2020.102551","journal-title":"International Journal of Human-Computer Studies"},{"key":"606_CR104","doi-asserted-by":"publisher","first-page":"102061","DOI":"10.1016\/j.ijinfomgt.2019.102061","volume":"52","author":"D Shin","year":"2020","unstructured":"Shin, D., Zhong, B., & Biocca, F. A. (2020). Beyond user experience: What constitutes algorithmic experiences? International Journal of Information Management, 52, 102061. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2019.102061","journal-title":"International Journal of Information Management"},{"key":"606_CR105","volume-title":"Designing the user interface: Strategies for effective human-computer interaction","author":"B Shneiderman","year":"2016","unstructured":"Shneiderman, B., & Plaisant, C. (2016). Designing the user interface: Strategies for effective human-computer interaction (Vol. 6). Pearson Education."},{"issue":"8","key":"606_CR106","doi-asserted-by":"publisher","first-page":"860","DOI":"10.1002\/mar.20823","volume":"32","author":"EL Slade","year":"2015","unstructured":"Slade, E. L., Dwivedi, Y. K., Piercy, N. C., & Williams, M. D. (2015). Modeling consumers\u2019 adoption intentions of remote mobile payments in the United Kingdom: Extending UTAUT with innovativeness, risk, and trust. Psychology & Marketing, 32(8), 860\u2013873. https:\/\/doi.org\/10.1002\/mar.20823","journal-title":"Psychology & Marketing"},{"key":"606_CR107","volume-title":"Conference on Fairness, Accountability, and Transparency","author":"K Sokol","year":"2020","unstructured":"Sokol, K., & Flach, P. (2020). Explainability fact sheets: A framework for systematic assessment of explainable approaches. Conference on Fairness, Accountability, and Transparency."},{"issue":"4","key":"606_CR108","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2307\/248957","volume":"4","author":"RH Sprague","year":"1980","unstructured":"Sprague, R. H. (1980). A Framework for the development of decision support systems. MIS Quarterly, 4(4), 1\u201326. https:\/\/doi.org\/10.2307\/248957","journal-title":"MIS quarterly"},{"issue":"4","key":"606_CR109","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1145\/3490699","volume":"65","author":"VC Storey","year":"2022","unstructured":"Storey, V. C., Lukyanenko, R., Maass, W., & Parsons, J. (2022). Explainable AI. Communication of the ACM, 65(4), 27\u201329. https:\/\/doi.org\/10.1145\/3490699","journal-title":"Commun. ACM"},{"key":"606_CR110","first-page":"273","volume-title":"Handbook of qualitative research","author":"A Strauss","year":"1994","unstructured":"Strauss, A., & Corbin, J. (1994). Grounded theory methodology: An overview. In K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 273\u2013285). Sage Publications Inc."},{"issue":"8","key":"606_CR111","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1016\/j.ijhcs.2009.03.004","volume":"67","author":"S Stumpf","year":"2019","unstructured":"Stumpf, S., Rajaram, V., Li, L., Wong, W.-K., Burnett, M., Dietterich, T., Sullivan, E., & Herlocker, J. (2019). Interacting meaningfully with machine learning systems: Three experiments. International Journal of Human-Computer Studies, 67(8), 639\u2013662. https:\/\/doi.org\/10.1016\/j.ijhcs.2009.03.004","journal-title":"International Journal of Human-Computer Studies"},{"key":"606_CR112","doi-asserted-by":"publisher","unstructured":"Sun, J., Liao, Q. V., Muller, M., Agarwal, M., Houde, S., Talamadupula, K., & Weisz, J. D. (2022). International Conference on Intelligent User Interfaces. International Conference on Intelligent User Interfaces. https:\/\/doi.org\/10.1145\/3490099.3511119","DOI":"10.1145\/3490099.3511119"},{"issue":"1","key":"606_CR113","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1093\/jcmc\/zmz026","volume":"25","author":"SS Sundar","year":"2020","unstructured":"Sundar, S. S. (2020). Rise of machine agency: A framework for studying the psychology of human\u2013AI interaction (HAII). Journal of Computer-Mediated Communication, 25(1), 74\u201388. https:\/\/doi.org\/10.1093\/jcmc\/zmz026","journal-title":"Journal of Computer-Mediated Communication"},{"issue":"2","key":"606_CR114","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1007\/s12525-020-00441-4","volume":"31","author":"S Thiebes","year":"2021","unstructured":"Thiebes, S., Lins, S., & Sunyaev, A. (2021). Trustworthy artificial intelligence. Electronic Markets, 31(2), 447\u2013464. https:\/\/doi.org\/10.1007\/s12525-020-00441-4","journal-title":"Electronic Markets"},{"issue":"2","key":"606_CR115","doi-asserted-by":"publisher","first-page":"121","DOI":"10.2307\/249031","volume":"10","author":"E Turban","year":"1986","unstructured":"Turban, E., & Watkins, P. R. (1986). Integrating expert systems and decision support systems. MIS Quarterly, 10(2), 121\u2013136. https:\/\/doi.org\/10.2307\/249031","journal-title":"MIS quarterly"},{"key":"606_CR116","doi-asserted-by":"crossref","unstructured":"Vaishnavi, V. K., & Kuechler, W. (2007). Design science research methods and patterns: Innovating information and communication technology. Auerbach Publications.","DOI":"10.1201\/9781420059335"},{"key":"606_CR117","doi-asserted-by":"publisher","unstructured":"Vale, D., El-Sharif, A., & Ali, M. (2022). Explainable artificial intelligence (XAI) post-hoc explainability methods: Risks and limitations in non-discrimination law. AI and Ethics, 1-12. https:\/\/doi.org\/10.1007\/s43681-022-00142-y","DOI":"10.1007\/s43681-022-00142-y"},{"key":"606_CR118","doi-asserted-by":"publisher","first-page":"103404","DOI":"10.1016\/j.artint.2020.103404","volume":"291","author":"J van der Waa","year":"2021","unstructured":"van der Waa, J., Nieuwburg, E., Cremers, A., & Neerincx, M. (2021). Evaluating XAI: A comparison of rule-based and example-based explanations. Artificial intelligence, 291, 103404. https:\/\/doi.org\/10.1016\/j.artint.2020.103404","journal-title":"Artificial intelligence"},{"issue":"1","key":"606_CR119","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1057\/ejis.2014.36","volume":"25","author":"J Venable","year":"2016","unstructured":"Venable, J., Pries-Heje, J., & Baskerville, R. (2016). FEDS: a framework for evaluation in design science research. European Journal of Information Systems, 25(1), 77\u201389. https:\/\/doi.org\/10.1057\/ejis.2014.36","journal-title":"European Journal of Information Systems"},{"issue":"1","key":"606_CR120","doi-asserted-by":"publisher","first-page":"206","DOI":"10.17705\/1CAIS.03709","volume":"37","author":"J vom Brocke","year":"2015","unstructured":"vom Brocke, J., Simons, A., Riemer, K., Niehaves, B., Plattfaut, R., & Cleven, A. (2015). Standing on the shoulders of giants: Challenges and recommendations of literature search in information systems research. Communications of the association for information systems, 37(1), 206\u2013224. https:\/\/doi.org\/10.17705\/1CAIS.03709","journal-title":"Communications of the association for information systems"},{"issue":"3","key":"606_CR121","doi-asserted-by":"publisher","first-page":"9. 10.17705\/1ja","DOI":"10.17705\/1jais.00611","volume":"21","author":"J vom Brocke","year":"2020","unstructured":"vom Brocke, J., Winter, R., Hevner, A., & Maedche, A. (2020). Accumulation and evolution of design knowledge in design science research: a journey through time and space. Journal of the Association for Information Systems, 21(3), 9. https:\/\/doi.org\/10.17705\/1jais.00611","journal-title":"Journal of the Association for Information Systems"},{"key":"606_CR122","doi-asserted-by":"publisher","unstructured":"Wanner, J., Herm, L-V., Heinrich, K., & Janiesch, C. (2022). The effect of transparency and trust on intelligent system acceptance: Evidence from a user-based study. Electronic Markets, 32(4). https:\/\/doi.org\/10.1007\/s12525-022-00593-5","DOI":"10.1007\/s12525-022-00593-5"},{"key":"606_CR123","unstructured":"Wanner, J., Popp, L., Fuchs, K., Heinrich, K., Herm, L.-V., & Janiesch, C. (2021). Adoption barriers of AI: A context-specific acceptance model for industrial maintenance. European Conference on Information Systems, Virtual Conference."},{"key":"606_CR124","doi-asserted-by":"crossref","unstructured":"Weitz, K., Schiller, D., Schlagowski, R., Huber, T., & Andr\u00e9, E. (2019). \"Do you trust me?\" Increasing user-trust by integrating virtual agents in explainable AI interaction design. International Conference on Intelligent Virtual Agents, New York, NY.","DOI":"10.1145\/3308532.3329441"},{"issue":"13","key":"606_CR125","doi-asserted-by":"publisher","first-page":"6563","DOI":"10.3390\/app12136563","volume":"12","author":"S Xinogalos","year":"2022","unstructured":"Xinogalos, S., & Satratzemi, M. (2022). The use of educational games in programming assignments: SQL Island as a case study. Applied Sciences, 12(13), 6563. https:\/\/doi.org\/10.3390\/app12136563","journal-title":"Applied Sciences"},{"key":"606_CR126","doi-asserted-by":"publisher","unstructured":"Zerilli, J., Bhatt, U., & Weller, A. (2022). How transparency modulates trust in artificial intelligence. Patterns, 100455. https:\/\/doi.org\/10.1016\/j.patter.2022.100455","DOI":"10.1016\/j.patter.2022.100455"},{"issue":"5","key":"606_CR127","doi-asserted-by":"publisher","first-page":"593","DOI":"10.3390\/electronics10050593","volume":"10","author":"J Zhou","year":"2021","unstructured":"Zhou, J., Gandomi, A. H., Chen, F., & Holzinger, A. (2021). Evaluating the quality of machine learning explanations: A survey on methods and metrics. Electronics, 10(5), 593. https:\/\/doi.org\/10.3390\/electronics10050593","journal-title":"Electronics"},{"key":"606_CR128","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1007\/s12599-020-00642-3","volume":"62","author":"P Zschech","year":"2020","unstructured":"Zschech, P., Horn, R., H\u00f6schele, D., Janiesch, C., & Heinrich, K. (2020). Intelligent user assistance for automated data mining method selection. Business & Information Systems Engineering, 62, 227\u2013247. https:\/\/doi.org\/10.1007\/s12599-020-00642-3","journal-title":"Business & Information Systems Engineering"}],"container-title":["Electronic Markets"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12525-022-00606-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12525-022-00606-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12525-022-00606-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,2]],"date-time":"2023-12-02T20:38:54Z","timestamp":1701549534000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12525-022-00606-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12]]},"references-count":128,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["606"],"URL":"https:\/\/doi.org\/10.1007\/s12525-022-00606-3","relation":{},"ISSN":["1019-6781","1422-8890"],"issn-type":[{"value":"1019-6781","type":"print"},{"value":"1422-8890","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12]]},"assertion":[{"value":"23 May 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 December 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}