{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,8]],"date-time":"2026-06-08T12:49:04Z","timestamp":1780922944890,"version":"3.54.1"},"publisher-location":"Cham","reference-count":33,"publisher":"Springer Nature Switzerland","isbn-type":[{"value":"9783031703959","type":"print"},{"value":"9783031703966","type":"electronic"}],"license":[{"start":{"date-parts":[[2024,1,1]],"date-time":"2024-01-01T00:00:00Z","timestamp":1704067200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,9,2]],"date-time":"2024-09-02T00:00:00Z","timestamp":1725235200000},"content-version":"vor","delay-in-days":245,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Prescriptive process monitoring (PrPM) systems analyze ongoing business process instances to recommend real-time interventions that optimize performance. The usefulness of these systems hinges on users applying the generated recommendations. Thus, users need to understand the rationale behind these recommendations. One way to build this understanding is to enhance each recommendation with explanations. Existing approaches generate explanations consisting of static text or plots, which users often struggle to understand. Previous work has shown that dialogue systems enhance the effectiveness of explanations in recommender systems. Large Language Models (LLMs) are an emerging technology that facilitates the construction of dialogue systems. In this paper, we investigate the applicability of LLMs for generating explanations in PrPM systems. Following a design science approach, we elicit explainability questions that users may have for PrPM outputs, we design a prompting method on this basis, and we conduct an evaluation with potential users to assess their perception of the explanations and their approach to interact with the system. The results indicate that LLMs can help users of PrPM systems to better understand the origin of the recommendations, and to produce recommendations that have sufficient detail and fulfill their expectations. On the other hand, users find that the explanations do not always address the \u201cwhy\u201d of a recommendation and do not let them judge if they can trust the recommendation.<\/jats:p>","DOI":"10.1007\/978-3-031-70396-6_23","type":"book-chapter","created":{"date-parts":[[2024,9,1]],"date-time":"2024-09-01T10:01:54Z","timestamp":1725184914000},"page":"403-420","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Explanatory Capabilities of\u00a0Large Language Models in\u00a0Prescriptive Process Monitoring"],"prefix":"10.1007","author":[{"given":"Kateryna","family":"Kubrak","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lana","family":"Botchorishvili","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fredrik","family":"Milani","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Nolte","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marlon","family":"Dumas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,9,2]]},"reference":[{"key":"23_CR1","series-title":"LNCS","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1007\/978-3-031-17604-3_11","volume-title":"EDOC 2022","author":"P Bellan","year":"2022","unstructured":"Bellan, P., Dragoni, M., Ghidini, C.: Extracting business process entities and relations from text using pre-trained language models and in-context learning. In: Almeida, J.P.A., Karastoyanova, D., Guizzardi, G., Montali, M., Maggi, F.M., Fonseca, C.M. (eds.) EDOC 2022. LNCS, vol. 13585, pp. 182\u2013199. Springer, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-031-17604-3_11"},{"key":"23_CR2","doi-asserted-by":"publisher","first-page":"102198","DOI":"10.1016\/j.is.2023.102198","volume":"116","author":"ZD Bozorgi","year":"2023","unstructured":"Bozorgi, Z.D., Teinemaa, I., Dumas, M., Rosa, M.L., Polyvyanyy, A.: Prescriptive process monitoring based on causal effect estimation. Inf. Syst. 116, 102198 (2023)","journal-title":"Inf. Syst."},{"key":"23_CR3","series-title":"LNBIP","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/978-3-031-34241-7_1","volume-title":"BPMDS EMMSAD 2023 2023","author":"K Busch","year":"2023","unstructured":"Busch, K., Rochlitzer, A., Sola, D., Leopold, H.: Just tell me: prompt engineering in business process management. In: van der Aa, H., Bork, D., Proper, H.A., Schmidt, R. (eds.) BPMDS EMMSAD 2023 2023. LNBIP, vol. 479, pp. 3\u201311. Springer, Cham (2023). https:\/\/doi.org\/10.1007\/978-3-031-34241-7_1"},{"issue":"1","key":"23_CR4","doi-asserted-by":"publisher","first-page":"103111","DOI":"10.1016\/j.ipm.2022.103111","volume":"60","author":"E Cambria","year":"2023","unstructured":"Cambria, E., Malandri, L., Mercorio, F., Mezzanzanica, M., Nobani, N.: A survey on XAI and natural language explanations. Inf. Process. Manag. 60(1), 103111 (2023)","journal-title":"Inf. Process. Manag."},{"key":"23_CR5","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1007\/978-3-030-85616-8_36","volume-title":"Human-Computer Interaction \u2013 INTERACT 2021","author":"M Chromik","year":"2021","unstructured":"Chromik, M., Butz, A.: Human-XAI interaction: a review and design principles for explanation user interfaces. In: Ardito, C., et al. (eds.) INTERACT 2021. LNCS, vol. 12933, pp. 619\u2013640. Springer, Cham (2021). https:\/\/doi.org\/10.1007\/978-3-030-85616-8_36"},{"key":"23_CR6","unstructured":"Dees, M., de\u00a0Leoni, M., van\u00a0der Aalst, W.M.P., Reijers, H.A.: What if process predictions are not followed by good recommendations? In: BPM (Industry Forum). CEUR Workshop Proceedings, vol.\u00a02428, pp. 61\u201372. CEUR-WS.org (2019)"},{"key":"23_CR7","unstructured":"Fahland, D., Fournier, F., Limonad, L., Skarbovsky, I., Swevels, A.J.E.: How well can large language models explain business processes? CoRR abs\/2401.12846 (2024)"},{"issue":"2","key":"23_CR8","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1007\/s10115-021-01633-w","volume":"64","author":"SA Fahrenkrog-Petersen","year":"2022","unstructured":"Fahrenkrog-Petersen, S.A., et al.: Fire now, fire later: alarm-based systems for prescriptive process monitoring. Knowl. Inf. Syst. 64(2), 559\u2013587 (2022)","journal-title":"Knowl. Inf. Syst."},{"key":"23_CR9","unstructured":"Feldhus, N., Ravichandran, A.M., M\u00f6ller, S.: Mediators: conversational agents explaining NLP model behavior. CoRR abs\/2206.06029 (2022)"},{"key":"23_CR10","doi-asserted-by":"crossref","unstructured":"Feuerriegel, S., Hartmann, J., Janiesch, C., Zschech, P.: Generative AI. Bus. Inf. Syst. Eng. (2023)","DOI":"10.2139\/ssrn.4443189"},{"key":"23_CR11","doi-asserted-by":"publisher","first-page":"105904","DOI":"10.1016\/j.engappai.2023.105904","volume":"120","author":"R Galanti","year":"2023","unstructured":"Galanti, R., et al.: An explainable decision support system for predictive process analytics. Eng. Appl. Artif. Intell. 120, 105904 (2023)","journal-title":"Eng. Appl. Artif. Intell."},{"key":"23_CR12","series-title":"LNBIP","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1007\/978-3-031-50974-2_34","volume-title":"BPM 2023","author":"M Grohs","year":"2023","unstructured":"Grohs, M., Abb, L., Elsayed, N., Rehse, J.: Large language models can accomplish business process management tasks. In: De Weerdt, J., Pufahl, L. (eds.) BPM 2023. LNBIP, vol. 492, pp. 453\u2013465. Springer, Cham (2023). https:\/\/doi.org\/10.1007\/978-3-031-50974-2_34"},{"key":"23_CR13","doi-asserted-by":"crossref","unstructured":"Hoffman, R.R., Mueller, S.T., Klein, G., Litman, J.: Measures for explainable AI: explanation goodness, user satisfaction, mental models, curiosity, trust, and human-ai performance. Front. Comput. Sci. 5 (2023)","DOI":"10.3389\/fcomp.2023.1096257"},{"key":"23_CR14","doi-asserted-by":"crossref","unstructured":"Holtzblatt, K.: Contextual design. In: The Human-computer Interaction Handbook, pp. 975\u2013990. CRC press (2007)","DOI":"10.1201\/9781410615862-63"},{"key":"23_CR15","doi-asserted-by":"crossref","unstructured":"Hsieh, C., Moreira, C., Ouyang, C.: Dice4el: interpreting process predictions using a milestone-aware counterfactual approach. In: ICPM, pp. 88\u201395. IEEE (2021)","DOI":"10.1109\/ICPM53251.2021.9576881"},{"key":"23_CR16","unstructured":"Jessen, U., Sroka, M., Fahland, D.: Chit-chat or deep talk: prompt engineering for process mining. CoRR abs\/2307.09909 (2023)"},{"key":"23_CR17","doi-asserted-by":"crossref","unstructured":"Ji, Z., Yu, T., Xu, Y., Lee, N., Ishii, E., Fung, P.: Towards mitigating LLM hallucination via self reflection. In: Bouamor, H., Pino, J., Bali, K. (eds.) Findings of the Association for Computational Linguistics: EMNLP 2023, pp. 1827\u20131843. ACL, Singapore (2023)","DOI":"10.18653\/v1\/2023.findings-emnlp.123"},{"key":"23_CR18","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1007\/978-3-030-91431-8_2","volume-title":"Service-Oriented Computing","author":"A Khan","year":"2021","unstructured":"Khan, A., et al.: DeepProcess: supporting business process execution using a MANN-based recommender system. In: Hacid, H., Kao, O., Mecella, M., Moha, N., Paik, H. (eds.) ICSOC 2021. LNCS, vol. 13121, pp. 19\u201333. Springer, Cham (2021). https:\/\/doi.org\/10.1007\/978-3-030-91431-8_2"},{"key":"23_CR19","series-title":"LNBIP","doi-asserted-by":"publisher","first-page":"319","DOI":"10.1007\/978-3-031-41623-1_19","volume-title":"BPM 2023","author":"N Klievtsova","year":"2023","unstructured":"Klievtsova, N., Benzin, J., Kampik, T., Mangler, J., Rinderle-Ma, S.: Conversational process modelling: state of the art, applications, and implications in practice. In: Di Francescomarino, C., Burattin, A., Janiesch, C., Sadiq, S. (eds.) BPM 2023. LNBIP, vol. 490, pp. 319\u2013336. Springer, Cham (2023). https:\/\/doi.org\/10.1007\/978-3-031-41623-1_19"},{"key":"23_CR20","doi-asserted-by":"publisher","first-page":"e1097","DOI":"10.7717\/peerj-cs.1097","volume":"8","author":"K Kubrak","year":"2022","unstructured":"Kubrak, K., Milani, F., Nolte, A., Dumas, M.: Prescriptive process monitoring: quo vadis? PeerJ Comput. Sci. 8, e1097 (2022)","journal-title":"PeerJ Comput. Sci."},{"issue":"7","key":"23_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1108\/INTR-08-2021-0600","volume":"32","author":"S Laato","year":"2022","unstructured":"Laato, S., Tiainen, M., Islam, A.K.M.N., M\u00e4ntym\u00e4ki, M.: How to explain AI systems to end users: a systematic literature review and research agenda. Internet Res. 32(7), 1\u201331 (2022)","journal-title":"Internet Res."},{"key":"23_CR22","doi-asserted-by":"crossref","unstructured":"Lee, Y., Kim, T.S., Kim, S., Yun, Y., Kim, J.: DAPIE: interactive step-by-step explanatory dialogues to answer children\u2019s why and how questions. In: CHI, pp. 450:1\u2013450:22. ACM (2023)","DOI":"10.1145\/3544548.3581369"},{"key":"23_CR23","doi-asserted-by":"crossref","unstructured":"Liao, Q.V., Gruen, D.M., Miller, S.: Questioning the AI: informing design practices for explainable AI user experiences. In: CHI, pp. 1\u201315. ACM (2020)","DOI":"10.1145\/3313831.3376590"},{"key":"23_CR24","unstructured":"Liao, Q.V., Varshney, K.R.: Human-centered explainable AI (XAI): from algorithms to user experiences. CoRR abs\/2110.10790 (2021)"},{"key":"23_CR25","series-title":"LNBIP","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1007\/978-3-031-05760-1_16","volume-title":"RCIS 2022","author":"F Milani","year":"2022","unstructured":"Milani, F., Lashkevich, K., Maggi, F.M., Francescomarino, C.D.: Process mining: a guide for practitioners. In: Guizzardi, R., Ralyt\u00e9, J., Franch, X. (eds.) RCIS 2022. LNBIP, vol. 446, pp. 265\u2013282. Springer, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-031-05760-1_16"},{"key":"23_CR26","doi-asserted-by":"crossref","unstructured":"Mohseni, S., Zarei, N., Ragan, E.D.: A multidisciplinary survey and framework for design and evaluation of explainable AI systems. ACM Trans. Interact. Intell. Syst. 11(3\u20134), 24:1\u201324:45 (2021)","DOI":"10.1145\/3387166"},{"key":"23_CR27","doi-asserted-by":"crossref","unstructured":"Nauta, M., et al.: From anecdotal evidence to quantitative evaluation methods: a systematic review on evaluating explainable AI. ACM Comp. Surv. 55(13s), 295:1\u2013295:42 (2023)","DOI":"10.1145\/3583558"},{"key":"23_CR28","doi-asserted-by":"crossref","unstructured":"Padella, A., de\u00a0Leoni, M., Dogan, O., Galanti, R.: Explainable process prescriptive analytics. In: ICPM, pp. 16\u201323. IEEE (2022)","DOI":"10.1109\/ICPM57379.2022.9980535"},{"issue":"3","key":"23_CR29","doi-asserted-by":"publisher","first-page":"45","DOI":"10.2753\/MIS0742-1222240302","volume":"24","author":"K Peffers","year":"2008","unstructured":"Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A design science research methodology for information systems research. J. Manage. Inf. Syst. 24(3), 45\u201377 (2008)","journal-title":"J. Manage. Inf. Syst."},{"key":"23_CR30","unstructured":"Rizzi, W., et al.: Explainable predictive process monitoring: a user evaluation. CoRR abs\/2202.07760 (2022)"},{"key":"23_CR31","doi-asserted-by":"crossref","unstructured":"Seo, W., Yang, C., Kim, Y.: Chacha: leveraging large language models to prompt children to share their emotions about personal events. CoRR abs\/2309.12244 (2023)","DOI":"10.1145\/3613904.3642152"},{"key":"23_CR32","unstructured":"Wei, J., Kim, S., Jung, H., Kim, Y.: Leveraging large language models to power chatbots for collecting user self-reported data. CoRR abs\/2301.05843 (2023)"},{"key":"23_CR33","doi-asserted-by":"publisher","first-page":"1488","DOI":"10.3758\/s13423-017-1258-z","volume":"24","author":"JC Zemla","year":"2017","unstructured":"Zemla, J.C., Sloman, S., Bechlivanidis, C., Lagnado, D.A.: Evaluating everyday explanations. Psychon. Bull. Rev. 24, 1488\u20131500 (2017)","journal-title":"Psychon. Bull. Rev."}],"container-title":["Lecture Notes in Computer Science","Business Process Management"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-70396-6_23","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,1]],"date-time":"2024-09-01T10:16:21Z","timestamp":1725185781000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-70396-6_23"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"ISBN":["9783031703959","9783031703966"],"references-count":33,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-70396-6_23","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024]]},"assertion":[{"value":"2 September 2024","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"BPM","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Business Process Management","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Krakow","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Poland","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"1 September 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"6 September 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"22","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"bpm2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/bpm2024.agh.edu.pl\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}