{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,19]],"date-time":"2025-10-19T16:41:10Z","timestamp":1760892070358,"version":"build-2065373602"},"publisher-location":"Cham","reference-count":33,"publisher":"Springer Nature Switzerland","isbn-type":[{"type":"print","value":"9783031822247"},{"type":"electronic","value":"9783031822254"}],"license":[{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,3,28]],"date-time":"2025-03-28T00:00:00Z","timestamp":1743120000000},"content-version":"vor","delay-in-days":86,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>The accurate prediction of service process performance, particularly in IT service management (ITSM), is critical for adhering to service-level agreements and avoiding associated penalties. However, existing predictive process monitoring solutions, predominantly based on recurrent neural networks, have been found to be inadequate in handling ITSM processes. Notably, the heterogeneity in process artifacts and environments impairs process predictions. This research proposes a novel transformer-based architecture to effectively handle IT service process event logs. By integrating advanced positional encoding techniques and distinguishing between static and dynamic attributes, a novel transformer architecture is evaluated using multiple publicly available ITSM event logs. This architecture demonstrates its potential to deliver more accurate predictions than LSTM models in terms of remaining time predictions. This work provides experimental results into the application of transformer architectures for predictive process monitoring, paving the way for enhanced efficiency in ITSM.<\/jats:p>","DOI":"10.1007\/978-3-031-82225-4_16","type":"book-chapter","created":{"date-parts":[[2025,3,30]],"date-time":"2025-03-30T03:02:32Z","timestamp":1743303752000},"page":"214-226","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Towards Accurate Predictions in ITSM: A Study on Transformer-Based Predictive Process Monitoring"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-6185-2623","authenticated-orcid":false,"given":"Marc C.","family":"Hennig","sequence":"first","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,3,28]]},"reference":[{"key":"16_CR1","doi-asserted-by":"publisher","first-page":"13","DOI":"10.2753\/mis0742-1222260402","volume":"26","author":"IR Bardhan","year":"2010","unstructured":"Bardhan, I.R., Demirkan, H., Kannan, P.K., Kauffman, R.J., Sougstad, R.: An interdisciplinary perspective on it services management and service science. JMIS. 26, 13\u201364 (2010). https:\/\/doi.org\/10.2753\/mis0742-1222260402","journal-title":"JMIS."},{"key":"16_CR2","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1109\/tsc.2021.3139807","volume":"16","author":"E Rama-Maneiro","year":"2022","unstructured":"Rama-Maneiro, E., Vidal, J., Lama, M.: Deep learning for predictive business process monitoring: review and benchmark. IEEE Trans. Serv. Comput. 16, 739\u2013756 (2022). https:\/\/doi.org\/10.1109\/tsc.2021.3139807","journal-title":"IEEE Trans. Serv. Comput."},{"key":"16_CR3","doi-asserted-by":"crossref","unstructured":"Loewenstern, D., Shwartz, L.: IT Service management of using heterogeneous, dynamically alterable configuration item lifecycles. In: Cordeiro, J. and Filipe, J. (eds.) 10th International Conference on Enterprise Information Systems, pp. 155\u2013160. Barcelona, (2008)","DOI":"10.5220\/0001718401550160"},{"key":"16_CR4","doi-asserted-by":"publisher","first-page":"11496","DOI":"10.3390\/su132011496","volume":"13","author":"H Mao","year":"2021","unstructured":"Mao, H., Zhang, T., Tang, Q.: Research framework for determining how artificial intelligence enables information technology service management for business model resilience. Sustainability. 13, 11496 (2021). https:\/\/doi.org\/10.3390\/su132011496","journal-title":"Sustainability."},{"key":"16_CR5","unstructured":"Vaswani, A., et al.: Attention is all you need. In: Guyon, I., Luxburg, U. von, Bengio, S., Wallach, H.M., Fergus, R., Vishwanathan, S.V.N., and Garnett, R. (eds.) Advances in Neural Information Processing Systems, pp. 5998\u20136008. NeurIPS, Long Beach, CA, USA (2017)"},{"key":"16_CR6","doi-asserted-by":"publisher","first-page":"1273","DOI":"10.3390\/electronics12061273","volume":"12","author":"W Ni","year":"2023","unstructured":"Ni, W., Zhao, G., Liu, T., Zeng, Q., Xu, X.: Predictive business process monitoring approach based on hierarchical transformer. Electronics 12, 1273 (2023). https:\/\/doi.org\/10.3390\/electronics12061273","journal-title":"Electronics"},{"key":"16_CR7","doi-asserted-by":"publisher","unstructured":"Johannesson, P., Perjons, E.: An Introduction to Design Science. Springer, Cham, Switzerland (2021). https:\/\/doi.org\/10.1007\/978-3-030-78132-3","DOI":"10.1007\/978-3-030-78132-3"},{"key":"16_CR8","doi-asserted-by":"publisher","unstructured":"Weytjens, H., De Weerdt, J.: Creating unbiased public benchmark datasets with data leakage prevention for predictive process monitoring. In: Marrella, A. and Weber, B. (eds.) Business Process Management Workshops. pp. 18\u201329. Springer, Cham (2022). https:\/\/doi.org\/10.1007\/978-3-030-94343-1_2","DOI":"10.1007\/978-3-030-94343-1_2"},{"key":"16_CR9","doi-asserted-by":"publisher","unstructured":"Tax, N., Verenich, I., La Rosa, M., Dumas, M.: Predictive business process monitoring with LSTM Neural Networks. In: Dubois, E. and Pohl, K. (eds.) Advanced Information Systems Engineering, pp. 477\u2013492. Springer, Essen, Germany (2017). https:\/\/doi.org\/10.1007\/978-3-319-59536-8_30","DOI":"10.1007\/978-3-319-59536-8_30"},{"key":"16_CR10","unstructured":"Bukhsh, Z.A., Saeed, A., Dijkman, R.M.: ProcessTransformer: Predictive Business Process Monitoring with Transformer Network (2021). http:\/\/arxiv.org\/abs\/2104.00721"},{"key":"16_CR11","doi-asserted-by":"publisher","unstructured":"Philipp, P., Jacob, R., Robert, S., Beyerer, J.: Predictive analysis of business processes using neural networks with attention mechanism. In: 2020 International Conference on Artificial Intelligence in Information and Communication, pp. 225\u2013230. IEEE, Fukuoka, Japan (2020). https:\/\/doi.org\/10.1109\/icaiic48513.2020.9065057","DOI":"10.1109\/icaiic48513.2020.9065057"},{"key":"16_CR12","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.109603","volume":"254","author":"H Chen","year":"2022","unstructured":"Chen, H., Fang, X., Fang, H.: Multi-task prediction method of business process based on BERT and Transfer Learning. Knowl. Based Syst. 254, 109603 (2022). https:\/\/doi.org\/10.1016\/j.knosys.2022.109603","journal-title":"Knowl. Based Syst."},{"key":"16_CR13","doi-asserted-by":"publisher","first-page":"864","DOI":"10.3390\/app11020864","volume":"11","author":"J Moon","year":"2021","unstructured":"Moon, J., Park, G., Jeong, J.: POP-ON: prediction of process using one-way language model based on NLP approach. Appl. Sci. 11, 864 (2021). https:\/\/doi.org\/10.3390\/app11020864","journal-title":"Appl. Sci."},{"key":"16_CR14","doi-asserted-by":"publisher","unstructured":"Wang, J., Yu, D., Liu, C., Sun, X.: Outcome-oriented predictive process monitoring with attention-based bidirectional LSTM neural networks. In: 13th International Conference on Web Services. pp. 360\u2013367. IEEE, Milan (2019). https:\/\/doi.org\/10.1109\/icws.2019.00065","DOI":"10.1109\/icws.2019.00065"},{"key":"16_CR15","doi-asserted-by":"publisher","unstructured":"Jalayer, A., Kahani, M., Beheshti, A., Pourmasoumi, A., Motahari-Nezhad, H.R.: Attention mechanism in predictive business process monitoring. In: 24th International Enterprise Distributed Object Computing Conference, pp. 181\u2013186. IEEE, Eindhoven, Netherlands (2020). https:\/\/doi.org\/10.1109\/edoc49727.2020.00030","DOI":"10.1109\/edoc49727.2020.00030"},{"key":"16_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.107722","volume":"236","author":"A Jalayer","year":"2022","unstructured":"Jalayer, A., Kahani, M., Pourmasoumi, A., Beheshti, A.: HAM-Net: predictive business process monitoring with a hierarchical attention mechanism. Knowl. Based Syst. 236, 107722 (2022). https:\/\/doi.org\/10.1016\/j.knosys.2021.107722","journal-title":"Knowl. Based Syst."},{"key":"16_CR17","doi-asserted-by":"publisher","unstructured":"Rivera-Lazo, G., \u00d1anculef, R.: Multi-attribute transformers for sequence prediction in business process management. In: Pascal, P. and Ienco, D. (eds.) Discovery Science. pp. 184\u2013194. Springer, Montpellier (2022). https:\/\/doi.org\/10.1007\/978-3-031-18840-4_14","DOI":"10.1007\/978-3-031-18840-4_14"},{"key":"16_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2022.108773","volume":"248","author":"B Wickramanayake","year":"2022","unstructured":"Wickramanayake, B., He, Z., Ouyang, C., Moreira, C., Xu, Y., Sindhgatta, R.: Building interpretable models for business process prediction using shared and specialised attention mechanisms. Knowl. Based Syst. 248, 108773 (2022). https:\/\/doi.org\/10.1016\/j.knosys.2022.108773","journal-title":"Knowl. Based Syst."},{"key":"16_CR19","doi-asserted-by":"crossref","unstructured":"Irwin, C., Dossena, M., Leonardi, G., Montani, S.: Structural positional encoding for knowledge integration in transformer-based medical process monitoring. In: Calimeri, F., Dragoni, M., and Stella, F. (eds.) 2nd AIxIA Workshop on Artificial Intelligence for Healthcare, pp. 18\u201330. CEUR, Rome, Italy (2023)","DOI":"10.1007\/s13748-024-00356-7"},{"key":"16_CR20","doi-asserted-by":"publisher","first-page":"76722","DOI":"10.1109\/access.2023.3298305","volume":"11","author":"J Wang","year":"2023","unstructured":"Wang, J., Huang, J., Ma, X., Li, Z., Wang, Y., Yu, D.: MTLFormer: multi-task learning guided transformer network for business process prediction. IEEE Access 11, 76722\u201376738 (2023). https:\/\/doi.org\/10.1109\/access.2023.3298305","journal-title":"IEEE Access"},{"key":"16_CR21","doi-asserted-by":"publisher","unstructured":"Amiri Elyasi, K., van der Aa, H., Stuckenschmidt, H.: PGTNet: a process graph transformer network for remaining time prediction of business process instances. In: Guizzardi, G., Santoro, F., Mouratidis, H., and Soffer, P. (eds.) Advanced Information Systems Engineering, pp. 124\u2013140. Springer, Cham (2024). https:\/\/doi.org\/10.1007\/978-3-031-61057-8_8","DOI":"10.1007\/978-3-031-61057-8_8"},{"key":"16_CR22","doi-asserted-by":"publisher","unstructured":"Brunk, J.: Structuring business process context information for process monitoring and prediction. In: 22nd Conference on Business Informatics, pp. 39\u201348. IEEE, Antwerp, Belgium (2020). https:\/\/doi.org\/10.1109\/cbi49978.2020.00012","DOI":"10.1109\/cbi49978.2020.00012"},{"key":"16_CR23","unstructured":"Lim, B., Arik, S.O., Loeff, N., Pfister, T.: Temporal fusion transformers for interpretable multi-horizon time series forecasting (2020). http:\/\/arxiv.org\/abs\/1912.09363"},{"key":"16_CR24","doi-asserted-by":"publisher","unstructured":"Wen, Q., et al.: Transformers in time series: a survey. In: Elkind, E. (ed.) 32nd International Joint Conference on Artificial Intelligence, pp. 6778\u20136786. Macao, PRC (2023). https:\/\/doi.org\/10.24963\/ijcai.2023\/759","DOI":"10.24963\/ijcai.2023\/759"},{"key":"16_CR25","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2023.127063","volume":"568","author":"J Su","year":"2024","unstructured":"Su, J., Ahmed, M., Lu, Y., Pan, S., Bo, W., Liu, Y.: RoFormer: enhanced transformer with rotary Position Embedding. Neurocomputing 568, 127063 (2024). https:\/\/doi.org\/10.1016\/j.neucom.2023.127063","journal-title":"Neurocomputing"},{"key":"16_CR26","unstructured":"Shazeer, N.: GLU Variants Improve Transformer (2020). http:\/\/arxiv.org\/abs\/2002.05202"},{"key":"16_CR27","doi-asserted-by":"crossref","unstructured":"Misra, D.: Mish: a self regularized non-monotonic activation function. In: 31st British Machine Vision Virtual Conference. Virtual (2020)","DOI":"10.5244\/C.34.191"},{"key":"16_CR28","doi-asserted-by":"publisher","unstructured":"Amaral, C., Fantinato, M., Peres, S.: Incident management process enriched event log, (2018). https:\/\/doi.org\/10.24432\/c57s4h","DOI":"10.24432\/c57s4h"},{"key":"16_CR29","doi-asserted-by":"publisher","unstructured":"Polato, M.: Dataset belonging to the help desk log of an Italian Company (2017).https:\/\/doi.org\/10.4121\/uuid:0c60edf1-6f83-4e75-9367-4c63b3e9d5bb","DOI":"10.4121\/uuid:0c60edf1-6f83-4e75-9367-4c63b3e9d5bb"},{"key":"16_CR30","doi-asserted-by":"publisher","unstructured":"Verenich, I.: Helpdesk (2016). https:\/\/doi.org\/10.17632\/39bp3vv62t.1","DOI":"10.17632\/39bp3vv62t.1"},{"key":"16_CR31","doi-asserted-by":"publisher","unstructured":"van Dongen, B.F.: BPI Challenge 2014 (2014). https:\/\/doi.org\/10.4121\/uuid:c3e5d162-0cfd-4bb0-bd82-af5268819c35","DOI":"10.4121\/uuid:c3e5d162-0cfd-4bb0-bd82-af5268819c35"},{"key":"16_CR32","doi-asserted-by":"publisher","unstructured":"Steeman, W.: BPI Challenge 2013 (2013). https:\/\/doi.org\/10.4121\/uuid:a7ce5c55-03a7-4583-b855-98b86e1a2b07","DOI":"10.4121\/uuid:a7ce5c55-03a7-4583-b855-98b86e1a2b07"},{"key":"16_CR33","unstructured":"Jadon, A., Patil, A., Jadon, S.: A comprehensive survey of regression based loss functions for time series forecasting (2022). http:\/\/arxiv.org\/abs\/2211.02989"}],"container-title":["Lecture Notes in Business Information Processing","Process Mining Workshops"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-031-82225-4_16","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,19]],"date-time":"2025-10-19T16:04:07Z","timestamp":1760889847000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-031-82225-4_16"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"ISBN":["9783031822247","9783031822254"],"references-count":33,"URL":"https:\/\/doi.org\/10.1007\/978-3-031-82225-4_16","relation":{},"ISSN":["1865-1348","1865-1356"],"issn-type":[{"type":"print","value":"1865-1348"},{"type":"electronic","value":"1865-1356"}],"subject":[],"published":{"date-parts":[[2025]]},"assertion":[{"value":"28 March 2025","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ICPM","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Process Mining","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Lyngby","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Denmark","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2024","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"14 October 2024","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"18 October 2024","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"6","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"icpm2024","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/icpmconference.org\/2024\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}}]}}