{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T02:15:34Z","timestamp":1781662534175,"version":"3.54.5"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,3,13]],"date-time":"2019-03-13T00:00:00Z","timestamp":1552435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002301","name":"Estonian Research Council","doi-asserted-by":"crossref","award":["IUT20-55"],"award-info":[{"award-number":["IUT20-55"]}],"id":[{"id":"10.13039\/501100002301","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"crossref","award":["DP150103356"],"award-info":[{"award-number":["DP150103356"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2019,4,30]]},"abstract":"<jats:p>Predictive business process monitoring refers to the act of making predictions about the future state of ongoing cases of a business process, based on their incomplete execution traces and logs of historical (completed) traces. Motivated by the increasingly pervasive availability of fine-grained event data about business process executions, the problem of predictive process monitoring has received substantial attention in the past years. In particular, a considerable number of methods have been put forward to address the problem of outcome-oriented predictive process monitoring, which refers to classifying each ongoing case of a process according to a given set of possible categorical outcomes\u2014e.g., Will the customer complain or not? Will an order be delivered, canceled, or withdrawn? Unfortunately, different authors have used different datasets, experimental settings, evaluation measures, and baselines to assess their proposals, resulting in poor comparability and an unclear picture of the relative merits and applicability of different methods. To address this gap, this article presents a systematic review and taxonomy of outcome-oriented predictive process monitoring methods, and a comparative experimental evaluation of eleven representative methods using a benchmark covering 24\u00a0predictive process monitoring tasks based on nine real-life event logs.<\/jats:p>","DOI":"10.1145\/3301300","type":"journal-article","created":{"date-parts":[[2019,3,14]],"date-time":"2019-03-14T17:11:58Z","timestamp":1552583518000},"page":"1-57","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":309,"title":["Outcome-Oriented Predictive Process Monitoring"],"prefix":"10.1145","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8045-8238","authenticated-orcid":false,"given":"Irene","family":"Teinemaa","sequence":"first","affiliation":[{"name":"University of Tartu, Tartu, Estonia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marlon","family":"Dumas","sequence":"additional","affiliation":[{"name":"University of Tartu, Tartu, Estonia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marcello La","family":"Rosa","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Victoria, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabrizio Maria","family":"Maggi","sequence":"additional","affiliation":[{"name":"University of Tartu, Tartu, Estonia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,3,13]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"James S. Bergstra R\u00e9mi Bardenet Yoshua Bengio and Bal\u00e1zs K\u00e9gl. 2011. Algorithms for hyper-parameter optimization. In NIPS. 2546--255.   James S. Bergstra R\u00e9mi Bardenet Yoshua Bengio and Bal\u00e1zs K\u00e9gl. 2011. Algorithms for hyper-parameter optimization. In NIPS. 2546--255."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31970-2_1"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38709-8_8"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2014.10.006"},{"key":"e_1_2_1_7_1","volume-title":"International Conference on Business Process Management. Springer, 250--266","author":"Leoni Massimiliano De"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2015.07.003"},{"key":"e_1_2_1_9_1","article-title":"Statistical comparisons of classifiers over multiple data sets","author":"Dem\u0161ar Janez","year":"2006","journal-title":"Journal of Machine Learning Research 7"},{"key":"e_1_2_1_10_1","volume-title":"Clustering-based predictive process monitoring","author":"Francescomarino Chiara Di","year":"2017"},{"key":"e_1_2_1_11_1","volume-title":"Jan Mendling, and Hajo A. Reijers.","author":"Dumas Marlon","year":"2018"},{"key":"e_1_2_1_12_1","volume-title":"Business Process Management Workshops. Springer, 327--338","author":"Evermann Joerg","year":"2016"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2697065"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07881-6_36"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1013203451"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-13-195"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2013.19"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/2592306.2592502"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2014.07.056"},{"key":"e_1_2_1_20_1","first-page":"1","article-title":"Procedures for performing systematic reviews. Keele, UK","volume":"33","author":"Kitchenham Barbara","year":"2004","journal-title":"Keele University"},{"key":"e_1_2_1_21_1","volume-title":"International Conference on Business Process Management. Springer, 640--651","author":"Lakshmanan Geetika T.","year":"2010"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-23063-4_21"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-18038-0_16"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2017.2720601"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07881-6_31"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/SRII.2012.42"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.2014.2347265"},{"key":"e_1_2_1_28_1","volume-title":"Proceedings of the Pacific Symposium on Biocomputing, Russ B. Altman, A. Keith Dunker, Lawrence Hunter, Marylyn D. Ritchie, and Teri E. Klein (Eds.). 192\u2013203","author":"Olson Randal S."},{"key":"e_1_2_1_29_1","volume-title":"International Conference on Advanced Information Systems Engineering (CAiSE\u201917)","author":"Ostovar Alireza"},{"key":"e_1_2_1_30_1","volume-title":"International Conference on Conceptual Modeling (ER\u201916)","author":"Ostovar Alireza"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/SFCS.1977.32"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-45005-1_27"},{"key":"e_1_2_1_34_1","volume-title":"A Dashboard-Based Predictive Process Monitoring Engine. Master\u2019s thesis","author":"Rozumnyi Andrii"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1670679.1670680"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38827-9_36"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-38827-9_36"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-65000-5_18"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-59536-8_30"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-45348-4_23"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-49851-4"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10270-008-0106-z"},{"key":"e_1_2_1_43_1","volume-title":"International Symposium on Data-Driven Process Discovery and Analysis. Springer, 60--83","author":"Der Spoel Sjoerd Van","year":"2012"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88871-0_22"},{"key":"e_1_2_1_45_1","volume-title":"International Conference on Business Process Management. Springer, 218--229","author":"Verenich Ilya","year":"2015"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.4018\/jdwm.2010070102"},{"key":"e_1_2_1_47_1","volume-title":"Yu","author":"Xing Zhengzheng","year":"2008"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3301300","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3301300","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:02:04Z","timestamp":1750208524000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3301300"}},"subtitle":["Review and Benchmark"],"short-title":[],"issued":{"date-parts":[[2019,3,13]]},"references-count":47,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,4,30]]}},"alternative-id":["10.1145\/3301300"],"URL":"https:\/\/doi.org\/10.1145\/3301300","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,13]]},"assertion":[{"value":"2017-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}