{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T10:26:20Z","timestamp":1777890380109,"version":"3.51.4"},"reference-count":71,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2020,9,11]],"date-time":"2020-09-11T00:00:00Z","timestamp":1599782400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2020,12,31]]},"abstract":"<jats:p>There is a growing need for empirical benchmarks that support researchers and practitioners in selecting the best machine learning technique for given prediction tasks. In this article, we consider the next event prediction task in business process predictive monitoring, and we extend our previously published benchmark by studying the impact on the performance of different encoding windows and of using ensemble schemes. The choice of whether to use ensembles and which scheme to use often depends on the type of data and classification task. While there is a general understanding that ensembles perform well in predictive monitoring of business processes, next event prediction is a task for which no other benchmarks involving ensembles are available. The proposed benchmark helps researchers to select a high-performing individual classifier or ensemble scheme given the variability at the case level of the event log under consideration. Experimental results show that choosing an optimal number of events for feature encoding is challenging, resulting in the need to consider each event log individually when selecting an optimal value. Ensemble schemes improve the performance of low-performing classifiers in this task, such as SVM, whereas high-performing classifiers, such as tree-based classifiers, are not better off when ensemble schemes are considered.<\/jats:p>","DOI":"10.1145\/3406541","type":"journal-article","created":{"date-parts":[[2020,9,12]],"date-time":"2020-09-12T19:46:24Z","timestamp":1599939984000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["An Empirical Investigation of Different Classifiers, Encoding, and Ensemble Schemes for Next Event Prediction Using Business Process Event Logs"],"prefix":"10.1145","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1821-6438","authenticated-orcid":false,"given":"Bayu Adhi","family":"Tama","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, Pohang University of Science and Technology (POSTECH)"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6944-4705","authenticated-orcid":false,"given":"Marco","family":"Comuzzi","sequence":"additional","affiliation":[{"name":"School of Management Engineering, Ulsan National Institute of Science and Technology (UNIST)"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonghyeon","family":"Ko","sequence":"additional","affiliation":[{"name":"School of Management Engineering, Ulsan National Institute of Science and Technology (UNIST)"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,9,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2016.12.020"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2013.12.003"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1002\/int.10143"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00153759"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1080\/00031305.1992.10475879","article-title":"An introduction to kernel and nearest-neighbor nonparametric regression","volume":"46","author":"Altman Naomi S.","year":"1992","journal-title":"Am. Stat."},{"key":"e_1_2_1_6_1","volume-title":"Jan Mendling, and Mathias Weske.","author":"Baier Thomas","year":"2015"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00058655"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010933404324"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the International Conference on Business Process Management. Springer, Cham, 541--553","author":"Breuker Dominic","year":"2014"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10172-9_31"},{"key":"e_1_2_1_11_1","first-page":"5","article-title":"Predictive business operations management","volume":"2","author":"Castellanos Malu","year":"2006","journal-title":"Int. J. Comput. Sci. Eng."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1961189.1961199"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-377-6.50023-2"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2014.10.006"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994110"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2015.07.003"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.is.2018.01.003"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2016.2645153"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-98648-7_27"},{"key":"e_1_2_1_22_1","volume-title":"Stork","author":"Duda Richard O.","year":"2000"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2017.04.003"},{"key":"e_1_2_1_24_1","volume-title":"LIBLINEAR: A library for large linear classification. J. Mach. Learn. Res. 9 (August","author":"Fan Rong-En","year":"2008"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015363"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1006\/jcss.1997.1504"},{"key":"e_1_2_1_27_1","volume-title":"The Elements of Statistical Learning","author":"Friedman Jerome"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1937.10503522"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177731944"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings of the Florida Artificial Intelligence Research Society Conference (FLAIRS\u201908)","volume":"2118","author":"Mark"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.709601"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1022631118932"},{"key":"e_1_2_1_34_1","unstructured":"Chih-Wei Hsu Chih-Chung Chang and Chih-Jen Lin. 2003. A practical guide to support vector classification. Available at http:\/\/ntucsu.csie.ntu.edu.tw\/~cjlin\/papers\/guide\/guide.pdf. Chih-Wei Hsu Chih-Chung Chang and Chih-Jen Lin. 2003. A practical guide to support vector classification. Available at http:\/\/ntucsu.csie.ntu.edu.tw\/~cjlin\/papers\/guide\/guide.pdf."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-1-55860-247-2.50035-8"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the 11th Conference on Uncertainty in Artificial Intelligence. Morgan Kaufmann","author":"George"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1108\/02635571211193617"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-92901-9_15"},{"key":"e_1_2_1_39_1","volume-title":"Combining Pattern Classifiers: Methods and Algorithms","author":"Kuncheva Ludmila I.","edition":"2"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10619-013-7125-7"},{"key":"e_1_2_1_41_1","volume-title":"Proceedings of the Service-oriented Computing Workshops (ICSOC\/ServiceWave\u201909)","author":"Leitner Philipp","year":"2009"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-23063-4_21"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2015.08.050"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07881-6_31"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.02.092"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSC.2017.2772256"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.05.069"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/CBI.2017.46"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-018-5733-1"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the 7th Conference of the Cognitive Science Society","author":"Pearl Judea","year":"1985"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00607-018-0593-x"},{"key":"e_1_2_1_52_1","volume-title":"Programs for Machine Learning. Morgan Kaufmann","author":"Quinlan J. Ross"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/77.3.663"},{"key":"e_1_2_1_54_1","volume-title":"Enterprise, Business-Process and Information Systems Modeling","author":"Santoso Ario"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2016.06.012"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2001.1463065"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.04.016"},{"key":"e_1_2_1_58_1","first-page":"1203","article-title":"A detailed analysis of classifier ensembles for intrusion detection in wireless network","volume":"13","author":"Tama Bayu Adhi","year":"2017","journal-title":"J. Inf. Process. Syst."},{"key":"e_1_2_1_59_1","first-page":"149","article-title":"An extensive empirical evaluation of classifier ensembles for intrusion detection task","volume":"32","author":"Tama Bayu Adhi","year":"2017","journal-title":"Comput. Syst. Sci. Eng."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-017-9565-3"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-59536-8_30"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-45348-4_23"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301300"},{"key":"e_1_2_1_64_1","volume-title":"Proceedings of the 14th International Conference on Machine Learning. Morgan Kaufmann","author":"Ting Kai Ming"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10115-015-0842-7"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-39696-5_12"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331449"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2010.06.048"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.585893"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2013.07.054"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89652-4_14"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3406541","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3406541","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:01:35Z","timestamp":1750197695000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3406541"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,11]]},"references-count":71,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,12,31]]}},"alternative-id":["10.1145\/3406541"],"URL":"https:\/\/doi.org\/10.1145\/3406541","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,11]]},"assertion":[{"value":"2020-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-06-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}