{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,3,28]],"date-time":"2025-03-28T03:16:20Z","timestamp":1743131780245,"version":"3.40.3"},"publisher-location":"Cham","reference-count":23,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783030985806"},{"type":"electronic","value":"9783030985813"}],"license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,3,24]],"date-time":"2022-03-24T00:00:00Z","timestamp":1648080000000},"content-version":"vor","delay-in-days":82,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Process mining algorithms discover a process model from an event log. The resulting process model is supposed to describe all possible event sequences of the underlying system. Generalization is a process model quality dimension of interest. A generalization metric should quantify the extent to which a process model represents the observed event sequences contained in the event log and the unobserved event sequences of the system. Most of the available metrics in the literature cannot properly quantify the generalization of a process model. A recently published method called Adversarial System Variant Approximation leverages Generative Adversarial Networks to approximate the underlying event sequence distribution of a system from an event log. While this method demonstrated performance gains over existing methods in measuring the generalization of process models, its experimental evaluations have been performed under ideal conditions. This paper experimentally investigates the performance of Adversarial System Variant Approximation under non-ideal conditions such as biased and limited event logs. Moreover, experiments are performed to investigate the originally proposed sampling parameter value of the method on its performance to measure the generalization. The results confirm the need to raise awareness about the working conditions of the Adversarial System Variant Approximation method and serve to initiate future research directions.<\/jats:p>","DOI":"10.1007\/978-3-030-98581-3_21","type":"book-chapter","created":{"date-parts":[[2022,3,23]],"date-time":"2022-03-23T18:03:23Z","timestamp":1648058603000},"page":"281-293","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["On the Performance Analysis of the Adversarial System Variant Approximation Method to Quantify Process Model Generalization"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0954-0938","authenticated-orcid":false,"given":"Julian","family":"Theis","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3043-6775","authenticated-orcid":false,"given":"Ilia","family":"Mokhtarian","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7881-6542","authenticated-orcid":false,"given":"Houshang","family":"Darabi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,3,24]]},"reference":[{"issue":"2","key":"21_CR1","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1002\/widm.1045","volume":"2","author":"W van der Aalst","year":"2012","unstructured":"van der Aalst, W., Adriansyah, A., van Dongen, B.: Replaying history on process models for conformance checking and performance analysis. Wiley Interdisc. Rev. Data Mining Knowl. Disc. 2(2), 182\u2013192 (2012). https:\/\/doi.org\/10.1002\/widm.1045","journal-title":"Wiley Interdisc. Rev. Data Mining Knowl. Disc."},{"issue":"5","key":"21_CR2","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1016\/j.is.2006.05.003","volume":"32","author":"WM van der Aalst","year":"2007","unstructured":"van der Aalst, W.M., et al.: Business process mining: an industrial application. Inf. Syst. 32(5), 713\u2013732 (2007)","journal-title":"Inf. Syst."},{"key":"21_CR3","unstructured":"Arora, S., Ge, R., Liang, Y., Ma, T., Zhang, Y.: Generalization and equilibrium in generative adversarial nets (GANs). In: Proceedings of the 34th International Conference on Machine Learning, vol. 70, pp. 224\u2013232. JMLR. org (2017)"},{"issue":"2","key":"21_CR4","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1007\/s10115-018-1214-x","volume":"59","author":"A Augusto","year":"2018","unstructured":"Augusto, A., Conforti, R., Dumas, M., La Rosa, M., Polyvyanyy, A.: Split miner: automated discovery of accurate and simple business process models from event logs. Knowl. Inf. Syst. 59(2), 251\u2013284 (2018). https:\/\/doi.org\/10.1007\/s10115-018-1214-x","journal-title":"Knowl. Inf. Syst."},{"key":"21_CR5","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1016\/j.dss.2017.04.005","volume":"100","author":"SK vanden Broucke","year":"2017","unstructured":"vanden Broucke, S.K., De Weerdt, J.: Fodina: a robust and flexible heuristic process discovery technique. Decis. Support. Syst. 100, 109\u2013118 (2017)","journal-title":"Decis. Support. Syst."},{"issue":"8","key":"21_CR6","doi-asserted-by":"publisher","first-page":"1877","DOI":"10.1109\/TKDE.2013.130","volume":"26","author":"SK vanden Broucke","year":"2013","unstructured":"vanden Broucke, S.K., De Weerdt, J., Vanthienen, J., Baesens, B.: Determining process model precision and generalization with weighted artificial negative events. IEEE Trans. Knowl. Data. Eng. 26(8), 1877\u20131889 (2013)","journal-title":"IEEE Trans. Knowl. Data. Eng."},{"issue":"1","key":"21_CR7","doi-asserted-by":"publisher","first-page":"1440001","DOI":"10.1142\/S0218843014400012","volume":"23","author":"JC Buijs","year":"2014","unstructured":"Buijs, J.C., Van Dongen, B.F., Van Der Aalst, W.M.: Quality dimensions in process discovery: the importance of fitness, precision, generalization and simplicity. Int. J. Cooper. Inf. Syst. 23(1), 1440001 (2014). https:\/\/doi.org\/10.1142\/S0218843014400012","journal-title":"Int. J. Cooper. Inf. Syst."},{"key":"21_CR8","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1007\/978-3-642-33606-5_19","volume-title":"On the Move to Meaningful Internet Systems: OTM 2012","author":"JCAM Buijs","year":"2012","unstructured":"Buijs, J.C.A.M., van Dongen, B.F., van der Aalst, W.M.P.: On the role of fitness, precision, generalization and simplicity in process discovery. In: Meersman, R., et al. (eds.) OTM 2012. LNCS, vol. 7565, pp. 305\u2013322. Springer, Heidelberg (2012). https:\/\/doi.org\/10.1007\/978-3-642-33606-5_19"},{"key":"21_CR9","doi-asserted-by":"publisher","unstructured":"Darabi, H., Galanter, W.L., Lin, J.Y., Buy, U., Sampath, R.: Modeling and integration of hospital information systems with Petri nets. In: 2009 IEEE\/INFORMS International Conference on Service Operations, Logistics and Informatics, pp. 190\u2013195, July 2009. https:\/\/doi.org\/10.1109\/SOLI.2009.5203928","DOI":"10.1109\/SOLI.2009.5203928"},{"key":"21_CR10","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1007\/978-3-319-45348-4_3","volume-title":"Business Process Management","author":"BF van Dongen","year":"2016","unstructured":"van Dongen, B.F., Carmona, J., Chatain, T.: A unified approach for measuring precision and generalization based on anti-alignments. In: La Rosa, M., Loos, P., Pastor, O. (eds.) BPM 2016. LNCS, vol. 9850, pp. 39\u201356. Springer, Cham (2016). https:\/\/doi.org\/10.1007\/978-3-319-45348-4_3"},{"issue":"1","key":"21_CR11","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1504\/IJEH.2016.078745","volume":"9","author":"M Ghasemi","year":"2016","unstructured":"Ghasemi, M., Amyot, D.: Process mining in healthcare: a systematised literature review. Int. J. Electron. Healthcare 9(1), 60\u201388 (2016)","journal-title":"Int. J. Electron. Healthcare"},{"issue":"6","key":"21_CR12","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1007\/s12599-018-0567-8","volume":"61","author":"G Janssenswillen","year":"2018","unstructured":"Janssenswillen, G., Depaire, B.: Towards confirmatory process discovery: making assertions about the underlying system. Bus. Inf. Syst. Eng. 61(6), 713\u2013728 (2018). https:\/\/doi.org\/10.1007\/s12599-018-0567-8","journal-title":"Bus. Inf. Syst. Eng."},{"key":"21_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.is.2017.06.002","volume":"71","author":"G Janssenswillen","year":"2017","unstructured":"Janssenswillen, G., Donders, N., Jouck, T., Depaire, B.: A comparative study of existing quality measures for process discovery. Inf. Syst. 71, 1\u201315 (2017). https:\/\/doi.org\/10.1016\/j.is.2017.06.002","journal-title":"Inf. Syst."},{"issue":"6","key":"21_CR14","doi-asserted-by":"publisher","first-page":"1087","DOI":"10.1063\/1.1699114","volume":"21","author":"N Metropolis","year":"1953","unstructured":"Metropolis, N., Rosenbluth, A.W., Rosenbluth, M.N., Teller, A.H., Teller, E.: Equation of state calculations by fast computing machines. J. Chem. Phys. 21(6), 1087\u20131092 (1953)","journal-title":"J. Chem. Phys."},{"key":"21_CR15","unstructured":"Nie, W., Narodytska, N., Patel, A.: RelGAN: relational generative adversarial networks for text generation. In: International Conference on Learning Representations (2018)"},{"key":"21_CR16","series-title":"Lecture Notes in Business Information Processing","doi-asserted-by":"publisher","first-page":"256","DOI":"10.1007\/978-3-319-74030-0_19","volume-title":"Business Process Management Workshops","author":"J-R Rehse","year":"2018","unstructured":"Rehse, J.-R., Fettke, P., Loos, P.: Process mining and the black swan: an empirical analysis of the influence of unobserved behavior on the quality of mined process models. In: Teniente, E., Weidlich, M. (eds.) BPM 2017. LNBIP, vol. 308, pp. 256\u2013268. Springer, Cham (2018). https:\/\/doi.org\/10.1007\/978-3-319-74030-0_19"},{"issue":"6","key":"21_CR17","doi-asserted-by":"publisher","first-page":"1085","DOI":"10.1007\/s00607-021-00910-4","volume":"103","author":"M Fani\u00a0Sani","year":"2021","unstructured":"Fani\u00a0Sani, M., van\u00a0Zelst, S.J., van\u00a0der\u00a0Aalst, W.M.P.: The impact of biased sampling of event logs on the performance of process discovery. Computing 103(6), 1085\u20131104 (2021). https:\/\/doi.org\/10.1007\/s00607-021-00910-4","journal-title":"Computing"},{"key":"21_CR18","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1007\/978-3-662-60651-3_8","volume-title":"Transactions on Petri Nets and Other Models of Concurrency XIV","author":"AF Syring","year":"2019","unstructured":"Syring, A.F., Tax, N., van der Aalst, W.M.P.: Evaluating conformance measures in process mining using conformance propositions. In: Koutny, M., Pomello, L., Kristensen, L.M. (eds.) Transactions on Petri Nets and Other Models of Concurrency XIV. LNCS, vol. 11790, pp. 192\u2013221. Springer, Heidelberg (2019). https:\/\/doi.org\/10.1007\/978-3-662-60651-3_8"},{"key":"21_CR19","doi-asserted-by":"publisher","unstructured":"Theis, J., Mokhtarian, I., Darabi, H.: Process mining of programmable logic controllers: input\/output event logs. In: 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE), pp. 216\u2013221, August 2019. https:\/\/doi.org\/10.1109\/COASE.2019.8842900","DOI":"10.1109\/COASE.2019.8842900"},{"key":"21_CR20","doi-asserted-by":"publisher","first-page":"194410","DOI":"10.1109\/ACCESS.2020.3033450","volume":"8","author":"J Theis","year":"2020","unstructured":"Theis, J., Darabi, H.: Adversarial system variant approximation to quantify process model generalization. IEEE Access 8, 194410\u2013194427 (2020)","journal-title":"IEEE Access"},{"issue":"1","key":"21_CR21","doi-asserted-by":"publisher","first-page":"388","DOI":"10.1109\/JBHI.2021.3092969","volume":"26","author":"J Theis","year":"2022","unstructured":"Theis, J., Galanter, W., Boyd, A., Darabi, H.: Improving the in-hospital mortality prediction of diabetes ICU patients using a process mining\/deep learning architecture. IEEE J. Biomed. Health Inf. 26(1), 388\u2013399 (2022). https:\/\/doi.org\/10.1109\/JBHI.2021.3092969","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"21_CR22","unstructured":"Turner, R., Hung, J., Frank, E., Saatchi, Y., Yosinski, J.: Metropolis-Hastings Generative Adversarial Networks. In: International Conference on Machine Learning, pp. 6345\u20136353 (2019)"},{"key":"21_CR23","doi-asserted-by":"crossref","unstructured":"Yang, H., Park, M., Cho, M., Song, M., Kim, S.: A system architecture for manufacturing process analysis based on big data and process mining techniques. In: 2014 IEEE International Conference on Big Data (Big Data), pp. 1024\u20131029. IEEE (2014)","DOI":"10.1109\/BigData.2014.7004336"}],"container-title":["Lecture Notes in Business Information Processing","Process Mining Workshops"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-98581-3_21","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,23]],"date-time":"2022-03-23T18:07:05Z","timestamp":1648058825000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-98581-3_21"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"ISBN":["9783030985806","9783030985813"],"references-count":23,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-98581-3_21","relation":{},"ISSN":["1865-1348","1865-1356"],"issn-type":[{"type":"print","value":"1865-1348"},{"type":"electronic","value":"1865-1356"}],"subject":[],"published":{"date-parts":[[2022]]},"assertion":[{"value":"24 March 2022","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"ICPM","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"International Conference on Process Mining","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Eindhoven","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"The Netherlands","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2021","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"31 October 2021","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"4 November 2021","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"3","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"icpm2021a","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"https:\/\/icpmconference.org\/2021\/category\/calls\/workshops\/","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Single-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"EasyChair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"65","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"28","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"43% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"2","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"The proceedings also include one survey paper on the results of the XES 2.9 Workshop.","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}