{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,1]],"date-time":"2026-01-01T09:48:12Z","timestamp":1767260892741,"version":"3.37.3"},"reference-count":55,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T00:00:00Z","timestamp":1635724800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T00:00:00Z","timestamp":1635724800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005713","name":"Technische Universit\u00e4t M\u00fcnchen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005713","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Data Min Knowl Disc"],"published-print":{"date-parts":[[2022,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Many systems can be expressed as multivariate state sequences (MSS) in terms of entities and their states with evolving dependencies over time. In order to interpret the temporal dynamics in such data, it is essential to capture relationships between entities and their changes in state and dependence over time under uncertainty. Existing probabilistic models do not explicitly model the evolution of causality between dependent state sequences and mostly result in complex structures when representing complete causal dependencies between random variables. To solve this, Temporal State Change Bayesian Networks (TSCBN) are introduced to effectively model interval relations of MSSs under evolving uncertainty. Our model outperforms competing approaches in terms of parameter complexity and expressiveness. Further, an efficient structure discovery method for TSCBNs is presented, that improves classical approaches by exploiting temporal knowledge and multiple parameter estimation approaches for TSCBNs are introduced. Those are expectation maximization, variational inference and a sampling based maximum likelihood estimation that allow to learn parameters from partially observed MSSs. Lastly, we demonstrate how TSCBNs allow to interpret and infer patterns of captured sequences for specification mining in automotive.<\/jats:p>","DOI":"10.1007\/s10618-021-00807-y","type":"journal-article","created":{"date-parts":[[2021,11,1]],"date-time":"2021-11-01T08:02:51Z","timestamp":1635753771000},"page":"240-294","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Temporal state change Bayesian networks for modeling of evolving multivariate state sequences: model, structure discovery and parameter estimation"],"prefix":"10.1007","volume":"36","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1719-1048","authenticated-orcid":false,"given":"Artur","family":"Mrowca","sequence":"first","affiliation":[]},{"given":"Florian","family":"Gyrock","sequence":"additional","affiliation":[]},{"given":"Stephan","family":"G\u00fcnnemann","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,11,1]]},"reference":[{"key":"807_CR1","unstructured":"Aliferis C, Cooper G (1996) A structurally and temporally extended Bayesian belief network model: definitions, properties, and modeling techniques. In: Proceedings of the UAI. Morgan Kaufmann"},{"key":"807_CR2","unstructured":"Arroyo-Figueroa G, Sucar L (1999) A temporal Bayesian network for diagnosis and prediction. In: Proceedings of the UAI. Morgan Kaufmann"},{"issue":"2","key":"807_CR3","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1007\/s10489-005-3413-x","volume":"23","author":"G Arroyo-Figueroa","year":"2005","unstructured":"Arroyo-Figueroa G, Sucar L (2005) Temporal Bayesian network of events for diagnosis and prediction in dynamic domains. Appl Intell 23(2):66","journal-title":"Appl Intell"},{"key":"807_CR4","doi-asserted-by":"crossref","unstructured":"Barber D (2012) Bayesian reasoning and machine learning. Cambridge University Press","DOI":"10.1017\/CBO9780511804779"},{"key":"807_CR5","unstructured":"Bartlett M, Cussens J (2013) Advances in Bayesian network learning using integer programming. arXiv preprint arXiv:13096825"},{"key":"807_CR6","unstructured":"Batal I, Sacchi (2009) Multivariate time series classification with temporal abstractions. In: FLAIRS conference"},{"key":"807_CR7","doi-asserted-by":"crossref","unstructured":"Berzuini C (1990) Representing time in causal probabilistic networks. In: Machine intelligence and pattern recognition, vol\u00a010. Elsevier","DOI":"10.1016\/B978-0-444-88738-2.50009-9"},{"key":"807_CR8","doi-asserted-by":"crossref","unstructured":"Bhattacharjya D, Shanmugam K, Gao T, Mattei N, Varshney K, Subramanian D (2020) Event-driven continuous time Bayesian networks. In: Proceedings of the AAAI conference on artificial intelligence, vol 34, pp 3259\u20133266","DOI":"10.1609\/aaai.v34i04.5725"},{"key":"807_CR9","unstructured":"Bishop CM, Spiegelhalter D, Winn J (2003) Vibes: a variational inference engine for Bayesian networks. In: Advances in neural information processing systems, pp 793\u2013800"},{"key":"807_CR10","doi-asserted-by":"crossref","unstructured":"Bodon F (2005) A trie-based apriori implementation for mining frequent item sequences. In: Proceedings of the 1st international workshop on open source data mining: frequent pattern mining implementations. ACM, pp 56\u201365","DOI":"10.1145\/1133905.1133913"},{"key":"807_CR11","unstructured":"Bubenzer J (2011) Minimization of acyclic dfas. In: Stringology, pp 132\u2013146"},{"issue":"4","key":"807_CR12","first-page":"309","volume":"9","author":"GF Cooper","year":"1992","unstructured":"Cooper GF, Herskovits E (1992) A Bayesian method for the induction of probabilistic networks from data. Mach Learn 9(4):309\u2013347","journal-title":"Mach Learn"},{"key":"807_CR13","doi-asserted-by":"crossref","unstructured":"Corneli M, Latouche P, Rossi F (2015) Modelling time evolving interactions in networks through a non stationary extension of stochastic block models. In: 2015 IEEE\/ACM international conference on advances in social networks analysis and mining (ASONAM). IEEE, pp 1590\u20131591","DOI":"10.1145\/2808797.2809348"},{"issue":"2","key":"807_CR14","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1017\/S0269888910000251","volume":"26","author":"R Daly","year":"2011","unstructured":"Daly R, Shen Q, Aitken S (2011) Learning Bayesian networks: approaches and issues. Knowl Eng Rev 26(2):99\u2013157","journal-title":"Knowl Eng Rev"},{"issue":"2","key":"807_CR15","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1002\/int.10085","volume":"18","author":"LM De Campos","year":"2003","unstructured":"De Campos LM, Fern\u00e1ndez-Luna JM, Puerta JM (2003) An iterated local search algorithm for learning Bayesian networks with restarts based on conditional independence tests. Int J Intell Syst 18(2):221\u2013235","journal-title":"Int J Intell Syst"},{"issue":"5","key":"807_CR16","first-page":"4282","volume":"5","author":"F De Carlo","year":"2013","unstructured":"De Carlo F, Borgia O, Tucci M (2013) Imperfect maintenance modelling by dynamic object oriented Bayesian networks. Int J Eng Technol 5(5):4282\u20134295","journal-title":"Int J Eng Technol"},{"issue":"2","key":"807_CR17","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1111\/j.1467-8640.1989.tb00324.x","volume":"5","author":"T Dean","year":"1989","unstructured":"Dean T, Kanazawa K (1989) A model for reasoning about persistence and causation. Comput Intell 5(2):66","journal-title":"Comput Intell"},{"key":"807_CR18","unstructured":"Gal\u00e1n S, Diez F (2000) Modeling dynamic causal interaction with Bayesian networks: temporal noisy gates. In: Proceedings 2nd international workshop on causal networks"},{"issue":"3","key":"807_CR19","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/S0888-613X(02)00071-3","volume":"30","author":"S Gal\u00e1n","year":"2002","unstructured":"Gal\u00e1n S, Diez F (2002) Networks of probabilistic events in discrete time. Int J Approx Reason 30(3):181\u2013202","journal-title":"Int J Approx Reason"},{"key":"807_CR20","unstructured":"Gopalratnam K, Kautz H, Weld DS (2005) Extending continuous time Bayesian networks. In: Proceedings of the national conference on artificial intelligence. AAAI Press\/MIT Press, Menlo Park, Cambridge, London, 1999, vol\u00a020, p 981"},{"key":"807_CR21","doi-asserted-by":"crossref","unstructured":"Gu Y, Sun Y, Gao J (2017) The co-evolution model for social network evolving and opinion migration. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 175\u2013184","DOI":"10.1145\/3097983.3098002"},{"key":"807_CR22","unstructured":"Gunawardana A, Meek C (2016) Universal models of multivariate temporal point processes, pp 556\u2013563"},{"key":"807_CR23","doi-asserted-by":"crossref","unstructured":"Hallac D, Vare S, Boyd S, Leskovec J (2017) Toeplitz inverse covariance-based clustering of multivariate time series data. In: Proceedings of the 23rd ACM SIGKDD international conference on knowledge discovery and data mining. ACM, pp 215\u2013223","DOI":"10.1145\/3097983.3098060"},{"issue":"3","key":"807_CR24","first-page":"197","volume":"20","author":"D Heckerman","year":"1995","unstructured":"Heckerman D, Geiger D, Chickering DM (1995) Learning Bayesian networks: the combination of knowledge and statistical data. Mach Learn 20(3):197\u2013243","journal-title":"Mach Learn"},{"key":"807_CR25","unstructured":"Karkera KR (2014) Building probabilistic graphical models with Python. Packt Publishing Ltd"},{"key":"807_CR26","doi-asserted-by":"crossref","unstructured":"Kwon WY, Suh IH (2012) A temporal Bayesian network with application to design of a proactive robotic assistant. In: 2012 IEEE international conference on robotics and automation. IEEE, pp 3685\u20133690","DOI":"10.1109\/ICRA.2012.6224673"},{"key":"807_CR27","doi-asserted-by":"crossref","unstructured":"Leemans SJ, Fahland D, van\u00a0der Aalst WM (2013) Discovering block-structured process models from event logs containing infrequent behaviour. In: International conference on business process management. Springer, pp 66\u201378","DOI":"10.1007\/978-3-319-06257-0_6"},{"key":"807_CR28","doi-asserted-by":"crossref","unstructured":"Mrowca A, Moser B, G\u00fcnnemann S (2018a) Discovering groups of signals in in-vehicle network traces for redundancy detection and functional grouping. In: Joint European conference on machine learning and knowledge discovery in databases. Springer, pp 86\u2013102","DOI":"10.1007\/978-3-030-10997-4_6"},{"key":"807_CR29","doi-asserted-by":"crossref","unstructured":"Mrowca A, Pramsohler T, Steinhorst S, Baumgarten U (2018b) Automated interpretation and reduction of in-vehicle network traces at a large scale. In: 2018 55th ACM\/ESDA\/IEEE design automation conference (DAC). IEEE, pp 1\u20136","DOI":"10.1109\/DAC.2018.8465937"},{"key":"807_CR30","doi-asserted-by":"crossref","unstructured":"Mrowca A, Nocker M, Steinhorst S, G\u00fcnnemann S (2019) Learning temporal specifications from imperfect traces using Bayesian inference. In: 2019 56th ACM\/ESDA\/IEEE design automation conference (DAC), IEEE","DOI":"10.1145\/3316781.3317847"},{"key":"807_CR31","unstructured":"Murphy KP, Russell S (2002) Dynamic Bayesian networks: representation, inference and learning"},{"key":"807_CR32","unstructured":"Nodelman U, Shelton CR, Koller D (2002) Continuous time Bayesian networks. In: Proceedings of the UAI. Morgan Kaufmann"},{"key":"807_CR33","unstructured":"Olesen K, Hejlesen O, Dessau R, Beltoft I, Trangeled M (2006) Diagnosing lyme disease-tailoring patient specific Bayesian networks for temporal reasoning. In: Probabilistic graphical models"},{"issue":"3","key":"807_CR34","doi-asserted-by":"publisher","first-page":"944","DOI":"10.1109\/JBHI.2015.2420534","volume":"20","author":"K Orphanou","year":"2016","unstructured":"Orphanou K, Stassopoulou A, Keravnou E (2016) Dbn-extended: a dynamic Bayesian network model extended with temporal abstractions for coronary heart disease prognosis. IEEE J Biomed Health Inform 20(3):944\u2013952","journal-title":"IEEE J Biomed Health Inform"},{"key":"807_CR35","unstructured":"Portinale L, Codetta-Raiteri D (2009) Generalizing continuous time Bayesian networks with immediate nodes. In: Proceedings of the workshop on graph structure for knowledge represetnation and reasoning, pp 12\u201317"},{"key":"807_CR36","doi-asserted-by":"crossref","unstructured":"Ryabov V, Trudel A (2004) Probabilistic temporal interval networks. In: Proceedings of the TIME 2004. IEEE","DOI":"10.1109\/TIME.2004.1314421"},{"key":"807_CR37","unstructured":"Savickas T, Vasilecas O (2014) Business process event log transformation into Bayesian belief network"},{"issue":"4","key":"807_CR38","doi-asserted-by":"publisher","first-page":"687","DOI":"10.15388\/Informatica.2017.146","volume":"28","author":"T Savickas","year":"2017","unstructured":"Savickas T, Vasilecas O (2017) Decision support using belief network constructed from business process event log. Informatica 28(4):687\u2013701","journal-title":"Informatica"},{"key":"807_CR39","unstructured":"Scanagatta M, de\u00a0Campos CP, Corani G, Zaffalon M (2015) Learning Bayesian networks with thousands of variables. In: Advances in neural information processing systems, pp 1864\u20131872"},{"issue":"2","key":"807_CR40","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1214\/aos\/1176344136","volume":"6","author":"G Schwarz","year":"1978","unstructured":"Schwarz G et al (1978) Estimating the dimension of a model. Ann Stat 6(2):461\u2013464","journal-title":"Ann Stat"},{"key":"807_CR41","first-page":"1137","volume":"11","author":"CR Shelton","year":"2010","unstructured":"Shelton CR, Fan Y, Lam W, Lee J, Xu J (2010) Continuous time Bayesian network reasoning and learning engine. J Mach Learn Res 11:1137\u20131140","journal-title":"J Mach Learn Res"},{"key":"807_CR42","unstructured":"Simma A, Jordan MI (2012) Modeling events with cascades of Poisson processes. arXiv preprint arXiv:12033516"},{"key":"807_CR43","unstructured":"Song L, Kolar M, Xing EP (2009) Time-varying dynamic Bayesian networks. In: Advances in neural information processing systems, pp 1732\u20131740"},{"issue":"1","key":"807_CR44","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1177\/089443939100900106","volume":"9","author":"P Spirtes","year":"1991","unstructured":"Spirtes P, Glymour C (1991) An algorithm for fast recovery of sparse causal graphs. Soc Sci Comput Rev 9(1):62\u201372","journal-title":"Soc Sci Comput Rev"},{"key":"807_CR45","doi-asserted-by":"crossref","unstructured":"Spirtes P, Glymour C, Scheines R (2000) Causation, prediction, and search. adaptive computation and machine learning","DOI":"10.7551\/mitpress\/1754.001.0001"},{"key":"807_CR46","doi-asserted-by":"crossref","unstructured":"Sutrisnowati RA, Bae H, Park J, Ha BH (2013) Learning Bayesian network from event logs using mutual information test. In: 2013 IEEE 6th international conference on service-oriented computing and applications. IEEE, pp 356\u2013360","DOI":"10.1109\/SOCA.2013.38"},{"issue":"1","key":"807_CR47","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1016\/S0951-8320(98)00027-1","volume":"63","author":"S Swaminathan","year":"1999","unstructured":"Swaminathan S, Smidts C (1999) The event sequence diagram framework for dynamic probabilistic risk assessment. Reliab Eng Syst Saf 63(1):66","journal-title":"Reliab Eng Syst Saf"},{"issue":"3","key":"807_CR48","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1111\/0824-7935.00116","volume":"16","author":"A Tawfik","year":"2000","unstructured":"Tawfik A, Neufeld E (2000) Temporal reasoning and Bayesian networks. Comput Intell 16(3):66","journal-title":"Comput Intell"},{"issue":"1","key":"807_CR49","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1007\/s10994-006-6889-7","volume":"65","author":"I Tsamardinos","year":"2006","unstructured":"Tsamardinos I, Brown LE, Aliferis CF (2006) The max-min hill-climbing Bayesian network structure learning algorithm. Mach Learn 65(1):31\u201378","journal-title":"Mach Learn"},{"key":"807_CR50","unstructured":"Tucker A (2001) The automatic explanation of multivariate time series. PhD thesis, Ph. D. thesis, Birkbeck College, University of London, UK"},{"key":"807_CR51","volume-title":"Efficient algorithms for Bayesian network parameter learning from incomplete data","author":"G Van den Broeck","year":"2015","unstructured":"Van den Broeck G, Mohan K, Choi A, Darwiche A, Pearl J (2015) Efficient algorithms for Bayesian network parameter learning from incomplete data. Meila, Marina"},{"issue":"9","key":"807_CR52","doi-asserted-by":"publisher","first-page":"1128","DOI":"10.1109\/TKDE.2004.47","volume":"16","author":"W Van der Aalst","year":"2004","unstructured":"Van der Aalst W, Weijters T, Maruster L (2004) Workflow mining: discovering process models from event logs. IEEE Trans Knowl Data Eng 16(9):1128\u20131142","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"10","key":"807_CR53","doi-asserted-by":"publisher","first-page":"821","DOI":"10.1016\/j.datak.2011.05.003","volume":"70","author":"M Walicki","year":"2011","unstructured":"Walicki M, Ferreira DR (2011) Sequence partitioning for process mining with unlabeled event logs. Data Knowl Eng 70(10):821\u201341","journal-title":"Data Knowl Eng"},{"key":"807_CR54","unstructured":"Weijters A, van Der Aalst WM, De Medeiros AA (2006) Process mining with the heuristics miner-algorithm, vol 166. Technische Universiteit Eindhoven, Tech Rep WP, pp 1\u201334"},{"key":"807_CR55","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1613\/jair.4039","volume":"48","author":"C Yuan","year":"2013","unstructured":"Yuan C, Malone B (2013) Learning optimal Bayesian networks: a shortest path perspective. J Artif Intell Res 48:23\u201365","journal-title":"J Artif Intell Res"}],"container-title":["Data Mining and Knowledge Discovery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-021-00807-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10618-021-00807-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-021-00807-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,14]],"date-time":"2023-01-14T07:03:15Z","timestamp":1673679795000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10618-021-00807-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,1]]},"references-count":55,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,1]]}},"alternative-id":["807"],"URL":"https:\/\/doi.org\/10.1007\/s10618-021-00807-y","relation":{},"ISSN":["1384-5810","1573-756X"],"issn-type":[{"type":"print","value":"1384-5810"},{"type":"electronic","value":"1573-756X"}],"subject":[],"published":{"date-parts":[[2021,11,1]]},"assertion":[{"value":"31 August 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 October 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 November 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}