{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T19:35:03Z","timestamp":1782761703756,"version":"3.54.5"},"reference-count":45,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T00:00:00Z","timestamp":1682467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["390621612"],"award-info":[{"award-number":["390621612"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Causal inference is a fundamental research topic for discovering the cause\u2013effect relationships in many disciplines. Inferring causality means identifying asymmetric relations between two variables. In real-world systems, e.g., finance, healthcare, and industrial processes, time series data from sensors and other data sources offer an especially good basis to infer causal relationships. Therefore, many different time series causal inference algorithms have been proposed in recent years. However, not all algorithms are equally well-suited for a given dataset. For instance, some approaches may only be able to identify linear relationships, while others are applicable for non-linearities. Algorithms further vary in their sensitivity to noise and their ability to infer causal information from coupled vs. non-coupled time series. As a consequence, different algorithms often generate different causal relationships for the same input. In order to achieve a more robust causal inference result, this publication proposes a novel data-driven two-phase multi-split causal ensemble model to combine the strengths of different causality base algorithms. In comparison to existing approaches, the proposed ensemble method reduces the influence of noise through a data partitioning scheme in a first phase. To achieve this, the data are initially divided into several partitions and the base causal inference algorithms are applied to each partition. Subsequently, Gaussian mixture models are used to identify the causal relationships derived from the different partitions that are likely to be valid. In the second phase, the identified relationships from each base algorithm are then merged based on three combination rules. The proposed ensemble approach is evaluated using multiple metrics, among them a newly developed evaluation index for causal ensemble approaches. We perform experiments using three synthetic datasets with different volumes and complexity, which have been specifically designed to test causality detection methods under different circumstances while knowing the ground truth causal relationships. In these experiments, our causality ensemble outperforms each of its base algorithms. In practical applications, the use of the proposed method could hence lead to more robust and reliable causality results.<\/jats:p>","DOI":"10.3390\/sym15050982","type":"journal-article","created":{"date-parts":[[2023,4,26]],"date-time":"2023-04-26T02:30:52Z","timestamp":1682476252000},"page":"982","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Data-Driven Two-Phase Multi-Split Causal Ensemble Model for Time Series"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4049-539X","authenticated-orcid":false,"given":"Zhipeng","family":"Ma","sequence":"first","affiliation":[{"name":"SDU Center for Energy Informatics, The Maersk Mc-Kinney Moller Institute, University of Southern Denmark, Campusvej 55, 5230 Odense, Denmark"},{"name":"Information Management in Mechanical Engineering, RWTH Aachen University, Dennewartstra\u00dfe 27, 52068 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0141-2050","authenticated-orcid":false,"given":"Marco","family":"Kemmerling","sequence":"additional","affiliation":[{"name":"Information Management in Mechanical Engineering, RWTH Aachen University, Dennewartstra\u00dfe 27, 52068 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8363-1331","authenticated-orcid":false,"given":"Daniel","family":"Buschmann","sequence":"additional","affiliation":[{"name":"Laboratory for Machine Tools and Production Engineering WZL, RWTH Aachen University, Campus-Boulevard 30, 52074 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3047-5846","authenticated-orcid":false,"given":"Chrismarie","family":"Enslin","sequence":"additional","affiliation":[{"name":"Information Management in Mechanical Engineering, RWTH Aachen University, Dennewartstra\u00dfe 27, 52068 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7070-8018","authenticated-orcid":false,"given":"Daniel","family":"L\u00fctticke","sequence":"additional","affiliation":[{"name":"Information Management in Mechanical Engineering, RWTH Aachen University, Dennewartstra\u00dfe 27, 52068 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0011-5962","authenticated-orcid":false,"given":"Robert H.","family":"Schmitt","sequence":"additional","affiliation":[{"name":"Information Management in Mechanical Engineering, RWTH Aachen University, Dennewartstra\u00dfe 27, 52068 Aachen, Germany"},{"name":"Laboratory for Machine Tools and Production Engineering WZL, RWTH Aachen University, Campus-Boulevard 30, 52074 Aachen, Germany"},{"name":"Fraunhofer Institute for Production Technology (IPT), Steinbachstra\u00dfe 17, 52074 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,26]]},"reference":[{"key":"ref_1","first-page":"88","article-title":"Causality: The place of the causal principle in modern science","volume":"51","author":"Bunge","year":"1959","journal-title":"Br. J. Philos. Sci."},{"key":"ref_2","unstructured":"Pearl, J. (2009). Causality, Cambridge University Press. [2nd ed.]."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1198","DOI":"10.1109\/TCYB.2016.2540657","article-title":"Empirical sensitivity analysis of discretization parameters for fault pattern extraction from multivariate time series data","volume":"47","author":"Baek","year":"2017","journal-title":"IEEE Trans. Cybern."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"424","DOI":"10.2307\/1912791","article-title":"Investigating causal relations by econometric models and crossspectral methods","volume":"37","author":"Granger","year":"1969","journal-title":"Econometrica"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.physrep.2006.12.004","article-title":"Causality detection based on information-theoretic approaches in time series analysis","volume":"441","author":"Vejmelka","year":"2007","journal-title":"Phys. Rep."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1126\/science.1227079","article-title":"Detecting causality in complex ecosystems","volume":"338","author":"Sugihara","year":"2012","journal-title":"Science"},{"key":"ref_7","first-page":"10220","article-title":"Cxplain: Causal explanations for model interpretation under uncertainty","volume":"32","author":"Schwab","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1030","DOI":"10.1093\/ije\/31.5.1030","article-title":"An overview of relations among causal modelling methods","volume":"31","author":"Greenland","year":"2002","journal-title":"Int. J. Epidemiol."},{"key":"ref_9","first-page":"4267","article-title":"Neural granger causality","volume":"44","author":"Tank","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1174","DOI":"10.1890\/14-1479.1","article-title":"Spatial convergent cross mapping to detect causal relationships from short time series","volume":"96","author":"Clark","year":"2015","journal-title":"Ecology"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5960171","DOI":"10.1155\/2020\/5960171","article-title":"Dli: A deep learning-based granger causality inference","volume":"2020","author":"Peng","year":"2020","journal-title":"Complexity"},{"key":"ref_12","unstructured":"L\u00f6we, S., Madras, D., Zemel, R., and Welling, M. (2022, January 11\u201313). Amortized causal discovery: Learning to infer causal graphs from time series data. Proceedings of the Conference on Causal Learning and Reasoning, Eureka, CA, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1109\/JPROC.2015.2476824","article-title":"Wiener\u2013granger causality in network physiology with applications to cardiovascular control and neuroscience","volume":"104","author":"Porta","year":"2015","journal-title":"Proc. IEEE"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2587","DOI":"10.1007\/s11009-022-09928-3","article-title":"Statistical causality for multivariate non-linear time series via gaussian process models","volume":"24","author":"Zaremba","year":"2022","journal-title":"Methodol. Comput. Appl. Probab."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1613\/jair.614","article-title":"Popular ensemble methods: An empirical study","volume":"11","author":"Opitz","year":"1999","journal-title":"J. Artif. Intell. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1002\/9781119485001.ch14","article-title":"Combining data-driven and theory-driven models for causality analysis in sociocultural systems","volume":"14","author":"Sliva","year":"2019","journal-title":"Soc.-Behav. Model. Complex Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Li, M., Zhang, R., and Liu, K. (2020). A new ensemble learning algorithm combined with causal analysis for bayesian network structural learning. Symmetry, 12.","DOI":"10.3390\/sym12122054"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1257\/pandp.20191069","article-title":"Ensemble methods for causal effects in panel data settings","volume":"109","author":"Athey","year":"2019","journal-title":"Aea Pap. Proc."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"100252","DOI":"10.1016\/j.bdr.2021.100252","article-title":"Scalable and flexible two-phase ensemble algorithms for causality discovery","volume":"26","author":"Guo","year":"2021","journal-title":"Big Data Res."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Kale, P., Vinita Acharya, J., Acharya, J., Subramanian, T., and Almekkawy, M. (2018, January 18\u201321). Normalized transfer entropy as a tool to identify multisource functional epileptic networks. Proceedings of the 2018 40th rAnnual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.","DOI":"10.1109\/EMBC.2018.8512532"},{"key":"ref_21","unstructured":"Runge, J. (2020, January 3\u20136). Discovering contemporaneous and lagged causal relations in autocorrelated non-linear time series data sets. Proceedings of the Conference on Uncertainty in Artificial Intelligence, Virtual Online."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1002\/9781119945710.ch22","article-title":"Causal inference in time series analysis","volume":"22","author":"Eichler","year":"2012","journal-title":"Causality Stat. Perspect. Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"697610","DOI":"10.1155\/2012\/697610","article-title":"Statistical analysis of single-trial granger causality spectra","volume":"2012","author":"Brovelli","year":"2012","journal-title":"Comput. Math. Methods Med."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1080\/00036848400000041","article-title":"A note on tests of granger causality","volume":"16","author":"Bessler","year":"1984","journal-title":"Appl. Econ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/0165-1889(80)90069-X","article-title":"Testing for causality: A personal viewpoint","volume":"2","author":"Granger","year":"1980","journal-title":"J. Econ. Dyn. Control."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1080\/02664760050173346","article-title":"A simple investigation of the granger-causality test in integrated-cointegrated var systems","volume":"27","author":"Shukur","year":"2000","journal-title":"J. Appl. Stat."},{"key":"ref_27","unstructured":"Seabold, S., and Perktold, J. (July, January 28). Statsmodels: Econometric and statistical modeling with Python. Proceedings of the 9th Python in Science Conference, Austin, TX, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Ikegwu, K.M., Trauger, J., McMullin, J., and Brunner, R.J. (2020, January 28\u201329). PyIF: A fast and light weight implementation to estimate bivariate transfer entropy for big data. Proceedings of the 2020 SoutheastCon, Raleigh, NC, USA.","DOI":"10.1109\/SoutheastCon44009.2020.9249650"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"066138","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Baig, M.Z., and Kavakli, M. (2019). Connectivity analysis using functional brain networks to evaluate cognitive activity during 3d modelling. Brain Sci., 9.","DOI":"10.3390\/brainsci9020024"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1eaau4996","DOI":"10.1126\/sciadv.aau4996","article-title":"Detecting and quantifying causal associations in large non-linear time series data sets","volume":"5","author":"Runge","year":"2019","journal-title":"Sci. Adv."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1177\/089443939100900106","article-title":"An algorithm for fast recovery of sparse causal graphs","volume":"9","author":"Spirtes","year":"1991","journal-title":"Soc. Sci. Comput. Rev."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Spirtes, P., Glymour, C., Scheines, R., and Heckerman, D. (2000). Causation, Prediction, and Search, MIT Press.","DOI":"10.7551\/mitpress\/1754.001.0001"},{"key":"ref_34","unstructured":"Arvind, D.K., and Maiya, S. (2023). Sensor data-driven analysis for identification of causal relationships between exposure to air pollution and respiratory rate in asthmatics. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1002\/cpe.4330050103","article-title":"An overview of manifold and its implementation","volume":"5","author":"Arbab","year":"1993","journal-title":"Concurr. Pract. Exp."},{"key":"ref_36","unstructured":"Takens, F. (1981). Dynamical Systems and Turbulence, Warwick 1980, Springer."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Sinha, R. (2014). Smooth Manifolds, Springer.","DOI":"10.1007\/978-81-322-2104-3"},{"key":"ref_38","unstructured":"Hussung, S., Mahmud, S., Sampath, A., Wu, M., Guo, P., and Wang, J. (2019). Evaluation of data-driven causality discovery approaches among dominant climate modes. UMBC Fac. Collect., 1\u201319."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1177\/0962280218799540","article-title":"A review and empirical comparison of causal inference methods for clustered observational data with application to the evaluation of the effectiveness of medical devices","volume":"28","author":"Cafri","year":"2019","journal-title":"Stat. Methods Med. Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.promfg.2018.12.025","article-title":"Comparison of K-means and GMM methods for contextual clustering in HSM","volume":"28","author":"Wang","year":"2019","journal-title":"Procedia Manuf."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"14750","DOI":"10.1038\/srep14750","article-title":"Distinguishing time-delayed causal interactions using convergent cross mapping","volume":"5","author":"Ye","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_42","first-page":"11722","article-title":"The case for evaluating causal models using interventional measures and empirical data","volume":"32","author":"Gentzel","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_43","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_44","unstructured":"Kemmerling, M., Combrzynski-Nogala, M., Ha\u00dfler, M., Enslin, C., L\u00fctticke, D., and Schmitt, R.H. (2022). 2022 Cybernetics & Informatics (K&I), IEEE."},{"key":"ref_45","unstructured":"Ma, Z. (2023, March 28). Two-Stage-Causal-Ensemble-Model. Available online: https:\/\/github.com\/zhipengmichaelma\/two-phase-causal-ensemble-model."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/15\/5\/982\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:23:37Z","timestamp":1760124217000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/15\/5\/982"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,26]]},"references-count":45,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["sym15050982"],"URL":"https:\/\/doi.org\/10.3390\/sym15050982","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,26]]}}}