{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T07:38:02Z","timestamp":1765438682768,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,12,11]],"date-time":"2020-12-11T00:00:00Z","timestamp":1607644800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["41875061","41775165"],"award-info":[{"award-number":["41875061","41775165"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Graduate Research and Innovation Project of Hunan Province","award":["CX20200009"],"award-info":[{"award-number":["CX20200009"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The Bayesian Network (BN) has been widely applied to causal reasoning in artificial intelligence, and the Search-Score (SS) method has become a mainstream approach to mine causal relationships for establishing BN structure. Aiming at the problems of local optimum and low generalization in existing SS algorithms, we introduce the Ensemble Learning (EL) and causal analysis to propose a new BN structural learning algorithm named C-EL. Combined with the Bagging method and causal Information Flow theory, the EL mechanism for BN structural learning is established. Base learners of EL are trained by using various SS algorithms. Then, a new causality-based weighted ensemble way is proposed to achieve the fusion of different BN structures. To verify the validity and feasibility of C-EL, we compare it with six different SS algorithms. The experiment results show that C-EL has high accuracy and a strong generalization ability. More importantly, it is capable of learning more accurate structures under the small training sample condition.<\/jats:p>","DOI":"10.3390\/sym12122054","type":"journal-article","created":{"date-parts":[[2020,12,14]],"date-time":"2020-12-14T00:45:36Z","timestamp":1607906736000},"page":"2054","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["A New Ensemble Learning Algorithm Combined with Causal Analysis for Bayesian Network Structural Learning"],"prefix":"10.3390","volume":"12","author":[{"given":"Ming","family":"Li","sequence":"first","affiliation":[{"name":"College of Meteorology and Oceanography, National University of Defense Technology, Nanjing 211101, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ren","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Meteorology and Oceanography, National University of Defense Technology, Nanjing 211101, China"},{"name":"Collaborative Innovation Center on Meteorological Disaster Forecast, Warning and Assessment, Nanjing University of Information Science and Engineering, Nanjing 210044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kefeng","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Meteorology and Oceanography, National University of Defense Technology, Nanjing 211101, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,12,11]]},"reference":[{"key":"ref_1","unstructured":"Pearl, J. (2000). Causality: Models, Reasoning, and Inference, Cambridge University Press."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Greenland, S., and Pearl, J. (2014). Causal Diagrams. Wiley StatsRef: Statistics Reference Online, American Cancer Society.","DOI":"10.1002\/9781118445112.stat03732"},{"key":"ref_3","unstructured":"Peter, S., Clark, G., and Scheines, R. (2000). Causation, Prediction, and Search, MIT Press. [2nd ed.]."},{"key":"ref_4","first-page":"642","article-title":"Review of Bayesian Networks Structure Learning","volume":"32","author":"Li","year":"2015","journal-title":"Appl. Res. Comput."},{"key":"ref_5","unstructured":"Sahin, F., and Bay, J. (2001, January 7\u201310). Structural Bayesian network learning in a biological decision-theoretic intelligent agent and its application to a herding problem in the context of distributed multi-agent systems. Proceedings of the 2001 IEEE International Conference on Systems, Tucson, AZ, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1007\/BF00994110","article-title":"A Bayesian method for the induction of probabilistic networks from data","volume":"9","author":"Cooper","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1111\/j.1467-8640.1994.tb00166.x","article-title":"Learning Bayesian belief networks: An approach based on the MDL principle","volume":"10","author":"Lam","year":"1994","journal-title":"Comput. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/BF00994016","article-title":"Learning Bayesian networks: The combination of knowledge and statistical data","volume":"20","author":"Heckerman","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_9","first-page":"98","article-title":"Structural Learning Bayesian Network Equivalence Classes Based on a Hybrid Method","volume":"41","author":"Zhu","year":"2013","journal-title":"Acta Electron. Sin."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Guo, W., Xiao, Q., and Hou, Y. (2013, January 25\u201327). Bayesian network learning based on relationship prediction PSO and its application in agricultural expert system. Proceedings of the 25th Chinese Control and Decision Conference (CCDC), Guiyang, China.","DOI":"10.1109\/CCDC.2013.6561228"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Carvalho, A. (2011, January 12\u201316). A cooperative coevolutionary genetic algorithm for learning bayesian network structures. Proceedings of the 2011 Conference on Genetic & Evolutionary Computation, Dublin, Ireland.","DOI":"10.1145\/2001576.2001729"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1007\/s00500-012-0966-6","article-title":"An artificial bee colony algorithm for learning Bayesian networks","volume":"17","author":"Ji","year":"2013","journal-title":"Soft Comput."},{"key":"ref_13","first-page":"185","article-title":"The Development and Prospect of the Study of Bayesian Network Structure","volume":"33","author":"He","year":"2004","journal-title":"Inf. Control"},{"key":"ref_14","first-page":"2149","article-title":"A Scoring Function for Learning Bayesian Networks based on Mutual Information and Conditional Independence Tests","volume":"7","author":"Campos","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5470","DOI":"10.1016\/j.eswa.2010.02.065","article-title":"Improving algorithms for structure learning in Bayesian Networks using a new implicit score","volume":"37","author":"Rebai","year":"2010","journal-title":"Expert Syst. Appl."},{"key":"ref_16","first-page":"4613","article-title":"An Improved Learning Algorithm of Bayesian Network Structure","volume":"82","author":"Fan","year":"2008","journal-title":"J. Syst. Simul."},{"key":"ref_17","first-page":"618","article-title":"Bayesian network structure learning method based on unconstrained optimization and genetic algorithm","volume":"28","author":"Wang","year":"2013","journal-title":"Control Decis."},{"key":"ref_18","first-page":"202","article-title":"Improved Structural Learning Algorithm of Bayesian Network based on Information Flow","volume":"465","author":"Li","year":"2018","journal-title":"Syst. Eng. Electron."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"150630","DOI":"10.1109\/ACCESS.2019.2947568","article-title":"Causality-based Attribute Weighting via Information Flow and Genetic Algorithm for Naive Bayes Classifier","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_20","first-page":"285","article-title":"Optimal Search on Clustered Structural Constraint for Learning Bayesian Network Structure","volume":"11","author":"Kojima","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, Y., and Yao, X. (1999). Ensemble Learning via Negative Correlation, Elsevier Science Ltd.","DOI":"10.1016\/S0893-6080(99)00073-8"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Okun, O., Valentini, G., and Re, M. (2011). Ensembles in Machine Learning Applications, Springer.","DOI":"10.1007\/978-3-642-22910-7"},{"key":"ref_23","first-page":"143","article-title":"Ensemble of Convolutional Neural Networks for Bioimage Classification","volume":"6","author":"Loris","year":"2018","journal-title":"Appl. Comput. Inform."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1638","DOI":"10.1109\/TFUZZ.2014.2371479","article-title":"A study on relationship between generalization abilities and fuzziness of base classifiers in ensemble learning","volume":"23","author":"Wang","year":"2015","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"052150","DOI":"10.1103\/PhysRevE.90.052150","article-title":"Unraveling the Cause-Effect Relation between Time Series","volume":"90","author":"Liang","year":"2014","journal-title":"Phys. Rev. E"},{"key":"ref_26","first-page":"33","article-title":"Overview of Bayesian Network Research","volume":"23","author":"Hu","year":"2013","journal-title":"J. Hefei Univ. (Nat. Sci. Ed.)"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, M., and Liu, K.F. (2020). Probabilistic Prediction of Significant Wave Height Using Dynamic Bayesian Network and Information Flow. Water, 12.","DOI":"10.3390\/w12082075"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1214\/aos\/1176344136","article-title":"Estimating the Dimension of a Model","volume":"6","author":"Schwarz","year":"1978","journal-title":"Ann. Stats"},{"key":"ref_29","first-page":"1287","article-title":"Large-Sample Learning of Bayesian Networks is NP-Hard","volume":"5","author":"Chickering","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s10994-006-6889-7","article-title":"The Max-Min Hill-Climbing Bayesian Network Structure Learning Algorithm","volume":"65","author":"Tsamardinos","year":"2006","journal-title":"Mach. Learn."},{"key":"ref_31","unstructured":"(2007, January 01). Package for Bayesian Network Learning and Inference. Available online: https:\/\/www.bnlearn.com\/."},{"key":"ref_32","unstructured":"Jongh, M.D., and Druzdzel, M.J. (2020, January 01). A Comparison of Structural Distance Measures for Causal Bayesian Network Models. Recent Advances in Intelligent Information Systems. Available online: https:\/\/www.researchgate.net\/publication\/254430204."},{"key":"ref_33","unstructured":"Wang, Q. (2011). Research on Several Key Issues in Integrated Learning, Fudan University."},{"key":"ref_34","unstructured":"Dietterich, T.G. (2002). Ensemble learning. The Handbook of Brain Theory and Neural Networks, MIT Press. [2nd ed.]."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging Predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, Y.J. (2009). Flight Delay and Spread Prediction Based on Bayesian Network, Tianjin University.","DOI":"10.1109\/KAM.2008.70"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"022126","DOI":"10.1103\/PhysRevE.92.022126","article-title":"Normalizing the causality between time series","volume":"92","author":"Liang","year":"2015","journal-title":"Phys. Rev. E"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/2054\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:43:39Z","timestamp":1760179419000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/12\/2054"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,11]]},"references-count":37,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["sym12122054"],"URL":"https:\/\/doi.org\/10.3390\/sym12122054","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2020,12,11]]}}}