{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T16:34:08Z","timestamp":1780763648304,"version":"3.54.1"},"reference-count":58,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2019,10,11]],"date-time":"2019-10-11T00:00:00Z","timestamp":1570752000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012165","name":"Key Technologies Research and Development Program","doi-asserted-by":"publisher","award":["2017YFC0405805"],"award-info":[{"award-number":["2017YFC0405805"]}],"id":[{"id":"10.13039\/501100012165","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Discovering the Bayesian network (BN) structure from big datasets containing rich causal relationships is becoming increasingly valuable for modeling and reasoning under uncertainties in many areas with big data gathered from sensors due to high volume and fast veracity. Most of the current BN structure learning algorithms have shortcomings facing big data. First, learning a BN structure from the entire big dataset is an expensive task which often ends in failure due to memory constraints. Second, it is quite difficult to select a learner from numerous BN structure learning algorithms to consistently achieve good learning accuracy. Lastly, there is a lack of an intelligent method that merges separately learned BN structures into a well structured BN network. To address these shortcomings, we introduce a novel parallel learning approach called PEnBayes (Parallel Ensemble-based Bayesian network learning). PEnBayes starts with an adaptive data preprocessing phase that calculates the Appropriate Learning Size and intelligently divides a big dataset for fast distributed local structure learning. Then, PEnBayes learns a collection of local BN Structures in parallel using a two-layered weighted adjacent matrix-based structure ensemble method. Lastly, PEnBayes merges the local BN Structures into a global network structure using the structure ensemble method at the global layer. For the experiment, we generate big data sets by simulating sensor data from patient monitoring, transportation, and disease diagnosis domains. The Experimental results show that PEnBayes achieves a significantly improved execution performance with more consistent and stable results compared with three baseline learning algorithms.<\/jats:p>","DOI":"10.3390\/s19204400","type":"journal-article","created":{"date-parts":[[2019,10,11]],"date-time":"2019-10-11T10:53:03Z","timestamp":1570791183000},"page":"4400","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["PEnBayes: A Multi-Layered Ensemble Approach for Learning Bayesian Network Structure from Big Data"],"prefix":"10.3390","volume":"19","author":[{"given":"Yan","family":"Tang","sequence":"first","affiliation":[{"name":"Data Science and Knowledge Engineering Laboratory, College of Computer and Information, Hohai University, Nanjing 210036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9933-1170","authenticated-orcid":false,"given":"Jianwu","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Information Systems, University of Maryland, Baltimore County, Baltimore, MD 21250, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mai","family":"Nguyen","sequence":"additional","affiliation":[{"name":"San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA 92093, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ilkay","family":"Altintas","sequence":"additional","affiliation":[{"name":"San Diego Supercomputer Center, University of California, San Diego, La Jolla, CA 92093, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"50","DOI":"10.5213\/inj.2014.18.2.50","article-title":"Big Data Analysis Using Modern Statistical and Machine Learning Methods in Medicine","volume":"18","author":"Yoo","year":"2014","journal-title":"Int. Neurourol J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1016\/j.neucom.2014.05.078","article-title":"Weighted ensemble learning of Bayesian network for gene regulatory networks","volume":"150","author":"Hasna","year":"2015","journal-title":"Neurocomputing"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1016\/j.neucom.2016.09.042","article-title":"A data-intensive approach for discovering user similarities in social behavioral interactions based on the bayesian network","volume":"219","author":"Yue","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yang, J., Tong, Y., Liu, X., and Tan, S. (2014, January 27\u201328). Causal inference from financial factors: Continuous variable based local structure learning algorithm. Proceedings of the 2014 IEEE Conference on Computational Intelligence for Financial Engineering & Economics (CIFEr), London, UK.","DOI":"10.1109\/CIFEr.2014.6924084"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1016\/j.neucom.2015.05.133","article-title":"Motor imagery EEG signals analysis based on Bayesian network with Gaussian distribution","volume":"188","author":"He","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_6","first-page":"1287","article-title":"Large-Sample Learning of Bayesian Networks is NP-Hard","volume":"5","author":"Chickering","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_7","unstructured":"Fang, Q., Yue, K., Fu, X., Wu, H., and Liu, W. (2013, January 4\u20136). A MapReduce-Based Method for Learning Bayesian Network from Massive Data. Proceedings of the 15th Asia-Pacific Web Conference (APWeb 2013), Sydney, Australia."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, J., Tang, Y., Nguyen, M., and Altintas, I. (2014, January 8\u201311). A Scalable Data Science Workflow Approach for Big Data Bayesian Network Learning. Proceedings of the 2014 IEEE\/ACM International Symposium on Big Data Computing (BDC 2014), London, UK.","DOI":"10.1109\/BDC.2014.10"},{"key":"ref_9","unstructured":"(2019, October 02). Apache Spark Project. Available online: http:\/\/spark.apache.org."},{"key":"ref_10","unstructured":"(2019, October 02). The Kepler Project. Available online: https:\/\/kepler-project.org."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/s13677-015-0026-8","article-title":"Towards cloud based big data analytics for smart future cities","volume":"4","author":"Khan","year":"2015","journal-title":"J. Cloud Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1186\/s13677-019-0127-x","article-title":"A view of programming scalable data analysis: From clouds to exascale","volume":"8","author":"Talia","year":"2019","journal-title":"J. Cloud Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1109\/MCSE.2014.50","article-title":"Big data applications using workflows for data parallel computing","volume":"16","author":"Wang","year":"2014","journal-title":"Comput. Sci. Eng."},{"key":"ref_14","unstructured":"(2019, October 02). Apache Hadoop Project. Available online: http:\/\/hadoop.apache.org."},{"key":"ref_15","unstructured":"(2019, October 02). The Stratosphere Project. Available online: http:\/\/stratosphere.eu\/."},{"key":"ref_16","unstructured":"(2019, October 02). Apache Flink Project. Available online: http:\/\/flink.apache.org."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1186\/s13677-017-0081-4","article-title":"Cloud resource management: towards efficient execution of large-scale scientific applications and workflows on complex infrastructures","volume":"6","author":"Gonzalez","year":"2017","journal-title":"J. Cloud Comput."},{"key":"ref_18","unstructured":"Altintas, I., Berkley, C., Jaeger, E., Jones, M., Ludascher, B., and Mock, S. (2004, January 23). Kepler: An extensible system for design and execution of scientific workflows. Proceedings of the 16th International Conference on Scientific and Statistical Database Management, Santorini Island, Greece."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1039","DOI":"10.1002\/cpe.994","article-title":"Scientific workflow management and the Kepler system","volume":"18","author":"Altintas","year":"2006","journal-title":"Concurr. Comput. Pract. Exp."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1016\/j.future.2008.06.014","article-title":"Heterogeneous composition of models of computation","volume":"25","author":"Goderis","year":"2009","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_21","unstructured":"Ben-Gal, I. (2019, October 02). Bayesian Networks. Available online: https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/9780470061572.eqr089."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Korb, K.B., and Nicholson, A.E. (2010). Bayesian Artificial Intelligence, CRC Press.","DOI":"10.1201\/b10391"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/S0004-3702(02)00191-1","article-title":"Learning Bayesian networks from data: An information-theory based approach","volume":"137","author":"Cheng","year":"2002","journal-title":"Artif. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann Publishers Inc.","DOI":"10.1016\/B978-0-08-051489-5.50008-4"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Spirtes, P., Glymour, C.N., Scheines, R., Heckerman, D., Meek, C., Cooper, G., and Richardson, T. (2001). Causation, Prediction, and Search, MIT Press.","DOI":"10.7551\/mitpress\/1754.001.0001"},{"key":"ref_26","unstructured":"Meek, C. (1995, January 18\u201320). Strong completeness and faithfulness in Bayesian networks. Proceedings of the Eleventh Annual Conference on Uncertainty in Artificial Intelligence, Montreal, QC, Canada."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s10994-006-6889-7","article-title":"The max-min hill-climbing Bayesian network structure learning algorithm","volume":"65","author":"Tsamardinos","year":"2006","journal-title":"Mach. Learn."},{"key":"ref_28","unstructured":"Tsamardinos, I., Aliferis, C.F., Statnikov, A.R., and Statnikov, E. (2003, January 12\u201314). Algorithms for Large Scale Markov Blanket Discovery. Proceedings of the FLAIRS 2003, St. Augustine, FL, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/BF00994016","article-title":"Learning Bayesian networks: The combination of knowledge and statistical data","volume":"20","author":"Heckerman","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_30","unstructured":"Yaramakala, S., and Margaritis, D. (2005, January 27\u201330). Speculative Markov blanket discovery for optimal feature selection. Proceedings of the Fifth IEEE International Conference on Data Mining (ICDM\u201905), Houston, TX, USA."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"3049","DOI":"10.1007\/s00500-017-2557-z","article-title":"A novel method for Bayesian networks structure learning based on Breeding Swarm algorithm","volume":"22","author":"Khanteymoori","year":"2018","journal-title":"Soft Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.neucom.2013.02.015","article-title":"Improved heuristic equivalent search algorithm based on Maximal Information Coefficient for Bayesian Network Structure Learning","volume":"117","author":"Zhang","year":"2013","journal-title":"Neurocomputing"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.neucom.2018.01.016","article-title":"An effective pattern-based Bayesian classifier for evolving data stream","volume":"295","author":"Yuan","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1186\/s13677-018-0122-7","article-title":"Using genetic algorithms to find optimal solution in a search space for a cloud predictive cost-driven decision maker","volume":"7","author":"Nikravesh","year":"2018","journal-title":"J. Cloud Comput."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhu, X., and Yuan, C. (2015, January 25\u201330). An Exact Algorithm for Solving Most Relevant Explanation in Bayesian Networks. Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v29i1.9686"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1613\/jair.3744","article-title":"Parameterized Complexity Results for Exact Bayesian Network Structure Learning","volume":"46","author":"Ordyniak","year":"2013","journal-title":"J. Artif. Intell. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1093\/bioinformatics\/btn505","article-title":"BNFinder: Exact and efficient method for learning Bayesian networks","volume":"25","author":"Wilczynski","year":"2009","journal-title":"Bioinformatics"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2890","DOI":"10.1109\/TCYB.2015.2388791","article-title":"A Parallel and Incremental Approach for Data-Intensive Learning of Bayesian Networks","volume":"45","author":"Yue","year":"2017","journal-title":"IEEE Trans. Cybern."},{"key":"ref_39","first-page":"1515","article-title":"Scalable learning of Bayesian network classifiers","volume":"17","author":"Webb","year":"2016","journal-title":"J. Mach. Learn. Res."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Tang, Y., Wang, Y., Cooper, K.M., and Li, L. (July, January 27). Towards Big Data Bayesian Network Learning - An Ensemble Learning Based Approach. Proceedings of the 2014 IEEE International Congress on Big Data, Anchorage, AK, USA.","DOI":"10.1109\/BigData.Congress.2014.58"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-009-9124-7","article-title":"Ensemble-based classifiers","volume":"33","author":"Rokach","year":"2010","journal-title":"Artif. Intell. Rev."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s13677-018-0109-4","article-title":"An SVM-based framework for detecting DoS attacks in virtualized clouds under changing environment","volume":"7","author":"Abusitta","year":"2018","journal-title":"J. Cloud Comput."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Wu, G., Li, H., Hu, X., Bi, Y., Zhang, J., and Wu, X. (2009, January 21\u201322). MReC4. 5: C4. 5 ensemble classification with MapReduce. Proceedings of the 2009 Fourth ChinaGrid Annual Conference, Yantai, China.","DOI":"10.1109\/ChinaGrid.2009.39"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Lin, J., and Kolcz, A. (2012, January 20\u201324). Large-scale machine learning at twitter. Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data, Scottsdale, AZ, USA.","DOI":"10.1145\/2213836.2213958"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.knosys.2016.07.031","article-title":"A parallel algorithm for Bayesian network structure learning from large data sets","volume":"117","author":"Madsen","year":"2017","journal-title":"Knowl.-Based Syst."},{"key":"ref_47","unstructured":"(2019, October 02). MLlib: Apache Spark\u2019s Scalable Machine Learning Library. Available online: https:\/\/spark.apache.org\/mllib\/."},{"key":"ref_48","unstructured":"(2019, October 02). The Mahout Project. Available online: http:\/\/mahout.apache.org\/."},{"key":"ref_49","unstructured":"(2019, October 02). H2O.ai: Brings AI to Enterprise. Available online: http:\/\/www.h2o.ai\/."},{"key":"ref_50","unstructured":"(2019, October 02). FlinkML: Machine Learning for Flink. Available online: https:\/\/github.com\/FlinkML."},{"key":"ref_51","unstructured":"Beinlich, I., Suermondt, H., Chavez, R., and Cooper, G. (1989, January 29\u201331). The ALARM Monitoring System: A Case Study with Two Probabilistic Inference Techniques for Belief Networks. Proceedings of the 2nd European Conference on Artificial Intelligence in Medicine, London, UK."},{"key":"ref_52","unstructured":"Cowell, R.G., Dawid, P., Lauritzen, S.L., and Spiegelhalter, D.J. (2007). Probabilistic Networks and Expert Systems: Exact Computational Methods for Bayesian Networks, Springer Science & Business Media."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1023\/A:1007421730016","article-title":"Adaptive probabilistic networks with hidden variables","volume":"29","author":"Binder","year":"1997","journal-title":"Mach. Learn."},{"key":"ref_54","unstructured":"(2019, October 02). SamIam Tool for Modeling and Reasoning with Bayesian Networks. Available online: http:\/\/reasoning.cs.ucla.edu\/samiam\/."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v035.i03","article-title":"Learning Bayesian Networks with the bnlearn R Package","volume":"35","author":"Scutari","year":"2010","journal-title":"J. Stat. Softw."},{"key":"ref_56","unstructured":"Zaharia, M., Konwinski, A., Joseph, A.D., Katz, R.H., and Stoica, I. (2008, January 8\u201310). Improving MapReduce Performance in Heterogeneous Environments. Proceedings of the 8th USENIX Symposium on Operating Systems Design and Implementation, San Diego, CA, USA."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Saranti, A., Taraghi, B., Ebner, M., and Holzinger, A. (2019, January 26\u201329). Insights into Learning Competence Through Probabilistic Graphical Models. Proceedings of the International Cross-Domain Conference, CD-MAKE 2019, Canterbury, UK.","DOI":"10.1007\/978-3-030-29726-8_16"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Goebel, R., Chander, A., Holzinger, K., Lecue, F., Akata, Z., Stumpf, S., Kieseberg, P., and Holzinger, A. (2018, January 27\u201330). Explainable AI: The New 42?. Proceedings of the International Cross-Domain Conference, CD-MAKE 2018, Hamburg, Germany.","DOI":"10.1007\/978-3-319-99740-7_21"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/20\/4400\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:25:14Z","timestamp":1760189114000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/20\/4400"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,11]]},"references-count":58,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["s19204400"],"URL":"https:\/\/doi.org\/10.3390\/s19204400","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,10,11]]}}}