{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T15:47:08Z","timestamp":1781020028493,"version":"3.54.1"},"reference-count":59,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T00:00:00Z","timestamp":1737676800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Natural Science Foundation of China General Project","award":["NSFC 62376089"],"award-info":[{"award-number":["NSFC 62376089"]}]},{"name":"National Natural Science Foundation of China General Project","award":["HBUT 4301\/00550"],"award-info":[{"award-number":["HBUT 4301\/00550"]}]},{"name":"Yellow Crane Talents Program funding","award":["NSFC 62376089"],"award-info":[{"award-number":["NSFC 62376089"]}]},{"name":"Yellow Crane Talents Program funding","award":["HBUT 4301\/00550"],"award-info":[{"award-number":["HBUT 4301\/00550"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The structure learning of a Bayesian network (BN) is a crucial process that aims to unravel the complex dependencies relationships among variables using a given dataset. This paper proposes a new BN structure learning method for data with continuous attribute values. As a non-parametric distribution-free method, kernel density estimation (KDE) is applied in the conditional independence (CI) test. The skeleton of the BN is constructed utilizing the test based on mutual information and conditional mutual information, delineating potential relational connections between parents and children without imposing any distributional assumptions. In the searching stage of BN structure learning, the causal relationships between variables are achieved by using the conditional entropy scoring function and hill-climbing strategy. To further enhance the computational efficiency of our method, we incorporate a locality sensitive hashing (LSH) function into the KDE process. The method speeds up the calculations of KDE while maintaining the precision of the estimates, leading to a notable decrease in the time required for computing mutual information, conditional mutual information, and conditional entropy. A BN classifier (BNC) is established by using the computationally efficient BN learning method. Our experiments demonstrated that KDE using LSH has greatly improved the speed compared to traditional KDE without losing fitting accuracy. This achievement underscores the effectiveness of our method in balancing speed and accuracy. By giving the benchmark networks, the network structure learning accuracy with the proposed method is superior to other traditional structure learning methods. The BNC also demonstrates better accuracy with stronger interpretability compared to conventional classifiers on public datasets.<\/jats:p>","DOI":"10.3390\/e27020123","type":"journal-article","created":{"date-parts":[[2025,1,24]],"date-time":"2025-01-24T09:40:39Z","timestamp":1737711639000},"page":"123","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Causal Discovery and Reasoning for Continuous Variables with an Improved Bayesian Network Constructed by Locality Sensitive Hashing and Kernel Density Estimation"],"prefix":"10.3390","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-6172-0486","authenticated-orcid":false,"given":"Chenghao","family":"Wei","sequence":"first","affiliation":[{"name":"School of Computer Science, Hubei University of Technology, Wuhan 430068, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7342-0677","authenticated-orcid":false,"given":"Chen","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science, Hubei University of Technology, Wuhan 430068, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingying","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Hubei University of Technology, Wuhan 430068, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Song","family":"Chen","sequence":"additional","affiliation":[{"name":"College of Acupuncture and Moxibustion and Orthopaedics, Hubei University of Chinese Medicine, Wuhan 430065, China"},{"name":"Hubei Shizhen Laboratory, Wuhan 430065, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiqiang","family":"Zuo","sequence":"additional","affiliation":[{"name":"School of Computer Science, Hubei University of Technology, Wuhan 430068, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pukai","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Hubei University of Technology, Wuhan 430068, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiwei","family":"Ye","sequence":"additional","affiliation":[{"name":"School of Computer Science, Hubei University of Technology, Wuhan 430068, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,1,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/BF00994016","article-title":"Learning Bayesian networks: The combination of knowledge and statistical data","volume":"20","author":"Heckerman","year":"1995","journal-title":"Mach. Learn."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1131","DOI":"10.1016\/j.ijhydene.2023.10.005","article-title":"Dynamic risk evaluation of hydrogen station leakage based on fuzzy dynamic Bayesian network","volume":"50","author":"Zhang","year":"2024","journal-title":"Int. J. Hydrogen Energy"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"109816","DOI":"10.1016\/j.ress.2023.109816","article-title":"A Bayesian network-based model for risk modeling and scenario deduction of collision accidents of inland intelligent ships","volume":"243","author":"Zhang","year":"2024","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"13499","DOI":"10.1111\/exsy.13499","article-title":"Advancements in medical diagnosis and treatment through machine learning: A review","volume":"41","author":"Ahsan","year":"2024","journal-title":"Expert Syst. J. Knowl. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Glymour, C., Zhang, K., and Spirtes, P. (2019). Review of causal discovery methods based on graphical models. Front. Genet., 10.","DOI":"10.3389\/fgene.2019.00524"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"108426","DOI":"10.1016\/j.knosys.2022.108426","article-title":"A novel discrete firefly algorithm for Bayesian network structure learning","volume":"242","author":"Wang","year":"2022","journal-title":"Knowl. Based Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4347","DOI":"10.3233\/JIFS-236454","article-title":"Bayesian network structure learning based on HC-PSO algorithm","volume":"41","author":"Gao","year":"2024","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5470","DOI":"10.1016\/j.eswa.2010.02.065","article-title":"Improving algorithms for structure learning in Bayesian Networks using a new implicit score","volume":"37","author":"Bouchaala","year":"2010","journal-title":"Expert Syst. Appl."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"DeCampos, C.P., Zeng, Z., and Ji, Q. (2009, January 14\u201318). Structure learning of Bayesian networks using constraints. Proceedings of the 26th Annual International Conference on Machine Learning, Montreal, QC, Canada.","DOI":"10.1145\/1553374.1553389"},{"key":"ref_10","unstructured":"Li, H., Cabeli, V., Sella, N., and Isambert, H. (2019, January 8\u201314). Constraint-based causal structure learning with consistent separating sets. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1007\/s10732-021-09469-x","article-title":"Analysis of Bayesian network learning techniques for a hybrid multi-objective Bayesian estimation of distribution algorithm: A case study on MNK landscape","volume":"27","author":"Martins","year":"2021","journal-title":"J. Heuristics"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Jose, S., Liu, S., Louis, S., and Dascalu, S. (2019, January 4\u20136). Towards a hybrid approach for evolving Bayesian networks using genetic algorithms. Proceedings of the IEEE International Conference on Tools with Artificial Intelligence, Portland, UT, USA.","DOI":"10.1109\/ICTAI.2019.00103"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"108105","DOI":"10.1016\/j.engappai.2024.108105","article-title":"An efficient skeleton learning approach-based hybrid algorithm for identifying Bayesian network structure","volume":"133","author":"Wang","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"127620","DOI":"10.1016\/j.neucom.2024.127620","article-title":"A novel structure learning method of Bayesian networks based on the neighboring complete node ordering search","volume":"585","author":"He","year":"2024","journal-title":"Neurocomputing"},{"key":"ref_15","unstructured":"Beierle, C., and Dekhtyar, A. (2015). Multivariate cluster-based discretization for Bayesian network structure learning. Scalable Uncertainty Management\u2014SUM 2015, Springer International Publishing."},{"key":"ref_16","unstructured":"Dimitris, M. (2005, January 9\u201313). Distribution-Free Learning of Bayesian Network Structure in Continuous Domains. Proceedings of the National Conference on Artificial Intelligence and the Innovative Applications of Artificial Intelligence Conference, Pittsburgh, PA, USA."},{"key":"ref_17","unstructured":"Hao, Z., Zhou, S.G., and Guan, J.H. (2018, January 2\u20137). Measuring conditional independence by independent residuals: Theoretical results and application in causal discovery. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA."},{"key":"ref_18","unstructured":"Bach, F., and Jordan, M. (2002, January 9\u201314). Learning Graphical Models with Mercer Kernels. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_19","unstructured":"Schmidt, M., Niculescu-Mizil, A., and Murphy, K. (2007, January 22\u201326). Learning graphical model structure using L1-regularization paths. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_20","first-page":"1709","article-title":"Estimation of a structural vector autoregression model using non-gaussianity","volume":"11","author":"Hyvarinen","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"107979","DOI":"10.1016\/j.engappai.2024.107979","article-title":"A multiple kernel-based kernel density estimator for multimodal probability density functions","volume":"132","author":"Chen","year":"2024","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1016\/j.eswa.2018.06.058","article-title":"An improved constraint-based Bayesian network learning method using Gaussian kernel probability density estimator","volume":"113","author":"Jiang","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_23","unstructured":"Tsamardinos, I., Aliferis, C.F., Statnikov, A.R., and Statnikov, E. (2003, January 12\u201314). Algorithms for large scale Markov blanket discovery. Proceedings of the International Florida Artificial Intelligence Research Society Conference, St. Augustine, FL, USA."},{"key":"ref_24","unstructured":"Aliferis, C.F., Tsamardinos, I., and Statnikov, A. (2003, January 8\u201312). HITON: A novel Markov Blanket algorithm for optimal variable selection. Proceedings of the American Medical Informatics Association Annual Symposium, Washington, DC, USA."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1007\/s10260-021-00618-x","article-title":"Bayesian network structural learning from complex survey data: A resampling based approach","volume":"31","author":"Marella","year":"2022","journal-title":"Stat. Method. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1007\/BF00994110","article-title":"A Bayesian method for the induction of probabilistic networks from data","volume":"9","author":"Cooper","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"103617","DOI":"10.1016\/j.engappai.2020.103617","article-title":"Improved K2 algorithm for Bayesian network structure learning","volume":"91","author":"Behjati","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Singh, M., and Valtorta, M. (1993, January 9\u201311). An algorithm for the construction of Bayesian network structures from data. Proceedings of the Annual Conference on Uncertainty in Artificial Intelligence, Washington, DC, USA.","DOI":"10.1016\/B978-1-4832-1451-1.50036-6"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1177\/089443939100900106","article-title":"An algorithm for fast recovery of sparse causal graphs","volume":"9","author":"Spirtes","year":"1991","journal-title":"Sol. Sci. Comput. Rev."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s10994-006-6889-7","article-title":"The max-min hill-climbing Bayesian network structure learning algorithm","volume":"65","author":"Tsamardinos","year":"2006","journal-title":"Mach. Learn."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Tsamardinos, I., Aliferis, C.F., and Statnikov, A. (2003, January 24\u201327). Time and sample efficient discovery of Markov blankets and direct causal relations. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.","DOI":"10.1145\/956750.956838"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Song, W., Gong, H., Wang, Q., Zhang, L., Qiu, L., Hu, X., Han, H., Li, Y., Li, R., and Li, Y. (2022). Using Bayesian networks with Max-Min Hill-Climbing algorithm to detect factors related to multimorbidity. Front. Cardiovasc. Med., 9.","DOI":"10.3389\/fcvm.2022.984883"},{"key":"ref_33","first-page":"103","article-title":"Learning discrete Bayesian networks from continuous data","volume":"59","author":"Chen","year":"2017","journal-title":"Front. Cardiovasc. Med."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Wang, Z.X., and Chan, L.W. (2009, January 23\u201326). A heuristic partial-correlation-based algorithm for causal relationship discovery on continuous data. Proceedings of the International Conference on Intelligent Data Engineering and Automated Learning, Burgos, Spain.","DOI":"10.1007\/978-3-642-04394-9_29"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, Z.X., and Chan, L.W. (2010, January 25\u201328). An efficient causal discovery algorithm for linear models. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.","DOI":"10.1145\/1835804.1835944"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Huegle, J., Hagedorn, C., and Schlosser, R. (2023, January 18\u201322). A KNN-Based Non-Parametric Conditional Independence Test for Mixed Data and Application in Causal Discovery. Proceedings of the Machine Learning and Knowledge Discovery in Databases: Research Track-European Conference, Turin, Italy.","DOI":"10.1007\/978-3-031-43412-9_32"},{"key":"ref_37","unstructured":"P\u00e1l, D., P\u00f3czos, B., and Szepesv\u00e1ri, C. (2010, January 6\u20139). Estimation of R\u00e9nyi entropy and mutual information based on generalized nearest-neighbor graphs. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/s12065-016-0143-4","article-title":"Mutual information for feature selection: Estimation or counting?","volume":"9","author":"Nguyen","year":"2016","journal-title":"Evol. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Charikar, M., and Siminelakis, P. (2017, January 15\u201317). Hashing-based-estimators for kernel density in high dimensions. Proceedings of the IEEE Annual Symposium on Foundations of Computer Science, Berkeley, CA, USA.","DOI":"10.1109\/FOCS.2017.99"},{"key":"ref_40","unstructured":"Geiger, D., and Heckerman, D. (1994, January 29\u201331). Learning gaussian networks. Proceedings of the Annual Conference on Uncertainty in Artificial Intelligence, Seattle, Washington, DC, USA."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s41060-017-0085-7","article-title":"Scoring Bayesian networks of mixed variables","volume":"6","author":"Andrews","year":"2018","journal-title":"Int. J. Data Sci. Anal."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"963","DOI":"10.1016\/j.knosys.2011.04.005","article-title":"A partial correlation-based Bayesian network structure learning algorithm under linear SEM","volume":"24","author":"Yang","year":"2011","journal-title":"Knowl. Based Syst."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"111840","DOI":"10.1016\/j.knosys.2024.111840","article-title":"Parallel structural learning of Bayesian networks: Iterative divide and conquer algorithm based on structural fusion","volume":"296","author":"Laborda","year":"2024","journal-title":"Knowl. Based Syst."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1017\/S0266466603004109","article-title":"Causality: Models, reasoning, and inference, by judea pearl, cambridge university press, 2000","volume":"19","author":"Neuberg","year":"2003","journal-title":"Econom. Theory"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2545","DOI":"10.1007\/s10618-024-01044-9","article-title":"The impact of variable ordering on Bayesian Network Structure Learning","volume":"38","author":"Kitson","year":"2024","journal-title":"Data Min. Knowl. Discov."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"109387","DOI":"10.1016\/j.rser.2019.109387","article-title":"Kernel density estimation model for wind speed probability distribution with applicability to wind energy assessment in China","volume":"115","author":"Han","year":"2019","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"W\u0119glarczyk, S. (2018, January 8). Kernel density estimation and its application. Proceedings of the ITM Web Conference, Krak\u00f3w, Poland.","DOI":"10.1051\/itmconf\/20182300037"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Kala, Z. (2021). Global sensitivity analysis based on entropy: From differential entropy to alternative measures. Entropy, 23.","DOI":"10.3390\/e23060778"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"114","DOI":"10.3847\/1538-3881\/ad20cf","article-title":"Planetary Complexity Revealed by the Joint Differential Entropy of Eigencolors","volume":"167","author":"Segal","year":"2024","journal-title":"Astorn. J."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"\u00c1lvarez Chaves, M., Gupta, H.V., Ehret, U., and Guthke, A. (2024). On the Accurate Estimation of Information-Theoretic Quantities from Multi-Dimensional Sample Data. Entropy, 26.","DOI":"10.3390\/e26050387"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Fischer, I. (2020). The conditional entropy bottleneck. Entropy, 22.","DOI":"10.3390\/e22090999"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Coleman, B., and Shrivastava, A. (2020, January 20\u201324). Sub-linear race sketches for approximate kernel density estimation on streaming data. Proceedings of the Web Conference 2020, Taipei, Taiwan.","DOI":"10.1145\/3366423.3380244"},{"key":"ref_53","unstructured":"Backurs, A., Indyk, P., and Wagner, T. (2019, January 8\u201314). Space and time efficient kernel density estimation in high dimensions. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Ou, G., He, Y., Fournier-Viger, P., and Huang, J.Z. (2022). A Novel Mixed-Attribute Fusion-Based Naive Bayesian Classifier. Appl. Sci., 12.","DOI":"10.3390\/app122010443"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1145\/2576868","article-title":"Discrete Bayesian network classifiers: A survey","volume":"47","author":"Bielza","year":"2014","journal-title":"ACM Comput. Surv."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.ins.2021.03.049","article-title":"Feature selection via max-independent ratio and min-redundant ratio based on adaptive weighted kernel density estimation","volume":"568","author":"Dai","year":"2021","journal-title":"Inf. Sci."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1016\/j.ijar.2008.08.008","article-title":"Bayesian classifiers based on kernel density estimation: Flexible classifiers","volume":"50","author":"Perez","year":"2009","journal-title":"Int. J. Approx. Reason"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"2023390","DOI":"10.1080\/08839514.2021.2023390","article-title":"Causal structure learning algorithm based on partial rank correlation under additive noise model","volume":"36","author":"Yang","year":"2022","journal-title":"Appl. Artif. Intell."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"111733","DOI":"10.1016\/j.nucengdes.2022.111733","article-title":"Bayesian network analysis of heat transfer deterioration in supercritical water","volume":"391","author":"Ma","year":"2022","journal-title":"Nucl. Eng. Des."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/2\/123\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T10:35:43Z","timestamp":1759919743000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/2\/123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,24]]},"references-count":59,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["e27020123"],"URL":"https:\/\/doi.org\/10.3390\/e27020123","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,24]]}}}