{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T07:12:26Z","timestamp":1769584346906,"version":"3.49.0"},"reference-count":28,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2015,6,8]],"date-time":"2015-06-08T00:00:00Z","timestamp":1433721600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"publisher","award":["61272209"],"award-info":[{"award-number":["61272209"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Postdoctoral Science Foundation of China","award":["20100481053"],"award-info":[{"award-number":["20100481053"]}]},{"name":"Postdoctoral Science Foundation of China","award":["2013M530980"],"award-info":[{"award-number":["2013M530980"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>As one of the most common types of graphical models, the Bayesian classifier has become an extremely popular approach to dealing with uncertainty and complexity. The scoring functions once proposed and widely used for a Bayesian network are not appropriate for a Bayesian classifier, in which class variable C is considered as a distinguished one. In this paper, we aim to clarify the working mechanism of Bayesian classifiers from the perspective of the chain rule of joint probability distribution. By establishing the mapping relationship between conditional probability distribution and mutual information, a new scoring function, Sum_MI, is derived and applied to evaluate the rationality of the Bayesian classifiers. To achieve global optimization and high dependence representation, the proposed learning algorithm, the flexible K-dependence Bayesian (FKDB) classifier, applies greedy search to extract more information from the K-dependence network structure. Meanwhile, during the learning procedure, the optimal attribute order is determined dynamically, rather than rigidly. In the experimental study, functional dependency analysis is used to improve model interpretability when the structure complexity is restricted.<\/jats:p>","DOI":"10.3390\/e17063766","type":"journal-article","created":{"date-parts":[[2015,6,10]],"date-time":"2015-06-10T14:05:45Z","timestamp":1433945145000},"page":"3766-3786","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Learning a Flexible K-Dependence Bayesian Classifier from the Chain Rule of Joint Probability Distribution"],"prefix":"10.3390","volume":"17","author":[{"given":"Limin","family":"Wang","sequence":"first","affiliation":[{"name":"Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haoyu","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Software, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,6,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"5487","DOI":"10.1109\/TSP.2014.2349874","article-title":"Proper Quaternion Gaussian Graphical Models","volume":"62","author":"Sloin","year":"2014","journal-title":"IEEE. Trans. Signal Process"},{"key":"ref_2","unstructured":"Koller, D., and Friedman, N. (2009). Probabilistic Graphical Models: Principles and Techniques, MIT Press."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2576868","article-title":"Discrete Bayesian Network Classifiers: A Survey","volume":"47","author":"Bielza","year":"2014","journal-title":"ACM Comput. Surv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann Publishers Inc.","DOI":"10.1016\/B978-0-08-051489-5.50008-4"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2521","DOI":"10.1007\/s10773-014-2042-8","article-title":"Investigation of Commuting Hamiltonian in Quantum Markov Network","volume":"53","author":"Jouneghani","year":"2014","journal-title":"Int. J. Theor. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1007\/s10844-013-0279-y","article-title":"A naive Bayes probability estimation model based on self-adaptive differential evolution","volume":"42","author":"Wu","year":"2014","journal-title":"J. Intell. Inf. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/JRPROC.1961.287775","article-title":"Steps toward Artificial Intelligence","volume":"49","author":"Minsky","year":"1961","journal-title":"Proc. IRE."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.knosys.2011.08.010","article-title":"Improving tree augmented naive bayes for class probability estimation","volume":"26","author":"Jiang","year":"2012","journal-title":"Knowl.-Based Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1023\/A:1007465528199","article-title":"Bayesian network classifiers","volume":"29","author":"Friedman","year":"1997","journal-title":"Mach. Learn."},{"key":"ref_10","unstructured":"Sahami, M. (1996, January 2\u20134). Learning limited dependence Bayesian classifiers. Portland, OR, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"11583","DOI":"10.1016\/j.eswa.2012.04.024","article-title":"Bagging k-dependence probabilistic networks: An alternative powerful fraud detection tool","volume":"39","author":"Francisco","year":"2012","journal-title":"Expert Syst. Appl."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s10044-009-0149-y","article-title":"Constrained domain maximum likelihood estimation for naive Bayes text classification","volume":"13","author":"Juan","year":"2010","journal-title":"Pattern Anal. Appl."},{"key":"ref_13","first-page":"867","article-title":"A Widely Applicable Bayesian Information Criterion","volume":"14","author":"Watanabe","year":"2013","journal-title":"J. Mach. Learn. Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1186\/1752-0509-4-S1-S7","article-title":"A novel gene network inference algorithm using predictive minimum description length approach","volume":"4","author":"Chaitankar","year":"2010","journal-title":"BMC Syst. Biol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1080\/10635150490522304","article-title":"Model selection and model averaging in phylogenetics: Advantages of akaike information criterion and Bayesian approaches over likelihood ratio tests","volume":"53","author":"Posada","year":"2004","journal-title":"Syst. Biol."},{"key":"ref_16","first-page":"1287","article-title":"Large-Sample Learning of Bayesian Networks is NP-Hard","volume":"5","author":"Chickering","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_17","unstructured":"Available online: https:\/\/archive.ics.uci.edu\/ml\/datasets.html."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/S0004-3702(02)00191-1","article-title":"Learning Bayesian networks from data: An information-theory based approach","volume":"137","author":"Cheng","year":"2002","journal-title":"Artif. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A Mathematical Theory of Communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1109\/TIT.1968.1054142","article-title":"Approximating discrete probability distributions with dependence trees","volume":"14","author":"Chow","year":"1968","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_21","unstructured":"Ma, S.H., and Shi, H.B. (2004, January 26\u201329). Tree-augmented naive Bayes ensembles. Shanghai, China."},{"key":"ref_22","unstructured":"Fayyad, U.M., and Irani, K.B. (September,, January 28). Multi-interval discretization of continuous-valued attributes for classification learning. Chamb\u00e9ry, France."},{"key":"ref_23","unstructured":"Josep, R.A. (2002, January 12\u201315). Incremental Learning of Tree Augmented Naive Bayes Classifiers. Seville, Spain."},{"key":"ref_24","first-page":"173","article-title":"Extracting Logical Rules and Attribute Subset from Confidence Domain","volume":"15","author":"Wang","year":"2012","journal-title":"Information"},{"key":"ref_25","unstructured":"Kohavi, R., and Wolpert, D. (1996, January 3\u20136). Bias plus variance decomposition for zero-one loss functions. Bari, Italy."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1263","DOI":"10.1109\/TKDE.2008.239","article-title":"Learning from imbalanced data","volume":"21","author":"He","year":"2009","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","article-title":"An introduction to ROC analysis","volume":"27","author":"Fawcett","year":"2006","journal-title":"Pattern Recogn. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1080\/01621459.1937.10503522","article-title":"The use of ranks to avoid the assumption of normality implicit in the analysis of variance","volume":"32","author":"Friedman","year":"1937","journal-title":"J. Am. Stat. Assoc."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/6\/3766\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:47:36Z","timestamp":1760215656000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/6\/3766"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,6,8]]},"references-count":28,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2015,6]]}},"alternative-id":["e17063766"],"URL":"https:\/\/doi.org\/10.3390\/e17063766","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,6,8]]}}}