{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:12:03Z","timestamp":1760235123094,"version":"build-2065373602"},"reference-count":58,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T00:00:00Z","timestamp":1627603200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Reconstructability Analysis (RA) and Bayesian Networks (BN) are both probabilistic graphical modeling methodologies used in machine learning and artificial intelligence. There are RA models that are statistically equivalent to BN models and there are also models unique to RA and models unique to BN. The primary goal of this paper is to unify these two methodologies via a lattice of structures that offers an expanded set of models to represent complex systems more accurately or more simply. The conceptualization of this lattice also offers a framework for additional innovations beyond what is presented here. Specifically, this paper integrates RA and BN by developing and visualizing: (1) a BN neutral system lattice of general and specific graphs, (2) a joint RA-BN neutral system lattice of general and specific graphs, (3) an augmented RA directed system lattice of prediction graphs, and (4) a BN directed system lattice of prediction graphs. Additionally, it (5) extends RA notation to encompass BN graphs and (6) offers an algorithm to search the joint RA-BN neutral system lattice to find the best representation of system structure from underlying system variables. All lattices shown in this paper are for four variables, but the theory and methodology presented in this paper are general and apply to any number of variables. These methodological innovations are contributions to machine learning and artificial intelligence and more generally to complex systems analysis. The paper also reviews some relevant prior work of others so that the innovations offered here can be understood in a self-contained way within the context of this paper.<\/jats:p>","DOI":"10.3390\/e23080986","type":"journal-article","created":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T12:59:24Z","timestamp":1627649964000},"page":"986","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Graphical Models in Reconstructability Analysis and Bayesian Networks"],"prefix":"10.3390","volume":"23","author":[{"given":"Marcus","family":"Harris","sequence":"first","affiliation":[{"name":"Systems Science Program, Portland State University, Portland, OR 97207, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Martin","family":"Zwick","sequence":"additional","affiliation":[{"name":"Systems Science Program, Portland State University, Portland, OR 97207, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,30]]},"reference":[{"key":"ref_1","first-page":"99","article-title":"Constraint Analysis of Many-Dimensional Relations","volume":"9","author":"Ashby","year":"1964","journal-title":"Gen. Syst. Yearb."},{"key":"ref_2","unstructured":"Broekstra, G. (1979, January 3\u20138). Nonprobabilistic constraint analysis and a two stage approximation method of structure identification. Proceedings of the 23rd Annual SGSR Meeting, Houston, TX, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Cavallo, R. (1979). The Role of System Science Methodology in Social Science Research, Martinus Nijhoff Publishing.","DOI":"10.1007\/978-94-009-9236-8"},{"key":"ref_4","unstructured":"Conant, R. (1981). Mechanisms of Intelligence: Ashby\u2019s Writings on Cybernetics, Intersystems Publications."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1080\/03081078808934999","article-title":"Extended dependency analysis of large systems","volume":"14","author":"Conant","year":"1988","journal-title":"Int. J. Gen. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1080\/03081077608934746","article-title":"Identification of generative structures in empirical data","volume":"3","author":"Klir","year":"1976","journal-title":"Int. J. Gen. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Klir, G. (1985). The Architecture of Systems Problem Solving, Plenum Press.","DOI":"10.1007\/978-1-4757-1168-4"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1002\/sres.3850030410","article-title":"Reconstructability analysis: An offspring of Ashby\u2019s constraint theory","volume":"3","author":"Klir","year":"1986","journal-title":"Syst. Res."},{"key":"ref_9","unstructured":"Gaines, B.R. (1979). On the identification of structures in multivariate data by the spectral analysis of relations. General Systems Research: A Science, a Methodology, a Technology, Society for General Systems Research. Available online: http:\/\/repository.upenn.edu\/asc_papers\/207."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1080\/03081078108934807","article-title":"An algorithm for identifying structural models of multivariate data","volume":"7","author":"Krippendorff","year":"1981","journal-title":"Int. J. Gen. Syst."},{"key":"ref_11","unstructured":"Krippendorff, K. (1986). Information Theory: Structural Models for Qualitative Data, Sage. Quantitative Applications in the Social Sciences #62."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1108\/03684920410534047","article-title":"A software architecture for reconstructability analysis","volume":"33","author":"Willet","year":"2004","journal-title":"Kybernetes"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zwick, M. (2010). Reconstructability Analysis of Epistasis. Ann. Hum. Genet., 157\u2013171. Available online: https:\/\/works.bepress.com\/martin_zwick\/3\/.","DOI":"10.1111\/j.1469-1809.2010.00628.x"},{"key":"ref_14","unstructured":"Wagner, G. (2001). Wholes and parts in general systems methodology. The Character Concept in Evolutionary Biology, Academic Press. Available online: https:\/\/works.bepress.com\/martin_zwick\/52\/."},{"key":"ref_15","first-page":"887","article-title":"An overview of reconstructability analysis","volume":"33","author":"Zwick","year":"2004","journal-title":"Kybernetes"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1108\/03684920410534092","article-title":"State-based reconstructability analysis","volume":"33","author":"Zwick","year":"2004","journal-title":"Kybernetes"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1080\/03081079.2017.1412435","article-title":"Exploratory Reconstructability Analysis of Accident TBI Data","volume":"47","author":"Zwick","year":"2018","journal-title":"Int. J. Gen. Syst."},{"key":"ref_18","first-page":"557","article-title":"Correlation and causation","volume":"20","author":"Wright","year":"1921","journal-title":"J. Agric. Res."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1214\/aoms\/1177732676","article-title":"The method of path coefficients","volume":"5","author":"Wright","year":"1934","journal-title":"Ann. Math. Stat."},{"key":"ref_20","unstructured":"Neapolitan, R. (1989). Probabilistic Reasoning in Expert Systems: Theory and Algorithms, Wiley."},{"key":"ref_21","unstructured":"Pearl, J. (1985, January 15\u201317). Bayesian Networks: A Model of Self-Activated Memory for Evidential Reasoning. Proceedings of the 7th Conference of the Cognitive Science Society, Irvine, CA, USA."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pearl, J. (1988). Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann Publishers, Inc.","DOI":"10.1016\/B978-0-08-051489-5.50008-4"},{"key":"ref_23","unstructured":"Pearl, J., and Verma, T. (1987, January 13\u201317). The logic of representing dependencies by directed graphs. Proceedings of the 6th National Conference on Artificial Intelligence, Seattle, WA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lauritzen, S. (1996). Graphical Models, Oxford University Press.","DOI":"10.1093\/oso\/9780198522195.001.0001"},{"key":"ref_25","unstructured":"Driver, E., and Morrell, D. (1995, January 18\u201320). Implementation of Continuous Bayesian Networks Using Sums of Weighted Gaussians. Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, Montr\u00e9al, QC, Canada."},{"key":"ref_26","unstructured":"Tang, Y., and Srihari, N. (2012, January 11\u201315). Efficient and Accurate Learning of Bayesian Networks using Chi-Squared. Proceedings of the 21st International Conference on Pattern Recognition, Tsukuba, Japan."},{"key":"ref_27","unstructured":"Rebane, G., and Pearl, J. (1987, January 10). The recovery of causal polytrees from statistical data. Proceedings of the Third Conference on Uncertainty Artificial Intelligence, Seattle, WA, USA."},{"key":"ref_28","unstructured":"Verma, T., and Pearl, J. (1990, January 27\u201329). Equivalence and synthesis of causal models. Proceedings of the Sixth Annual Conference on Uncertainty in Artificial Intelligence, Cambridge, MA, USA."},{"key":"ref_29","first-page":"445","article-title":"Learning Equivalence Classes of Bayesian-Network Structures","volume":"2","author":"Chickering","year":"2002","journal-title":"J. Mach. Learn. Res."},{"key":"ref_30","unstructured":"Hanks, S., and Besnard, P. (1995, January 18\u201320). Causal inference and causal explanation with background knowledge. Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, Montreal, QC, Canada."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1214\/aos\/1031833662","article-title":"A Characterization of Markov Equivalence Classes For Acyclic Digraphs","volume":"25","author":"Andersson","year":"1997","journal-title":"Ann. Stat."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Gillispie, S., and Perlman, M. (2001, January 2). Enumerating Markov Equivalence Classes of Acyclic Digraph Models. Proceedings of the Seventeenth conference on Uncertainty in Artificial Intelligence, Seattle, WA, USA.","DOI":"10.1016\/S0004-3702(02)00264-3"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Harris, M., and Zwick, M. (2021). Joint Lattice of Reconstructability Analysis and Bayesian Network General Graphs. Unifying Themes in Complex Systems X, ICCS 2020, Springer.","DOI":"10.1007\/978-3-030-67318-5_24"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Heckerman, D., Geiger, D., and Chickering, D. (1994, January 29\u201331). Learning Bayesian networks: The combination of knowledge and statistical data. Proceedings of the Tenth Conference on Uncertainty in Artificial Intelligence, Seattle, WA, USA.","DOI":"10.1016\/B978-1-55860-332-5.50042-0"},{"key":"ref_35","first-page":"1287","article-title":"Large-Sample Learning of Bayesian Networks is NP-Hard","volume":"5","author":"Chickering","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_36","unstructured":"Murphy, K. (2021, July 27). A Brief Introduction to Graphical Models and Bayesian Networks. Available online: https:\/\/www.cs.ubc.ca\/~murphyk\/Bayes\/bayes_tutorial.pdf."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Bouckaert, R. (1994, January 29\u201331). Properties of Bayesian Belief Network Learning Algorithms. Proceedings of the Tenth international conference on Uncertainty in artificial intelligence, Seattle, WA, USA.","DOI":"10.1016\/B978-1-55860-332-5.50018-3"},{"key":"ref_38","unstructured":"Buntine, W. (1991, January 24\u201330). Classifiers: A theoretical and empirical study. Proceedings of the IJCAI, Sydney, Australia."},{"key":"ref_39","unstructured":"Buntine, W. (1991, January 13\u201315). Theory refinement on Bayesian networks. Proceedings of the Seventh Conference on Uncertainty in Artificial Intelligence, Los Angeles, CA, USA."},{"key":"ref_40","unstructured":"Chickering, D., Geiger, D., and Heckerman, D. (1995, January 4\u20137). Learning Bayesian networks: Search methods and experimental results. Proceedings of the Fifth Conference on Artificial Intelligence and Statistics, Ft. Lauderdale, FL, USA."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1007\/BF00994110","article-title":"A Bayesian method for the induction of probabilistic networks from data","volume":"9","author":"Cooper","year":"1992","journal-title":"Mach. Learn."},{"key":"ref_42","unstructured":"Friedman, N., and Goldszmidt, M. (1996, January 4\u20138). Building classifiers using Bayesian Networks. Proceedings of the National Conference on Artificial Intelligence, Portland, OR, USA."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1023\/A:1020249912095","article-title":"Being Bayesian about network structure: A Bayesian approach to structure discovery in Bayesian networks","volume":"50","author":"Friedman","year":"2003","journal-title":"Mach. Learn."},{"key":"ref_44","first-page":"549","article-title":"Exact Bayesian structure discovery in Bayesian networks","volume":"5","author":"Koivisto","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1109\/3468.508827","article-title":"Learning Bayesian network structures by searching for the best ordering with genetic algorithms","volume":"26","author":"Larranaga","year":"1996","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_46","unstructured":"Malone, B., Yuan, C., and Hanse, E. (2011, January 7\u201311). Memory-Efficient Dynamic Programming for Learning Optimal Bayesian Networks. Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence, San Francisco, CA, USA."},{"key":"ref_47","unstructured":"Chen, Y. (2016). Structure Discovery in Bayesian Networks: Algorithms and Applications. [Master\u2019s Thesis, Iowa State University]."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1016\/j.ijar.2010.01.014","article-title":"Geometric view on learning Bayesian Network Structures","volume":"51","author":"Vomlel","year":"2010","journal-title":"Int. J. Approx. Reason."},{"key":"ref_49","unstructured":"Tian, J., He, R., and Ram, L. (2010, January 8\u201311). Bayesian model averaging using the k-best Bayesian network structures. Proceedings of the Twenty-Sixth Conference on Uncertainty in Artificial Intelligence, Catalina Island, CA, USA."},{"key":"ref_50","unstructured":"Zhang, H. (2004, January 12\u201314). The Optimality of Naive Bayes. Proceedings of the FLAIRS Conference, Miami Beach, FL, USA."},{"key":"ref_51","unstructured":"Pearl, J. (2000). Causality: Models, Reasoning, and Inference, Cambridge University Press."},{"key":"ref_52","unstructured":"Chickering, D. (1995, January 18\u201320). Transformational Characterization of Equivalent Bayesian Network Structures. Proceedings of the Eleventh Conference on Uncertainty in Artificial Intelligence, Montr\u00e9al, QC, Canada."},{"key":"ref_53","unstructured":"Geiger, D. (1997, January 1\u20133). A Bayesian approach to learning Bayesian networks with local structure. Proceedings of the Thirteenth Conference on Uncertainty in Artificial Intelligence, Providence, RI, USA."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1214\/aos\/1176344064","article-title":"Bayesian Inference for Causal Effects: The Role of Randomization","volume":"6","author":"Rubin","year":"1978","journal-title":"Ann. Stat."},{"key":"ref_55","unstructured":"MIT (2021, July 27). D-Separation. Available online: http:\/\/web.mit.edu\/jmn\/www\/6.034\/d-separation.pdf."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.1007\/s10472-020-09701-7","article-title":"On a hypergraph probabilistic graphical model","volume":"88","author":"Javidian","year":"2020","journal-title":"Ann. Math Artif. Intell."},{"key":"ref_57","unstructured":"Forre, P., and Mooij, J. (2019, January 22\u201325). Causal Calculus in the Presence of Cycles, Latent Confounders and Selection Bias. Proceedings of the Uncertainty in Artificial Intelligence Conference, Tel Aviv, Israel."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"962","DOI":"10.1214\/aos\/1031689015","article-title":"Ancestral graph Markov models","volume":"30","author":"Richardson","year":"2002","journal-title":"Ann. Stat."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/8\/986\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:37:17Z","timestamp":1760164637000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/8\/986"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,30]]},"references-count":58,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["e23080986"],"URL":"https:\/\/doi.org\/10.3390\/e23080986","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2021,7,30]]}}}