{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T23:35:59Z","timestamp":1772321759170,"version":"3.50.1"},"reference-count":52,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T00:00:00Z","timestamp":1669593600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T00:00:00Z","timestamp":1669593600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Data Min Knowl Disc"],"published-print":{"date-parts":[[2023,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In Bayesian Networks (BNs), the direction of edges is crucial for causal reasoning and inference. However, Markov equivalence class considerations mean it is not always possible to establish edge orientations, which is why many BN structure learning algorithms cannot orientate all edges from purely observational data. Moreover, latent confounders can lead to false positive edges. Relatively few methods have been proposed to address these issues. In this work, we present the hybrid mFGS-BS (majority rule and Fast Greedy equivalence Search with Bayesian Scoring) algorithm for structure learning from discrete data that involves an observational data set and one or more interventional data sets. The algorithm assumes causal insufficiency in the presence of latent variables and produces a Partial Ancestral Graph (PAG). Structure learning relies on a hybrid approach and a novel Bayesian scoring paradigm that calculates the posterior probability of each directed edge being added to the learnt graph. Experimental results based on well-known networks of up to 109 variables and 10\u00a0k sample size show that mFGS-BS improves structure learning accuracy relative to the state-of-the-art and it is computationally efficient.<\/jats:p>","DOI":"10.1007\/s10618-022-00882-9","type":"journal-article","created":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T11:04:06Z","timestamp":1669633446000},"page":"476-520","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Hybrid Bayesian network discovery with latent variables by scoring multiple interventions"],"prefix":"10.1007","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3158-6003","authenticated-orcid":false,"given":"Kiattikun","family":"Chobtham","sequence":"first","affiliation":[]},{"given":"Anthony C.","family":"Constantinou","sequence":"additional","affiliation":[]},{"given":"Neville K.","family":"Kitson","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,11,28]]},"reference":[{"issue":"2","key":"882_CR1","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1214\/aos\/1031833662","volume":"25","author":"SA Andersson","year":"1997","unstructured":"Andersson SA, Madigan D, Perlman MD (1997) A characterization of Markov equivalence classes for acyclic digraphs. Ann Stat 25(2):505\u2013541. https:\/\/doi.org\/10.1214\/aos\/1031833662","journal-title":"Ann Stat"},{"key":"882_CR2","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1007\/978-3-642-93437-7_28","volume-title":"AIME 89","author":"IA Beinlich","year":"1989","unstructured":"Beinlich IA, Suermondt HJ, Martin Chavez R, Cooper GF (1989) The alarm monitoring system: A case study with two probabilistic inference techniques for belief networks. In: Hunter Jim, Cookson John, Wyatt Jeremy (eds) AIME 89. Springer Berlin Heidelberg, Berlin, pp 247\u2013256. https:\/\/doi.org\/10.1007\/978-3-642-93437-7_28"},{"issue":"1","key":"882_CR3","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/S0888-613X(99)00041-9","volume":"24","author":"R Castelo","year":"2000","unstructured":"Castelo R, Siebes A (2000) Priors on network structures. Biasing the search for Bayesian networks. Int J Approx Reason 24(1):39\u201357. https:\/\/doi.org\/10.1016\/S0888-613X(99)00041-9","journal-title":"Int J Approx Reason"},{"key":"882_CR4","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1162\/153244303321897717","volume":"3","author":"DM Chickering","year":"2003","unstructured":"Chickering DM (2003) Optimal structure identification with greedy search. J Mach Learn Res 3:507\u2013554. https:\/\/doi.org\/10.1162\/153244303321897717","journal-title":"J Mach Learn Res"},{"key":"882_CR5","unstructured":"Chobtham K and Constantinou AC (2020) Bayesian network structure learning with causal effects in the presence of latent variables. In M. Jaeger and T. D. Nielsen, (eds). In: proceedings of the 10th international conference on probabilistic graphical models, volume 138 of proceedings of machine learning research, pages 101\u2013112"},{"issue":"116","key":"882_CR7","first-page":"3921","volume":"15","author":"D Colombo","year":"2014","unstructured":"Colombo D, Maathuis MH (2014) Order-independent constraint-based causal structure learning. J Mach Learn Res 15(116):3921\u20133962","journal-title":"J Mach Learn Res"},{"key":"882_CR8","doi-asserted-by":"publisher","first-page":"04","DOI":"10.1214\/11-AOS940","volume":"40","author":"D Colombo","year":"2011","unstructured":"Colombo D, Maathuis M, Kalisch M, Richardson T (2011) Learning high-dimensional directed acyclic graphs with latent and selection variables. Annals Statist 40:04. https:\/\/doi.org\/10.1214\/11-AOS940","journal-title":"Annals Statist"},{"key":"882_CR9","first-page":"2019","volume":"12666","author":"AC Constantinou","year":"1905","unstructured":"Constantinou AC (1905) Evaluating structure learning algorithms with a balanced scoring function. CoRR, arXiv 12666:2019","journal-title":"CoRR, arXiv"},{"key":"882_CR10","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1016\/j.eswa.2016.02.050","volume":"56","author":"AC Constantinou","year":"2016","unstructured":"Constantinou AC, Fenton N, Neil M (2016) Integrating expert knowledge with data in Bayesian networks: Preserving data-driven expectations when the expert variables remain unobserved. Expert Syst Appl 56:197\u2013208. https:\/\/doi.org\/10.1016\/j.eswa.2016.02.050","journal-title":"Expert Syst Appl"},{"key":"882_CR11","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1016\/j.ijar.2021.01.001","volume":"131","author":"AC Constantinou","year":"2021","unstructured":"Constantinou AC, Liu Y, Chobtham K, Guo Z, Kitson NK (2021) Large-scale empirical validation of Bayesian network structure learning algorithms with noisy data. Int J Approx Reason 131:151\u2013188. https:\/\/doi.org\/10.1016\/j.ijar.2021.01.001","journal-title":"Int J Approx Reason"},{"key":"882_CR12","unstructured":"Constantinou AC, Liu Y, Chobtham K, Guo Z, and Kitson NK (2020) The bayesys data and bayesian network Repository. URL http:\/\/Bayesian-ai.eecs.qmul.ac.uk\/ bayesys\/."},{"key":"882_CR13","unstructured":"Cussens J (2012) An upper bound for Bdeu local scores."},{"key":"882_CR53","unstructured":"de Waal A, Koen H, de Villiers P, Roodt H, Moorosi N and Pavlin G (2016) Construction and evaluation of Bayesian networks with expert-defined latent variables. In 2016 19th International Conference on Information Fusion (FUSION), pages 774\u2013781."},{"issue":"4","key":"882_CR14","doi-asserted-by":"publisher","first-page":"367","DOI":"10.1016\/j.scijus.2019.03.003","volume":"59","author":"J de Zoete","year":"2019","unstructured":"de Zoete J, Fenton N, Noguchi T, Lagnado D (2019) Resolving the so-called \u201cprobabilistic paradoxes in legal reasoning\u201d with Bayesian networks. Sci Justice 59(4):367\u2013379. https:\/\/doi.org\/10.1016\/j.scijus.2019.03.003","journal-title":"Sci Justice"},{"key":"882_CR15","unstructured":"Eaton D and Murphy K (2007) Exact Bayesian structure learning from uncertain interventions. In M. Meila and X. Shen, (eds), In: Proceedings of the eleventh international conference on artificial intelligence and statistics, volume 2 of proceedings of machine learning research, pages 107\u2013114, San Juan, Puerto Rico, 21\u201324. PMLR."},{"key":"882_CR16","unstructured":"Fisher R (1935) The design of experiments. 1935. Oliver and Boyd, Edinburgh."},{"key":"882_CR17","doi-asserted-by":"publisher","first-page":"107","DOI":"10.3233\/AIC-2011-0491","volume":"24","author":"M Gebser","year":"2011","unstructured":"Gebser M, Kaufmann B, Kaminski R, Ostrowski M, Schaub T, Schneider M (2011) 1 potassco: The potsdam answer set solving collection. AI Commun 24:107\u2013124. https:\/\/doi.org\/10.3233\/AIC-2011-0491","journal-title":"AI Commun"},{"key":"882_CR18","unstructured":"Gelfond M and Lifschitz V (1988) The stable model semantics for logic programming. In R. Kowalski, Bowen, and Kenneth, (eds). In: proceedings of international logic programming conference and symposium, pages 1070\u20131080. MIT Press. URL http:\/\/www.cs.utexas.edu\/users\/ai-lab?gel88."},{"key":"882_CR20","unstructured":"Hauser A and Bu\u00a8hlmann P (2012) Characterization and greedy learning of interventional Markov equivalence classes of directed acyclic graphs."},{"key":"882_CR21","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1055\/s-0038-1634867","volume":"31","author":"D Heckerman","year":"1992","unstructured":"Heckerman D, Horvitz E, Nathwani B (1992) Toward normative expert systems: Part I the pathfinder project. Method Inform Med 31:90\u2013105. https:\/\/doi.org\/10.1055\/s-0038-1634867","journal-title":"Method Inform Med"},{"issue":"3","key":"882_CR22","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/BF00994016","volume":"20","author":"D Heckerman","year":"1995","unstructured":"Heckerman D, Geiger D, Chickering DM (1995) Learning Bayesian networks: the combination of knowledge and statistical data. Mach Learn 20(3):197\u2013243. https:\/\/doi.org\/10.1007\/BF00994016","journal-title":"Mach Learn"},{"key":"882_CR24","unstructured":"Hyttinen A, Eberhardt F and Ja\u00a8rvisalo M (2014) Constraint-based causal discovery: Conflict resolution with answer set programming. In: Proceedings of the thirtieth conference on uncertainty in artificial intelligence, UAI\u201914, page 340\u2013349, Arlington, Virginia, USA. AUAI Press. ISBN 9780974903910."},{"key":"882_CR25","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611976236.49","author":"F Jabbari","year":"2020","unstructured":"Jabbari F, Cooper G (2020) An instance-specific algorithm for learning the structure of causal Bayesian networks containing latent variables. Proc SIAM Int Conf Data Mining. https:\/\/doi.org\/10.1137\/1.9781611976236.49","journal-title":"Proc SIAM Int Conf Data Mining"},{"key":"882_CR26","first-page":"2017","volume":"142\u2013157","author":"F Jabbari","year":"2017","unstructured":"Jabbari F, Ramsey J, Spirtes P, Cooper GF (2017) Discovery of causal models that contain latent variables through Bayesian scoring of independence constraints. Mach Learn Knowl Discov Databases: Eur Conf, ECML PKDD 142\u2013157:2017","journal-title":"Mach Learn Knowl Discov Databases: Eur Conf, ECML PKDD"},{"key":"882_CR27","volume-title":"PRICAI 2004: Trends in Artificial Intelligence","author":"KB Korb","year":"2004","unstructured":"Korb KB, Hope LR, Nicholson AE, Axnick K (2004) Varieties of causal intervention. In: Zhang C, Guesgen HW, Yeap W-K (eds) PRICAI 2004: Trends in Artificial Intelligence. Springer Berlin Heidelberg, Berlin"},{"issue":"4","key":"882_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0249415","volume":"16","author":"E Kummerfeld","year":"2021","unstructured":"Kummerfeld E (2021) A simple interpretation of undirected edges in essential graphs is wrong. PLOS ONE 16(4):1\u201312. https:\/\/doi.org\/10.1371\/journal.pone.0249415","journal-title":"PLOS ONE"},{"issue":"2","key":"882_CR29","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1111\/j.2517-6161.1988.tb01721.x","volume":"50","author":"SL Lauritzen","year":"1988","unstructured":"Lauritzen SL, Spiegelhalter DJ (1988) Local computations with probabilities on graphical structures and their application to expert systems. J Roy Stat Soc: Ser B (Methodol) 50(2):157\u2013194","journal-title":"J Roy Stat Soc: Ser B (Methodol)"},{"key":"882_CR30","unstructured":"Magliacane S, Claassen T and Mooij JM (2017) Ancestral causal inference."},{"key":"882_CR31","unstructured":"Margaritis D (2005) Distribution-free learning of bayesian network structure in continuous domains. In: proceedings of the 20th national conference on artificial intelligence - volume 2, AAAI\u201905, page 825\u2013830. AAAI Press, 2005. ISBN 157735236x."},{"key":"882_CR32","unstructured":"Mooij JM, Magliacane S and Claassen T (2020) Joint causal inference from multiple contexts."},{"issue":"3\u20134","key":"882_CR33","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1023\/A:1018930122475","volume":"25","author":"I Niemela","year":"1999","unstructured":"Niemela I (1999) Logic programs with stable model semantics as a constraint programming paradigm. Ann Math Artif Intell 25(3\u20134):241\u2013273","journal-title":"Ann Math Artif Intell"},{"key":"882_CR34","unstructured":"Ogarrio JM, Spirtes P and Ramsey J (2016) A hybrid causal search algorithm for latent variable models. In A. Antonucci, G. Corani, and C. P. Campos, (eds). In: Proceedings of the eighth international conference on probabilistic graphical models, pages 368\u2013379."},{"key":"882_CR35","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511803161","volume-title":"Causality: Models, reasoning, and inference","author":"J Pearl","year":"2013","unstructured":"Pearl J (2013) Causality: Models, reasoning, and inference. Cambridge University Press. https:\/\/doi.org\/10.1017\/CBO9780511803161"},{"key":"882_CR36","unstructured":"Ramsey J, Zhang J and Spirtes P (2012) Adjacency-faithfulness and conservative causal inference. CoRR, abs\/1206.6843."},{"key":"882_CR37","unstructured":"Ramsey JD (2015) Scaling up greedy equivalence search for continuous variables. CoRR, abs\/1507.07749."},{"key":"882_CR38","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1214\/aos\/1031689015","volume":"30","author":"T Richardson","year":"2000","unstructured":"Richardson T, Spirtes P (2000) Ancestral graph Markov models. Ann Stat 30:11. https:\/\/doi.org\/10.1214\/aos\/1031689015","journal-title":"Ann Stat"},{"key":"882_CR39","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1007\/s11019-008-9140-4","volume":"12","author":"D Rickles","year":"2009","unstructured":"Rickles D (2009) Causality in complex interventions. Med Health Care Philos 12:77\u201390","journal-title":"Med Health Care Philos"},{"key":"882_CR40","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-10105-3","author":"J Runge","year":"2019","unstructured":"Runge J, Bathiany S, Bollt E, Camps-Valls G, Coumou D, Deyle E, Glymour C, Kretschmer M, Mahecha MD, Mu\u00f1oz-Mar\u00ed J, van Nes EH, Peters J, Quax R, Reichstein M, Scheffer M, Sch\u00f6lkopf B, Spirtes P, Sugihara G, Sun J, Zhang K, Zscheischler J (2019) Inferring causation from time series in earth system sciences. Nat Commun. https:\/\/doi.org\/10.1038\/s41467-019-10105-3","journal-title":"Nat Commun"},{"issue":"5721","key":"882_CR41","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1126\/science.1105809","volume":"308","author":"K Sachs","year":"2005","unstructured":"Sachs K, Perez O, Pe\u2019er D, Lauffenburger DA, Nolan GP (2005) Causal protein-signaling networks derived from multiparameter single-cell data. Science 308(5721):523\u2013529. https:\/\/doi.org\/10.1126\/science.1105809","journal-title":"Science"},{"key":"882_CR43","unstructured":"M. Scutari. An empirical-bayes score for discrete Bayesian networks, 2017."},{"key":"882_CR44","unstructured":"Scutari M (2019) Bnlearn dataset repository. URL https:\/\/www.bnlearn.com\/bnrepository."},{"key":"882_CR45","unstructured":"Silander T, Kontkanen P and Myllymaki P (2012) On sensitivity of the map Bayesian network structure to the equivalent sample size parameter."},{"key":"882_CR46","doi-asserted-by":"crossref","unstructured":"Spirtes P, Glymour C and Scheines R (2001) Causation, prediction, and search, 2nd edition, volume 1 of MIT Press Books. The MIT Press. ISBN ARRAY(0x479b6ad8).","DOI":"10.7551\/mitpress\/1754.001.0001"},{"issue":"1","key":"882_CR47","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1093\/rheumatology\/kes269","volume":"52","author":"S Thornley","year":"2012","unstructured":"Thornley S, Marshall RJ, Jackson R, Gentles D, Dalbeth N, Crengle S, Kerr A, Wells S (2012) Is serum urate causally associated with incident cardiovascular disease? Rheumatology 52(1):135\u2013142. https:\/\/doi.org\/10.1093\/rheumatology\/kes269","journal-title":"Rheumatology"},{"key":"882_CR48","unstructured":"Tian J and Pearl J (2001) Causal discovery from changes: a Bayesian approach. 01 2001."},{"issue":"66","key":"882_CR49","first-page":"2147","volume":"16","author":"S Triantafillou","year":"2015","unstructured":"Triantafillou S, Tsamardinos I (2015) Constraint-based causal discovery from multiple interventions over overlapping variable sets. J Mach Learn Res 16(66):2147\u20132205","journal-title":"J Mach Learn Res"},{"key":"882_CR50","unstructured":"Triantafillou S (2016) COmbINE MATLAB library. URL https:\/\/github.com\/striantafillou\/COmbINE ."},{"key":"882_CR51","doi-asserted-by":"publisher","first-page":"08","DOI":"10.1016\/j.ijar.2018.08.002","volume":"102","author":"K Tsirlis","year":"2018","unstructured":"Tsirlis K, Lagani V, Triantafillou S, Tsamardinos I (2018) On scoring maximal ancestral graphs with the max\u2013min hill climbing algorithm. Int J Approx Reason 102:08. https:\/\/doi.org\/10.1016\/j.ijar.2018.08.002","journal-title":"Int J Approx Reason"},{"key":"882_CR52","unstructured":"Verma T and Pearl J (1990) Equivalence and synthesis of causal models. In: proceedings of the sixth annual conference on uncertainty in artificial intelligence, UAI \u201990, page 255\u2013270, USA, 1990. Elsevier Science Inc. ISBN 0444892648."},{"key":"882_CR54","unstructured":"Wang Y, Solus L, Yang KD and Uhler C (2017) Permutation-based causal inference algorithms with interventions."},{"key":"882_CR55","unstructured":"Wongchokprasitti C (2019) R-causal R Wrapper for Tetrad Library, v1.1.1. https:\/\/github.com\/bd2kccd\/r-causal"},{"key":"882_CR56","unstructured":"Zhang J (2006) Causal inference and reasoning in causally insufficient systems. Technical report."}],"container-title":["Data Mining and Knowledge Discovery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-022-00882-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10618-022-00882-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10618-022-00882-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T16:32:56Z","timestamp":1728491576000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10618-022-00882-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,28]]},"references-count":52,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2023,1]]}},"alternative-id":["882"],"URL":"https:\/\/doi.org\/10.1007\/s10618-022-00882-9","relation":{},"ISSN":["1384-5810","1573-756X"],"issn-type":[{"value":"1384-5810","type":"print"},{"value":"1573-756X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,28]]},"assertion":[{"value":"20 December 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}