{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T12:30:29Z","timestamp":1779107429125,"version":"3.51.4"},"reference-count":56,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2023,2,20]],"date-time":"2023-02-20T00:00:00Z","timestamp":1676851200000},"content-version":"vor","delay-in-days":1445,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,7,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>We introduce a new method to estimate the Markov equivalence class of a directed acyclic graph (DAG) in the presence of hidden variables, in settings where the underlying DAG among the observed variables is sparse, and there are a few hidden variables that have a direct effect on many of the observed variables. Building on the so-called low rank plus sparse framework, we suggest a two-stage approach which first removes the effect of the hidden variables and then estimates the Markov equivalence class of the underlying DAG under the assumption that there are no remaining hidden variables. This approach is consistent in certain high dimensional regimes and performs favourably when compared with the state of the art, in terms of both graphical structure recovery and total causal effect estimation.<\/jats:p>","DOI":"10.1111\/rssb.12315","type":"journal-article","created":{"date-parts":[[2019,3,9]],"date-time":"2019-03-09T03:34:25Z","timestamp":1552102465000},"page":"459-487","source":"Crossref","is-referenced-by-count":23,"title":["Robust Causal Structure Learning with Some Hidden Variables"],"prefix":"10.1093","volume":"81","author":[{"given":"Benjamin","family":"Frot","sequence":"first","affiliation":[{"name":"Eidgen\u00f6ssiche Technische Hochschule, Z\u00fcrich \u00a0 Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Preetam","family":"Nandy","sequence":"additional","affiliation":[{"name":"University of Pennsylvania , Philadelphia , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marloes H.","family":"Maathuis","sequence":"additional","affiliation":[{"name":"Eidgen\u00f6ssiche Technische Hochschule, Z\u00fcrich \u00a0 Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2019,3,8]]},"reference":[{"key":"2023022002404788700_","volume-title":"Local genetic effects on gene expression across 44 human tissues","author":"Aguet","year":"2016"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"2808","DOI":"10.1214\/08-AOS626","article-title":"Markov equivalence for ancestral graphs","volume":"37","author":"Ali","year":"2009","journal-title":"Ann. Statist."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1214\/aos\/1031833662","article-title":"A characterization of Markov equivalence classes for acyclic digraphs","volume":"25","author":"Andersson","year":"1997","journal-title":"Ann. Statist."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","DOI":"10.1002\/9781118619179","volume-title":"Structural Equations with Latent Variables","author":"Bollen","year":"1989"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","DOI":"10.1145\/1970392.1970395","article-title":"Robust principal component analysis?","volume":"58","author":"Cand\u00e8s","year":"2011","journal-title":"J. Ass. Comput. Mach"},{"key":"2023022002404788700_","first-page":"1935","article-title":"Latent variable graphical model selection via convex optimization","volume":"40","author":"Chandrasekaran","year":"2012","journal-title":"Ann. Statist."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1137\/090761793","article-title":"Rank-sparsity incoherence for matrix decomposition","volume":"21","author":"Chandrasekaran","year":"2011","journal-title":"SIAM J. Optimizn"},{"key":"2023022002404788700_","first-page":"445","article-title":"Learning equivalence classes of Bayesian-network structures","volume":"2","author":"Chickering","year":"2002","journal-title":"J. Mach. Learn. Res."},{"key":"2023022002404788700_","first-page":"172","volume-title":"Learning sparse causal models is not NP-hard","author":"Claassen","year":"2013"},{"key":"2023022002404788700_","first-page":"3741","article-title":"Order-independent constraint-based causal structure learning","volume":"15","author":"Colombo","year":"2014","journal-title":"J. Mach. Learn. Res."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1214\/11-AOS940","article-title":"Learning high-dimensional directed acyclic graphs with latent and selection variables","volume":"40","author":"Colombo","year":"2012","journal-title":"Ann. Statist."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1038\/nrc906","article-title":"Transcription factors as targets for cancer therapy","volume":"2","author":"Darnell","year":"2002","journal-title":"Nat. Rev. Cancer"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1146\/annurev-statistics-060116-053803","article-title":"Structure learning in graphical modeling","volume":"4","author":"Drton","year":"2017","journal-title":"A. Rev. Statist. Appl."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"4027","DOI":"10.1242\/jcs.054916","article-title":"Defining specificity of transcription factor regulatory activities","volume":"122","author":"Eeckhoute","year":"2009","journal-title":"J. Cell Sci."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-2937-2","volume-title":"Symmetric Multivariate and Related Distributions","author":"Fang","year":"1990"},{"key":"2023022002404788700_","first-page":"604","volume-title":"Proc. 23rd Int. Conf. Neural Information Processing Systems","author":"Foygel","year":"2010"},{"key":"2023022002404788700_","article-title":"Graphical model selection for Gaussian conditional random fields in the presence of latent variables","author":"Frot","year":"2018","journal-title":"J. Am. Statist. Ass."},{"key":"2023022002404788700_","volume-title":"Removing unwanted variation from high dimensional data with negative controls. Technical Report 820.","author":"Gagnon-Bartsch","year":"2013"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1080\/01621459.2016.1142880","article-title":"Estimation of directed acyclic graphs through two-stage adaptive lasso for gene network inference","volume":"111","author":"Han","year":"2016","journal-title":"J. Am. Statist. Ass."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"23","DOI":"10.3150\/15-BEJ702","article-title":"Statistical analysis of latent generalized correlation matrix estimation in transelliptical distribution","volume":"23","author":"Han","year":"2017","journal-title":"Bernoulli"},{"key":"2023022002404788700_","article-title":"TRRUST: a reference database of human transcriptional regulatory interactions","volume":"5","author":"Han","year":"2015","journal-title":"Scient. Rep."},{"key":"2023022002404788700_","first-page":"3365","article-title":"PC algorithm for nonparanormal graphical models","volume":"14","author":"Harris","year":"2013","journal-title":"J. Mach. Learn. Res."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","DOI":"10.1201\/b18401","volume-title":"Statistical Learning with Sparsity: the Lasso and Generalizations","author":"Hastie","year":"2015"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1146\/annurev-statistics-031017-100630","article-title":"Causal structure learning","volume":"5","author":"Heinze-Deml","year":"2018","journal-title":"A. Rev. Statist. Appl."},{"key":"2023022002404788700_","first-page":"613","article-title":"Estimating high-dimensional directed acyclic graphs with the PC-algorithm","volume":"8","author":"Kalisch","year":"2007","journal-title":"J. Mach. Learn. Res."},{"key":"2023022002404788700_","first-page":"1","article-title":"Causal inference using graphical models with the R package pcalg","volume":"47","author":"Kalisch","year":"2012","journal-title":"J. Statist. Softwr."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"1909","DOI":"10.1534\/genetics.108.094201","article-title":"Accurate discovery of expression quantitative trait loci under confounding from spurious and genuine regulatory hotspots","volume":"180","author":"Kang","year":"2008","journal-title":"Genetics"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198522195.001.0001","volume-title":"Graphical Models","author":"Lauritzen","year":"1996"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pgen.0030161","article-title":"Capturing heterogeneity in gene expression studies by surrogate variable analysis","volume":"3","author":"Leek","year":"2007","journal-title":"PLOS Genet."},{"key":"2023022002404788700_","first-page":"800","volume-title":"Proc. 25th Int. Conf. Neural Information Processing Systems","author":"Liu","year":"2012"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"2172","DOI":"10.1162\/NECO_a_00379","article-title":"Alternating direction methods for latent variable Gaussian graphical model selection","volume":"25","author":"Ma","year":"2013","journal-title":"Neurl Comput."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1038\/nmeth0410-247","article-title":"Predicting causal effects in large-scale systems from observational data","volume":"7","author":"Maathuis","year":"2010","journal-title":"Nat. Meth."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"3133","DOI":"10.1214\/09-AOS685","article-title":"Estimating high-dimensional intervention effects from observational data","volume":"37","author":"Maathuis","year":"2009","journal-title":"Ann. Statist."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.ijar.2017.06.005","article-title":"Estimating bounds on causal effects in high-dimensional and possibly confounded systems","volume":"88","author":"Malinsky","year":"2017","journal-title":"Int. J. Approx. Reason."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0068141","article-title":"Normalizing RNA-sequencing data by modeling hidden covariates with prior knowledge","volume":"8","author":"Mostafavi","year":"2013","journal-title":"PLOS One"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"3151","DOI":"10.1214\/17-AOS1654","article-title":"High-dimensional consistency in score-based and hybrid structure learning","volume":"46","author":"Nandy","year":"2018","journal-title":"Ann. Statist."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1214\/16-AOS1462","article-title":"Estimating the effect of joint interventions from observational data in sparse high-dimensional settings","volume":"45","author":"Nandy","year":"2017","journal-title":"Ann. Statist."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1214\/09-SS057","article-title":"Causal inference in statistics: an overview","volume":"3","author":"Pearl","year":"2009","journal-title":"Statist. Surv."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511803161","volume-title":"Causality: Models, Reasoning and Inference","author":"Pearl","year":"2009"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1137\/050624509","article-title":"A quadratically convergent Newton method for computing the nearest correlation matrix","volume":"28","author":"Qi","year":"2006","journal-title":"SIAM J. Matrx Anal. Appl."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"2873","DOI":"10.2174\/1381612054546699","article-title":"Targeting transcription factors for cancer therapy","volume":"11","author":"Redell","year":"2005","journal-title":"Curr. Pharmceut. Desgn"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"962","DOI":"10.1214\/aos\/1031689015","article-title":"Ancestral graph Markov models","volume":"30","author":"Richardson","year":"2002","journal-title":"Ann. Statist."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1007\/BFb0069178","volume-title":"Combinatorial Mathematics","author":"Robinson","year":"1977"},{"key":"2023022002404788700_","first-page":"191","volume-title":"J. Mach. Learn. Res.","author":"Silva","year":"2006"},{"key":"2023022002404788700_","volume-title":"Causation, Prediction, and Search","author":"Spirtes","year":"2000","edition":"2nd edn"},{"key":"2023022002404788700_","first-page":"499","volume-title":"Proc. 11th Conf. Uncertainty in Artificial Intelligence","author":"Spirtes","year":"1995"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1177\/0049124198027002003","article-title":"Using path diagrams as a structural equation modeling tool","volume":"27","author":"Spirtes","year":"1998","journal-title":"Sociol. Meth. Res."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"500","DOI":"10.1038\/nprot.2011.457","article-title":"Using probabilistic estimation of expression residuals (PEER) to obtain increased power and interpretability of gene expression analyses","volume":"7","author":"Stegle","year":"2012","journal-title":"Nat. Protcls"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"9721","DOI":"10.1002\/2017WR020412","article-title":"A statistical graphical model of the California reservoir system","volume":"53","author":"Taeb","year":"2017","journal-title":"Wat. Resour. Res."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/s10994-006-6889-7","article-title":"The max-min hill-climbing Bayesian network structure learning algorithm","volume":"65","author":"Tsamardinos","year":"2006","journal-title":"Mach. Learn."},{"key":"2023022002404788700_","first-page":"255","volume-title":"Proc. 6th A. Conf. Uncertainty in Artificial Intelligence","author":"Verma","year":"1991"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1017\/CBO9780511794308.006","volume-title":"Compressed Sensing: Theory and Applications","author":"Vershynin","year":"2012"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"1184","DOI":"10.3150\/14-BEJ690","article-title":"Adaptive estimation of the copula correlation matrix for semiparametric elliptical copulas","volume":"22","author":"Wegkamp","year":"2016","journal-title":"Bernoulli"},{"key":"2023022002404788700_","doi-asserted-by":"crossref","DOI":"10.1186\/gb-2004-5-11-r92","article-title":"Sparse graphical Gaussian modeling of the isoprenoid gene network in Arabidopsis thaliana","volume":"5","author":"Wille","year":"2004","journal-title":"Genome Biol."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"1873","DOI":"10.1016\/j.artint.2008.08.001","article-title":"On the completeness of orientation rules for causal discovery in the presence of latent confounders and selection bias","volume":"172","author":"Zhang","year":"2008","journal-title":"Artif. Intell."},{"key":"2023022002404788700_","doi-asserted-by":"crossref","first-page":"1418","DOI":"10.1198\/016214506000000735","article-title":"The adaptive lasso and its oracle properties","volume":"101","author":"Zou","year":"2006","journal-title":"J. Am. Statist. Ass."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12315","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/81\/3\/459\/49270358\/jrsssb_81_3_459.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/81\/3\/459\/49270358\/jrsssb_81_3_459.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,15]],"date-time":"2024-07-15T17:13:50Z","timestamp":1721063630000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/81\/3\/459\/7048382"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3,8]]},"references-count":56,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,3,8]]},"published-print":{"date-parts":[[2019,7,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12315","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,7]]},"published":{"date-parts":[[2019,3,8]]}}}