{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T21:03:40Z","timestamp":1694120620921},"reference-count":57,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2023,6,28]],"date-time":"2023-06-28T00:00:00Z","timestamp":1687910400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,6,28]],"date-time":"2023-06-28T00:00:00Z","timestamp":1687910400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Deutsches Zentrum f\u00fcr Neurodegenerative Erkrankungen e.V. (DZNE) in der Helmholtz-Gemeinschaft"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Stat Comput"],"published-print":{"date-parts":[[2023,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Causal structure learning (CSL) refers to the estimation of causal graphs from data. Causal versions of tools such as ROC curves play a prominent role in empirical assessment of CSL methods and performance is often compared with \u201crandom\u201d baselines (such as the diagonal in an ROC analysis). However, such baselines do not take account of constraints arising from the graph context and hence may represent a \u201clow bar\u201d. In this paper, motivated by examples in systems biology, we focus on assessment of CSL methods for multivariate data where part of the graph structure is known via interventional experiments. For this setting, we put forward a new class of baselines called graph-based predictors (GBPs). In contrast to the \u201crandom\u201d baseline, GBPs leverage the known graph structure, exploiting simple graph properties to provide improved baselines against which to compare CSL methods. We discuss GBPs in general and provide a detailed study in the context of transitively closed graphs, introducing two conceptually simple baselines for this setting, the observed in-degree predictor (OIP) and the transitivity assuming predictor (TAP). While the former is straightforward to compute, for the latter we propose several simulation strategies. Moreover, we study and compare the proposed predictors theoretically, including a result showing that the OIP outperforms in expectation the \u201crandom\u201d baseline on a subclass of latent network models featuring positive correlation among edge probabilities. Using both simulated and real biological data, we show that the proposed GBPs outperform random baselines in practice, often substantially. Some GBPs even outperform standard CSL methods (whilst being computationally cheap in practice). Our results provide a new way to assess CSL methods for interventional data.<\/jats:p>","DOI":"10.1007\/s11222-023-10257-9","type":"journal-article","created":{"date-parts":[[2023,6,28]],"date-time":"2023-06-28T12:02:31Z","timestamp":1687953751000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Improved baselines for causal structure learning on interventional data"],"prefix":"10.1007","volume":"33","author":[{"given":"Robin","family":"Richter","sequence":"first","affiliation":[]},{"given":"Shankar","family":"Bhamidi","sequence":"additional","affiliation":[]},{"given":"Sach","family":"Mukherjee","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,6,28]]},"reference":[{"key":"10257_CR1","unstructured":"Anari, N., Hu, N., Saberi, A., Schild, A.: Sampling arborescences in parallel (2020). arXiv:2012.09502"},{"issue":"5","key":"10257_CR2","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.72.056708","volume":"72","author":"Y Artzy-Randrup","year":"2005","unstructured":"Artzy-Randrup, Y., Stone, L.: Generating uniformly distributed random networks. Phys. Rev. E 72(5), 056708 (2005)","journal-title":"Phys. Rev. E"},{"issue":"3","key":"10257_CR3","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1016\/j.sbi.2004.05.004","volume":"14","author":"MM Babu","year":"2004","unstructured":"Babu, M.M., Luscombe, N.M., Aravind, L., Gerstein, M., Teichmann, S.A.: Structure and evolution of transcriptional regulatory networks. Curr. Opin. Struct. Biol. 14(3), 283\u2013291 (2004). https:\/\/doi.org\/10.1016\/j.sbi.2004.05.004","journal-title":"Curr. Opin. Struct. Biol."},{"issue":"4","key":"10257_CR4","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1080\/15427951.2010.557277","volume":"6","author":"J Blitzstein","year":"2011","unstructured":"Blitzstein, J., Diaconis, P.: A sequential importance sampling algorithm for generating random graphs with prescribed degrees. Internet Math. 6(4), 489\u2013522 (2011). https:\/\/doi.org\/10.1080\/15427951.2010.557277","journal-title":"Internet Math."},{"issue":"1","key":"10257_CR5","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1002\/rsa.20168","volume":"31","author":"B Bollob\u00e1s","year":"2007","unstructured":"Bollob\u00e1s, B., Janson, S., Riordan, O.: The phase transition in inhomogeneous random graphs. Random Struct. Algorithms 31(1), 3\u2013122 (2007)","journal-title":"Random Struct. Algorithms"},{"key":"10257_CR6","first-page":"442","volume":"89","author":"AZ Broder","year":"1989","unstructured":"Broder, A.Z.: Generating random spanning trees. FOCS 89, 442\u2013447 (1989)","journal-title":"FOCS"},{"key":"10257_CR7","first-page":"21865","volume":"33","author":"P Brouillard","year":"2020","unstructured":"Brouillard, P., Lachapelle, S., Lacoste, A., Lacoste-Julien, S., Drouin, A.: Differentiable causal discovery from interventional data. Adv. Neural. Inf. Process. Syst. 33, 21865\u201321877 (2020)","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"10257_CR8","first-page":"3741","volume":"15","author":"D Colombo","year":"2014","unstructured":"Colombo, D., Maathuis, M.H.: Order-independent constraint-based causal structure learning. J. Mach. Learn. Res. 15, 3741\u20133782 (2014)","journal-title":"J. Mach. Learn. Res."},{"issue":"1","key":"10257_CR9","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1214\/11-AOS940","volume":"40","author":"D Colombo","year":"2012","unstructured":"Colombo, D., Maathuis, M.H., Kalisch, M., Richardson, T.S.: Learning high-dimensional directed acyclic graphs with latent and selection variables. Ann. Stat. 40(1), 294\u2013321 (2012). https:\/\/doi.org\/10.1214\/11-AOS940","journal-title":"Ann. Stat."},{"key":"10257_CR10","unstructured":"Cortes, C., Mohri, M.: Confidence intervals for the area under the roc curve. Adv. Neural Inf. Process. Syst. 17 (2004)"},{"issue":"7","key":"10257_CR11","doi-asserted-by":"publisher","first-page":"1853","DOI":"10.1016\/j.cell.2016.11.038","volume":"167","author":"A Dixit","year":"2016","unstructured":"Dixit, A., Parnas, O., Li, B., Chen, J., Fulco, C.P., Jerby-Arnon, L., Marjanovic, N.D., Dionne, D., Burks, T., Raychowdhury, R., Adamson, B., Norman, T.M., Lander, E.S., Weissman, J.S., Friedman, N., Regev, A.: Perturb-seq: dissecting molecular circuits with scalable single-cell RNA profiling of pooled genetic screens. Cell 167(7), 1853-1866.e17 (2016). https:\/\/doi.org\/10.1016\/j.cell.2016.11.038","journal-title":"Cell"},{"key":"10257_CR12","unstructured":"Eigenmann, M., Mukherjee, A., Maathuis, M.: Evaluation of causal structure learning algorithms via risk estimation. In: UAI, pp. 151\u2013160. PMLR (2020). http:\/\/proceedings.mlr.press\/v124\/eigenmann20a.html"},{"key":"10257_CR13","doi-asserted-by":"publisher","DOI":"10.1016\/C2012-0-06036-X","volume-title":"Fundamentals of Brain Network Analysis","author":"A Fornito","year":"2016","unstructured":"Fornito, A., Zalesky, A., Bullmore, E.: Fundamentals of Brain Network Analysis. Academic Press, Cambridge (2016). https:\/\/doi.org\/10.1016\/C2012-0-06036-X"},{"issue":"3\u20135","key":"10257_CR14","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/j.physrep.2009.11.002","volume":"486","author":"S Fortunato","year":"2010","unstructured":"Fortunato, S.: Community detection in graphs. Phys. Rep. 486(3\u20135), 75\u2013174 (2010)","journal-title":"Phys. Rep."},{"issue":"2","key":"10257_CR15","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1137\/16M1087175","volume":"60","author":"BK Fosdick","year":"2018","unstructured":"Fosdick, B.K., Larremore, D.B., Nishimura, J., Ugander, J.: Configuring random graph models with fixed degree sequences. SIAM Rev. 60(2), 315\u2013355 (2018). https:\/\/doi.org\/10.1137\/16M1087175","journal-title":"SIAM Rev."},{"key":"10257_CR16","unstructured":"Gauvin, L., G\u00e9nois, M., Karsai, M., Kivel\u00e4, M., Takaguchi, T., Valdano, E., Vestergaard, C.L. Randomized reference models for temporal networks (2018). arXiv:1806.04032"},{"key":"10257_CR17","doi-asserted-by":"crossref","unstructured":"Greenhill, C.: The switch Markov chain for sampling irregular graphs. In: Proceedings of the Twenty-Sixth Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 1564\u20131572. SIAM (2014)","DOI":"10.1137\/1.9781611973730.103"},{"issue":"1","key":"10257_CR18","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","volume":"143","author":"JA Hanley","year":"1982","unstructured":"Hanley, J.A., McNeil, B.J.: The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143(1), 29\u201336 (1982)","journal-title":"Radiology"},{"issue":"1","key":"10257_CR19","first-page":"2409","volume":"13","author":"A Hauser","year":"2012","unstructured":"Hauser, A., B\u00fchlmann, P.: Characterization and greedy learning of interventional Markov equivalence classes of directed acyclic graphs. J. Mach. Learn. Res. 13(1), 2409\u20132464 (2012)","journal-title":"J. Mach. Learn. Res."},{"issue":"1","key":"10257_CR20","doi-asserted-by":"publisher","first-page":"371","DOI":"10.1146\/annurev-statistics-031017-100630","volume":"5","author":"C Heinze-Deml","year":"2018","unstructured":"Heinze-Deml, C., Maathuis, M.H., Meinshausen, N.: Causal structure learning. Annu. Rev. Stat. Appl. 5(1), 371\u2013391 (2018). https:\/\/doi.org\/10.1146\/annurev-statistics-031017-100630","journal-title":"Annu. Rev. Stat. Appl."},{"key":"10257_CR21","doi-asserted-by":"publisher","unstructured":"Hill, S.M., Heiser, L.M., Cokelaer, T., Unger, M., Nesser, N.K., Carlin, D.E., Zhang, Y., Sokolov, A., Paull, E.O., Wong, C.K., Graim, K., Bivol, A., Wang, H., Zhu, F., Afsari, B., Danilova, L.V., Favorov, A.V., Lee, W.S., Taylor, D., Hu, C.W., Long, B.L., Noren, D.P., Bisberg, A.J., Consortium, H.-D., Mills, G.B., Gray, J.W., Kellen, M., Norman, T., Friend, S., Qutub, A.A., Fertig, E.J., Guan, Y., Song, M., Stuart, J.M., Spellman, P.T., Koeppl, H., Stolovitzky, G., Saez-Rodriguez, J., Mukherjee, S.: Inferring causal molecular networks: empirical assessment through a community-based effort. Nat. Methods 13(4), 310\u2013318 (2016). https:\/\/doi.org\/10.1038\/nmeth.3773","DOI":"10.1038\/nmeth.3773"},{"key":"10257_CR22","doi-asserted-by":"publisher","first-page":"127","DOI":"10.17863\/cam.44718","volume":"20","author":"SM Hill","year":"2019","unstructured":"Hill, S.M., Oates, C.J., Blythe, D.A., Mukherjee, S.: Causal learning via manifold regularization. J. Mach. Learn. Res.: JMLR 20, 127 (2019). https:\/\/doi.org\/10.17863\/cam.44718","journal-title":"J. Mach. Learn. Res.: JMLR"},{"issue":"460","key":"10257_CR23","doi-asserted-by":"publisher","first-page":"1090","DOI":"10.1198\/016214502388618906","volume":"97","author":"PD Hoff","year":"2002","unstructured":"Hoff, P.D., Raftery, A.E., Handcock, M.S.: Latent space approaches to social network analysis. J. Am. Stat. Assoc. 97(460), 1090\u20131098 (2002)","journal-title":"J. Am. Stat. Assoc."},{"key":"10257_CR24","unstructured":"Hyttinen, A., Eberhardt, F., J\u00e4rvisalo, M.: Constraint-based causal discovery: Conflict resolution with answer set programming. UAI (2014). http:\/\/www.its.caltech.edu\/~fehardt\/papers\/HEJ_UAI2014.pdf"},{"key":"10257_CR25","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1146\/annurev.genom.2.1.343","volume":"2","author":"T Ideker","year":"2001","unstructured":"Ideker, T., Galitski, T., Hood, L.: A new approach to decoding life: systems biology. Annu. Rev. Genomics Hum. Genet. 2, 343\u2013372 (2001). https:\/\/doi.org\/10.1146\/annurev.genom.2.1.343","journal-title":"Annu. Rev. Genomics Hum. Genet."},{"issue":"11","key":"10257_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v047.i11","volume":"47","author":"M Kalisch","year":"2012","unstructured":"Kalisch, M., M\u00e4chler, M., Colombo, D., Maathuis, M.H., B\u00fchlmann, P.: Causal inference using graphical models with the R package pcalg. J. Stat. Softw. 47(11), 1\u201326 (2012)","journal-title":"J. Stat. Softw."},{"issue":"1","key":"10257_CR27","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1002\/rsa.3240010106","volume":"1","author":"RM Karp","year":"1990","unstructured":"Karp, R.M.: The transitive closure of a random digraph. Random Struct. Algorithms 1(1), 73\u201393 (1990). https:\/\/doi.org\/10.1002\/rsa.3240010106","journal-title":"Random Struct. Algorithms"},{"issue":"3","key":"10257_CR28","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1016\/j.cell.2014.02.054","volume":"157","author":"P Kemmeren","year":"2014","unstructured":"Kemmeren, P., Sameith, K., van\u00a0de Pasch, L.A.L., Benschop, J.J., Lenstra, T.L., Margaritis, T., O\u2019Duibhir, E., Apweiler, E., van Wageningen, S., Ko, C.W., van Heesch, S., Kashani, M.M., Ampatziadis-Michailidis, G., Brok, M.O., Brabers, N.A.C.H., Miles, A.J., Bouwmeester, D., van Hooff, S.R., van Bakel, H., Sluiters, E., Bakker, L.V., Snel, B., Lijnzaad, P., van Leenen, D., Groot\u00a0Koerkamp, M.J.A., Holstege, F.C.P.: Large-scale genetic perturbations reveal regulatory networks and an abundance of gene-specific repressors. Cell 157(3), 740\u2013752 (2014). https:\/\/doi.org\/10.1016\/j.cell.2014.02.054","journal-title":"Cell"},{"issue":"2","key":"10257_CR29","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1002\/rsa.20470","volume":"43","author":"M Krivelevich","year":"2013","unstructured":"Krivelevich, M., Sudakov, B.: The phase transition in random graphs: a simple proof. Random Struct. Algorithms 43(2), 131\u2013138 (2013). https:\/\/doi.org\/10.1002\/rsa.20470","journal-title":"Random Struct. Algorithms"},{"issue":"6A","key":"10257_CR30","doi-asserted-by":"publisher","first-page":"3133","DOI":"10.1214\/09-AOS685","volume":"37","author":"MH Maathuis","year":"2009","unstructured":"Maathuis, M.H., Kalisch, M., B\u00fchlmann, P.: Estimating high-dimensional intervention effects from observational data. Ann. Stat. 37(6A), 3133\u20133164 (2009). https:\/\/doi.org\/10.1214\/09-AOS685","journal-title":"Ann. Stat."},{"key":"10257_CR31","unstructured":"Magliacane, S., van Ommen, T.: Causal transfer learning (2017). https:\/\/staff.science.uva.nl\/j.m.mooij\/articles\/1707.06422.pdf"},{"key":"10257_CR32","unstructured":"Magliacane, S., Claassen, T., Mooij, J.: Joint causal inference on observational and experimental datasets (2016a). https:\/\/staff.fnwi.uva.nl\/j.m.mooij\/articles\/1611.10351v2.pdf"},{"key":"10257_CR33","unstructured":"Magliacane, S., Claassen, T., Mooij, J.M.: Ancestral causal inference. In: Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol.\u00a029. Curran Associates, Inc. (2016b). https:\/\/proceedings.neurips.cc\/paper\/2016\/file\/f3d9de86462c28781cbe5c47ef22c3e5-Paper.pdf"},{"key":"10257_CR34","unstructured":"Malinsky, D., Spirtes, P.: Estimating causal effects with ancestral graph Markov models. In: Conference on Probabilistic Graphical Models, pp. 299\u2013309. PMLR (2016)"},{"issue":"27","key":"10257_CR35","doi-asserted-by":"publisher","first-page":"7361","DOI":"10.1073\/pnas.1510493113","volume":"113","author":"N Meinshausen","year":"2016","unstructured":"Meinshausen, N., Hauser, A., Mooij, J., Peters, J., Versteeg, P., B\u00fchlmann, P.: Methods for causal inference from gene perturbation experiments and validation. Proc. Natl. Acad. Sci. U.S.A. 113(27), 7361\u20137368 (2016). https:\/\/doi.org\/10.1073\/pnas.1510493113","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"10257_CR36","unstructured":"Milo, R., Kashtan, N., Itzkovitz, S., Newman, M.: On the uniform generation of random graphs with prescribed degree sequences (2003). https:\/\/arxiv.org\/abs\/cond-mat\/0312028"},{"key":"10257_CR37","unstructured":"Mooij, J.M., Claassen, T.: Constraint-based causal discovery using partial ancestral graphs in the presence of cycles. In: Conference on Uncertainty in Artificial Intelligence, pp. 1159\u20131168. PMLR (2020)"},{"issue":"2","key":"10257_CR38","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.67.026126","volume":"67","author":"ME Newman","year":"2003","unstructured":"Newman, M.E.: Mixing patterns in networks. Phys. Rev. E 67(2), 026126 (2003)","journal-title":"Phys. Rev. E"},{"issue":"2","key":"10257_CR39","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.69.026113","volume":"69","author":"ME Newman","year":"2004","unstructured":"Newman, M.E., Girvan, M.: Finding and evaluating community structure in networks. Phys. Rev. E 69(2), 026113 (2004)","journal-title":"Phys. Rev. E"},{"issue":"2","key":"10257_CR40","volume":"12","author":"AR Nogueira","year":"2022","unstructured":"Nogueira, A.R., Pugnana, A., Ruggieri, S., Pedreschi, D., Gama, J.: Methods and tools for causal discovery and causal inference. Wiley Interdiscip. Rev.: Data Min. Knowl. Discov. 12(2), e1449 (2022)","journal-title":"Wiley Interdiscip. Rev.: Data Min. Knowl. Discov."},{"key":"10257_CR41","unstructured":"O\u2019Donnell, R.T., Korb, K.B., Allison, L.: Causal KL: evaluating causal discovery (2021). arXiv:2111.06029"},{"issue":"8","key":"10257_CR42","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1038\/nrg3934","volume":"16","author":"NN Parikshak","year":"2015","unstructured":"Parikshak, N.N., Gandal, M.J., Geschwind, D.H.: Systems biology and gene networks in neurodevelopmental and neurodegenerative disorders. Nat. Rev. Genet. 16(8), 441\u2013458 (2015). https:\/\/doi.org\/10.1038\/nrg3934","journal-title":"Nat. Rev. Genet."},{"key":"10257_CR43","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511803161","volume-title":"Causality","author":"J Pearl","year":"2009","unstructured":"Pearl, J.: Causality. Cambridge University Press, Cambridge (2009). https:\/\/doi.org\/10.1017\/CBO9780511803161"},{"issue":"5","key":"10257_CR44","doi-asserted-by":"publisher","first-page":"947","DOI":"10.1111\/rssb.12167","volume":"78","author":"J Peters","year":"2016","unstructured":"Peters, J., B\u00fchlmann, P., Meinshausen, N.: Causal inference by using invariant prediction: identification and confidence intervals. J. R. Stat. Soc.: Ser. B (Stat. Methodol.) 78(5), 947\u20131012 (2016). https:\/\/doi.org\/10.1111\/rssb.12167","journal-title":"J. R. Stat. Soc.: Ser. B (Stat. Methodol.)"},{"issue":"11","key":"10257_CR45","doi-asserted-by":"publisher","first-page":"855","DOI":"10.1038\/nrg2452","volume":"9","author":"PC Phillips","year":"2008","unstructured":"Phillips, P.C.: Epistasis-the essential role of gene interactions in the structure and evolution of genetic systems. Nat. Rev. Genet. 9(11), 855\u2013867 (2008). https:\/\/doi.org\/10.1038\/nrg2452","journal-title":"Nat. Rev. Genet."},{"key":"10257_CR46","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1186\/1752-0509-7-111","volume":"7","author":"A Rau","year":"2013","unstructured":"Rau, A., Jaffr\u00e9zic, F., Nuel, G.: Joint estimation of causal effects from observational and intervention gene expression data. BMC Syst. Biol. 7, 111 (2013). https:\/\/doi.org\/10.1186\/1752-0509-7-111","journal-title":"BMC Syst. Biol."},{"key":"10257_CR47","unstructured":"Richardson, T.: A discovery algorithm for directed cyclic graphs. In: Proceedings of the Twelfth International Conference on Uncertainty in Artificial Intelligence, pp. 454\u2013461 (1996)"},{"key":"10257_CR48","doi-asserted-by":"publisher","unstructured":"Rothenh\u00e4usler, D., B\u00fchlmann, P., Meinshausen, N.: Causal Dantzig: fast inference in linear structural equation models with hidden variables under additive interventions. Ann. Stat. 47(3), 1688\u20131722 (2019). https:\/\/doi.org\/10.1214\/18-AOS1732","DOI":"10.1214\/18-AOS1732"},{"issue":"5721","key":"10257_CR49","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1126\/science.1105809","volume":"308","author":"K Sachs","year":"2005","unstructured":"Sachs, K., Perez, O., Pe\u2019er, D., Lauffenburger, D.A., Nolan, G.P.: Causal protein-signaling networks derived from multiparameter single-cell data. Science 308(5721), 523\u2013529 (2005). https:\/\/doi.org\/10.1126\/science.1105809","journal-title":"Science"},{"key":"10257_CR50","series-title":"Methods in Molecular Biology","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4939-8882-2","volume-title":"Gene Regulatory Networks: Methods and Protocols","year":"2019","unstructured":"Sanguinetti, G., Huynh-Thu, V.A. (eds.): Gene Regulatory Networks: Methods and Protocols. Methods in Molecular Biology, vol. 1883. Springer, New York (2019). https:\/\/doi.org\/10.1007\/978-1-4939-8882-2"},{"issue":"5","key":"10257_CR51","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1038\/nrg3899","volume":"16","author":"O Shalem","year":"2015","unstructured":"Shalem, O., Sanjana, N.E., Zhang, F.: High-throughput functional genomics using CRISPR-Cas9. Nat. Rev. Genet. 16(5), 299\u2013311 (2015)","journal-title":"Nat. Rev. Genet."},{"key":"10257_CR52","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1214\/15-AOAS806","volume":"9","author":"SE Spencer","year":"2015","unstructured":"Spencer, S.E., Hill, S.M., Mukherjee, S.: Inferring network structure from interventional time-course experiments. Ann. Appl. Stat. 9, 507\u2013524 (2015)","journal-title":"Ann. Appl. Stat."},{"key":"10257_CR53","unstructured":"Spirtes, P.: Introduction to causal inference. J. Mach. Learn. Res. 11(5) (2010)"},{"key":"10257_CR54","doi-asserted-by":"crossref","unstructured":"Spirtes, P., Glymour, C.N., Scheines, R., Heckerman, D.: Causation, Prediction, and Search. MIT Press, Cambridge (2000)","DOI":"10.7551\/mitpress\/1754.001.0001"},{"key":"10257_CR55","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41587-021-01203-z","volume":"40","author":"O Ursu","year":"2022","unstructured":"Ursu, O., Neal, J.T., Shea, E., Thakore, P.I., Jerby-Arnon, L., Nguyen, L., Dionne, D., Diaz, C., Bauman, J., Mosaad, M.M., et al.: Massively parallel phenotyping of coding variants in cancer with perturb-seq. Nat. Biotechnol. 40, 1\u201310 (2022)","journal-title":"Nat. Biotechnol."},{"key":"10257_CR56","volume-title":"Advances in Neural Information Processing Systems","author":"Y Wang","year":"2017","unstructured":"Wang, Y., Solus, L., Yang, K., Uhler, C.: Permutation-based causal inference algorithms with interventions. In: Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 30. Curran Associates Inc., New York (2017)"},{"key":"10257_CR57","first-page":"1437","volume":"9","author":"J Zhang","year":"2008","unstructured":"Zhang, J.: Causal reasoning with ancestral graphs. J. Mach. Learn. Res. 9, 1437\u20131474 (2008)","journal-title":"J. Mach. Learn. Res."}],"container-title":["Statistics and Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-023-10257-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11222-023-10257-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11222-023-10257-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,4]],"date-time":"2023-09-04T07:08:45Z","timestamp":1693811325000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11222-023-10257-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,28]]},"references-count":57,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,10]]}},"alternative-id":["10257"],"URL":"https:\/\/doi.org\/10.1007\/s11222-023-10257-9","relation":{},"ISSN":["0960-3174","1573-1375"],"issn-type":[{"value":"0960-3174","type":"print"},{"value":"1573-1375","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,28]]},"assertion":[{"value":"14 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 May 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 June 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}],"article-number":"93"}}