{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,20]],"date-time":"2026-09-20T17:33:13Z","timestamp":1789925593678,"version":"4.0.1"},"reference-count":23,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2015,12,17]],"date-time":"2015-12-17T00:00:00Z","timestamp":1450310400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Research Grants Council of Hong Kong under General Research Fund","award":["LU342213"],"award-info":[{"award-number":["LU342213"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2016,1,22]]},"abstract":"<jats:p>Compared to constraint-based causal discovery, causal discovery based on functional causal models is able to identify the whole causal model under appropriate assumptions [Shimizu et al. 2006; Hoyer et al. 2009; Zhang and Hyv\u00e4rinen 2009b]. Functional causal models represent the effect as a function of the direct causes together with an independent noise term. Examples include the linear non-Gaussian acyclic model (LiNGAM), nonlinear additive noise model, and post-nonlinear (PNL) model. Currently, there are two ways to estimate the parameters in the models: dependence minimization and maximum likelihood. In this article, we show that for any acyclic functional causal model, minimizing the mutual information between the hypothetical cause and the noise term is equivalent to maximizing the data likelihood with a flexible model for the distribution of the noise term. We then focus on estimation of the PNL causal model and propose to estimate it with the warped Gaussian process with the noise modeled by the mixture of Gaussians. As a Bayesian nonparametric approach, it outperforms the previous one based on mutual information minimization with nonlinear functions represented by multilayer perceptrons; we also show that unlike the ordinary regression, estimation results of the PNL causal model are sensitive to the assumption on the noise distribution. Experimental results on both synthetic and real data support our theoretical claims.<\/jats:p>","DOI":"10.1145\/2700476","type":"journal-article","created":{"date-parts":[[2015,12,18]],"date-time":"2015-12-18T09:32:38Z","timestamp":1450431158000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["On Estimation of Functional Causal Models"],"prefix":"10.1145","volume":"7","author":[{"given":"Kun","family":"Zhang","sequence":"first","affiliation":[{"name":"Max-Planck Institute for Intelligent Systems, Tubingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhikun","family":"Wang","sequence":"additional","affiliation":[{"name":"Max-Planck Institute for Intelligent Systems, Tubingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiji","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Philosophy, Lingnan University, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bernhard","family":"Sch\u00f6lkopf","sequence":"additional","affiliation":[{"name":"Max-Planck Institute for Intelligent Systems, Tubingen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,12,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1981.10477649"},{"key":"e_1_2_1_2_1","doi-asserted-by":"crossref","unstructured":"T. M. Cover and J. A. Thomas. 1991. Elements of Information Theory. Wiley.   T. M. Cover and J. A. Thomas. 1991. Elements of Information Theory. Wiley.","DOI":"10.1002\/0471200611"},{"key":"e_1_2_1_3_1","unstructured":"A. Gretton K. Fukumizu C. H. Teo L. Song B. Sch\u00f6lkopf and A. J. Smola. 2008. A kernel statistical test of independence. In Advances in Neural Information Procssing Systems 20. MIT Press Cambridge MA 585--592.  A. Gretton K. Fukumizu C. H. Teo L. Song B. Sch\u00f6lkopf and A. J. Smola. 2008. A kernel statistical test of independence. In Advances in Neural Information Procssing Systems 20. MIT Press Cambridge MA 585--592."},{"key":"e_1_2_1_4_1","unstructured":"P. O. Hoyer D. Janzing J. Mooij J. Peters and B. Sch\u00f6lkopf. 2009. Nonlinear causal discovery with additive noise models. In Advances in Neural Information Processing Systems 21.  P. O. Hoyer D. Janzing J. Mooij J. Peters and B. Sch\u00f6lkopf. 2009. Nonlinear causal discovery with additive noise models. In Advances in Neural Information Processing Systems 21."},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"A. Hyv\u00e4rinen J. Karhunen and E. Oja. 2001. Independent Component Analysis. John Wiley & Sons.  A. Hyv\u00e4rinen J. Karhunen and E. Oja. 2001. Independent Component Analysis. John Wiley & Sons.","DOI":"10.1002\/0471221317"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(98)00140-3"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2012.01.002"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1198\/106186001317115045"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553470"},{"key":"e_1_2_1_10_1","unstructured":"J. Mooij O. Stegle D. Janzing K. Zhang and B. Sch\u00f6lkopf. 2010. Probabilistic latent variable models for distinguishing between cause and effect. In Advances in Neural Information Processing Systems 23.  J. Mooij O. Stegle D. Janzing K. Zhang and B. Sch\u00f6lkopf. 2010. Probabilistic latent variable models for distinguishing between cause and effect. In Advances in Neural Information Processing Systems 23."},{"key":"e_1_2_1_11_1","volume-title":"Causality: Models, Reasoning, and Inference","author":"Pearl J.","year":"2000","unstructured":"J. Pearl . 2000 . Causality: Models, Reasoning, and Inference . Cambridge University Press , Cambridge, MA . J. Pearl. 2000. Causality: Models, Reasoning, and Inference. Cambridge University Press, Cambridge, MA."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the 29th International Conference on Machine Learning (ICML\u201912)","author":"Sch\u00f6lkopf B.","unstructured":"B. Sch\u00f6lkopf , D. Janzing , J. Peters , E. Sgouritsa , K. Zhang , and J. Mooij . 2012. On causal and anticausal learning . In Proceedings of the 29th International Conference on Machine Learning (ICML\u201912) . B. Sch\u00f6lkopf, D. Janzing, J. Peters, E. Sgouritsa, K. Zhang, and J. Mooij. 2012. On causal and anticausal learning. In Proceedings of the 29th International Conference on Machine Learning (ICML\u201912)."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248619"},{"key":"e_1_2_1_14_1","unstructured":"E. Snelson C. E. Rasmussen and Z. Ghahramani. 2004. Warped Gaussian processes. In Advances in Neural Information Processing Systems 16.  E. Snelson C. E. Rasmussen and Z. Ghahramani. 2004. Warped Gaussian processes. In Advances in Neural Information Processing Systems 16."},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"P. Spirtes C. Glymour and R. Scheines. 2001. Causation Prediction and Search (2nd ed.). MIT Press Cambridge MA.  P. Spirtes C. Glymour and R. Scheines. 2001. Causation Prediction and Search (2nd ed.). MIT Press Cambridge MA.","DOI":"10.7551\/mitpress\/1754.001.0001"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/78.790661"},{"key":"e_1_2_1_17_1","volume-title":"Proceedings of the 24th AAAI Conference on Artificial Intelligence (AAAI\u201910)","author":"Yamada M.","unstructured":"M. Yamada and M. Sugiyama . 2010. Dependence minimizing regression with model selection for non-linear causal inference under non-Gaussian noise . In Proceedings of the 24th AAAI Conference on Artificial Intelligence (AAAI\u201910) . 643--648. M. Yamada and M. Sugiyama. 2010. Dependence minimizing regression with model selection for non-linear causal inference under non-Gaussian noise. In Proceedings of the 24th AAAI Conference on Artificial Intelligence (AAAI\u201910). 643--648."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1162\/0899766053011500"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD\u201909)","author":"Zhang K.","unstructured":"K. Zhang and A. Hyv\u00e4rinen . 2009a. Acyclic causality discovery with additive noise: An information-theoretical perspective . In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD\u201909) . K. Zhang and A. Hyv\u00e4rinen. 2009a. Acyclic causality discovery with additive noise: An information-theoretical perspective. In Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD\u201909)."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence.","author":"Zhang K.","unstructured":"K. Zhang and A. Hyv\u00e4rinen . 2009b. On the identifiability of the post-nonlinear causal model . In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. K. Zhang and A. Hyv\u00e4rinen. 2009b. On the identifiability of the post-nonlinear causal model. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI\u201911)","author":"Zhang K.","unstructured":"K. Zhang , J. Peters , D. Janzing , and B. Sch\u00f6lkopf . 2011. Kernel-based conditional independence test and application in causal discovery . In Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI\u201911) . K. Zhang, J. Peters, D. Janzing, and B. Sch\u00f6lkopf. 2011. Kernel-based conditional independence test and application in causal discovery. In Proceedings of the 27th Conference on Uncertainty in Artificial Intelligence (UAI\u201911)."},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 30th International Conference on Machine Learning.","author":"Zhang K.","unstructured":"K. Zhang , B. Sch\u00f6lkopf , K. Muandet , and Z. Wang . 2013a. Domain adaptation under target and conditional shift . In Proceedings of the 30th International Conference on Machine Learning. K. Zhang, B. Sch\u00f6lkopf, K. Muandet, and Z. Wang. 2013a. Domain adaptation under target and conditional shift. In Proceedings of the 30th International Conference on Machine Learning."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/2606262.2606574"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2700476","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2700476","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:07:44Z","timestamp":1750208864000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2700476"}},"subtitle":["General Results and Application to the Post-Nonlinear Causal Model"],"short-title":[],"issued":{"date-parts":[[2015,12,17]]},"references-count":23,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,1,22]]}},"alternative-id":["10.1145\/2700476"],"URL":"https:\/\/doi.org\/10.1145\/2700476","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,12,17]]},"assertion":[{"value":"2014-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-12-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}