{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T23:05:51Z","timestamp":1773702351219,"version":"3.50.1"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"POPL","license":[{"start":{"date-parts":[[2019,1,2]],"date-time":"2019-01-02T00:00:00Z","timestamp":1546387200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["FA8750-17-C-0239"],"award-info":[{"award-number":["FA8750-17-C-0239"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2019,1,2]]},"abstract":"<jats:p>We present new techniques for automatically constructing probabilistic programs for data analysis, interpretation, and prediction. These techniques work with probabilistic domain-specific data modeling languages that capture key properties of a broad class of data generating processes, using Bayesian inference to synthesize probabilistic programs in these modeling languages given observed data. We provide a precise formulation of Bayesian synthesis for automatic data modeling that identifies sufficient conditions for the resulting synthesis procedure to be sound. We also derive a general class of synthesis algorithms for domain-specific languages specified by probabilistic context-free grammars and establish the soundness of our approach for these languages. We apply the techniques to automatically synthesize probabilistic programs for time series data and multivariate tabular data. We show how to analyze the structure of the synthesized programs to compute, for key qualitative properties of interest, the probability that the underlying data generating process exhibits each of these properties. Second, we translate probabilistic programs in the domain-specific language into probabilistic programs in Venture, a general-purpose probabilistic programming system. The translated Venture programs are then executed to obtain predictions of new time series data and new multivariate data records. Experimental results show that our techniques can accurately infer qualitative structure in multiple real-world data sets and outperform standard data analysis methods in forecasting and predicting new data.<\/jats:p>","DOI":"10.1145\/3290350","type":"journal-article","created":{"date-parts":[[2019,1,4]],"date-time":"2019-01-04T13:33:51Z","timestamp":1546608831000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["Bayesian synthesis of probabilistic programs for automatic data modeling"],"prefix":"10.1145","volume":"3","author":[{"given":"Feras A.","family":"Saad","sequence":"first","affiliation":[{"name":"Massachusetts Institute of Technology, USA"}]},{"given":"Marco F.","family":"Cusumano-Towner","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, USA"}]},{"given":"Ulrich","family":"Schaechtle","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, USA"}]},{"given":"Martin C.","family":"Rinard","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, USA"}]},{"given":"Vikash K.","family":"Mansinghka","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, USA"}]}],"member":"320","published-online":{"date-parts":[[2019,1,2]]},"reference":[{"key":"e_1_2_2_1_1","first-page":"329","article-title":"Correlation","volume":"11","author":"Abbott Martin L.","year":"2016","unstructured":"Martin L. Abbott . 2016 . Correlation . In Using Statistics in the Social and Health Sciences with SPSS and Excel. Chapter 11 , 329 \u2013 370 . Martin L. Abbott. 2016. Correlation. In Using Statistics in the Social and Health Sciences with SPSS and Excel. Chapter 11, 329\u2013370.","journal-title":"Using Statistics in the Social and Health Sciences with SPSS and Excel. Chapter"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/FMCAD.2013.6679385"},{"key":"e_1_2_2_3_1","volume-title":"International Conference on Learning Representations (ICLR).","author":"Balog Matej","year":"2017","unstructured":"Matej Balog , Alexander L. Gaunt , Marc Brockschmidt , Sebastian Nowozin , and Daniel Tarlow . 2017 . DeepCoder: Learning to write programs . In International Conference on Learning Representations (ICLR). Matej Balog, Alexander L. Gaunt, Marc Brockschmidt, Sebastian Nowozin, and Daniel Tarlow. 2017. DeepCoder: Learning to write programs. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_2_2_4_1","volume-title":"Bayesian Theory","author":"Bernardo Jos\u00e9-Miguel","unstructured":"Jos\u00e9-Miguel Bernardo and Adrian Smith . 1994. Bayesian Theory . John Wiley & amp; Sons, Inc. Jos\u00e9-Miguel Bernardo and Adrian Smith. 1994. Bayesian Theory. John Wiley &amp; Sons, Inc."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-C.1973.223746"},{"key":"e_1_2_2_6_1","volume-title":"Neural Abstract Machines and Program Induction Workshop v2.","author":"Bo\u0161nak Matko","year":"2018","unstructured":"Matko Bo\u0161nak , Pushmeet Kohli , Tejas Kulkrani , Sebastian Riedel , Tim Rockt\u00e4schel , Dawn Song , and Robert Zinkov ( Eds .). 2018 . Neural Abstract Machines and Program Induction Workshop v2. Matko Bo\u0161nak, Pushmeet Kohli, Tejas Kulkrani, Sebastian Riedel, Tim Rockt\u00e4schel, Dawn Song, and Robert Zinkov (Eds.). 2018. Neural Abstract Machines and Program Induction Workshop v2."},{"key":"e_1_2_2_7_1","volume-title":"Box and Gwilym Jenkins","author":"George E.","year":"1976","unstructured":"George E. P. Box and Gwilym Jenkins . 1976 . Time Series Analysis: Forecasting and Control. Holden-Day, Inc . George E. P. Box and Gwilym Jenkins. 1976. Time Series Analysis: Forecasting and Control. Holden-Day, Inc."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/321992.321996"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v076.i01"},{"key":"e_1_2_2_10_1","volume-title":"Proceedings of the Twenty-Ninth International Conference on Computer Aided Verification (CAV), Rupak Majumdar and Viktor Kun\u010dak (Eds.)","volume":"10426","author":"Chasins Sarah","unstructured":"Sarah Chasins and Phitchaya M. Phothilimthana . 2017. Data-driven synthesis of full probabilistic programs . In Proceedings of the Twenty-Ninth International Conference on Computer Aided Verification (CAV), Rupak Majumdar and Viktor Kun\u010dak (Eds.) , Vol. 10426 . Springer, 279\u2013304. Sarah Chasins and Phitchaya M. Phothilimthana. 2017. Data-driven synthesis of full probabilistic programs. In Proceedings of the Twenty-Ninth International Conference on Computer Aided Verification (CAV), Rupak Majumdar and Viktor Kun\u010dak (Eds.), Vol. 10426. Springer, 279\u2013304."},{"key":"e_1_2_2_11_1","volume-title":"Smith","author":"Cody Ron P.","year":"2005","unstructured":"Ron P. Cody and Jeffrey K . Smith . 2005 . Applied Statistics and the SAS Programming Language (5 ed.). Prentice-Hall . Ron P. Cody and Jeffrey K. Smith. 2005. Applied Statistics and the SAS Programming Language (5 ed.). Prentice-Hall."},{"key":"e_1_2_2_12_1","unstructured":"Dua Dheeru and Efi Karra Taniskidou. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml . (2017).  Dua Dheeru and Efi Karra Taniskidou. 2017. UCI Machine Learning Repository. http:\/\/archive.ics.uci.edu\/ml . (2017)."},{"key":"e_1_2_2_13_1","volume-title":"Draper and Harry Smith","author":"Norman","year":"1966","unstructured":"Norman R. Draper and Harry Smith . 1966 . Applied Regression Analysis. John Wiley & amp; Sons, Inc. Norman R. Draper and Harry Smith. 1966. Applied Regression Analysis. John Wiley &amp; Sons, Inc."},{"key":"e_1_2_2_14_1","volume-title":"Proceedings of the Thirtieth International Conference on Machine Learning (ICML), Sanjoy Dasgupta and David McAllester (Eds.)","volume":"28","author":"Duvenaud David","year":"2013","unstructured":"David Duvenaud , James Lloyd , Roger Grosse , Joshua B. Tenenbaum , and Zoubin Ghahramani . 2013 . Structure discovery in nonparametric regression through compositional kernel search . In Proceedings of the Thirtieth International Conference on Machine Learning (ICML), Sanjoy Dasgupta and David McAllester (Eds.) , Vol. 28 . PMLR, 1166\u20131174. David Duvenaud, James Lloyd, Roger Grosse, Joshua B. Tenenbaum, and Zoubin Ghahramani. 2013. Structure discovery in nonparametric regression through compositional kernel search. In Proceedings of the Thirtieth International Conference on Machine Learning (ICML), Sanjoy Dasgupta and David McAllester (Eds.), Vol. 28. PMLR, 1166\u20131174."},{"key":"e_1_2_2_15_1","volume-title":"Advances in Neural Information Processing Systems 28 (NIPS), Corinna Cortes, Neil D","author":"Ellis Kevin","unstructured":"Kevin Ellis , Armando Solar-Lezama , and Josh Tenenbaum . 2015. Unsupervised learning by program synthesis . In Advances in Neural Information Processing Systems 28 (NIPS), Corinna Cortes, Neil D . Lawrence, Daniel D. Lee, Masashi Sugiyama, and Roman Garnett (Eds.). Curran Associates , 973\u2013981. Kevin Ellis, Armando Solar-Lezama, and Josh Tenenbaum. 2015. Unsupervised learning by program synthesis. In Advances in Neural Information Processing Systems 28 (NIPS), Corinna Cortes, Neil D. Lawrence, Daniel D. Lee, Masashi Sugiyama, and Roman Garnett (Eds.). Curran Associates, 973\u2013981."},{"key":"e_1_2_2_16_1","volume-title":"Advances in Neural Information Processing Systems 29 (NIPS), Daniel D","author":"Ellis Kevin","unstructured":"Kevin Ellis , Armando Solar-Lezama , and Josh Tenenbaum . 2016. Sampling for Bayesian program learning . In Advances in Neural Information Processing Systems 29 (NIPS), Daniel D . Lee, Masashi Sugiyama, Ulrich von Luxburg, I. Guyon, and Roman Garnett (Eds.). Curran Associates , 1297\u20131305. Kevin Ellis, Armando Solar-Lezama, and Josh Tenenbaum. 2016. Sampling for Bayesian program learning. In Advances in Neural Information Processing Systems 29 (NIPS), Daniel D. Lee, Masashi Sugiyama, Ulrich von Luxburg, I. Guyon, and Roman Garnett (Eds.). Curran Associates, 1297\u20131305."},{"key":"e_1_2_2_17_1","volume-title":"Methods of Correlation Analysis","author":"Ezekiel Mordecai","unstructured":"Mordecai Ezekiel . 1941. Methods of Correlation Analysis . John Wiley & amp; Sons, Inc. Mordecai Ezekiel. 1941. Methods of Correlation Analysis. John Wiley &amp; Sons, Inc."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737924.2737977"},{"key":"e_1_2_2_19_1","volume-title":"Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics (AISTATS), Amos Storkey and Fernando Perez-Cruz (Eds.)","volume":"84","author":"Ge Hong","year":"2018","unstructured":"Hong Ge , Kai Xu , and Zoubin Ghahramani . 2018 . Turing: A language for flexible probabilistic inference . In Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics (AISTATS), Amos Storkey and Fernando Perez-Cruz (Eds.) , Vol. 84 . PMLR, 1682\u20131690. Hong Ge, Kai Xu, and Zoubin Ghahramani. 2018. Turing: A language for flexible probabilistic inference. In Proceedings of the Twenty-First International Conference on Artificial Intelligence and Statistics (AISTATS), Amos Storkey and Fernando Perez-Cruz (Eds.), Vol. 84. PMLR, 1682\u20131690."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mcm.2010.03.046"},{"key":"e_1_2_2_21_1","volume-title":"Data Analysis Using Regression and Multilevel\/Hierarchical Models","author":"Gelman Andrew","unstructured":"Andrew Gelman and Jennifer Hill . 2007. Data Analysis Using Regression and Multilevel\/Hierarchical Models . Cambridge University Press . Andrew Gelman and Jennifer Hill. 2007. Data Analysis Using Regression and Multilevel\/Hierarchical Models. Cambridge University Press."},{"key":"e_1_2_2_22_1","volume-title":"Proceedings of the Twenty-Fourth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI). AUAI Press, 220\u2013229","author":"Goodman Noah","year":"2008","unstructured":"Noah Goodman , Vikash Mansinghka , Daniel Roy , Keith Bonawitz , and Joshua Tenenbaum . 2008 . Church: A language for generative models . In Proceedings of the Twenty-Fourth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI). AUAI Press, 220\u2013229 . Noah Goodman, Vikash Mansinghka, Daniel Roy, Keith Bonawitz, and Joshua Tenenbaum. 2008. Church: A language for generative models. In Proceedings of the Twenty-Fourth Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI). AUAI Press, 220\u2013229."},{"key":"e_1_2_2_23_1","volume-title":"Goodman and Andreas Stuhlm\u00fcller","author":"Noah","year":"2014","unstructured":"Noah D. Goodman and Andreas Stuhlm\u00fcller . 2014 . The Design and Implementation of Probabilistic Programming Languages . http:\/\/dippl.org . (2014). Noah D. Goodman and Andreas Stuhlm\u00fcller. 2014. The Design and Implementation of Probabilistic Programming Languages. http:\/\/dippl.org . (2014)."},{"key":"e_1_2_2_24_1","unstructured":"Alex Graves Greg Wayne and Ivo Danihelka. 2014. Neural Turing machines. (2014). arXiv: 1410.5401  Alex Graves Greg Wayne and Ivo Danihelka. 2014. Neural Turing machines. (2014). arXiv: 1410.5401"},{"key":"e_1_2_2_25_1","volume-title":"Tenenbaum","author":"Grosse Roger","year":"2012","unstructured":"Roger Grosse , Ruslan Salakhutdinov , William Freeman , and Joshua B . Tenenbaum . 2012 . Exploiting compositionality to explore a large space of model structures. In Proceedings of the Twenty-Eighth Annual Conference on Uncertainty in Artificial Intelligence (UAI). AUAI Press , 306\u201331. Roger Grosse, Ruslan Salakhutdinov, William Freeman, and Joshua B. Tenenbaum. 2012. Exploiting compositionality to explore a large space of model structures. In Proceedings of the Twenty-Eighth Annual Conference on Uncertainty in Artificial Intelligence (UAI). AUAI Press, 306\u201331."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1926385.1926423"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1993498.1993506"},{"key":"e_1_2_2_28_1","volume-title":"Goodman","author":"Hwang Irvin","year":"2011","unstructured":"Irvin Hwang , Andreas Stuhlm\u00fcller , and Noah D . Goodman . 2011 . Inducing probabilistic programs by Bayesian program merging. (2011). arXiv: 1110.5667 Irvin Hwang, Andreas Stuhlm\u00fcller, and Noah D. Goodman. 2011. Inducing probabilistic programs by Bayesian program merging. (2011). arXiv: 1110.5667"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v027.i03"},{"key":"e_1_2_2_30_1","volume-title":"An Introduction to Statistical Learning: with Applications in R","author":"James Gareth","unstructured":"Gareth James , Daniela Witten , Trevor Hastie , and Robert Tibshirani . 2013. An Introduction to Statistical Learning: with Applications in R . Springer . Gareth James, Daniela Witten, Trevor Hastie, and Robert Tibshirani. 2013. An Introduction to Statistical Learning: with Applications in R. Springer."},{"key":"e_1_2_2_31_1","volume-title":"Mercer","author":"Jelinek Frederick","year":"1992","unstructured":"Frederick Jelinek , John D. Lafferty , and Robert L . Mercer . 1992 . Basic methods of probabilistic context free grammars. In Speech Recognition and Understanding (NATO ASI Series, Sub-Series F: Computer and Systems Sciences), Pietro Laface and Renato De Mori (Eds.), Vol. 75 . Springer , 345\u2013360. Frederick Jelinek, John D. Lafferty, and Robert L. Mercer. 1992. Basic methods of probabilistic context free grammars. In Speech Recognition and Understanding (NATO ASI Series, Sub-Series F: Computer and Systems Sciences), Pietro Laface and Renato De Mori (Eds.), Vol. 75. Springer, 345\u2013360."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1806799.1806833"},{"key":"e_1_2_2_33_1","volume-title":"Advances in Neural Information Processing Systems 19 (NIPS)","author":"Johnson Mark","unstructured":"Mark Johnson , Thomas L. Griffiths , and Sharon Goldwater . 2007. Adaptor grammars: A framework for specifying compositional nonparametric Bayesian models . In Advances in Neural Information Processing Systems 19 (NIPS) , Bernard Sch\u00f6lkopf , John C. Platt, and Thomas Hoffman (Eds.). Curran Associates , 641\u2013648. Mark Johnson, Thomas L. Griffiths, and Sharon Goldwater. 2007. Adaptor grammars: A framework for specifying compositional nonparametric Bayesian models. In Advances in Neural Information Processing Systems 19 (NIPS), Bernard Sch\u00f6lkopf, John C. Platt, and Thomas Hoffman (Eds.). Curran Associates, 641\u2013648."},{"key":"e_1_2_2_34_1","first-page":"673","article-title":"Bayesian nonparametric hidden semi-Markov models","author":"Johnson Matthew J.","year":"2013","unstructured":"Matthew J. Johnson and Alan S. Willsky . 2013 . Bayesian nonparametric hidden semi-Markov models . Journal of Machine Learning Research 14 , Feb (2013), 673 \u2013 701 . Matthew J. Johnson and Alan S. Willsky. 2013. Bayesian nonparametric hidden semi-Markov models. Journal of Machine Learning Research 14, Feb (2013), 673\u2013701.","journal-title":"Journal of Machine Learning Research 14"},{"key":"e_1_2_2_35_1","volume-title":"Genetic Programming: On the Programming of Computers by Means of Natural Selection","author":"Koza John R.","year":"1992","unstructured":"John R. Koza . 1992 . Genetic Programming: On the Programming of Computers by Means of Natural Selection . MIT Press . John R. Koza. 1992. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.687879"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3192366.3192410"},{"key":"e_1_2_2_38_1","volume-title":"Proceedings of the Twenty-Seventh International Conference on Machine Learning (ICML), Johannes F\u00fcrnkranz and Thorsten Joachims (Eds.). Omnipress, 639\u2013646","author":"Liang Percy","year":"2010","unstructured":"Percy Liang , Michael I. Jordan , and Dan Klein . 2010 . Learning programs: A hierarchical Bayesian approach . In Proceedings of the Twenty-Seventh International Conference on Machine Learning (ICML), Johannes F\u00fcrnkranz and Thorsten Joachims (Eds.). Omnipress, 639\u2013646 . Percy Liang, Michael I. Jordan, and Dan Klein. 2010. Learning programs: A hierarchical Bayesian approach. In Proceedings of the Twenty-Seventh International Conference on Machine Learning (ICML), Johannes F\u00fcrnkranz and Thorsten Joachims (Eds.). Omnipress, 639\u2013646."},{"key":"e_1_2_2_39_1","unstructured":"James R. Lloyd. 2014. Kernel structure discovery research code. https:\/\/github.com\/jamesrobertlloyd\/gpss- research\/tree\/ master\/data . (2014).  James R. Lloyd. 2014. Kernel structure discovery research code. https:\/\/github.com\/jamesrobertlloyd\/gpss- research\/tree\/ master\/data . (2014)."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.5555\/2893873.2894066"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1979.234198"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/357084.357090"},{"key":"e_1_2_2_43_1","volume-title":"Tenenbaum","author":"Mansinghka Vikash","year":"2006","unstructured":"Vikash Mansinghka , Charles Kemp , Thomas Griffiths , and Joshua B . Tenenbaum . 2006 . Structured priors for structure learning. In Proceedings of the Twenty-Second Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI). AUAI Press , 324\u2013331. Vikash Mansinghka, Charles Kemp, Thomas Griffiths, and Joshua B. Tenenbaum. 2006. Structured priors for structure learning. In Proceedings of the Twenty-Second Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI). AUAI Press, 324\u2013331."},{"key":"e_1_2_2_44_1","volume-title":"Venture: A higher-order probabilistic programming platform with programmable inference.","author":"Mansinghka Vikash","year":"2014","unstructured":"Vikash Mansinghka , Daniel Selsam , and Yura Perov . 2014 . Venture: A higher-order probabilistic programming platform with programmable inference. (2014). arXiv: 1404.0099 Vikash Mansinghka, Daniel Selsam, and Yura Perov. 2014. Venture: A higher-order probabilistic programming platform with programmable inference. (2014). arXiv: 1404.0099"},{"key":"e_1_2_2_45_1","first-page":"1","article-title":"CrossCat: A fully Bayesian nonparametric method for analyzing heterogeneous, high dimensional data","volume":"17","author":"Mansinghka Vikash","year":"2016","unstructured":"Vikash Mansinghka , Patrick Shafto , Eric Jonas , Cap Petschulat , Max Gasner , and Joshua B. Tenenbaum . 2016 . CrossCat: A fully Bayesian nonparametric method for analyzing heterogeneous, high dimensional data . Journal of Machine Learning Research 17 , 138 (2016), 1 \u2013 49 . Vikash Mansinghka, Patrick Shafto, Eric Jonas, Cap Petschulat, Max Gasner, and Joshua B. Tenenbaum. 2016. CrossCat: A fully Bayesian nonparametric method for analyzing heterogeneous, high dimensional data. Journal of Machine Learning Research 17, 138 (2016), 1\u201349.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3192366.3192409"},{"key":"e_1_2_2_47_1","volume-title":"FACTORIE: Probabilistic programming via imperatively defined factor graphs. In Advances in Neural Information Processing Systems 22 (NIPS), Yoshua Bengio, Dale Schuurmans, John D","author":"McCallum Andrew","year":"2009","unstructured":"Andrew McCallum , Karl Schultz , and Sameer Singh . 2009 . FACTORIE: Probabilistic programming via imperatively defined factor graphs. In Advances in Neural Information Processing Systems 22 (NIPS), Yoshua Bengio, Dale Schuurmans, John D . Lafferty, Christopher K. Williams, and Aron Culotta (Eds.). Curran Associates , 1249\u20131257. Andrew McCallum, Karl Schultz, and Sameer Singh. 2009. FACTORIE: Probabilistic programming via imperatively defined factor graphs. In Advances in Neural Information Processing Systems 22 (NIPS), Yoshua Bengio, Dale Schuurmans, John D. Lafferty, Christopher K. Williams, and Aron Culotta (Eds.). Curran Associates, 1249\u20131257."},{"key":"e_1_2_2_48_1","volume-title":"Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI). Morgan Kaufmann Publishers Inc., 1352\u20131359","author":"Milch Brian","year":"2005","unstructured":"Brian Milch , Bhaskara Marthi , Stuart Russell , David Sontag , Daniel L. Ong , and Andrey Kolobov . 2005 . BLOG: Probabilistic models with unknown objects . In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI). Morgan Kaufmann Publishers Inc., 1352\u20131359 . Brian Milch, Bhaskara Marthi, Stuart Russell, David Sontag, Daniel L. Ong, and Andrey Kolobov. 2005. BLOG: Probabilistic models with unknown objects. In Proceedings of the Nineteenth International Joint Conference on Artificial Intelligence (IJCAI). Morgan Kaufmann Publishers Inc., 1352\u20131359."},{"key":"e_1_2_2_49_1","volume-title":"Machine Learning: A Probabilistic Perspective","author":"Murphy Kevin P.","year":"2012","unstructured":"Kevin P. Murphy . 2012 . Machine Learning: A Probabilistic Perspective . MIT Press . Kevin P. Murphy. 2012. Machine Learning: A Probabilistic Perspective. MIT Press."},{"key":"e_1_2_2_50_1","volume-title":"SPSS: Statistical Package for the Social Sciences","author":"Nie Norman H.","year":"1975","unstructured":"Norman H. Nie . 1975 . SPSS: Statistical Package for the Social Sciences . McGraw-Hill . Norman H. Nie. 1975. SPSS: Statistical Package for the Social Sciences. McGraw-Hill."},{"key":"e_1_2_2_51_1","volume-title":"Normal Forms, and Parsing","author":"Nijholt Antinus","unstructured":"Antinus Nijholt . 1980. Context-Free Grammars: Covers , Normal Forms, and Parsing . Springer . Antinus Nijholt. 1980. Context-Free Grammars: Covers, Normal Forms, and Parsing. Springer."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737924.2737982"},{"key":"e_1_2_2_53_1","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","author":"Pedregosa Fabian","year":"2011","unstructured":"Fabian Pedregosa , Gael Varoquaux , Alexandre Gramfort , Vincent Michel , Bertrand Thirion , Olivier Grisel , Mathieu Blondel , Peter Prettenhofer , Ron Weiss , Vincent Dubourg , Jake Vanderplas , Alexandre Passos , David Cournapeau , Matthieu Brucher , Matthieu Perrot , and Edouard Duchesnay . 2011 . Scikit-learn: Machine learning in Python . Journal of Machine Learning Research 12 , Oct (2011), 2825 \u2013 2830 . Fabian Pedregosa, Gael Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and Edouard Duchesnay. 2011. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research 12, Oct (2011), 2825\u20132830.","journal-title":"Journal of Machine Learning Research 12"},{"key":"e_1_2_2_54_1","volume-title":"Wood","author":"Perov Yura N.","year":"2014","unstructured":"Yura N. Perov and Frank D . Wood . 2014 . Learning probabilistic programs. (2014). arXiv: 1407.2646 Yura N. Perov and Frank D. Wood. 2014. Learning probabilistic programs. (2014). arXiv: 1407.2646"},{"key":"e_1_2_2_55_1","volume-title":"Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI)","volume":"1","author":"Pfeffer Avi","year":"2001","unstructured":"Avi Pfeffer . 2001 . IBAL: A probabilistic rational programming language . In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI) , Vol. 1 . Morgan Kaufmann Publishers Inc., 733\u2013740. Avi Pfeffer. 2001. IBAL: A probabilistic rational programming language. In Proceedings of the Seventeenth International Joint Conference on Artificial Intelligence (IJCAI), Vol. 1. Morgan Kaufmann Publishers Inc., 733\u2013740."},{"key":"e_1_2_2_56_1","volume-title":"Practical Probabilistic Programming (1 ed.)","author":"Pfeffer Avi","unstructured":"Avi Pfeffer . 2016. Practical Probabilistic Programming (1 ed.) . Manning Publications Co. Avi Pfeffer. 2016. Practical Probabilistic Programming (1 ed.). Manning Publications Co."},{"key":"e_1_2_2_57_1","volume-title":"Proceedings of the Third International Workshop on Distributed Statistical Computing (DSC), Kurt Hornik, Friedrich Leisch, and Achim Zeileis (Eds.). Austrian Association for Statistical Computing.","author":"Plummer Martyn","year":"2003","unstructured":"Martyn Plummer . 2003 . JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling . In Proceedings of the Third International Workshop on Distributed Statistical Computing (DSC), Kurt Hornik, Friedrich Leisch, and Achim Zeileis (Eds.). Austrian Association for Statistical Computing. Martyn Plummer. 2003. JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling. In Proceedings of the Third International Workshop on Distributed Statistical Computing (DSC), Kurt Hornik, Friedrich Leisch, and Achim Zeileis (Eds.). Austrian Association for Statistical Computing."},{"key":"e_1_2_2_58_1","first-page":"1939","article-title":"A unifying view of sparse approximate Gaussian process regression","author":"Qui\u00f1onero-Candela Joaquin","year":"2005","unstructured":"Joaquin Qui\u00f1onero-Candela and Carl E. Rasmussen . 2005 . A unifying view of sparse approximate Gaussian process regression . Journal of Machine Learning Research 6 , Dec (2005), 1939 \u2013 1959 . Joaquin Qui\u00f1onero-Candela and Carl E. Rasmussen. 2005. A unifying view of sparse approximate Gaussian process regression. Journal of Machine Learning Research 6, Dec (2005), 1939\u20131959.","journal-title":"Journal of Machine Learning Research 6"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0304-4076(03)00157-X"},{"key":"e_1_2_2_60_1","volume-title":"Gaussian Processes for Machine Learning","author":"Rasmussen Carl","unstructured":"Carl Rasmussen and Christopher Williams . 2006. Gaussian Processes for Machine Learning . The MIT Press . Carl Rasmussen and Christopher Williams. 2006. Gaussian Processes for Machine Learning. The MIT Press."},{"key":"e_1_2_2_61_1","first-page":"3011","article-title":"Gaussian processes for machine learning (GPML) toolbox","author":"Rasmussen Carl E.","year":"2010","unstructured":"Carl E. Rasmussen and Hannes Nickisch . 2010 . Gaussian processes for machine learning (GPML) toolbox . Journal of Machine Learning Research 11 , Nov (2010), 3011 \u2013 3015 . Carl E. Rasmussen and Hannes Nickisch. 2010. Gaussian processes for machine learning (GPML) toolbox. Journal of Machine Learning Research 11, Nov (2010), 3011\u20133015.","journal-title":"Journal of Machine Learning Research 11"},{"key":"e_1_2_2_62_1","volume-title":"International Conference on Learning Representations (ICLR).","author":"Reed Scott","year":"2016","unstructured":"Scott Reed and Nando de Freitas . 2016 . Neural programmer-interpreters . In International Conference on Learning Representations (ICLR). Scott Reed and Nando de Freitas. 2016. Neural programmer-interpreters. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_2_2_63_1","unstructured":"Feras Saad and Vikash Mansinghka. 2016. Probabilistic data analysis with probabilistic programming. (2016). arXiv: 1608.05347  Feras Saad and Vikash Mansinghka. 2016. Probabilistic data analysis with probabilistic programming. (2016). arXiv: 1608.05347"},{"key":"e_1_2_2_64_1","volume-title":"Aarti Singh and Jerry Zhu (Eds.)","volume":"54","author":"Saad Feras","year":"2017","unstructured":"Feras Saad and Vikash Mansinghka . 2017 . Detecting dependencies in sparse, multivariate databases using probabilistic programming and non-parametric Bayes. In Artificial Intelligence and Statistics (AISTATS) , Aarti Singh and Jerry Zhu (Eds.) , Vol. 54 . PMLR, 632\u2013641. Feras Saad and Vikash Mansinghka. 2017. Detecting dependencies in sparse, multivariate databases using probabilistic programming and non-parametric Bayes. In Artificial Intelligence and Statistics (AISTATS), Aarti Singh and Jerry Zhu (Eds.), Vol. 54. PMLR, 632\u2013641."},{"key":"e_1_2_2_65_1","volume-title":"Proceedings of the Twenty-First Conference on Artificial Intelligence and Statistics (AISTATS), Amos Storkey and Fernando Perez-Cruz (Eds.)","volume":"84","author":"Feras","unstructured":"Feras A. Saad and Vikash K. Mansinghka. 2018. Temporally-reweighted Chinese restaurant process mixtures for clustering, imputing, and forecasting multivariate time series . In Proceedings of the Twenty-First Conference on Artificial Intelligence and Statistics (AISTATS), Amos Storkey and Fernando Perez-Cruz (Eds.) , Vol. 84 . PMLR, 755\u2013764. Feras A. Saad and Vikash K. Mansinghka. 2018. Temporally-reweighted Chinese restaurant process mixtures for clustering, imputing, and forecasting multivariate time series. In Proceedings of the Twenty-First Conference on Artificial Intelligence and Statistics (AISTATS), Amos Storkey and Fernando Perez-Cruz (Eds.), Vol. 84. PMLR, 755\u2013764."},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.55"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2451116.2451150"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01448013"},{"key":"e_1_2_2_69_1","volume-title":"Multivariate Density Estimation: Theory, Practice, and Visualization","author":"Scott David W.","unstructured":"David W. Scott . 2009. Multivariate Density Estimation: Theory, Practice, and Visualization . John Wiley & amp; Sons, Inc. David W. Scott. 2009. Multivariate Density Estimation: Theory, Practice, and Visualization. John Wiley &amp; Sons, Inc."},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-92bf1922-011"},{"key":"e_1_2_2_71_1","volume-title":"Density Estimation for Statistics and Data Analysis","author":"Silverman Bernard W.","unstructured":"Bernard W. Silverman . 1986. Density Estimation for Statistics and Data Analysis . CRC Press . Bernard W. Silverman. 1986. Density Estimation for Statistics and Data Analysis. CRC Press."},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/1168857.1168907"},{"key":"e_1_2_2_73_1","volume-title":"Bayesian Inference Using Gibbs Sampling Manual (version ii). MRC Biostatistics Unit","author":"Spiegelhalter David","unstructured":"David Spiegelhalter , Andrew Thomas , Nicky Best , and Wally Gilks . 1996. BUGS 0.5 : Bayesian Inference Using Gibbs Sampling Manual (version ii). MRC Biostatistics Unit , Institute of Public Health , Cambridge, United Kingdom. David Spiegelhalter, Andrew Thomas, Nicky Best, and Wally Gilks. 1996. BUGS 0.5: Bayesian Inference Using Gibbs Sampling Manual (version ii). MRC Biostatistics Unit, Institute of Public Health, Cambridge, United Kingdom."},{"key":"e_1_2_2_74_1","doi-asserted-by":"publisher","DOI":"10.1080\/00031305.2017.1380080"},{"key":"e_1_2_2_75_1","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176325750"},{"key":"e_1_2_2_76_1","unstructured":"Anh Tong and Jaesik Choi. 2016. Automatic generation of probabilistic programming from time series data. (2016). arXiv: 1607.00710  Anh Tong and Jaesik Choi. 2016. Automatic generation of probabilistic programming from time series data. (2016). arXiv: 1607.00710"},{"key":"e_1_2_2_77_1","volume-title":"International Conference on Learning Representations (ICLR).","author":"Tran Dustin","unstructured":"Dustin Tran , Matthew D. Hoffman , Rif A. Saurous , Eugene Brevdo , Kevin Murphy , and David M. Blei . 2017. Deep probabilistic programming . In International Conference on Learning Representations (ICLR). Dustin Tran, Matthew D. Hoffman, Rif A. Saurous, Eugene Brevdo, Kevin Murphy, and David M. Blei. 2017. Deep probabilistic programming. In International Conference on Learning Representations (ICLR)."},{"key":"e_1_2_2_78_1","volume-title":"Exploratory Data Analysis","author":"Tukey John W.","unstructured":"John W. Tukey . 1977. Exploratory Data Analysis . Addison-Wesley Publishing Company . John W. Tukey. 1977. Exploratory Data Analysis. Addison-Wesley Publishing Company."},{"key":"e_1_2_2_79_1","volume-title":"Sheldon","author":"Turbak Franklyn","year":"2008","unstructured":"Franklyn Turbak , David Gifford , and Mark A . Sheldon . 2008 . Design Concepts in Programming Languages. MIT Press . Franklyn Turbak, David Gifford, and Mark A. Sheldon. 2008. Design Concepts in Programming Languages. MIT Press."},{"key":"e_1_2_2_80_1","volume-title":"Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics (AISTATS)","volume":"33","author":"Wood Frank","unstructured":"Frank Wood , Jan Willem van de Meent, and Vikash Mansinghka. 2014. A new approach to probabilistic programming inference . In Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics (AISTATS) , Vol. 33 . PMLR, 1024\u20131032. Frank Wood, Jan Willem van de Meent, and Vikash Mansinghka. 2014. A new approach to probabilistic programming inference. In Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics (AISTATS), Vol. 33. PMLR, 1024\u20131032."}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3290350","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3290350","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3290350","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:58:04Z","timestamp":1750208284000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3290350"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,1,2]]},"references-count":80,"journal-issue":{"issue":"POPL","published-print":{"date-parts":[[2019,1,2]]}},"alternative-id":["10.1145\/3290350"],"URL":"https:\/\/doi.org\/10.1145\/3290350","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,1,2]]},"assertion":[{"value":"2019-01-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}