{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:07:41Z","timestamp":1750306061260,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":22,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,7,15]],"date-time":"2017-07-15T00:00:00Z","timestamp":1500076800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1617087,1129139,1331283"],"award-info":[{"award-number":["1617087,1129139,1331283"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,7,15]]},"DOI":"10.1145\/3067695.3082533","type":"proceedings-article","created":{"date-parts":[[2017,7,11]],"date-time":"2017-07-11T20:17:18Z","timestamp":1499804238000},"page":"1589-1596","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["On the difficulty of benchmarking inductive program synthesis methods"],"prefix":"10.1145","author":[{"given":"Edward","family":"Pantridge","sequence":"first","affiliation":[{"name":"MassMutual Financial Group"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Helmuth","sequence":"additional","affiliation":[{"name":"Washington and Lee University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas Freitag","family":"McPhee","sequence":"additional","affiliation":[{"name":"University of Minnesota"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lee","family":"Spector","sequence":"additional","affiliation":[{"name":"Hampshire College"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,7,15]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-55696-3_17"},{"key":"e_1_3_2_1_2_1","volume-title":"TerpreT: A Probabilistic Programming Language for Program Induction. CoRR abs\/1608.04428","author":"Gaunt Alexander L.","year":"2016","unstructured":"Alexander L. Gaunt , Marc Brockschmidt , Rishabh Singh , Nate Kushman , Push-meet Kohli, Jonathan Taylor , and Daniel Tarlow . 2016. TerpreT: A Probabilistic Programming Language for Program Induction. CoRR abs\/1608.04428 ( 2016 ). http:\/\/arxiv.org\/abs\/1608.04428 Alexander L. Gaunt, Marc Brockschmidt, Rishabh Singh, Nate Kushman, Push-meet Kohli, Jonathan Taylor, and Daniel Tarlow. 2016. TerpreT: A Probabilistic Programming Language for Program Induction. CoRR abs\/1608.04428 (2016). http:\/\/arxiv.org\/abs\/1608.04428"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1925844.1926423"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2240236.2240260"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1993316.1993536"},{"volume-title":"Nicholas Freitag McPhee, and Lee Spector. Lexicase selection for program synthesis: a diversity analysis","author":"Helmuth Thomas","key":"e_1_3_2_1_6_1","unstructured":"Thomas Helmuth , Nicholas Freitag McPhee, and Lee Spector. Lexicase selection for program synthesis: a diversity analysis . In Genetic Programming Theory and Practice XIII. Springer . Thomas Helmuth, Nicholas Freitag McPhee, and Lee Spector. Lexicase selection for program synthesis: a diversity analysis. In Genetic Programming Theory and Practice XIII. Springer."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754769"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2014.2362729"},{"volume-title":"Trends in Functional Programming (Trends in Functional Programming), Marko C","author":"Katayama Susumu","key":"e_1_3_2_1_10_1","unstructured":"Susumu Katayama . 2005. Systematic search for lambda expressions . In Trends in Functional Programming (Trends in Functional Programming), Marko C . J. D. van Eekelen (Ed.), Vol. 6 . Intellect , 111--126. Susumu Katayama. 2005. Systematic search for lambda expressions. In Trends in Functional Programming (Trends in Functional Programming), Marko C. J. D. van Eekelen (Ed.), Vol. 6. Intellect, 111--126."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89197-0_21"},{"volume-title":"Approaches and Applications of Inductive Programming","author":"Katayama Susumu","key":"e_1_3_2_1_12_1","unstructured":"Susumu Katayama . 2010. Recent Improvements of MagicHaskeller . In Approaches and Applications of Inductive Programming . Springer . Susumu Katayama. 2010. Recent Improvements of MagicHaskeller. In Approaches and Applications of Inductive Programming. Springer."},{"key":"e_1_3_2_1_13_1","volume-title":"Proceedings of AAIP 2011 4th International Workshop on Approaches and Applications of Inductive Programming.","author":"Katayama Susumu","year":"2011","unstructured":"Susumu Katayama . 2011 . MagicHaskeller: System demonstration . In Proceedings of AAIP 2011 4th International Workshop on Approaches and Applications of Inductive Programming. Susumu Katayama. 2011. MagicHaskeller: System demonstration. In Proceedings of AAIP 2011 4th International Workshop on Approaches and Applications of Inductive Programming."},{"key":"e_1_3_2_1_14_1","volume-title":"Haskell '13: Proceedings of the 2013 ACM SIGPLAN Symposium on Haskell. ACM.","author":"Katayama Susumu","year":"2013","unstructured":"Susumu Katayama . 2013 . MagicHaskeller on the Web: Automated Programming as a Service . In Haskell '13: Proceedings of the 2013 ACM SIGPLAN Symposium on Haskell. ACM. Susumu Katayama. 2013. MagicHaskeller on the Web: Automated Programming as a Service. In Haskell '13: Proceedings of the 2013 ACM SIGPLAN Symposium on Haskell. ACM."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Emanuel Kitzelmann. 2009. Inductive Programming A Survey of Program Synthesis Techniques. (2009).  Emanuel Kitzelmann. 2009. Inductive Programming A Survey of Program Synthesis Techniques. (2009).","DOI":"10.1007\/978-3-642-11931-6_3"},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of AAIP 2011 4th International Workshop on Approaches and Applications of Inductive Programming.","author":"Kitzelmann Emanuel","year":"2011","unstructured":"Emanuel Kitzelmann . 2011 . Two New Operators for IGOR2 to Increase Synthesis Efficieny . In Proceedings of AAIP 2011 4th International Workshop on Approaches and Applications of Inductive Programming. Emanuel Kitzelmann. 2011. Two New Operators for IGOR2 to Increase Synthesis Efficieny. In Proceedings of AAIP 2011 4th International Workshop on Approaches and Applications of Inductive Programming."},{"key":"e_1_3_2_1_17_1","volume-title":"Genetic Programming: On the Programming of Computers by Means of Natural Selection","author":"Koza John R.","year":"1992","unstructured":"John R. Koza . 1992 . Genetic Programming: On the Programming of Computers by Means of Natural Selection . MIT Press , Cambridge, MA, USA . http:\/\/mitpress.mit.edu\/books\/genetic-programming John R. Koza. 1992. Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge, MA, USA. http:\/\/mitpress.mit.edu\/books\/genetic-programming"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1025671410623"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666356.2594297"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.14778\/2212351.2212356"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31424-7_44"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1068009.1068292"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1014538503543"}],"event":{"name":"GECCO '17: Genetic and Evolutionary Computation Conference","sponsor":["SIGEVO ACM Special Interest Group on Genetic and Evolutionary Computation"],"location":"Berlin Germany","acronym":"GECCO '17"},"container-title":["Proceedings of the Genetic and Evolutionary Computation Conference Companion"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3067695.3082533","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3067695.3082533","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3067695.3082533","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:03:43Z","timestamp":1750215823000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3067695.3082533"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,7,15]]},"references-count":22,"alternative-id":["10.1145\/3067695.3082533","10.1145\/3067695"],"URL":"https:\/\/doi.org\/10.1145\/3067695.3082533","relation":{},"subject":[],"published":{"date-parts":[[2017,7,15]]},"assertion":[{"value":"2017-07-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}