{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T21:53:07Z","timestamp":1776117187086,"version":"3.50.1"},"reference-count":39,"publisher":"Association for Computing Machinery (ACM)","issue":"POPL","license":[{"start":{"date-parts":[[2017,12,27]],"date-time":"2017-12-27T00:00:00Z","timestamp":1514332800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2018,1]]},"abstract":"<jats:p>Data integration between web sources and relational data is a key challenge faced by data scientists and spreadsheet users. There are two main challenges in programmatically joining web data with relational data. First, most websites do not expose a direct interface to obtain tabular data, so the user needs to formulate a logic to get to different webpages for each input row in the relational table. Second, after reaching the desired webpage, the user needs to write complex scripts to extract the relevant data, which is often conditioned on the input data. Since many data scientists and end-users come from diverse backgrounds, writing such complex regular-expression based logical scripts to perform data integration tasks is unfortunately often beyond their programming expertise.<\/jats:p>\n          <jats:p>We present WebRelate, a system that allows users to join semi-structured web data with relational data in spreadsheets using input-output examples. WebRelate decomposes the web data integration task into two sub-tasks of i) URL learning and ii) input-dependent web extraction. We introduce a novel synthesis paradigm called \"Output-constrained Programming By Examples\", which allows us to use the finite set of possible outputs for the new inputs to efficiently constrain the search in the synthesis algorithm. We instantiate this paradigm for the two sub-tasks in WebRelate. The first sub-task generates the URLs for the webpages containing the desired data for all rows in the relational table. WebRelate achieves this by learning a string transformation program using a few example URLs. The second sub-task uses examples of desired data to be extracted from the corresponding webpages and learns a program to extract the data for the other rows. We design expressive domain-specific languages for URL generation and web data extraction, and present efficient synthesis algorithms for learning programs in these DSLs from few input-output examples. We evaluate WebRelate on 88 real-world web data integration tasks taken from online help forums and Excel product team, and show that WebRelate can learn the desired programs within few seconds using only 1 example for the majority of the tasks.<\/jats:p>","DOI":"10.1145\/3158090","type":"journal-article","created":{"date-parts":[[2017,12,29]],"date-time":"2017-12-29T14:21:49Z","timestamp":1514557309000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["WebRelate: integrating web data with spreadsheets using examples"],"prefix":"10.1145","volume":"2","author":[{"given":"Jeevana Priya","family":"Inala","sequence":"first","affiliation":[{"name":"Massachusetts Institute of Technology, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rishabh","family":"Singh","sequence":"additional","affiliation":[{"name":"Microsoft Research, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,12,27]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Dataxformer: Leveraging the Web for Semantic Transformations.. In CIDR.","author":"Abedjan Ziawasch","year":"2015"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/FMCAD.2013.6679385"},{"key":"e_1_2_2_3_1","volume-title":"GI Workshops, Saarbrcken. 126\u2013133","author":"Anton Tobias","year":"2005"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983990.2984020"},{"key":"e_1_2_2_5_1","volume-title":"Xml path language (xpath)","author":"Berglund Anders","year":"2003"},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Sarah Chasins Shaon Barman Rastislav Bod\u00edk and Sumit Gulwani. 2015. Browser Record and Replay as a Building Block for End-User Web Automation Tools. In WWW. 179\u2013182.  Sarah Chasins Shaon Barman Rastislav Bod\u00edk and Sumit Gulwani. 2015. Browser Record and Replay as a Building Block for End-User Web Automation Tools. In WWW. 179\u2013182.","DOI":"10.1145\/2740908.2742849"},{"key":"e_1_2_2_7_1","first-page":"109","article-title":"Roadrunner: Towards automatic data extraction from large web sites","volume":"1","author":"Crescenzi Valter","year":"2001","journal-title":"VLDB"},{"key":"e_1_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Nilesh Dalvi Philip Bohannon and Fei Sha. 2009. Robust Web Extraction: An Approach Based on a Probabilistic Tree-edit Model. In SIGMOD. 335\u2013348.  Nilesh Dalvi Philip Bohannon and Fei Sha. 2009. Robust Web Extraction: An Approach Based on a Probabilistic Tree-edit Model. In SIGMOD. 335\u2013348.","DOI":"10.1145\/1559845.1559882"},{"key":"e_1_2_2_9_1","unstructured":"Jacob Devlin Jonathan Uesato Surya Bhupatiraju Rishabh Singh Abdel-rahman Mohamed and Pushmeet Kohli. 2017. RobustFill: Neural Program Learning under Noisy I\/O. In ICML. 990\u2013998.  Jacob Devlin Jonathan Uesato Surya Bhupatiraju Rishabh Singh Abdel-rahman Mohamed and Pushmeet Kohli. 2017. RobustFill: Neural Program Learning under Noisy I\/O. In ICML. 990\u2013998."},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Jonathan Frankle Peter-Michael Osera David Walker and Steve Zdancewic. 2016. Example-directed synthesis: a typetheoretic interpretation. In POPL. 802\u2013815.  Jonathan Frankle Peter-Michael Osera David Walker and Steve Zdancewic. 2016. Example-directed synthesis: a typetheoretic interpretation. In POPL. 802\u2013815.","DOI":"10.1145\/2914770.2837629"},{"key":"e_1_2_2_11_1","volume-title":"Deputize end-user developers to deliver business agility and reduce costs. Forrester Report for Application Development and Program Management Professionals","author":"Gualtieri Mike","year":"2009"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1926385.1926423"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2240236.2240260"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1561\/2500000010"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/2824032.2824036"},{"key":"e_1_2_2_16_1","unstructured":"Jeffrey Heer Joseph M Hellerstein and Sean Kandel. 2015. Predictive Interaction for Data Transformation.. In CIDR.  Jeffrey Heer Joseph M Hellerstein and Sean Kandel. 2015. Predictive Interaction for Data Transformation.. In CIDR."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4379(98)00027-1"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979444"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v30i4.2262"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666356.2594333"},{"key":"e_1_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Gilly Leshed Eben M Haber Tara Matthews and Tessa Lau. 2008. CoScripter: automating & sharing how-to knowledge in the enterprise. In CHI. 1719\u20131728.  Gilly Leshed Eben M Haber Tara Matthews and Tessa Lau. 2008. CoScripter: automating & sharing how-to knowledge in the enterprise. In CHI. 1719\u20131728.","DOI":"10.1145\/1357054.1357323"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737924.2738002"},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"James Lin Jeffrey Wong Jeffrey Nichols Allen Cypher and Tessa A Lau. 2009. End-user programming of mashups with vegemite. In IUI. 97\u2013106.  James Lin Jeffrey Wong Jeffrey Nichols Allen Cypher and Tessa A Lau. 2009. End-user programming of mashups with vegemite. In IUI. 97\u2013106.","DOI":"10.1145\/1502650.1502667"},{"key":"e_1_2_2_25_1","volume-title":"Mourad Ouzzani, Paolo Papotti, and Michael Stonebraker.","author":"Morcos John","year":"2015"},{"key":"e_1_2_2_26_1","volume-title":"Workshop on AI and Information Integration. AAAI, 74\u201381","author":"Muslea Ion","year":"1998"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2737924.2738007"},{"key":"e_1_2_2_28_1","unstructured":"Emilio Parisotto Abdel-rahman Mohamed Rishabh Singh Lihong Li Dengyong Zhou and Pushmeet Kohli. 2017. NeuroSymbolic Program Synthesis. In ICLR.  Emilio Parisotto Abdel-rahman Mohamed Rishabh Singh Lihong Li Dengyong Zhou and Pushmeet Kohli. 2017. NeuroSymbolic Program Synthesis. In ICLR."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2814270.2814310"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2451116.2451150"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.14778\/2977797.2977807"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.14778\/2212351.2212356"},{"key":"e_1_2_2_33_1","first-page":"1","article-title":"AP","volume":"16","author":"Singh Rishabh","year":"2017","journal-title":"Artificial Programming. In SNAPL."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2025113.2025153"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1168857.1168907"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2491956.2462174"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3133886"},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"Xinyu Wang Isil Dillig and Rishabh Singh. 2018. Program Synthesis using Abstraction Refinement. In POPL.  Xinyu Wang Isil Dillig and Rishabh Singh. 2018. Program Synthesis using Abstraction Refinement. In POPL.","DOI":"10.1145\/3158151"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908080.2908088"},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","unstructured":"Yanhong Zhai and Bing Liu. 2005. Web Data Extraction Based on Partial Tree Alignment. In WWW. 76\u201385.  Yanhong Zhai and Bing Liu. 2005. Web Data Extraction Based on Partial Tree Alignment. In WWW. 76\u201385.","DOI":"10.1145\/1060745.1060761"}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3158090","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3158090","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:11:30Z","timestamp":1750212690000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3158090"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,12,27]]},"references-count":39,"journal-issue":{"issue":"POPL","published-print":{"date-parts":[[2018,1]]}},"alternative-id":["10.1145\/3158090"],"URL":"https:\/\/doi.org\/10.1145\/3158090","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,12,27]]},"assertion":[{"value":"2017-12-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}