{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T17:05:54Z","timestamp":1789059954706,"version":"build-2803163510"},"reference-count":31,"publisher":"Association for Computing Machinery (ACM)","issue":"OOPSLA","license":[{"start":{"date-parts":[[2017,10,12]],"date-time":"2017-10-12T00:00:00Z","timestamp":1507766400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DGE 1106400"],"award-info":[{"award-number":["DGE 1106400"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Program. Lang."],"published-print":{"date-parts":[[2017,10,12]]},"abstract":"<jats:p>\n                    With more and more web scripting languages on offer, programmers have access to increasing language support for web scraping tasks. However, in our experiences collaborating with data scientists, we learned that two issues still plague long-running scraping scripts: i) When a network or website goes down mid-scrape, recovery sometimes requires restarting from the beginning, which users find frustratingly slow. ii) Websites do not offer atomic snapshots of their databases; they update their content so frequently that output data is cluttered with slight variations of the same information \u2014\n                    <jats:italic toggle=\"yes\">e.g.<\/jats:italic>\n                    , a tweet from profile 1 that is retweeted on profile 2 and scraped from both profiles, once with 52 responses then later with 53 responses.\n                  <\/jats:p>\n                  <jats:p>\n                    We introduce the\n                    <jats:italic toggle=\"yes\">skip block<\/jats:italic>\n                    , a language construct that addresses both of these disparate problems. Programmers write lightweight annotations to indicate when the current object can be considered equivalent to a previously scraped object and direct the program to skip over the scraping actions in the block. The construct is hierarchical, so programs can skip over long or short script segments, allowing adaptive reuse of prior work. After network and server failures, skip blocks accelerate failure recovery by 7.9x on average. Even scripts that do not encounter failures benefit; because sites display redundant objects, skipping over them accelerates scraping by up to 2.1x. For longitudinal scraping tasks that aim to fetch only new objects, the second run exhibits an average speedup of 5.2x. Our small user study reveals that programmers can quickly produce skip block annotations.\n                  <\/jats:p>","DOI":"10.1145\/3133875","type":"journal-article","created":{"date-parts":[[2017,10,13]],"date-time":"2017-10-13T11:15:45Z","timestamp":1507893345000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Skip blocks: reusing execution history to accelerate web scripts"],"prefix":"10.1145","volume":"1","author":[{"given":"Sarah","family":"Chasins","sequence":"first","affiliation":[{"name":"University of California at Berkeley, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rastislav","family":"Bodik","sequence":"additional","affiliation":[{"name":"University of Washington, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,10,12]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Adelberg Brad. 1998. NoDoSE - a tool for semi-automatically extracting structured and semistructured data from text documents. In: Sigmod record.","DOI":"10.1145\/276304.276330"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983990.2984020"},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"Chang Chia-Hui Kayed Mohammed Girgis Moheb Ramzy &amp; Shaalan Khaled F. 2006. A survey of web information extraction systems. Ieee trans. on knowl. and data eng. 18(10) 1411\u20131428.","DOI":"10.1109\/TKDE.2006.152"},{"key":"e_1_2_1_4_1","unstructured":"Chasins Sarah. 2017 ( July). schasins\/helena: A chrome extension for web automation and web scraping. https:\/\/github.com\/ schasins\/helena ."},{"key":"e_1_2_1_5_1","unstructured":"Flesca Sergio Manco Giuseppe Masciari Elio Rende Eugenio &amp; Tagarelli Andrea. 2004. Web wrapper induction: A brief survey. Ai commun. 17(2) 57\u201361."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2882903.2915214"},{"key":"e_1_2_1_7_1","unstructured":"Greasemonkey. 2015 (Nov.). Greasemonkey :: Add-ons for firefox. https:\/\/addons.mozilla.org\/enus\/firefox\/addon\/greasemonkey\/."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1294211.1294226"},{"key":"e_1_2_1_9_1","unstructured":"Import.io. 2016 (Mar.). Import.io | web data platform &amp; free web scraping tool."},{"key":"e_1_2_1_10_1","unstructured":"KimonoLabs. 2016 (Mar.). Kimono: Turn websites into structured APIs from your browser in seconds."},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Koesnandar Andhy Elbaum Sebastian Rothermel Gregg Hochstein Lorin Scaffidi Christopher &amp; Stolee Kathryn T. 2008. Using assertions to help end-user programmers create dependable web macros. Pages 124\u2013134 of: Proceedings of the 16th acm sigsoft international symposium on foundations of software engineering. SIGSOFT \u201908\/FSE-16. New York NY USA: ACM.","DOI":"10.1145\/1453101.1453119"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","unstructured":"Kushmerick Nicholas. 2000. Wrapper induction: Efficiency and expressiveness. Artificial intelligence 118(1) 15 \u2013 68. 10.1016\/S0004-3702(99)00100-9","DOI":"10.1016\/S0004-3702(99)00100-9"},{"key":"e_1_2_1_13_1","volume-title":"Proc. ijcai-97","author":"Kushmerick Nicholas","year":"1997","unstructured":"Kushmerick, Nicholas, Weld, Daniel S., &amp; Doorenbos, Robert. 1997. Wrapper induction for information extraction. In: Proc. ijcai-97."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2666356.2594333"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357323"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753432"},{"key":"e_1_2_1_17_1","volume-title":"End-user programming of mashups with Vegemite. Pages 97\u2013106 of: Proceedings of the 14th international conference on intelligent user interfaces. IUI \u201909","author":"Lin James","unstructured":"Lin, James, Wong, Jeffrey, Nichols, Jeffrey, Cypher, Allen, &amp; Lau, Tessa A. 2009. End-user programming of mashups with Vegemite. Pages 97\u2013106 of: Proceedings of the 14th international conference on intelligent user interfaces. IUI \u201909. New York, NY, USA: ACM."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1719970.1719994"},{"key":"e_1_2_1_19_1","volume-title":"User interaction models for disambiguation in programming by example. Pages 291\u2013301 of: Proceedings of the 28th annual acm symposium on user interface software &amp","author":"Mayer Mika\u00ebl","unstructured":"Mayer, Mika\u00ebl, Soares, Gustavo, Grechkin, Maxim, Le, Vu, Marron, Mark, Polozov, Oleksandr, Singh, Rishabh, Zorn, Benjamin, &amp; Gulwani, Sumit. 2015. User interaction models for disambiguation in programming by example. Pages 291\u2013301 of: Proceedings of the 28th annual acm symposium on user interface software &amp; technology. UIST \u201915. New York, NY, USA: ACM."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/301136.301191"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1229428.1229442"},{"key":"e_1_2_1_22_1","unstructured":"Nokogiri. 2016 (Nov.). Tutorials - nokogiri. http:\/\/www.nokogiri.org\/ ."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3018661.3018740"},{"key":"e_1_2_1_24_1","unstructured":"Platypus. 2013 (Nov.). Platypus. http:\/\/platypus.mozdev.org\/ ."},{"key":"e_1_2_1_25_1","unstructured":"Richardson Leonard. 2016 (Mar.). Beautiful Soup: We called him Tortoise because he taught us. http:\/\/www.crummy.com\/ software\/BeautifulSoup\/ ."},{"key":"e_1_2_1_26_1","unstructured":"Scrapy. 2013 ( July). Scrapy. http:\/\/scrapy.org\/ ."},{"key":"e_1_2_1_27_1","unstructured":"Selenium. 2013 ( July). Selenium-web browser automation. http:\/\/seleniumhq.org\/ ."},{"key":"e_1_2_1_28_1","unstructured":"Selenium. 2016 (Mar.). Selenium IDE plugins. http:\/\/www.seleniumhq.org\/projects\/ide\/ ."},{"key":"e_1_2_1_29_1","unstructured":"StackOverflow. 2017. Posts containing \u201cincremental scraping\u201d - stack overflow."},{"key":"e_1_2_1_30_1","unstructured":"VisualWebRipper. 2017 (Apr.). Visual web ripper | data extraction software. http:\/\/visualwebripper.com\/ ."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1645962"}],"container-title":["Proceedings of the ACM on Programming Languages"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3133875","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3133875","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3133875","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,10]],"date-time":"2026-09-10T16:07:06Z","timestamp":1789056426000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3133875"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,10,12]]},"references-count":31,"journal-issue":{"issue":"OOPSLA","published-print":{"date-parts":[[2017,10,12]]}},"alternative-id":["10.1145\/3133875"],"URL":"https:\/\/doi.org\/10.1145\/3133875","relation":{},"ISSN":["2475-1421"],"issn-type":[{"value":"2475-1421","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,10,12]]},"assertion":[{"value":"2017-10-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}