{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T10:05:44Z","timestamp":1775815544800,"version":"3.50.1"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"14","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2014,10]]},"abstract":"<jats:p>The web is overflowing with implicitly structured data, spread over hundreds of thousands of sites, hidden deep behind search forms, or siloed in marketplaces, only accessible as HTML. Automatic extraction of structured data at the scale of thousands of websites has long proven elusive, despite its central role in the \"web of data\".<\/jats:p>\n          <jats:p>\n            Through an extensive evaluation spanning over 10000 web sites from multiple application domains, we show that automatic, yet accurate full-site extraction is no longer a distant dream. diadem is the first automatic full-site extraction system that is able to extract structured data from different domains at very high accuracy. It combines automated\n            <jats:italic>exploration<\/jats:italic>\n            of websites,\n            <jats:italic>identification<\/jats:italic>\n            of relevant data, and\n            <jats:italic>induction<\/jats:italic>\n            of exhaustive wrappers. Automating these components is the first challenge. diadem overcomes this challenge by combining phenomenological and ontological knowledge. Integrating these components is the second challenge. diadem overcomes this challenge through a self-adaptive network of relational transducers that produces effective wrappers for a wide variety of websites.\n          <\/jats:p>\n          <jats:p>Our extensive and publicly available evaluation shows that, for more than 90% of sites from three domains, diadem obtains an effective wrapper that extracts all relevant data with 97% average precision. diadem also tolerates noisy entity recognisers, and its components individually outperform comparable approaches.<\/jats:p>","DOI":"10.14778\/2733085.2733091","type":"journal-article","created":{"date-parts":[[2015,5,12]],"date-time":"2015-05-12T15:37:52Z","timestamp":1431445072000},"page":"1845-1856","source":"Crossref","is-referenced-by-count":38,"title":["DIADEM"],"prefix":"10.14778","volume":"7","author":[{"given":"Tim","family":"Furche","sequence":"first","affiliation":[{"name":"Oxford University, Oxford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Georg","family":"Gottlob","sequence":"additional","affiliation":[{"name":"Oxford University, Oxford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giovanni","family":"Grasso","sequence":"additional","affiliation":[{"name":"Oxford University, Oxford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaonan","family":"Guo","sequence":"additional","affiliation":[{"name":"Oxford University, Oxford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giorgio","family":"Orsi","sequence":"additional","affiliation":[{"name":"Oxford University, Oxford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Schallhart","sequence":"additional","affiliation":[{"name":"Oxford University, Oxford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng","family":"Wang","sequence":"additional","affiliation":[{"name":"Oxford University, Oxford"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,10]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/275487.275507"},{"key":"e_1_2_1_2_1","first-page":"119","volume-title":"VLDB","author":"Baumgartner R.","year":"2001","unstructured":"R. Baumgartner , S. Flesca , and G. Gottlob . Visual web information extraction with Lixto . In VLDB , p. 119 -- 128 , 2001 . R. Baumgartner, S. Flesca, and G. Gottlob. Visual web information extraction with Lixto. In VLDB, p. 119--128, 2001."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508434"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536206.2536209"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1897816.1897839"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.14778\/1453856.1453916"},{"key":"e_1_2_1_7_1","first-page":"1623","volume-title":"WWW","author":"Chakrabarti S.","year":"1999","unstructured":"S. Chakrabarti , M. van den Berg, and B. Dom. Focused crawling: a new approach to topic-specific web resource discovery . In WWW , p. 1623 -- 1640 , 1999 . S. Chakrabarti, M. van den Berg, and B. Dom. Focused crawling: a new approach to topic-specific web resource discovery. In WWW, p. 1623--1640, 1999."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536258.2536261"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1017460.1017462"},{"key":"e_1_2_1_10_1","first-page":"261","volume-title":"WWW","author":"Crescenzi V.","year":"2013","unstructured":"V. Crescenzi , P. Merialdo , and D. Qiu . A framework for learning web wrappers from the crowd . In WWW , p. 261 -- 272 , 2013 . V. Crescenzi, P. Merialdo, and D. Qiu. A framework for learning web wrappers from the crowd. In WWW, p. 261--272, 2013."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.14778\/2180912.2180920"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559882"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.14778\/1938545.1938547"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2012.90"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687665"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409360.1409378"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187980.2188025"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-013-0323-0"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/2036949.2036955"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-012-0286-6"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2011.5767842"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772826"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.82"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1860702.1860708"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(99)00100-9"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1149114.1149117"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/956750.956826"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2009.109"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.14778\/1454159.1454163"},{"key":"e_1_2_1_30_1","volume-title":"Online retail in the united states","year":"2013","unstructured":"MarketLine. Online retail in the united states , 2013 . On-line at http:\/\/www.marketresearch.com\/MarketLine-v3883\/Online-Retail-United-States-7760207\/. MarketLine. Online retail in the united states, 2013. On-line at http:\/\/www.marketresearch.com\/MarketLine-v3883\/Online-Retail-United-States-7760207\/."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2109205.2109208"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.14778\/1453856.1453931"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1458502.1458505"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1099554.1099672"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1538909.1538914"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2460383.2460387"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242667"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.14778\/1929861.1929862"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/1557019.1557163"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/775152.775179"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-04141-9_4"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1645953.1646194"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2006.197"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1060745.1060760"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2733085.2733091","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T11:15:56Z","timestamp":1672226156000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2733085.2733091"}},"subtitle":["thousands of websites to a single database"],"short-title":[],"issued":{"date-parts":[[2014,10]]},"references-count":44,"journal-issue":{"issue":"14","published-print":{"date-parts":[[2014,10]]}},"alternative-id":["10.14778\/2733085.2733091"],"URL":"https:\/\/doi.org\/10.14778\/2733085.2733091","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2014,10]]}}}