{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,11]],"date-time":"2025-04-11T15:51:25Z","timestamp":1744386685929,"version":"3.28.0"},"reference-count":26,"publisher":"Association for Computing Machinery (ACM)","issue":"11","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2013,8,27]]},"abstract":"<jats:p>Search, exploration and social experience on the Web has recently undergone tremendous changes with search engines, web portals and social networks offering a different perspective on information discovery and consumption. This new perspective is aimed at capturing user intents, and providing richer and highly connected experiences. The new battleground revolves around technologies for the ingestion, disambiguation and enrichment of entities from a variety of structured and unstructured data sources - we refer to this process as knowledge base synthesis. This paper presents the design, implementation and production deployment of the Web Of Objects (WOO) system, a Hadoop-based platform tackling such challenges. WOO has been designed and implemented to enable various products in Yahoo! to synthesize knowledge bases (KBs) of entities relevant to their domains. Currently, the implementation of WOO we describe is used by various Yahoo! properties such as Intonow, Yahoo! Local, Yahoo! Events and Yahoo! Search. This paper highlights: (i) challenges that arise in designing, building and operating a platform that handles multi-domain, multi-version, and multi-tenant disambiguation of web-scale knowledge bases (hundreds of millions of entities), (ii) the architecture and technical solutions we devised, and (iii) an evaluation on real-world production datasets.<\/jats:p>","DOI":"10.14778\/2536222.2536236","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"1114-1125","source":"Crossref","is-referenced-by-count":12,"title":["WOO"],"prefix":"10.14778","volume":"6","author":[{"given":"Kedar","family":"Bellare","sequence":"first","affiliation":[{"name":"Facebook"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carlo","family":"Curino","sequence":"additional","affiliation":[{"name":"Microsoft"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ashwin","family":"Machanavajihala","sequence":"additional","affiliation":[{"name":"Duke University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Mika","sequence":"additional","affiliation":[{"name":"Yahoo!"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mandar","family":"Rahurkar","sequence":"additional","affiliation":[{"name":"Yahoo!"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aamod","family":"Sane","sequence":"additional","affiliation":[{"name":"Yahoo!"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2013,8]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1411509.1411513"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2009.43"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2339530.2339707"},{"key":"e_1_2_1_4_1","volume-title":"KDD","author":"Bilenko M.","year":"2003","unstructured":"M. Bilenko and R. J. Mooney. On evaluation and training-set construction for duplicate detection. In KDD, 2003."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/2063016.2063023"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281192.1281217"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1982185.1982411"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559795.1559797"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.14778\/2180912.2180920"},{"key":"e_1_2_1_10_1","volume":"201","author":"Efrati A.","unstructured":"A. Efrati. Google gives search a refresh. Wall Street Journal, 2012.","journal-title":"Wall Street Journal"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/1191547.1191739"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1061318.1061323"},{"key":"e_1_2_1_13_1","volume-title":"CoRR","author":"Gemmell J.","year":"2011","unstructured":"J. Gemmell, B. Rubinstein, and A. K. Chandra. Improving entity resolution with global constraints. CoRR, 2011."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.14778\/2367502.2367527"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.datak.2009.10.003"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.14778\/1920841.1920904"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35176-1_16"},{"key":"e_1_2_1_18_1","volume-title":"QDB","author":"McNeill B.","year":"2012","unstructured":"B. McNeill, H. Kardes, and A. Borthwick. Dynamic Record Blocking: Efficient Linking of Massive Databases in MapReduce. In QDB, 2012."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559970"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2187836.2187943"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDEW.2011.5767671"},{"key":"e_1_2_1_22_1","volume-title":"CIKM","author":"Sarma A. D.","year":"2012","unstructured":"A. D. Sarma, A. Jain, A. Machanavajjhala, and P. Bohannon. An automatic blocking mechanism for large-scale de-duplication tasks. In CIKM, 2012."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1629175.1629201"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1807167.1807222"},{"key":"e_1_2_1_25_1","unstructured":"M. J. Welch C. Drome and A. Sane. High quality real-time incremental entity resolution in a knowledge base."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2396761.2398719"}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2536222.2536236","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T22:35:52Z","timestamp":1729722952000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2536222.2536236"}},"subtitle":["a scalable and multi-tenant platform for continuous knowledge base synthesis"],"short-title":[],"issued":{"date-parts":[[2013,8]]},"references-count":26,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2013,8,27]]}},"alternative-id":["10.14778\/2536222.2536236"],"URL":"https:\/\/doi.org\/10.14778\/2536222.2536236","relation":{},"ISSN":["2150-8097"],"issn-type":[{"type":"print","value":"2150-8097"}],"subject":[],"published":{"date-parts":[[2013,8]]}}}