{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T07:31:20Z","timestamp":1761895880045},"reference-count":30,"publisher":"Association for Computing Machinery (ACM)","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Proc. VLDB Endow."],"published-print":{"date-parts":[[2013,4]]},"abstract":"<jats:p>A basic step in integration is the identification of linkage points, i.e., finding attributes that are shared (or related) between data sources, and that can be used to match records or entities across sources. This is usually performed using a match operator, that associates attributes of one database to another. However, the massive growth in the amount and variety of unstructured and semi-structured data on the Web has created new challenges for this task. Such data sources often do not have a fixed pre-defined schema and contain large numbers of diverse attributes. Furthermore, the end goal is not schema alignment as these schemas may be too heterogeneous (and dynamic) to meaningfully align. Rather, the goal is to align any overlapping data shared by these sources. We will show that even attributes with different meanings (that would not qualify as schema matches) can sometimes be useful in aligning data. The solution we propose in this paper replaces the basic schema-matching step with a more complex instance-based schema analysis and linkage discovery. We present a framework consisting of a library of efficient lexical analyzers and similarity functions, and a set of search algorithms for effective and efficient identification of linkage points over Web data. We experimentally evaluate the effectiveness of our proposed algorithms in real-world integration scenarios in several domains.<\/jats:p>","DOI":"10.14778\/2536336.2536345","type":"journal-article","created":{"date-parts":[[2014,6,24]],"date-time":"2014-06-24T12:17:57Z","timestamp":1403612277000},"page":"445-456","source":"Crossref","is-referenced-by-count":27,"title":["Discovering linkage points over web data"],"prefix":"10.14778","volume":"6","author":[{"given":"Oktie","family":"Hassanzadeh","sequence":"first","affiliation":[{"name":"IBM T.J. Watson Research Center"}]},{"given":"Ken Q.","family":"Pu","sequence":"additional","affiliation":[{"name":"UOIT"}]},{"given":"Soheil Hassas","family":"Yeganeh","sequence":"additional","affiliation":[{"name":"University of Toronto"}]},{"given":"Ren\u00e9e J.","family":"Miller","sequence":"additional","affiliation":[{"name":"University of Toronto"}]},{"given":"Lucian","family":"Popa","sequence":"additional","affiliation":[{"name":"IBM Research-Almaden"}]},{"given":"Mauricio A.","family":"Hern\u00e1ndez","sequence":"additional","affiliation":[{"name":"IBM Research-Almaden"}]},{"given":"Howard","family":"Ho","sequence":"additional","affiliation":[{"name":"IBM Research-Almaden"}]}],"member":"320","published-online":{"date-parts":[[2013,4]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"952","volume-title":"Proc. of the IEEE Int'l Conf. on Data Eng.","author":"Arasu A.","year":"2009","unstructured":"A. Arasu , C. R\u00e9 , and D. Suciu . Large-Scale Deduplication with Constraints Using Dedupalog . In Proc. of the IEEE Int'l Conf. on Data Eng. , pages 952 - 963 , 2009 . A. Arasu, C. R\u00e9, and D. Suciu. Large-Scale Deduplication with Constraints Using Dedupalog. In Proc. of the IEEE Int'l Conf. on Data Eng., pages 952-963, 2009."},{"key":"e_1_2_1_2_1","volume-title":"ISWC Workshop on Consuming Linked Data (COLD)","author":"Bizer C.","year":"2010","unstructured":"C. Bizer and A. Schultz . The R2R Framework: Publishing and Discovering Mappings on the Web . In ISWC Workshop on Consuming Linked Data (COLD) , 2010 . C. Bizer and A. Schultz. The R2R Framework: Publishing and Discovering Mappings on the Web. In ISWC Workshop on Consuming Linked Data (COLD), 2010."},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"J. Bleiholder and F. Naumann. Data Fusion. ACM Computing Surveys 2008 41 1 10.1145\/1456650.1456651","DOI":"10.1145\/1456650.1456651"},{"issue":"3","key":"e_1_2_1_4_1","first-page":"60","volume":"34","author":"Burdick D.","year":"2011","unstructured":"D. Burdick , M. A. Hern\u00e1ndez , H. Ho , G. Koutrika , R. Krishnamurthy , L. Popa , I. Stanoi , S. Vaithyanathan , and S. R. Das . Extracting, Linking and Integrating Data from Public Sources: A Financial Case Study. IEEE Data Engineering Bulletin , 34 ( 3 ): 60 - 67 , 2011 . D. Burdick, M. A. Hern\u00e1ndez, H. Ho, G. Koutrika, R. Krishnamurthy, L. Popa, I. Stanoi, S. Vaithyanathan, and S. R. Das. Extracting, Linking and Integrating Data from Public Sources: A Financial Case Study. IEEE Data Engineering Bulletin, 34(3):60-67, 2011.","journal-title":"IEEE Data Engineering Bulletin"},{"key":"e_1_2_1_5_1","volume-title":"Entity Resolution, and Duplicate Detection. Data-centric systems and applications","author":"Christen P.","year":"2012","unstructured":"P. Christen . Data Matching - Concepts and Techniques for Record Linkage , Entity Resolution, and Duplicate Detection. Data-centric systems and applications . Springer , 2012 . P. Christen. Data Matching - Concepts and Techniques for Record Linkage, Entity Resolution, and Duplicate Detection. Data-centric systems and applications. Springer, 2012."},{"key":"e_1_2_1_6_1","first-page":"383","volume-title":"ACM SIGMOD Int'l Conf. on Mgmt. of Data","author":"Dhamanka R.","year":"2004","unstructured":"R. Dhamanka , Y. Lee , A. Doan , A. Halevy , and P. Domingos . iMAP: Discovering Complex Semantic Matches between Database Schemas . In ACM SIGMOD Int'l Conf. on Mgmt. of Data , pages 383 - 394 , 2004 . R. Dhamanka, Y. Lee, A. Doan, A. Halevy, and P. Domingos. iMAP: Discovering Complex Semantic Matches between Database Schemas. In ACM SIGMOD Int'l Conf. on Mgmt. of Data, pages 383-394, 2004."},{"key":"e_1_2_1_7_1","first-page":"49","volume-title":"Proc. of the Int'l Semantic Web Conference (ISWC)","author":"Duan S.","year":"2012","unstructured":"S. Duan , A. Fokoue , O. Hassanzadeh , A. Kementsietsidis , K. Srinivas , and M. J. Ward . Instance-Based Matching of Large Ontologies Using Locality-Sensitive Hashing . In Proc. of the Int'l Semantic Web Conference (ISWC) , pages 49 - 64 , 2012 . S. Duan, A. Fokoue, O. Hassanzadeh, A. Kementsietsidis, K. Srinivas, and M. J. Ward. Instance-Based Matching of Large Ontologies Using Locality-Sensitive Hashing. In Proc. of the Int'l Semantic Web Conference (ISWC), pages 49-64, 2012."},{"key":"e_1_2_1_8_1","volume-title":"Ontology Matching","author":"Euzenat J.","year":"2007","unstructured":"J. Euzenat and P. Shvaiko . Ontology Matching . Springer-Verlag , 2007 . http:\/\/book.ontologymatching.org\/. J. Euzenat and P. Shvaiko. Ontology Matching. Springer-Verlag, 2007. http:\/\/book.ontologymatching.org\/."},{"key":"e_1_2_1_9_1","first-page":"225","author":"Hassanzadeh O.","year":"2011","unstructured":"O. Hassanzadeh , S. Duan , A. Fokoue , A. Kementsietsidis , K. Srinivas , and M. J. Ward . Helix: Online Enterprise Data Analytics. In Int'l World Wide Web Conference (WWW), pages 225 - 228 , 2011 . O. Hassanzadeh, S. Duan, A. Fokoue, A. Kementsietsidis, K. Srinivas, and M. J. Ward. Helix: Online Enterprise Data Analytics. In Int'l World Wide Web Conference (WWW), pages 225-228, 2011.","journal-title":"Helix: Online Enterprise Data Analytics. In Int'l World Wide Web Conference (WWW), pages"},{"issue":"2","key":"e_1_2_1_10_1","doi-asserted-by":"crossref","first-page":"1590","DOI":"10.14778\/1687553.1687599","volume":"2","author":"Hassanzadeh O.","year":"2009","unstructured":"O. Hassanzadeh , R. Xin , R. J. Miller , A. Kementsietsidis , L. Lim , and M. Wang . Linkage Query Writer. Proceedings of the VLDB Endowment (PVLDB) , 2 ( 2 ): 1590 - 1593 , 2009 . O. Hassanzadeh, R. Xin, R. J. Miller, A. Kementsietsidis, L. Lim, and M. Wang. Linkage Query Writer. Proceedings of the VLDB Endowment (PVLDB), 2(2):1590-1593, 2009.","journal-title":"Linkage Query Writer. Proceedings of the VLDB Endowment (PVLDB)"},{"key":"e_1_2_1_11_1","first-page":"549","volume-title":"Advances in Database Technology - Int'l Conf. on Extending Database Technology (EDBT)","author":"Hern\u00e1ndez M. A.","year":"2013","unstructured":"M. A. Hern\u00e1ndez , G. Koutrika , R. Krishnamurthy , L. Popa , and R. Wisnesky . HIL: A High-Level Scripting Language for Entity Integration . In Advances in Database Technology - Int'l Conf. on Extending Database Technology (EDBT) , pages 549 - 560 , 2013 . M. A. Hern\u00e1ndez, G. Koutrika, R. Krishnamurthy, L. Popa, and R. Wisnesky. HIL: A High-Level Scripting Language for Entity Integration. In Advances in Database Technology - Int'l Conf. on Extending Database Technology (EDBT), pages 549-560, 2013."},{"key":"e_1_2_1_12_1","first-page":"1152","volume-title":"Proc. of the AAAI Conference on Artificial Intelligence (AAAI)","author":"Hutter F.","year":"2007","unstructured":"F. Hutter , H. H. Hoos , and T. St\u00fctzle . Automatic Algorithm Configuration Based on Local Search . In Proc. of the AAAI Conference on Artificial Intelligence (AAAI) , pages 1152 - 1157 , 2007 . F. Hutter, H. H. Hoos, and T. St\u00fctzle. Automatic Algorithm Configuration Based on Local Search. In Proc. of the AAAI Conference on Artificial Intelligence (AAAI), pages 1152-1157, 2007."},{"issue":"11","key":"e_1_2_1_13_1","first-page":"1638","volume":"5","author":"Isele R.","year":"2012","unstructured":"R. Isele and C. Bizer . Learning Expressive Linkage Rules using Genetic Programming. Proceedings of the VLDB Endowment (PVLDB) , 5 ( 11 ): 1638 - 1649 , 2012 . R. Isele and C. Bizer. Learning Expressive Linkage Rules using Genetic Programming. Proceedings of the VLDB Endowment (PVLDB), 5(11):1638-1649, 2012.","journal-title":"Learning Expressive Linkage Rules using Genetic Programming. Proceedings of the VLDB Endowment (PVLDB)"},{"key":"e_1_2_1_14_1","first-page":"205","author":"Kang J.","year":"2003","unstructured":"J. Kang and J. F. Naughton . On Schema Matching with Opaque Column Names and Data Values. In ACM SIGMOD Int'l Conf. on Mgmt. of Data, pages 205 - 216 , 2003 . J. Kang and J. F. Naughton. On Schema Matching with Opaque Column Names and Data Values. In ACM SIGMOD Int'l Conf. on Mgmt. of Data, pages 205-216, 2003.","journal-title":"In ACM SIGMOD Int'l Conf. on Mgmt. of Data, pages"},{"key":"e_1_2_1_15_1","first-page":"233","volume-title":"Data Integration: A Theoretical Perspective. In Proc. of the ACM Symp. on Principles of Database Systems (PODS)","author":"Lenzerini M.","year":"2002","unstructured":"M. Lenzerini . Data Integration: A Theoretical Perspective. In Proc. of the ACM Symp. on Principles of Database Systems (PODS) , pages 233 - 246 , 2002 . M. Lenzerini. Data Integration: A Theoretical Perspective. In Proc. of the ACM Symp. on Principles of Database Systems (PODS), pages 233-246, 2002."},{"key":"e_1_2_1_16_1","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-01835-0","volume-title":"An Introduction to Duplicate Detection. Synthesis Lectures on Data Management","author":"Naumann F.","year":"2010","unstructured":"F. Naumann and M. Herschel . An Introduction to Duplicate Detection. Synthesis Lectures on Data Management . Morgan & Claypool Publishers , 2010 . F. Naumann and M. Herschel. An Introduction to Duplicate Detection. Synthesis Lectures on Data Management. Morgan & Claypool Publishers, 2010."},{"key":"e_1_2_1_17_1","volume-title":"RAVEN - Active Learning of Link Specifications. In ISWC Workshop on Ontology Matching","author":"Ngonga Ngomo A.-C.","year":"2011","unstructured":"A.-C. Ngonga Ngomo , J. Lehmann , S\u00f6ren Auer , and K. H\u00f6ffner . RAVEN - Active Learning of Link Specifications. In ISWC Workshop on Ontology Matching , 2011 . A.-C. Ngonga Ngomo, J. Lehmann, S\u00f6ren Auer, and K. H\u00f6ffner. RAVEN - Active Learning of Link Specifications. In ISWC Workshop on Ontology Matching, 2011."},{"issue":"4","key":"e_1_2_1_18_1","first-page":"334","volume":"10","author":"Rahm E.","year":"2001","unstructured":"E. Rahm and P. A. Bernstein . A Survey of Approaches to Automatic Schema Matching. The Int'l Journal on Very Large Data Bases , 10 ( 4 ): 334 - 350 , 2001 . E. Rahm and P. A. Bernstein. A Survey of Approaches to Automatic Schema Matching. The Int'l Journal on Very Large Data Bases, 10(4):334-350, 2001.","journal-title":"A Survey of Approaches to Automatic Schema Matching. The Int'l Journal on Very Large Data Bases"},{"issue":"4","key":"e_1_2_1_19_1","first-page":"333","volume":"3","author":"Robertson S.","year":"2009","unstructured":"S. Robertson and H. Zaragoza . The Probabilistic Relevance Framework: BM25 and Beyond. Found. Trends Inf. Retr. , 3 ( 4 ): 333 - 389 , 2009 . S. Robertson and H. Zaragoza. The Probabilistic Relevance Framework: BM25 and Beyond. Found. Trends Inf. Retr., 3(4):333-389, 2009.","journal-title":"The Probabilistic Relevance Framework: BM25 and Beyond. Found. Trends Inf. Retr."},{"issue":"11","key":"e_1_2_1_20_1","first-page":"613","volume":"18","author":"Salton G.","year":"1975","unstructured":"G. Salton , A. Wong , and C. S. Yang . A Vector Space Model for Automatic Indexing. Communications of the ACM , 18 ( 11 ): 613 - 620 , 1975 . G. Salton, A. Wong, and C. S. Yang. A Vector Space Model for Automatic Indexing. Communications of the ACM, 18(11):613-620, 1975.","journal-title":"A Vector Space Model for Automatic Indexing. Communications of the ACM"},{"key":"e_1_2_1_21_1","first-page":"331","volume-title":"Proc. of the Int'l Conf. on Very Large Data Bases (VLDB)","author":"Warren R. H.","year":"2006","unstructured":"R. H. Warren and F. Wm. Tompa . Multi-column Substring Matching for Database Schema Translation . In Proc. of the Int'l Conf. on Very Large Data Bases (VLDB) , pages 331 - 342 , 2006 . R. H. Warren and F. Wm. Tompa. Multi-column Substring Matching for Database Schema Translation. In Proc. of the Int'l Conf. on Very Large Data Bases (VLDB), pages 331-342, 2006."},{"issue":"1","key":"e_1_2_1_22_1","doi-asserted-by":"crossref","first-page":"805","DOI":"10.14778\/1920841.1920944","volume":"3","author":"Zhang M.","year":"2010","unstructured":"M. Zhang , M. Hadjieleftheriou , B. C. Ooi , C. M. Procopiuc , and D. Srivastava . On Multi-Column Foreign Key Discovery. Proceedings of the VLDB Endowment (PVLDB) , 3 ( 1 ): 805 - 814 , 2010 . M. Zhang, M. Hadjieleftheriou, B. C. Ooi, C. M. Procopiuc, and D. Srivastava. On Multi-Column Foreign Key Discovery. Proceedings of the VLDB Endowment (PVLDB), 3(1):805-814, 2010.","journal-title":"On Multi-Column Foreign Key Discovery. Proceedings of the VLDB Endowment (PVLDB)"},{"key":"e_1_2_1_23_1","volume-title":"http:\/\/dbpedia.org\/. [Online","year":"2012","unstructured":"DBpedia. http:\/\/dbpedia.org\/. [Online ; accessed 12-12- 2012 ]. DBpedia. http:\/\/dbpedia.org\/. [Online; accessed 12-12-2012]."},{"key":"e_1_2_1_24_1","volume-title":"http:\/\/drugbank.ca\/. [Online","year":"2012","unstructured":"DrugBank. http:\/\/drugbank.ca\/. [Online ; accessed 12-12- 2012 ]. DrugBank. http:\/\/drugbank.ca\/. [Online; accessed 12-12-2012]."},{"key":"e_1_2_1_25_1","volume-title":"http:\/\/www.imdb.com\/. [Online","year":"2012","unstructured":"IMDb. http:\/\/www.imdb.com\/. [Online ; accessed 12-12- 2012 ]. IMDb. http:\/\/www.imdb.com\/. [Online; accessed 12-12-2012]."},{"key":"e_1_2_1_26_1","volume-title":"http:\/\/redis.io\/. [Online","year":"2012","unstructured":"Redis. http:\/\/redis.io\/. [Online ; accessed 12-12- 2012 ]. Redis. http:\/\/redis.io\/. [Online; accessed 12-12-2012]."},{"key":"e_1_2_1_27_1","volume-title":"http:\/\/xapian.org\/. [Online","year":"2012","unstructured":"Xapian. http:\/\/xapian.org\/. [Online ; accessed 12-12- 2012 ]. Xapian. http:\/\/xapian.org\/. [Online; accessed 12-12-2012]."},{"key":"e_1_2_1_28_1","volume-title":"http:\/\/freebase.com\/. [Online","year":"2012","unstructured":"Freebase. http:\/\/freebase.com\/. [Online ; accessed 12-12- 2012 ]. Freebase. http:\/\/freebase.com\/. [Online; accessed 12-12-2012]."},{"key":"e_1_2_1_29_1","volume-title":"http:\/\/ftp.sec.gov\/. [Online","author":"The U.S. Securities & Exchange Commission","year":"2012","unstructured":"The U.S. Securities & Exchange Commission 's Public Information Server . http:\/\/ftp.sec.gov\/. [Online ; accessed 12-12- 2012 ]. The U.S. Securities & Exchange Commission's Public Information Server. http:\/\/ftp.sec.gov\/. [Online; accessed 12-12-2012]."},{"key":"e_1_2_1_30_1","unstructured":"Project Data Sets & Results. http:\/\/purl.org\/linkdiscovery\/touch\/data.  Project Data Sets & Results. http:\/\/purl.org\/linkdiscovery\/touch\/data."}],"container-title":["Proceedings of the VLDB Endowment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.14778\/2536336.2536345","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T10:42:38Z","timestamp":1672224158000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.14778\/2536336.2536345"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,4]]},"references-count":30,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2013,4]]}},"alternative-id":["10.14778\/2536336.2536345"],"URL":"https:\/\/doi.org\/10.14778\/2536336.2536345","relation":{},"ISSN":["2150-8097"],"issn-type":[{"value":"2150-8097","type":"print"}],"subject":[],"published":{"date-parts":[[2013,4]]}}}