{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T22:39:30Z","timestamp":1780439970985,"version":"3.54.1"},"reference-count":32,"publisher":"World Scientific Pub Co Pte Ltd","issue":"02","funder":[{"name":"EU Horizon 2020 MSCA-ITN programme DEDS","award":["955895"],"award-info":[{"award-number":["955895"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Semantic Computing"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:p> Data lakes store vast amount of datasets of various forms collected from various sources. In this context, efficient table search is essential for identifying and integrating data to support business intelligence and machine learning pipelines. This paper explores effective methods for finding related tables using advanced table representation learning. Representation learning generates dense vector representations for tables at different levels (row, column, cell), enabling the use of advanced indexing techniques such as LSH, HNSW, and DiskANN, which speed up the core operation of approximate k-NN search within vector spaces. However, while several indexing techniques have been proposed so far, a thorough study and comparison of their effectiveness versus performance trade-offs is still missing. In this paper, we aim at shedding light on this gap. We begin by reviewing advanced vector-search techniques for table search in data lakes, followed by a detailed analysis of k-ANN indexes. Next, we present a comparison of the HNSW and DiskANN indexing techniques, comparing their internal structure, effectiveness, efficiency, and scalability. Additionally, we explore the impact of model accuracy on index performance. Our experiments include four datasets of various sizes and complexity. This study allows us to explore indexing design options, revealing the strengths and weaknesses of each, and also to identify potentially interesting future research directions. <\/jats:p>","DOI":"10.1142\/s1793351x25420024","type":"journal-article","created":{"date-parts":[[2025,3,7]],"date-time":"2025-03-07T15:09:42Z","timestamp":1741360182000},"page":"173-196","source":"Crossref","is-referenced-by-count":1,"title":["Comparative Analysis of Indexing Techniques for Table Search in Data Lakes"],"prefix":"10.1142","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-2956-7281","authenticated-orcid":false,"given":"Ibraheem","family":"Taha","sequence":"first","affiliation":[{"name":"National Kapodistrian University of Athens, Athena Research Center, Aalborg University, Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7922-5998","authenticated-orcid":false,"given":"Matteo","family":"Lissandrini","sequence":"additional","affiliation":[{"name":"University of Verona, Verona, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-6078-5323","authenticated-orcid":false,"given":"Alkis","family":"Simitsis","sequence":"additional","affiliation":[{"name":"Athena Research Center, Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1705-8247","authenticated-orcid":false,"given":"Yannis","family":"Ioannidis","sequence":"additional","affiliation":[{"name":"National Kapodistrian University of Athens, Athena Research Center, Athens, Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2025,5,14]]},"reference":[{"key":"S1793351X25420024BIB001","first-page":"69","author":"Fan G.","year":"2023","journal-title":"SIGMOD"},{"key":"S1793351X25420024BIB002","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313685"},{"key":"S1793351X25420024BIB003","doi-asserted-by":"publisher","DOI":"10.14778\/2994509.2994534"},{"key":"S1793351X25420024BIB004","doi-asserted-by":"publisher","DOI":"10.1145\/3318464.3389726"},{"key":"S1793351X25420024BIB005","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3300065"},{"key":"S1793351X25420024BIB006","doi-asserted-by":"publisher","DOI":"10.14778\/3529337.3529353"},{"key":"S1793351X25420024BIB007","doi-asserted-by":"publisher","DOI":"10.14778\/3603581.3603587"},{"key":"S1793351X25420024BIB008","doi-asserted-by":"publisher","DOI":"10.14778\/3587136.3587146"},{"key":"S1793351X25420024BIB009","doi-asserted-by":"publisher","DOI":"10.14778\/3192965.3192973"},{"key":"S1793351X25420024BIB010","doi-asserted-by":"publisher","DOI":"10.1145\/3588689"},{"key":"S1793351X25420024BIB011","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330993"},{"key":"S1793351X25420024BIB012","doi-asserted-by":"publisher","DOI":"10.14778\/3430915.3430921"},{"key":"S1793351X25420024BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2018.00094"},{"key":"S1793351X25420024BIB014","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE48307.2020.00067"},{"key":"S1793351X25420024BIB015","doi-asserted-by":"publisher","DOI":"10.1145\/276698.276876"},{"key":"S1793351X25420024BIB016","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2889473"},{"key":"S1793351X25420024BIB017","volume-title":"Advances in Neural Information Processing Systems","author":"Subramanya S. J.","year":"2019"},{"key":"S1793351X25420024BIB018","doi-asserted-by":"publisher","DOI":"10.1109\/ICSC59802.2024.00046"},{"key":"S1793351X25420024BIB019","doi-asserted-by":"publisher","DOI":"10.14778\/1687627.1687750"},{"key":"S1793351X25420024BIB020","doi-asserted-by":"publisher","DOI":"10.14778\/3407790.3407793"},{"key":"S1793351X25420024BIB021","first-page":"670","volume-title":"Proc. 28th Int. Conf. Very Large Databases","author":"Hristidis V.","year":"2002"},{"key":"S1793351X25420024BIB022","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2002.994756"},{"key":"S1793351X25420024BIB023","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2002.994693"},{"key":"S1793351X25420024BIB024","first-page":"69","volume-title":"22nd Int. Conf. Data Engineering","author":"Koutrika G.","year":"2006"},{"key":"S1793351X25420024BIB025","first-page":"1382","volume-title":"2007 IEEE 23rd Int. Conf. Data Engineering","author":"Simitsis A.","year":"2007"},{"key":"S1793351X25420024BIB026","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-007-0075-9"},{"key":"S1793351X25420024BIB027","doi-asserted-by":"publisher","DOI":"10.1145\/2588555.2594533"},{"key":"S1793351X25420024BIB028","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-2068"},{"key":"S1793351X25420024BIB030","first-page":"66239","volume-title":"Advances in Neural Information Processing Systems","author":"Indyk P.","year":"2023"},{"key":"S1793351X25420024BIB031","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.57"},{"key":"S1793351X25420024BIB032","doi-asserted-by":"publisher","DOI":"10.14778\/3476249.3476255"},{"key":"S1793351X25420024BIB036","doi-asserted-by":"publisher","DOI":"10.1145\/2872518.2889386"}],"container-title":["International Journal of Semantic Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1793351X25420024","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,27]],"date-time":"2025-06-27T01:00:02Z","timestamp":1750986002000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S1793351X25420024"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,14]]},"references-count":32,"journal-issue":{"issue":"02","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["10.1142\/S1793351X25420024"],"URL":"https:\/\/doi.org\/10.1142\/s1793351x25420024","relation":{},"ISSN":["1793-351X","1793-7108"],"issn-type":[{"value":"1793-351X","type":"print"},{"value":"1793-7108","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,14]]}}}