{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,28]],"date-time":"2025-11-28T12:17:47Z","timestamp":1764332267479,"version":"3.41.0"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2014,5,13]],"date-time":"2014-05-13T00:00:00Z","timestamp":1399939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMOD Rec."],"published-print":{"date-parts":[[2014,5,13]]},"abstract":"<jats:p>String similarity search and its variants are fundamental problems with many applications in areas such as data integration, data quality, computational linguistics, or bioinformatics. A plethora of methods have been developed over the last decades. Obtaining an overview of the state-of-the-art in this field is difficult, as results are published in various domains without much cross-talk, papers use different data sets and often study subtle variations of the core problems, and the sheer number of proposed methods exceeds the capacity of a single research group. In this paper, we report on the results of the probably largest benchmark ever performed in this field. To overcome the resource bottleneck, we organized the benchmark as an international competition, a workshop at EDBT\/ICDT 2013. Various teams from different fields and from all over the world developed or tuned programs for two crisply defined problems. All algorithms were evaluated by an external group on two machines. Altogether, we compared 14 different programs on two string matching problems (k-approximate search and k-approximate join) using data sets of increasing sizes and with different characteristics from two different domains. We compare programs primarily by wall clock time, but also provide results on memory usage, indexing time, batch query effects and scalability in terms of CPU cores. Results were averaged over several runs and confirmed on a second, different hardware platform. A particularly interesting observation is that disciplines can and should learn more from each other, with the three best teams rooting in computational linguistics, databases, and bioinformatics, respectively.<\/jats:p>","DOI":"10.1145\/2627692.2627706","type":"journal-article","created":{"date-parts":[[2014,5,27]],"date-time":"2014-05-27T12:56:59Z","timestamp":1401195419000},"page":"64-76","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":32,"title":["State-of-the-art in string similarity search and join"],"prefix":"10.1145","volume":"43","author":[{"given":"Sebastian","family":"Wandelt","sequence":"first","affiliation":[{"name":"Knowledge Management in Bioinformatics, HU Berlin, Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong","family":"Deng","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefan","family":"Gerdjikov","sequence":"additional","affiliation":[{"name":"FMI Sofia University, Sofia, Bulgaria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shashwat","family":"Mishra","sequence":"additional","affiliation":[{"name":"Special Interest Group in Data, IIT Kanpur, Kanpur, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Petar","family":"Mitankin","sequence":"additional","affiliation":[{"name":"IICT Bulgarian Academy of Sciences, FMI Sofia University, Sofia, Bulgaria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Manish","family":"Patil","sequence":"additional","affiliation":[{"name":"Louisiana State University, Louisiana, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Enrico","family":"Siragusa","sequence":"additional","affiliation":[{"name":"Algorithmic Bioinformatics, FU Berlin, Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"Tiskin","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Warwick, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Wang","sequence":"additional","affiliation":[{"name":"University of New South Wales, New South Wales, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaying","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University Shenyang, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ulf","family":"Leser","sequence":"additional","affiliation":[{"name":"Knowledge Management in Bioinformatics, HU Berlin, Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,5,13]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"918","volume-title":"VLDB '06","author":"Arasu A.","year":"2006","unstructured":"A. Arasu , V. Ganti , and R. Kaushik . Efficient exact set-similarity joins. In PVLDB , VLDB '06 , pages 918 -- 929 . VLDB Endowment , 2006 . A. Arasu, V. Ganti, and R. Kaushik. Efficient exact set-similarity joins. In PVLDB, VLDB '06, pages 918--929. VLDB Endowment, 2006."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242572.1242591"},{"key":"e_1_2_1_3_1","volume-title":"UCI Flamingo Package 4.1","author":"Behm A.","year":"2010","unstructured":"A. Behm , R. Vernica , S. Alsubaiee , S. Ji , J. Lu , L. Jin , Y. Lu , and C. Li . UCI Flamingo Package 4.1 , 2010 . A. Behm, R. Vernica, S. Alsubaiee, S. Ji, J. Lu, L. Jin, Y. Lu, and C. Li. UCI Flamingo Package 4.1, 2010."},{"key":"e_1_2_1_4_1","volume-title":"Digital SRC Research Report","author":"Burrows M.","year":"1994","unstructured":"M. Burrows and D. J. Wheeler . A block-sorting lossless data compression algorithm. Technical report , Digital SRC Research Report , 1994 . M. Burrows and D. J. Wheeler. A block-sorting lossless data compression algorithm. Technical report, Digital SRC Research Report, 1994."},{"key":"e_1_2_1_5_1","first-page":"426","volume-title":"VLDB '97","author":"Ciaccia P.","year":"1997","unstructured":"P. Ciaccia , M. Patella , and P. Zezula . M-tree: An efficient access method for similarity search in metric spaces. In PVLDB , VLDB '97 , pages 426 -- 435 , San Francisco, CA, USA , 1997 . Morgan Kaufmann Publishers Inc. P. Ciaccia, M. Patella, and P. Zezula. M-tree: An efficient access method for similarity search in metric spaces. In PVLDB, VLDB '97, pages 426--435, San Francisco, CA, USA, 1997. Morgan Kaufmann Publishers Inc."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-0190(01)00182-X"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2002.1000343"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-011-0252-8"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31235-9_18"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/347090.347109"},{"key":"e_1_2_1_11_1","volume-title":"Jan.","author":"Gerdjikov S.","year":"2013","unstructured":"S. Gerdjikov , S. Mihov , P. Mitankin , and K. U. Schulz . Good parts first - a new algorithm for approximate search in lexica and string databases. ArXiv e-prints , Jan. 2013 . S. Gerdjikov, S. Mihov, P. Mitankin, and K. U. Schulz. Good parts first - a new algorithm for approximate search in lexica and string databases. ArXiv e-prints, Jan. 2013."},{"key":"e_1_2_1_12_1","first-page":"518","volume-title":"VLDB '99","author":"Gionis A.","year":"1999","unstructured":"A. Gionis , P. Indyk , and R. Motwani . Similarity search in high dimensions via hashing. In PVLDB , VLDB '99 , pages 518 -- 529 , San Francisco, CA, USA , 1999 . Morgan Kaufmann Publishers Inc. A. Gionis, P. Indyk, and R. Motwani. Similarity search in high dimensions via hashing. In PVLDB, VLDB '99, pages 518--529, San Francisco, CA, USA, 1999. Morgan Kaufmann Publishers Inc."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1148170.1148222"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1064546.1180617"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.14778\/2078331.2078340"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btp324"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1989323.1989370"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1162\/0891201042544938"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tcs.2011.01.013"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2133803.2330085"},{"issue":"1","key":"e_1_2_1_21_1","first-page":"205","article-title":"A hybrid indexing method for approximate string matching","volume":"1","author":"Navarro G.","year":"2000","unstructured":"G. Navarro and R. Baeza-Yates . A hybrid indexing method for approximate string matching . Journal of Discrete Algorithms , 1 ( 1 ): 205 -- 239 , 2000 . G. Navarro and R. Baeza-Yates. A hybrid indexing method for approximate string matching. Journal of Discrete Algorithms, 1(1):205--239, 2000.","journal-title":"Journal of Discrete Algorithms"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2009992"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29740-3_3"},{"key":"e_1_2_1_24_1","volume-title":"Jan.","author":"Siragusa E.","year":"2013","unstructured":"E. Siragusa , D. Weese , and K. Reinert . Fast and accurate read mapping with approximate seeds and multiple backtracking. Nucleic acids research , Jan. 2013 . E. Siragusa, D. Weese, and K. Reinert. Fast and accurate read mapping with approximate seeds and multiple backtracking. Nucleic acids research, Jan. 2013."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jda.2008.07.001"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0019-9958(85)80046-2"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2010.28"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1559845.1559925"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.14778\/2536336.2536339"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.14778\/1453856.1453957"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1367497.1367516"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2000824.2000825"}],"container-title":["ACM SIGMOD Record"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2627692.2627706","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2627692.2627706","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:01:36Z","timestamp":1750230096000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2627692.2627706"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,5,13]]},"references-count":32,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,5,13]]}},"alternative-id":["10.1145\/2627692.2627706"],"URL":"https:\/\/doi.org\/10.1145\/2627692.2627706","relation":{},"ISSN":["0163-5808"],"issn-type":[{"type":"print","value":"0163-5808"}],"subject":[],"published":{"date-parts":[[2014,5,13]]},"assertion":[{"value":"2014-05-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}