{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T10:30:00Z","timestamp":1762079400792,"version":"build-2065373602"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"13","license":[{"start":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T00:00:00Z","timestamp":1669766400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T00:00:00Z","timestamp":1669766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100016386","name":"Conselleria de Innovaci\u00f3n, Universidades, Ciencia y Sociedad Digital, Generalitat Valenciana","doi-asserted-by":"publisher","award":["GVA-COVID19\/2021\/103"],"award-info":[{"award-number":["GVA-COVID19\/2021\/103"]}],"id":[{"id":"10.13039\/501100016386","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Spanish Government","award":["PID2021-123956OB-I00","PID2021-122263OB- C22"],"award-info":[{"award-number":["PID2021-123956OB-I00","PID2021-122263OB- C22"]}]},{"DOI":"10.13039\/100009092","name":"Universidad de Alicante","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100009092","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2023,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper presents a new approach to retrieve and further integrate tabular datasets (collections of rows and columns) using union and join operations. In this work, both processes were carried out using a similarity measure based on contextual word embeddings, which allows finding semantically similar tables and overcome the recall problem of lexical approaches based on string similarity. This work is the first attempt to use contextual word embeddings in the whole pipeline of table search and integration, including for the first time their use in the join operation. A comprehensive analysis of their performance was carried out on both retrieving and integrating tabular datasets, comparing them with context-free models. Column headings and cell values were used as contextual information and their impact on each task was evaluated. The results revealed that contextual models significantly outperform context-free models and a traditional weighting schema in ad hoc table retrieval. In the data integration task, contextual models also improved the results on union operation compared to context-free approaches.<\/jats:p>","DOI":"10.1007\/s00521-022-08066-8","type":"journal-article","created":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T14:03:55Z","timestamp":1669817035000},"page":"9319-9333","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Contextual word embeddings for tabular data search and integration"],"prefix":"10.1007","volume":"35","author":[{"given":"Jos\u00e9","family":"Pilaluisa","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3287-9366","authenticated-orcid":false,"given":"David","family":"Tom\u00e1s","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Borja","family":"Navarro-Colorado","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jose-Norberto","family":"Maz\u00f3n","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,11,30]]},"reference":[{"issue":"4","key":"8066_CR1","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1145\/3385658.3385668","volume":"48","author":"D Abadi","year":"2020","unstructured":"Abadi D, Ailamaki A, Andersen D, Bailis P, Balazinska M, Bernstein P, Boncz P, Chaudhuri S, Cheung A, Doan A et al (2020) The seattle report on database research. ACM SIGMOD Rec 48(4):44\u201353. https:\/\/doi.org\/10.1145\/3385658.3385668","journal-title":"ACM SIGMOD Rec"},{"issue":"12","key":"8066_CR2","doi-asserted-by":"publisher","first-page":"2130","DOI":"10.14778\/3229863.3240491","volume":"11","author":"RJ Miller","year":"2018","unstructured":"Miller RJ (2018) Open data integration. Proc Very Large Data Base Endow 11(12):2130\u20132139. https:\/\/doi.org\/10.14778\/3229863.3240491","journal-title":"Proc Very Large Data Base Endow"},{"key":"8066_CR3","doi-asserted-by":"publisher","unstructured":"Peters ME, Neumann M, Zettlemoyer L, Yih W-t (2018) Dissecting contextual word embeddings: Architecture and representation. In: Proceedings of the 2018 conference on empirical methods in natural language processing, pp. 1499\u20131509. Association for computational linguistics, Brussels, Belgium. https:\/\/doi.org\/10.18653\/v1\/D18-1179","DOI":"10.18653\/v1\/D18-1179"},{"key":"8066_CR4","doi-asserted-by":"publisher","unstructured":"Zhang S, Balog K (2018) Ad hoc table retrieval using semantic similarity. In: Proceedings of the 2018 world wide web conference, Lyon, France, pp. 1553\u20131562. https:\/\/doi.org\/10.1145\/3178876.3186067","DOI":"10.1145\/3178876.3186067"},{"issue":"2","key":"8066_CR5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3372117","volume":"11","author":"S Zhang","year":"2020","unstructured":"Zhang S, Balog K (2020) Web table extraction, retrieval, and augmentation: a survey. ACM Transact Intelli Syst Technol 11(2):1\u201335. https:\/\/doi.org\/10.1145\/3372117","journal-title":"ACM Transact Intelli Syst Technol"},{"key":"8066_CR6","doi-asserted-by":"publisher","unstructured":"Trabelsi M, Davison BD, Heflin J (2019) Improved table retrieval using multiple context embeddings for attributes. In: 2019 IEEE international conference on big data (Big Data), pp. 1238\u20131244. IEEE, Los Angeles, CA, USA. https:\/\/doi.org\/10.1109\/BigData47090.2019.9005681","DOI":"10.1109\/BigData47090.2019.9005681"},{"key":"8066_CR7","doi-asserted-by":"publisher","unstructured":"Ahmadov A, Thiele M, Eberius J, Lehner W, Wrembel R (2015) Towards a hybrid imputation approach using web tables. In: Proceedings of the IEEE 2nd international symposium on big data computing, pp. 21\u201330. https:\/\/doi.org\/10.1109\/BDC.2015.38","DOI":"10.1109\/BDC.2015.38"},{"key":"8066_CR8","doi-asserted-by":"publisher","unstructured":"Nguyen TT, Nguyen QVH, Matthias W, Karl A (2015) Result selection and summarization for web table search. In: Proceedings of the 31st international conference on data engineering (ISDE\u201915), pp. 231\u2013242. IEEE, Seoul, South Korea. https:\/\/doi.org\/10.1109\/ICDE.2015.7113287","DOI":"10.1109\/ICDE.2015.7113287"},{"key":"8066_CR9","doi-asserted-by":"publisher","unstructured":"Shraga R, Roitman H, Feigenblat G, Cannim M (2020) Web table retrieval using multimodal deep learning. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp. 1399\u20131408. Association for computing machinery, Virtual. https:\/\/doi.org\/10.1145\/3397271.3401120","DOI":"10.1145\/3397271.3401120"},{"issue":"7","key":"8066_CR10","doi-asserted-by":"publisher","first-page":"813","DOI":"10.14778\/3192965.3192973","volume":"11","author":"F Nargesian","year":"2018","unstructured":"Nargesian F, Zhu E, Pu KQ, Miller RJ (2018) Table union search on open data. Proc Very Large Data Base Endow 11(7):813\u2013825. https:\/\/doi.org\/10.14778\/3192965.3192973","journal-title":"Proc Very Large Data Base Endow"},{"key":"8066_CR11","unstructured":"Liu Q, Kusner MJ, Blunsom P (2020) A survey on contextual embeddings. CoRR arXiv:abs\/2003.07278"},{"key":"8066_CR12","doi-asserted-by":"publisher","unstructured":"Chen Z, Trabelsi M, Heflin J, Xu Y, Davison BD (2020) Table search using a deep contextualized language model. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pp. 589\u2013598. Association for computing machinery, Virtual. https:\/\/doi.org\/10.1145\/3397271.3401044","DOI":"10.1145\/3397271.3401044"},{"key":"8066_CR13","doi-asserted-by":"publisher","unstructured":"Devlin J, Chang M-W, Lee K, Toutanova K (2019) Bert: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 conference of the North American chapter of the association for computational linguistics, pp. 4171\u20134186. Association for computational linguistics, Minneapolis, MN, USA. https:\/\/doi.org\/10.18653\/v1\/N19-1423","DOI":"10.18653\/v1\/N19-1423"},{"key":"8066_CR14","doi-asserted-by":"publisher","unstructured":"Herzig J, Nowak PK, M\u00fcller T, Piccinno F, Eisenschlos J (2020) TaPas: Weakly supervised table parsing via pre-training. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp. 4320\u20134333. Association for computational linguistics, Virtual. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.398","DOI":"10.18653\/v1\/2020.acl-main.398"},{"key":"8066_CR15","doi-asserted-by":"publisher","unstructured":"Yin P, Neubig G, Yih W-t, Riedel S (2020) TaBERT: Pretraining for joint understanding of textual and tabular data. In: Proceedings of the 58th annual meeting of the association for computational linguistics, pp. 8413\u20138426. Association for computational linguistics, Virtual. https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.745","DOI":"10.18653\/v1\/2020.acl-main.745"},{"key":"8066_CR16","doi-asserted-by":"publisher","unstructured":"Agarwal V, Bhardwaj A, Rosso P, Cudr\u00e9-Mauroux P (2021) Convtab: A context-preserving, convolutional model for ad-hoc table retrieval. In: 2021 IEEE International conference on big data (Big Data), pp. 5043\u20135052. https:\/\/doi.org\/10.1109\/BigData52589.2021.9671828","DOI":"10.1109\/BigData52589.2021.9671828"},{"key":"8066_CR17","doi-asserted-by":"publisher","unstructured":"Du L, Gao F, Chen X, Jia R, Wang J, Zhang J, Han S, Zhang D (2021) Tabularnet: a neural network architecture for understanding semantic structures of tabular data. In: Proceedings of the 27th ACM SIGKDD conference on knowledge discovery and data mining. KDD \u201921, pp. 322\u2013331. Association for computing machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3447548.3467228","DOI":"10.1145\/3447548.3467228"},{"key":"8066_CR18","unstructured":"Cappuzzo R, Papotti P, Thirumuruganathan S (2021) Embdi: generating embeddings for relational data integration. In: Greco S, Lenzerini M, Masciari E, Tagarelli A (eds.) Proceedings of the 29th Italian symposium on advanced database systems, SEBD 2021, Pizzo Calabro, Italy, September 5-9, 2021. CEUR Workshop Proceedings, vol. 2994, pp. 331\u2013338. http:\/\/ceur-ws.org\/Vol-2994\/paper36.pdf"},{"key":"8066_CR19","unstructured":"Huang X, Khetan A, Cvitkovic MW, Karnin ZS (2021) Tabtransformer: tabular data modeling using contextual embeddings. In: Workshop on weakly supervised learning (WeaSuL 2021). ICLR 2021 Workshop., Virtual. https:\/\/weasul.github.io\/papers\/7.pdf"},{"key":"8066_CR20","doi-asserted-by":"publisher","unstructured":"Wang C, Chakrabarti K, He Y, Ganjam K, Chen Z, Bernstein PA (2015) Concept expansion using web tables. In: Proceedings of the 24th international conference on World Wide Web, Florence, Italy, pp. 1198\u20131208. https:\/\/doi.org\/10.1145\/2736277.2741644","DOI":"10.1145\/2736277.2741644"},{"key":"8066_CR21","doi-asserted-by":"publisher","unstructured":"Deng L, Zhang S, Balog K (2019) Table2vec: Neural word and entity embeddings for table population and retrieval. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp. 1029\u20131032. Association for computing machinery, Paris, France. https:\/\/doi.org\/10.1145\/3331184.3331333","DOI":"10.1145\/3331184.3331333"},{"key":"8066_CR22","doi-asserted-by":"publisher","unstructured":"Cafarella MJ, Halevy A, Wang DZ, Wu E, Zhang Y (2008) Webtables: Exploring the power of tables on the web. In: Proceedings of the very large data base endowment, pp. 538\u2013549. https:\/\/doi.org\/10.14778\/1453856.1453916","DOI":"10.14778\/1453856.1453916"},{"key":"8066_CR23","doi-asserted-by":"publisher","unstructured":"Zhang S, Balog K (2017) Entitables: smart assistance for entity-focused tables. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp. 255\u2013264. Association for computing machinery, Shinjuku, Tokyo, Japan. https:\/\/doi.org\/10.1145\/3077136.3080796","DOI":"10.1145\/3077136.3080796"},{"key":"8066_CR24","doi-asserted-by":"publisher","unstructured":"Bhagavatula CS, Noraset T, Downey D (2013) Methods for exploring and mining tables on wikipedia. In: Proceedings of the ACM SIGKDD workshop on interactive data exploration and analytics. IDEA \u201913, pp. 18\u201326. Association for computing machinery, Chicago, Illinois. https:\/\/doi.org\/10.1145\/2501511.2501516","DOI":"10.1145\/2501511.2501516"},{"key":"8066_CR25","unstructured":"Mikolov T, Sutskever I, Chen K, Corrado G, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Proceedings of the 26th international conference on neural information processing systems - Volume 2. NIPS\u201913, pp. 3111\u20133119. Curran Associates Inc., Lake Tahoe, Nevada"},{"key":"8066_CR26","doi-asserted-by":"publisher","unstructured":"Pennington J, Socher R, Manning CD (2014) Glove: global vectors for word representation. In: Empirical methods in natural language processing (EMNLP), Doha, Qatar, pp. 1532\u20131543. https:\/\/doi.org\/10.3115\/v1\/D14-1162. http:\/\/www.aclweb.org\/anthology\/D14-1162","DOI":"10.3115\/v1\/D14-1162"},{"key":"8066_CR27","doi-asserted-by":"publisher","unstructured":"Peters M, Neumann M, Iyyer M, Gardner M, Clark C, Lee K, Zettlemoyer L (2018) Deep contextualized word representations. In: Proceedings of the 2018 conference of the North American chapter of the association for computational linguistics: human language technologies, Volume 1 (Long Papers), pp. 2227\u20132237. Association for computational linguistics, New Orleans, Louisiana. https:\/\/doi.org\/10.18653\/v1\/N18-1202","DOI":"10.18653\/v1\/N18-1202"},{"key":"8066_CR28","doi-asserted-by":"publisher","unstructured":"Howard J, Ruder S (2018) Universal language model fine-tuning for text classification. In: Proceedings of the 56th annual meeting of the association for computational linguistics, pp. 328\u2013339. Association for computational linguistics, Melbourne, Australia. https:\/\/doi.org\/10.18653\/v1\/P18-1031","DOI":"10.18653\/v1\/P18-1031"},{"key":"8066_CR29","unstructured":"Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, Levy O, Lewis M, Zettlemoyer L, Stoyanov V (2019) Roberta: A robustly optimized bert pretraining approach. CoRR arXiv:abs\/1907.11692"},{"key":"8066_CR30","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Advances in neural information processing systems, vol. 30, pp. 5998\u20136008. Curran Associates, Inc., Long Beach, CA, USA"},{"key":"8066_CR31","unstructured":"Wu Y, Schuster M, Chen Z, Le QV, Norouzi M, Macherey W, Krikun M, Cao Y, Gao Q, Macherey K, Klingner J, Shah A, Johnson M, Liu X, Kaiser L, Gouws S, Kato Y, Kudo T, Kazawa H, Stevens K, Kurian G, Patil N, Wang W, Young C, Smith J, Riesa J, Rudnick A, Vinyals O, Corrado G, Hughes M, Dean J (2016) Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. arXiv CoRR arXiv:abs\/1609.08144"},{"key":"8066_CR32","doi-asserted-by":"publisher","unstructured":"Sennrich R, Haddow B, Birch A (2016) Neural machine translation of rare words with subword units. In: Proceedings of the 54th annual meeting of the association for computational linguistics, pp. 1715\u20131725. Association for computational linguistics, Berlin, Germany. https:\/\/doi.org\/10.18653\/v1\/P16-1162","DOI":"10.18653\/v1\/P16-1162"},{"key":"8066_CR33","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fams.2019.00067","volume":"5","author":"S Gupta","year":"2020","unstructured":"Gupta S, Kanchinadam T, Conathan D, Fung G (2020) Task-optimized word embeddings for text classification representations. Front Appl Math Stat 5:1\u201310. https:\/\/doi.org\/10.3389\/fams.2019.00067","journal-title":"Front Appl Math Stat"},{"key":"8066_CR34","unstructured":"Mu J, Viswanath P (2018) All-but-the-top: Simple and effective postprocessing for word representations. In: 6th International conference on learning representations, ICLR, Vancouver, BC, Canada"},{"key":"8066_CR35","first-page":"707","volume":"10","author":"VI Levenshtein","year":"1966","unstructured":"Levenshtein VI (1966) Binary codes capable of correcting deletions, insertions and reversals. Soviet Phys Dokl 10:707\u2013710","journal-title":"Soviet Phys Dokl"},{"key":"8066_CR36","doi-asserted-by":"publisher","unstructured":"Sarma AD, Fang L, Gupta N, Halevy A, Lee H, Wu F, Xin R, Yu C (2012) Finding related tables. In: Proceedings of the ACM SIGMOD international conference on management of data (SIGMOD\u201912), pp. 817\u2013828. Association for computing machinery, Scottsdale, Arizona, USA. https:\/\/doi.org\/10.1145\/2213836.2213962","DOI":"10.1145\/2213836.2213962"},{"key":"8066_CR37","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1162\/tacl\\_a_00051","volume":"5","author":"P Bojanowski","year":"2017","unstructured":"Bojanowski P, Grave E, Joulin A, Mikolov T (2017) Enriching word vectors with subword information. Transact Assoc Comput Linguist 5:135\u2013146. https:\/\/doi.org\/10.1162\/tacl_a_00051","journal-title":"Transact Assoc Comput Linguist"},{"key":"8066_CR38","doi-asserted-by":"publisher","unstructured":"Bhagavatula CS, Noraset T, Downey D (2015) Tabel: entity linking in web tables. In: The semantic web - ISWC 2015, pp. 425\u2013441. Springer, Cham. https:\/\/doi.org\/10.1007\/978-3-319-25007-6_25","DOI":"10.1007\/978-3-319-25007-6_25"},{"issue":"2","key":"8066_CR39","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1145\/358923.358934","volume":"32","author":"M Kobayashi","year":"2000","unstructured":"Kobayashi M, Takeda K (2000) Information retrieval on the web. ACM Comput Surv 32(2):144\u2013173. https:\/\/doi.org\/10.1145\/358923.358934","journal-title":"ACM Comput Surv"},{"key":"8066_CR40","doi-asserted-by":"crossref","unstructured":"Robertson SE, Walker S, Jones S, Hancock-Beaulieu MM, Gatford M (1994) Okapi at trec-3. In: Proceedings of the third TREC conference, vol. 500-225, pp. 109\u2013126. National Institute of Standards & Technology, Gaithersburg, Maryland, USA","DOI":"10.6028\/NIST.SP.500-225.routing-city"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-022-08066-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-022-08066-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-022-08066-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,9]],"date-time":"2024-10-09T19:02:53Z","timestamp":1728500573000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-022-08066-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,30]]},"references-count":40,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2023,5]]}},"alternative-id":["8066"],"URL":"https:\/\/doi.org\/10.1007\/s00521-022-08066-8","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"type":"print","value":"0941-0643"},{"type":"electronic","value":"1433-3058"}],"subject":[],"published":{"date-parts":[[2022,11,30]]},"assertion":[{"value":"1 April 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 November 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}