{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T22:14:38Z","timestamp":1777932878039,"version":"3.51.4"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2023,11,29]],"date-time":"2023-11-29T00:00:00Z","timestamp":1701216000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,11,29]],"date-time":"2023-11-29T00:00:00Z","timestamp":1701216000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Scientists face challenges when finding datasets related to their research problems due to the limitations of current dataset search engines. Existing tools for searching research datasets rely on publication content or metadata, do not considering the data contained in the publication in the form of tables. Moreover, scientists require more elaborate inputs and functionalities to retrieve different parts of an article, such as data presented in tables, based on their search purposes. Therefore, this paper proposes a novel approach to retrieve relevant tabular datasets from publications. The input of our system is a research problem stated as an abstract from a scientific paper, and the output is a set of relevant tables from publications that are related to the research problem. This approach aims to provide a better solution for scientists to find useful datasets that support them in addressing their research problems. To validate this approach, experiments were conducted using word embedding from different language models to calculate the semantic similarity between abstracts and tables. The results showed that contextual models significantly outperformed non-contextual models, especially when pre-trained with scientific data. Furthermore, the importance of context was found to be crucial for improving the results.<\/jats:p>","DOI":"10.1007\/s10994-023-06472-0","type":"journal-article","created":{"date-parts":[[2023,11,29]],"date-time":"2023-11-29T18:02:13Z","timestamp":1701280933000},"page":"2227-2248","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Word embeddings for retrieving tabular data from research publications"],"prefix":"10.1007","volume":"113","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2867-8329","authenticated-orcid":false,"given":"Alberto","family":"Berenguer","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jose-Norberto","family":"Maz\u00f3n","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Tom\u00e1s","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,11,29]]},"reference":[{"key":"6472_CR1","doi-asserted-by":"publisher","unstructured":"Agarwal, V., Bhardwaj, A., Rosso, P., & Cudr\u00e9-Mauroux, P. (2021). Convtab: A context-preserving, convolutional model for ad-hoc table retrieval. In 2021 IEEE International Conference on Big Data (Big Data), pp. 5043\u20135052, https:\/\/doi.org\/10.1109\/BigData52589.2021.9671828","DOI":"10.1109\/BigData52589.2021.9671828"},{"key":"6472_CR2","doi-asserted-by":"publisher","unstructured":"Beltagy, I., Lo, K., & Cohan, A. (2019). SciBERT: A pretrained language model for scientific text. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Association for Computational Linguistics, Hong Kong, China, pp. 3615\u20133620, https:\/\/doi.org\/10.18653\/v1\/D19-1371. https:\/\/aclanthology.org\/D19-1371","DOI":"10.18653\/v1\/D19-1371"},{"key":"6472_CR3","doi-asserted-by":"crossref","unstructured":"Bhagavatula, C.S., Noraset, T., & Downey, D. (2013). Methods for exploring and mining tables on wikipedia. In Proceedings of the ACM SIGKDD Workshop on Interactive Data Exploration and Analytics, pp. 18\u201326","DOI":"10.1145\/2501511.2501516"},{"key":"6472_CR4","doi-asserted-by":"crossref","unstructured":"Bhagavatula, C.S., Noraset, T., & Downey, D. (2015). Tabel: Entity linking in web tables. In The Semantic Web - ISWC 2015, Springer International Publishing, Cham, pp. 425-441.","DOI":"10.1007\/978-3-319-25007-6_25"},{"key":"6472_CR5","doi-asserted-by":"crossref","unstructured":"Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2016). Enriching word vectors with subword information. CoRR arXiv:1607.04606.","DOI":"10.1162\/tacl_a_00051"},{"issue":"1","key":"6472_CR6","doi-asserted-by":"publisher","first-page":"538","DOI":"10.14778\/1453856.1453916","volume":"1","author":"MJ Cafarella","year":"2008","unstructured":"Cafarella, M. J., Halevy, A. Y., Wang, D. Z., Wu, E., & Zhang, Y. (2008). Webtables: exploring the power of tables on the web. Proceedings of the VLDB Endowment, 1(1), 538\u2013549.","journal-title":"Proceedings of the VLDB Endowment"},{"issue":"1","key":"6472_CR7","doi-asserted-by":"publisher","first-page":"1090","DOI":"10.14778\/1687627.1687750","volume":"2","author":"MJ Cafarella","year":"2009","unstructured":"Cafarella, M. J., Halevy, A. Y., & Khoussainova, N. (2009). Data integration for the relational web. Proceedings of the VLDB Endowment, 2(1), 1090\u20131101.","journal-title":"Proceedings of the VLDB Endowment"},{"key":"6472_CR8","doi-asserted-by":"crossref","unstructured":"Chen, J., Wang, X., Cheng, G., Kharlamov, E., & Qu, Y. (2019). Towards more usable dataset search: From query characterization to snippet generation. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, pp. 2445\u20132448.","DOI":"10.1145\/3357384.3358096"},{"key":"6472_CR9","doi-asserted-by":"publisher","unstructured":"Chen, Z., Trabelsi, M., Heflin, J., Xu, Y., & Davison, B.D. (2020). Table search using a deep contextualized language model. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Association for Computing Machinery, Virtual, pp. 589\u2013598, https:\/\/doi.org\/10.1145\/3397271.3401044","DOI":"10.1145\/3397271.3401044"},{"key":"6472_CR10","doi-asserted-by":"crossref","unstructured":"Cohan, A., Feldman, S., Beltagy, I., Downey, D., & Weld, D.S. (2020). Specter: Document-level representation learning using citation-informed transformers. arXiv:2004.07180.","DOI":"10.18653\/v1\/2020.acl-main.207"},{"key":"6472_CR11","doi-asserted-by":"publisher","unstructured":"Deng, L., Zhang, S., & Balog, K. (2019). Table2vec: Neural word and entity embeddings for table population and retrieval. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Association for Computing Machinery, Paris, France, pp. 1029\u20131032, https:\/\/doi.org\/10.1145\/3331184.3331333","DOI":"10.1145\/3331184.3331333"},{"key":"6472_CR12","doi-asserted-by":"publisher","unstructured":"Devlin, J., Chang, M.W., Lee, K., & Toutanova, K. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics, Association for Computational Linguistics, pp. 4171\u20134186, https:\/\/doi.org\/10.18653\/v1\/N19-1423","DOI":"10.18653\/v1\/N19-1423"},{"key":"6472_CR13","doi-asserted-by":"publisher","unstructured":"Du, L., Gao, F., Chen, X., Jia, R., Wang, J., Jiang, Z., Han, S., & Zhang, D. (2021). Tabularnet: A neural network architecture for understanding semantic structures of tabular data. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery, New York, NY, USA, KDD \u201921, pp 322\u2014331, https:\/\/doi.org\/10.1145\/3447548.3467228","DOI":"10.1145\/3447548.3467228"},{"key":"6472_CR14","doi-asserted-by":"crossref","unstructured":"F\u00e4rber, M., & Leisinger, A.K. (2021). Recommending datasets for scientific problem descriptions. In CIKM, pp. 3014\u20133018.","DOI":"10.1145\/3459637.3482166"},{"key":"6472_CR15","unstructured":"Firth, J.R. (1957). A synopsis of linguistic theory 1930-1955. In Studies in Linguistic Analysis, Blackwell, Oxford, pp. 1-32."},{"issue":"4","key":"6472_CR16","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1177\/0165551519837182","volume":"46","author":"KM Gregory","year":"2020","unstructured":"Gregory, K. M., Cousijn, H., Groth, P., Scharnhorst, A., & Wyatt, S. (2020). Understanding data search as a socio-technical practice. Journal of Information Science, 46(4), 459\u2013475.","journal-title":"Journal of Information Science"},{"issue":"4","key":"6472_CR17","doi-asserted-by":"publisher","first-page":"610","DOI":"10.5860\/crl.83.4.610","volume":"83","author":"Y Hagiwara","year":"2022","unstructured":"Hagiwara, Y., Ishita, E., Watanabe, Y., & Tomiura, Y. (2022). Identifying scholarly search skills based on resource and document selection behavior among researchers and master\u2019s students in engineering. College & Research Libraries, 83(4), 610.","journal-title":"College & Research Libraries"},{"issue":"2\u20133","key":"6472_CR18","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1080\/00437956.1954.11659520","volume":"10","author":"ZS Harris","year":"1954","unstructured":"Harris, Z. S. (1954). Distributional structure. Word, 10(2\u20133), 146\u2013162. https:\/\/doi.org\/10.1080\/00437956.1954.11659520","journal-title":"Word"},{"key":"6472_CR19","doi-asserted-by":"publisher","unstructured":"Herzig, J., Nowak, P.K., M\u00fcller, T., Piccinno, F., & Eisenschlos, J. (2020). TaPas: Weakly supervised table parsing via pre-training. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Virtual, pp. 4320\u20134333, https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.398","DOI":"10.18653\/v1\/2020.acl-main.398"},{"key":"6472_CR20","doi-asserted-by":"crossref","unstructured":"Howard, J., & Ruder, S. (2018). Universal language model fine-tuning for text classification. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Melbourne, Australia, pp. 328\u2013339.","DOI":"10.18653\/v1\/P18-1031"},{"issue":"6","key":"6472_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3530013","volume":"29","author":"HB Kang","year":"2022","unstructured":"Kang, H. B., Qian, X., Hope, T., Shahaf, D., Chan, J., & Kittur, A. (2022). Augmenting scientific creativity with an analogical search engine. ACM Transactions on Computer-Human Interaction, 29(6), 1\u201336.","journal-title":"ACM Transactions on Computer-Human Interaction"},{"key":"6472_CR22","doi-asserted-by":"crossref","unstructured":"Lilleberg, J., Zhu, Y., & Zhang, Y. (2015). Support vector machines and word2vec for text classification with semantic features. In 2015 IEEE 14th International Conference on Cognitive Informatics Cognitive Computing (ICCI*CC), pp. 136\u2013140.","DOI":"10.1109\/ICCI-CC.2015.7259377"},{"key":"6472_CR23","unstructured":"Liu, Q., Kusner, M.J., & Blunsom, P. (2020). A Survey on Contextual Embeddings. arXiv preprint arXiv:2003.07278."},{"key":"6472_CR24","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). Roberta: A robustly optimized BERT pretraining approach. CoRR arXiv:1907.11692."},{"key":"6472_CR25","unstructured":"Mikolov, T., Sutskever, I., Chen, K., Corrado, G., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Proceedings of the 26th International Conference on Neural Information Processing Systems - vol. 2, Curran Associates Inc., Lake Tahoe, Nevada, NIPS\u201913, pp. 3111\u20133119."},{"key":"6472_CR26","doi-asserted-by":"crossref","unstructured":"Mysore, S., Jasim, M., Song, H., Akbar, S., Randall, A.K.C., & Mahyar, N. (2023). How Data Scientists Review the Scholarly Literature. arXiv preprint arXiv:2301.03774.","DOI":"10.1145\/3576840.3578309"},{"issue":"11","key":"6472_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2021.100336","volume":"2","author":"A Paullada","year":"2021","unstructured":"Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021). Data and its (dis) contents: A survey of dataset development and use in machine learning research. Patterns, 2(11), 100336.","journal-title":"Patterns"},{"key":"6472_CR28","doi-asserted-by":"crossref","unstructured":"Pennington, J., Socher, R., & Manning, C.D. (2014). Glove: Global vectors for word representation. In Empirical Methods in Natural Language Processing (EMNLP), pp. 1532\u20131543, http:\/\/www.aclweb.org\/anthology\/D14-1162.","DOI":"10.3115\/v1\/D14-1162"},{"key":"6472_CR29","doi-asserted-by":"publisher","unstructured":"Peters, M., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., & Zettlemoyer, L. (2018). Deep contextualized word representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational inguistics: Human Language Technologies, Vol. 1 (Long Papers), Association for Computational Linguistics, New Orleans, Louisiana, pp. 2227\u20132237, https:\/\/doi.org\/10.18653\/v1\/N18-1202. https:\/\/www.aclweb.org\/anthology\/N18-1202.","DOI":"10.18653\/v1\/N18-1202"},{"key":"6472_CR30","doi-asserted-by":"crossref","unstructured":"Reimers, N., & Gurevych, I. (2019). Sentence-bert: Sentence embeddings using siamese bert-networks. CoRR arXiv:1908.10084.","DOI":"10.18653\/v1\/D19-1410"},{"issue":"5","key":"6472_CR31","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1016\/0306-4573(88)90021-0","volume":"24","author":"G Salton","year":"1988","unstructured":"Salton, G., & Buckley, C. (1988). Term-weighting approaches in automatic text retrieval. Information Processing & Management, 24(5), 513\u2013523.","journal-title":"Information Processing & Management"},{"key":"6472_CR32","unstructured":"Scao, T.L., Fan, A., Akiki, C., Pavlick, E., Ili\u0107, S., Hesslow, D., Castagn\u00e9, R., Luccioni, A.S., Yvon, F., Gall\u00e9, M., et\u00a0al. (2022). Bloom: A 176b-parameter open-access multilingual language model. arXiv preprint arXiv:2211.05100."},{"key":"6472_CR33","doi-asserted-by":"crossref","unstructured":"Shih, K.J., Singh, S., & Hoiem, D. (2016). Where to look: Focus regions for visual question answering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","DOI":"10.1109\/CVPR.2016.499"},{"key":"6472_CR34","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1613\/jair.2934","volume":"37","author":"PD Turney","year":"2010","unstructured":"Turney, P. D., & Pantel, P. (2010). From frequency to meaning: Vector space models of semantics. Journal of Artificial Intelligence Research, 37, 141\u2013188.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"6472_CR35","first-page":"5998","volume":"30","author":"A Vaswani","year":"2017","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, Curran Associates Inc, Long Beach, CA, USA, 30, 5998\u20136008.","journal-title":"Advances in Neural Information Processing Systems, Curran Associates Inc, Long Beach, CA, USA"},{"key":"6472_CR36","doi-asserted-by":"crossref","unstructured":"Viswanathan, V., Gao, L., Wu, T., Liu, P., & Neubig, G. (2023). Datafinder: Scientific dataset recommendation from natural language descriptions. arXiv preprint arXiv:2305.16636.","DOI":"10.18653\/v1\/2023.acl-long.573"},{"key":"6472_CR37","unstructured":"Wu, Y., Schuster, M., Chen, Z., Le, Q.V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., Macherey, K., Klingner, J., Shah, A., Johnson, M., Liu, X., Kaiser, L., Gouws, S., Kato, Y., Kudo, T., Kazawa, H., Stevens, K., Kurian, G., Patil, N., Wang, W., Young, C., Smith, J., Riesa, J., Rudnick, A., Vinyals, O., Corrado, G., Hughes, M., & Dean, J. (2016). Google\u2019s neural machine translation system: Bridging the gap between human and machine translation. CoRR arXiv:1609.08144."},{"key":"6472_CR38","doi-asserted-by":"publisher","unstructured":"Yin, P., Neubig, G., tau, Yih, W., & Riedel, S. (2020). TaBERT: Pretraining for joint understanding of textual and tabular data. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Virtual, pp. 8413\u20138426, https:\/\/doi.org\/10.18653\/v1\/2020.acl-main.745","DOI":"10.18653\/v1\/2020.acl-main.745"},{"key":"6472_CR39","doi-asserted-by":"crossref","unstructured":"Zhang, L., Zhang, S., & Balog, K. (2019). Table2vec: Neural word and entity embeddings for table population and retrieval. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information retrieval, pp. 1029\u20131032.","DOI":"10.1145\/3331184.3331333"},{"key":"6472_CR40","doi-asserted-by":"publisher","unstructured":"Zhang, S., & Balog, K. (2018). Ad hoc table retrieval using semantic similarity. In Proceedings of the 2018 World Wide Web Conference on World Wide Web - WWW \u201918, ACM Press, pp. 1553\u20131562, https:\/\/doi.org\/10.1145\/3178876.3186067","DOI":"10.1145\/3178876.3186067"},{"issue":"2","key":"6472_CR41","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3372117","volume":"11","author":"S Zhang","year":"2020","unstructured":"Zhang, S., & Balog, K. (2020). Web table extraction, retrieval, and augmentation: A survey. ACM Transactions on Intelligent Systems and Technology, 11(2), 1\u201335. https:\/\/doi.org\/10.1145\/3372117","journal-title":"ACM Transactions on Intelligent Systems and Technology"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-023-06472-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-023-06472-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-023-06472-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,28]],"date-time":"2024-03-28T17:16:37Z","timestamp":1711646197000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-023-06472-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,29]]},"references-count":41,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["6472"],"URL":"https:\/\/doi.org\/10.1007\/s10994-023-06472-0","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,29]]},"assertion":[{"value":"14 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 August 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 November 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}