{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T18:37:23Z","timestamp":1771699043287,"version":"3.50.1"},"reference-count":40,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,8,4]],"date-time":"2024-08-04T00:00:00Z","timestamp":1722729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62072075"],"award-info":[{"award-number":["62072075"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>To optimize the utilization and analysis of tables, it is essential to recognize and understand their semantics comprehensively. This requirement is especially critical given that many tables lack explicit annotations, necessitating the identification of column types and inter-column relationships. Such identification can significantly augment data quality, streamline data integration, and support data analysis and mining. Current table annotation models often address each subtask independently, which may result in the neglect of constraints and contextual information, causing relational ambiguities and inference errors. To address this issue, we propose a unified multi-task learning framework capable of concurrently handling multiple tasks within a single model, including column named entity recognition, column type identification, and inter-column relationship detection. By integrating these tasks, the framework exploits their interrelations, facilitating the exchange of shallow features and the sharing of representations. Their cooperation enables each task to leverage insights from the others, thereby improving the performance of individual subtasks and enhancing the model\u2019s overall generalization capabilities. Notably, our model is designed to employ only the internal information of tabular data, avoiding reliance on external context or knowledge graphs. This design ensures robust performance even with limited input information. Extensive experiments demonstrate the superior performance of our model across various tasks, validating the effectiveness of unified multi-task learning framework in the recognition and comprehension of table semantics.<\/jats:p>","DOI":"10.3390\/e26080664","type":"journal-article","created":{"date-parts":[[2024,8,5]],"date-time":"2024-08-05T13:57:28Z","timestamp":1722866248000},"page":"664","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Hierarchical Multi-Task Learning Framework for Semantic Annotation in Tabular Data"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3941-8538","authenticated-orcid":false,"given":"Jie","family":"Wu","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5283-7318","authenticated-orcid":false,"given":"Mengshu","family":"Hou","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chen, Z., Zhang, S., and Davison, B.D. (2021, January 11\u201315). WTR: A Test Collection for Web Table Retrieval. Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada.","DOI":"10.1145\/3404835.3463260"},{"key":"ref_2","unstructured":"Zhong, V., Xiong, C., and Socher, R. (2017). Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning. arXiv."},{"key":"ref_3","unstructured":"Chen, W., Wang, H., Chen, J., Zhang, Y., Wang, H., Li, S., Zhou, X., and Wang, W.Y. (2020, January 26\u201330). TabFact: A Large-scale Dataset for Table-based Fact Verification. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Chen, J., Jim\u00e9nez-Ruiz, E., Horrocks, I., and Sutton, C. (2019, January 10\u201316). Learning semantic annotations for tabular data. Proceedings of the 28th International Joint Conference on Artificial Intelligence, Macao, China. Available online: https:\/\/dl.acm.org\/doi\/abs\/10.5555\/3367243.3367329.","DOI":"10.24963\/ijcai.2019\/289"},{"key":"ref_5","unstructured":"Chen, J., Jim\u00e9nez-Ruiz, E., Horrocks, I., and Sutton, C. (February, January 27). ColNet: Embedding the semantics of web tables for column type prediction. Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"921","DOI":"10.3233\/SW-160242","article-title":"Effective and efficient Semantic Table Interpretation using TableMiner+","volume":"8","author":"Hitzler","year":"2017","journal-title":"Semant. Web"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yin, P., Neubig, G., Yih, W.t., and Riedel, S. (2020, January 5\u201310). TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.745"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Iida, H., Thai, D., Manjunatha, V., and Iyyer, M. (2021, January 6\u201311). TABBIE: Pretrained Representations of Tabular Data. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Online.","DOI":"10.18653\/v1\/2021.naacl-main.270"},{"key":"ref_9","unstructured":"Ramnandan, S., Mittal, A., Knoblock, C.A., and Szekely, P. (June, January 31). Assigning Semantic Labels to Data Sources. Proceedings of the 12th European Semantic Web Conference on The Semantic Web, Berlin\/Heidelberg, Germany."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hulsebos, M., Hu, K., Bakker, M., Zgraggen, E., Satyanarayan, A., Kraska, T., Demiralp, C., and Hidalgo, C. (2019, January 4\u20138). Sherlock: A Deep Learning Approach to Semantic Data Type Detection. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330993"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1835","DOI":"10.14778\/3407790.3407793","article-title":"Sato: Contextual semantic type detection in tables","volume":"13","author":"Zhang","year":"2020","journal-title":"Proc. VLDB Endow."},{"key":"ref_12","unstructured":"Takeoka, K., Oyamada, M., Nakadai, S., and Okadome, T. (February, January 27). Meimei: An efficient probabilistic approach for semantically annotating tables. Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Khurana, U., and Galhotra, S. (2021, January 1\u20135). Semantic Concept Annotation for Tabular Data. Proceedings of the 30th ACM International Conference on Information & Knowledge Management, Virtual Event, Queensland, Australia.","DOI":"10.1145\/3459637.3482295"},{"key":"ref_14","unstructured":"Korini, K., and Bizer, C. (September, January 28). Column type annotation using ChatGPT. Proceedings of the Joint Proceedings of Workshops at the 49th International Conference on Very Large Data Bases (VLDBW\u201923), Vancouver, BC, Canada."},{"key":"ref_15","unstructured":"Korini, K., and Bizer, C. (2024, June 28). Column Property Annotation Using Large Language Models, Crete, Greece. Available online: https:\/\/2024.eswc-conferences.org\/wp-content\/uploads\/2024\/04\/ESWC_2024_paper_283.pdf."},{"key":"ref_16","unstructured":"OpenAI (2023). GPT-4 Technical Report. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, Z., Dong, H., Jia, R., Li, J., Fu, Z., Han, S., and Zhang, D. (2021, January 14\u201318). TUTA: Tree-based Transformers for Generally Structured Table Pre-training. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, Virtual Event, Singapore.","DOI":"10.1145\/3447548.3467434"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Eisenschlos, J., Gor, M., M\u00fcller, T., and Cohen, W. (2021, January 7\u201311). MATE: Multi-view Attention for Table Transformer Efficiency. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Online, Punta Cana, Dominican Republic.","DOI":"10.18653\/v1\/2021.emnlp-main.600"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"307","DOI":"10.14778\/3430915.3430921","article-title":"TURL: Table understanding through representation learning","volume":"14","author":"Deng","year":"2020","journal-title":"Proc. VLDB Endow."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.14778\/3457390.3457391","article-title":"RPT: Relational pre-trained transformer is almost all you need towards democratizing data preparation","volume":"14","author":"Tang","year":"2021","journal-title":"Proc. VLDB Endow."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wang, F., Sun, K., Chen, M., Pujara, J., and Szekely, P. (2021, January 11\u201315). Retrieving Complex Tables with Multi-Granular Graph Representation Learning. Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada.","DOI":"10.1145\/3404835.3462909"},{"key":"ref_22","unstructured":"Ruder, S. (2017). An overview of multi-task learning in deep neural networks. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Br\u00fcggemann, D., Kanakis, M., Obukhov, A., Georgoulis, S., and Van Gool, L. (2021, January 10\u201317). Exploring Relational Context for Multi-Task Dense Prediction. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01557"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Xu, Y., Yang, Y., and Zhang, L. (2023, January 7\u201314). DeMT: Deformable mixer transformer for multi-task learning of dense prediction. Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, Washington, DC, USA.","DOI":"10.1609\/aaai.v37i3.25411"},{"key":"ref_25","unstructured":"He, J., Zhou, C., Ma, X., Berg-Kirkpatrick, T., and Neubig, G. (2022, January 25\u201329). Towards a Unified View of Parameter-Efficient Transfer Learning. Proceedings of the International Conference on Learning Representations, Virtual."},{"key":"ref_26","unstructured":"Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L., and Chen, W. (2022, January 25\u201329). LoRA: Low-Rank Adaptation of Large Language Models. Proceedings of the International Conference on Learning Representations, Virtual."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Karimi Mahabadi, R., Ruder, S., Dehghani, M., and Henderson, J. (2021, January 1\u20136). Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Online.","DOI":"10.18653\/v1\/2021.acl-long.47"},{"key":"ref_28","unstructured":"Tay, Y., Zhao, Z., Bahri, D., Metzler, D., and Juan, D.C. (2021, January 4). HyperGrid Transformers: Towards A Single Model for Multiple Tasks. Proceedings of the International Conference on Learning Representations, Vienna, Austria."},{"key":"ref_29","unstructured":"Zhao, S., Liu, T., Zhao, S., and Wang, F. (February, January 27). A neural multi-task learning framework to jointly model medical named entity recognition and normalization. Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhao, H., Huang, L., Zhang, R., Lu, Q., and Xue, H. (2020, January 5\u201310). SpanMlt: A Span-based Multi-Task Learning Framework for Pair-wise Aspect and Opinion Terms Extraction. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.296"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Fei, H., Tan, S., and Li, P. (2019, January 4\u20138). Hierarchical Multi-Task Word Embedding Learning for Synonym Prediction. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330914"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chauhan, D.S., S R, D., Ekbal, A., and Bhattacharyya, P. (2020, January 5\u201310). Sentiment and Emotion help Sarcasm? A Multi-task Learning Framework for Multi-Modal Sarcasm, Sentiment and Emotion Analysis. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.","DOI":"10.18653\/v1\/2020.acl-main.401"},{"key":"ref_33","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L.u., and Polosukhin, I. (2017). Attention is All you Need. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_34","unstructured":"Jim\u00e9nez-Ruiz, E., Hassanzadeh, O., Efthymiou, V., Chen, J., and Srinivas, K. (June, January 31). SemTab 2019: Resources to Benchmark Tabular Data to Knowledge Graph Matching Systems. Proceedings of the The Semantic Web, Crete, Greece."},{"key":"ref_35","unstructured":"Hassanzadeh, O., Efthymiou, V., and Chen, J. (2022). SemTab 2022: Semantic Web Challenge on Tabular Data to Knowledge Graph Matching Data Sets\u2014\u201cHard Tables\u201d R1 and R2. The Semantic Web, Zenodo."},{"key":"ref_36","first-page":"411","article-title":"spaCy 2: Natural language understanding with Bloom embeddings, convolutional neural networks and incremental parsing","volume":"7","author":"Honnibal","year":"2017","journal-title":"To Appear"},{"key":"ref_37","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019). PyTorch: An Imperative Style, High-Performance Deep Learning Library. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., and Funtowicz, M. (2020, January 16\u201320). Transformers: State-of-the-Art Natural Language Processing. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, Online.","DOI":"10.18653\/v1\/2020.emnlp-demos.6"},{"key":"ref_39","unstructured":"Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., and Stoyanov, V. (2019). RoBERTa: A Robustly Optimized BERT Pretraining Approach. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Suhara, Y., Li, J., Li, Y., Zhang, D., Demiralp, C., Chen, C., and Tan, W.C. (2022, January 12\u201317). Annotating Columns with Pre-trained Language Models. Proceedings of the 2022 International Conference on Management of Data, Philadelphia, PA, USA.","DOI":"10.1145\/3514221.3517906"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/8\/664\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:29:53Z","timestamp":1760110193000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/26\/8\/664"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,4]]},"references-count":40,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["e26080664"],"URL":"https:\/\/doi.org\/10.3390\/e26080664","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,4]]}}}