{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T15:09:39Z","timestamp":1784560179881,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":48,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T00:00:00Z","timestamp":1628899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,8,14]]},"DOI":"10.1145\/3447548.3467434","type":"proceedings-article","created":{"date-parts":[[2021,8,13]],"date-time":"2021-08-13T18:21:39Z","timestamp":1628878899000},"page":"1780-1790","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":74,"title":["TUTA"],"prefix":"10.1145","author":[{"given":"Zhiruo","family":"Wang","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haoyu","family":"Dong","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ran","family":"Jia","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jia","family":"Li","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhiyi","family":"Fu","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shi","family":"Han","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongmei","family":"Zhang","sequence":"additional","affiliation":[{"name":"Microsoft Research, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,8,14]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"International Semantic Web Conference. Springer","author":"Bhagavatula Chandra Sekhar","year":"2015","unstructured":"Chandra Sekhar Bhagavatula , Thanapon Noraset , and Doug Downey . Tabel : entity linking in web tables . In International Semantic Web Conference. Springer , 2015 . Chandra Sekhar Bhagavatula, Thanapon Noraset, and Doug Downey. Tabel: entity linking in web tables. In International Semantic Web Conference. Springer, 2015."},{"key":"e_1_3_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2509908.2509909"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2623330.2623617"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.330129"},{"key":"e_1_3_2_2_5_1","volume-title":"Learning semantic annotations for tabular data. arXiv preprint:1906.00781","author":"Chen Jiaoyan","year":"2019","unstructured":"Jiaoyan Chen , Ernesto Jim\u00e9nez-Ruiz , Ian Horrocks , and Charles Sutton . Learning semantic annotations for tabular data. arXiv preprint:1906.00781 , 2019 . Jiaoyan Chen, Ernesto Jim\u00e9nez-Ruiz, Ian Horrocks, and Charles Sutton. Learning semantic annotations for tabular data. arXiv preprint:1906.00781, 2019."},{"key":"e_1_3_2_2_6_1","volume-title":"Tabfact: A large-scale dataset for table-based fact verification. arXiv preprint:1909.02164","author":"Chen Wenhu","year":"2019","unstructured":"Wenhu Chen , Hongmin Wang , Jianshu Chen , Yunkai Zhang , Hong Wang , Shiyang Li , Xiyou Zhou , and William Yang Wang . Tabfact: A large-scale dataset for table-based fact verification. arXiv preprint:1909.02164 , 2019 . Wenhu Chen, Hongmin Wang, Jianshu Chen, Yunkai Zhang, Hong Wang, Shiyang Li, Xiyou Zhou, and William Yang Wang. Tabfact: A large-scale dataset for table-based fact verification. arXiv preprint:1909.02164, 2019."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1935826.1935904"},{"key":"e_1_3_2_2_8_1","volume-title":"Turl: Table understanding through representation learning. arXiv preprint:2006.14806","author":"Deng Xiang","year":"2020","unstructured":"Xiang Deng , Huan Sun , Alyssa Lees , You Wu , and Cong Yu . Turl: Table understanding through representation learning. arXiv preprint:2006.14806 , 2020 . Xiang Deng, Huan Sun, Alyssa Lees, You Wu, and Cong Yu. Turl: Table understanding through representation learning. arXiv preprint:2006.14806, 2020."},{"key":"e_1_3_2_2_9_1","volume-title":"Bert: Pretraining of deep bidirectional transformers for language understanding. arXiv preprint:1810.04805","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . Bert: Pretraining of deep bidirectional transformers for language understanding. arXiv preprint:1810.04805 , 2018 . Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pretraining of deep bidirectional transformers for language understanding. arXiv preprint:1810.04805, 2018."},{"key":"e_1_3_2_2_10_1","volume-title":"Workshop on Document Intelligence at NeurIPS 2019","author":"Dong Haoyu","year":"2019","unstructured":"Haoyu Dong , Shijie Liu , Zhouyu Fu , Shi Han , and Dongmei Zhang . Semantic structure extraction for spreadsheet tables with a multi-task learning architecture . In Workshop on Document Intelligence at NeurIPS 2019 , 2019 . Haoyu Dong, Shijie Liu, Zhouyu Fu, Shi Han, and Dongmei Zhang. Semantic structure extraction for spreadsheet tables with a multi-task learning architecture. In Workshop on Document Intelligence at NeurIPS 2019, 2019."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.330169"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3411943"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3238147.3238222"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/BDC.2015.30"},{"key":"e_1_3_2_2_15_1","volume-title":"Twenty-Sixth AAAI Conference on Artificial Intelligence","author":"Fang Jing","year":"2012","unstructured":"Jing Fang , Prasenjit Mitra , Zhi Tang , and C Lee Giles . Table header detection and classification . In Twenty-Sixth AAAI Conference on Artificial Intelligence , 2012 . Jing Fang, Prasenjit Mitra, Zhi Tang, and C Lee Giles. Table header detection and classification. In Twenty-Sixth AAAI Conference on Artificial Intelligence, 2012."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313629"},{"key":"e_1_3_2_2_17_1","volume-title":"Tabvec: Table vectors for classification of web tables. arXiv preprint:1802.06290","author":"Ghasemi-Gol Majid","year":"2018","unstructured":"Majid Ghasemi-Gol and Pedro Szekely . Tabvec: Table vectors for classification of web tables. arXiv preprint:1802.06290 , 2018 . Majid Ghasemi-Gol and Pedro Szekely. Tabvec: Table vectors for classification of web tables. arXiv preprint:1802.06290, 2018."},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1109\/ICDM.2019.00033","volume-title":"2019 IEEE International Conference on Data Mining (ICDM)","author":"Gol Majid Ghasemi","year":"2019","unstructured":"Majid Ghasemi Gol , Jay Pujara , and Pedro Szekely . Tabular cell classification using pre-trained cell embeddings . In 2019 IEEE International Conference on Data Mining (ICDM) , pages 230 -- 239 . IEEE, 2019 . Majid Ghasemi Gol, Jay Pujara, and Pedro Szekely. Tabular cell classification using pre-trained cell embeddings. In 2019 IEEE International Conference on Data Mining (ICDM), pages 230--239. IEEE, 2019."},{"key":"e_1_3_2_2_19_1","volume-title":"EDBT\/ICDT Workshops","author":"Gonsior Julius","year":"2020","unstructured":"Julius Gonsior , Josephine Rehak , Maik Thiele , Elvis Koci , Michael G\u00fcnther , and Wolfgang Lehner . Active learning for spreadsheet cell classification . In EDBT\/ICDT Workshops , 2020 . Julius Gonsior, Josephine Rehak, Maik Thiele, Elvis Koci, Michael G\u00fcnther, and Wolfgang Lehner. Active learning for spreadsheet cell classification. In EDBT\/ICDT Workshops, 2020."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-60029-7_37"},{"key":"e_1_3_2_2_21_1","volume-title":"Thomas M\u00fcller, Francesco Piccinno, and Julian Martin Eisenschlos. Tapas: Weakly supervised table parsing via pretraining. arXiv preprint:2004.02349","author":"Herzig Jonathan","year":"2020","unstructured":"Jonathan Herzig , Pawe\u0140 Krzysztof Nowak , Thomas M\u00fcller, Francesco Piccinno, and Julian Martin Eisenschlos. Tapas: Weakly supervised table parsing via pretraining. arXiv preprint:2004.02349 , 2020 . Jonathan Herzig, Pawe\u0140 Krzysztof Nowak, Thomas M\u00fcller, Francesco Piccinno, and Julian Martin Eisenschlos. Tapas: Weakly supervised table parsing via pretraining. arXiv preprint:2004.02349, 2020."},{"key":"e_1_3_2_2_22_1","volume-title":"Axcell: Automatic extraction of results from machine learning papers. arXiv preprint:2004.14356","author":"Kardas Marcin","year":"2020","unstructured":"Marcin Kardas , Piotr Czapla , Pontus Stenetorp , Sebastian Ruder , Sebastian Riedel , Ross Taylor , and Robert Stojnic . Axcell: Automatic extraction of results from machine learning papers. arXiv preprint:2004.14356 , 2020 . Marcin Kardas, Piotr Czapla, Pontus Stenetorp, Sebastian Ruder, Sebastian Riedel, Ross Taylor, and Robert Stojnic. Axcell: Automatic extraction of results from machine learning papers. arXiv preprint:2004.14356, 2020."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/DAS.2018.48"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2019.00207"},{"key":"e_1_3_2_2_25_1","volume-title":"Cross-lingual language model pretraining. arXiv preprint:1901.07291","author":"Lample Guillaume","year":"2019","unstructured":"Guillaume Lample and Alexis Conneau . Cross-lingual language model pretraining. arXiv preprint:1901.07291 , 2019 . Guillaume Lample and Alexis Conneau. Cross-lingual language model pretraining. arXiv preprint:1901.07291, 2019."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2536669.2536674"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2872518.2889386"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/319950.320052"},{"key":"e_1_3_2_2_29_1","volume-title":"Steven CH Hoi, and Richard Socher. Tree-structured attention with hierarchical accumulation. arXiv preprint:2002.08046","author":"Nguyen Xuan-Phi","year":"2020","unstructured":"Xuan-Phi Nguyen , Shafiq Joty , Steven CH Hoi, and Richard Socher. Tree-structured attention with hierarchical accumulation. arXiv preprint:2002.08046 , 2020 . Xuan-Phi Nguyen, Shafiq Joty, Steven CH Hoi, and Richard Socher. Tree-structured attention with hierarchical accumulation. arXiv preprint:2002.08046, 2020."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/3298239.3298265"},{"key":"e_1_3_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-59506-7_13"},{"key":"e_1_3_2_2_32_1","volume-title":"Compositional semantic parsing on semi-structured tables. arXiv preprint:1508.00305","author":"Pasupat Panupong","year":"2015","unstructured":"Panupong Pasupat and Percy Liang . Compositional semantic parsing on semi-structured tables. arXiv preprint:1508.00305 , 2015 . Panupong Pasupat and Percy Liang. Compositional semantic parsing on semi-structured tables. arXiv preprint:1508.00305, 2015."},{"key":"e_1_3_2_2_33_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Harsha Rayudu Jay Pujara Kexuan Sun","year":"2021","unstructured":"Kexuan Sun Harsha Rayudu Jay Pujara . A hybrid probabilistic approach for table understanding . Proceedings of the AAAI Conference on Artificial Intelligence , 2021 . Kexuan Sun Harsha Rayudu Jay Pujara. A hybrid probabilistic approach for table understanding. Proceedings of the AAAI Conference on Artificial Intelligence, 2021."},{"key":"e_1_3_2_2_34_1","volume-title":"Improving language understanding by generative pre-training","author":"Radford Alec","year":"2018","unstructured":"Alec Radford , Karthik Narasimhan , Tim Salimans , and Ilya Sutskever . Improving language understanding by generative pre-training , 2018 . Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. Improving language understanding by generative pre-training, 2018."},{"key":"e_1_3_2_2_35_1","volume-title":"Matching web tables to dbpedia-a feature utility study. context, 42(41):19--31","author":"Ritze Dominique","year":"2017","unstructured":"Dominique Ritze and Christian Bizer . Matching web tables to dbpedia-a feature utility study. context, 42(41):19--31 , 2017 . Dominique Ritze and Christian Bizer. Matching web tables to dbpedia-a feature utility study. context, 42(41):19--31, 2017."},{"key":"e_1_3_2_2_36_1","volume-title":"Advances in Neural Information Processing Systems","author":"Shiv Vighnesh","year":"2019","unstructured":"Vighnesh Shiv and Chris Quirk . Novel positional encodings to enable tree-based transformers . In Advances in Neural Information Processing Systems , 2019 . Vighnesh Shiv and Chris Quirk. Novel positional encodings to enable tree-based transformers. In Advances in Neural Information Processing Systems, 2019."},{"key":"e_1_3_2_2_37_1","first-page":"5998","volume-title":"Advances in neural information processing systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani , Noam Shazeer , Niki Parmar , Jakob Uszkoreit , Llion Jones , Aidan N Gomez , \u0141ukasz Kaiser , and Illia Polosukhin . Attention is all you need . In Advances in neural information processing systems , pages 5998 -- 6008 , 2017 . Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Advances in neural information processing systems, pages 5998--6008, 2017."},{"key":"e_1_3_2_2_38_1","volume-title":"Graph attention networks. arXiv preprint:1710.10903","author":"Veli\u010dkovi\u0107 Petar","year":"2017","unstructured":"Petar Veli\u010dkovi\u0107 , Guillem Cucurull , Arantxa Casanova , Adriana Romero , Pietro Lio , and Yoshua Bengio . Graph attention networks. arXiv preprint:1710.10903 , 2017 . Petar Veli\u010dkovi\u0107, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. Graph attention networks. arXiv preprint:1710.10903, 2017."},{"key":"e_1_3_2_2_39_1","volume-title":"Tree transformer: Integrating tree structures into self-attention. arXiv preprint:1909.06639","author":"Wang Yau-Shian","year":"2019","unstructured":"Yau-Shian Wang , Hung-Yi Lee , and Yun-Nung Chen . Tree transformer: Integrating tree structures into self-attention. arXiv preprint:1909.06639 , 2019 . Yau-Shian Wang, Hung-Yi Lee, and Yun-Nung Chen. Tree transformer: Integrating tree structures into self-attention. arXiv preprint:1909.06639, 2019."},{"key":"e_1_3_2_2_40_1","volume-title":"Tabular abstraction, editing, and formatting","author":"Wang Xinxin","year":"2016","unstructured":"Xinxin Wang . Tabular abstraction, editing, and formatting . 2016 . Xinxin Wang. Tabular abstraction, editing, and formatting. 2016."},{"key":"e_1_3_2_2_41_1","volume-title":"Tabert: Pretraining for joint understanding of textual and tabular data. arxiv","author":"Yin Pengcheng","year":"2020","unstructured":"Pengcheng Yin , Graham Neubig , Wen-tau Yih, and Sebastian Riedel . Tabert: Pretraining for joint understanding of textual and tabular data. arxiv , 2020 . Pengcheng Yin, Graham Neubig, Wen-tau Yih, and Sebastian Riedel. Tabert: Pretraining for joint understanding of textual and tabular data. arxiv, 2020."},{"key":"e_1_3_2_2_42_1","volume-title":"et al. Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task. arXiv preprint:1809.08887","author":"Yu Tao","year":"2018","unstructured":"Tao Yu , Rui Zhang , Kai Yang , Michihiro Yasunaga , Dongxu Wang , Zifan Li , James Ma , Irene Li , et al. Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task. arXiv preprint:1809.08887 , 2018 . Tao Yu, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Li, et al. Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task. arXiv preprint:1809.08887, 2018."},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10032-004-0120-9"},{"key":"e_1_3_2_2_44_1","volume-title":"Representations for question answering from documents with tables and text. ArXiv:2101.10573","author":"Zayats Vicky","year":"2021","unstructured":"Vicky Zayats , Kristina Toutanova , and Mari Ostendorf . Representations for question answering from documents with tables and text. ArXiv:2101.10573 , 2021 . Vicky Zayats, Kristina Toutanova, and Mari Ostendorf. Representations for question answering from documents with tables and text. ArXiv:2101.10573, 2021."},{"key":"e_1_3_2_2_45_1","volume-title":"Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Zhang Li","year":"2019","unstructured":"Li Zhang , Shuo Zhang , and Krisztian Balog . Table2vec : Neural word and entity embeddings for table population and retrieval . In Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval , 2019 . Li Zhang, Shuo Zhang, and Krisztian Balog. Table2vec: Neural word and entity embeddings for table population and retrieval. In Proceedings of International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019."},{"key":"e_1_3_2_2_46_1","volume-title":"A graph representation of semi-structured data for web question answering. arXiv preprint:2010.06801","author":"Zhang Xingyao","year":"2020","unstructured":"Xingyao Zhang , Linjun Shou , Jian Pei , Ming Gong , Lijie Wen , and Daxin Jiang . A graph representation of semi-structured data for web question answering. arXiv preprint:2010.06801 , 2020 . Xingyao Zhang, Linjun Shou, Jian Pei, Ming Gong, Lijie Wen, and Daxin Jiang. A graph representation of semi-structured data for web question answering. arXiv preprint:2010.06801, 2020."},{"key":"e_1_3_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313578"},{"key":"e_1_3_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i01.5366"}],"event":{"name":"KDD '21: The 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Virtual Event Singapore","acronym":"KDD '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467434","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447548.3467434","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:37Z","timestamp":1750191517000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447548.3467434"}},"subtitle":["Tree-based Transformers for Generally Structured Table Pre-training"],"short-title":[],"issued":{"date-parts":[[2021,8,14]]},"references-count":48,"alternative-id":["10.1145\/3447548.3467434","10.1145\/3447548"],"URL":"https:\/\/doi.org\/10.1145\/3447548.3467434","relation":{},"subject":[],"published":{"date-parts":[[2021,8,14]]},"assertion":[{"value":"2021-08-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}