{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T04:45:10Z","timestamp":1784263510601,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":53,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T00:00:00Z","timestamp":1665360000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSFC","award":["U1811461"],"award-info":[{"award-number":["U1811461"]}]},{"name":"Program for Guangdong Introducing Innovative and Entrepreneurial Teams","award":["2016ZT06D211"],"award-info":[{"award-number":["2016ZT06D211"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,10,10]]},"DOI":"10.1145\/3503161.3548112","type":"proceedings-article","created":{"date-parts":[[2022,10,10]],"date-time":"2022-10-10T15:43:12Z","timestamp":1665416592000},"page":"4083-4091","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":478,"title":["LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking"],"prefix":"10.1145","author":[{"given":"Yupan","family":"Huang","sequence":"first","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tengchao","family":"Lv","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Cui","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yutong","family":"Lu","sequence":"additional","affiliation":[{"name":"Sun Yat-sen University, Guangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Furu","family":"Wei","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,10,10]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Xcit: Cross-covariance image transformers. In NeurIPS.","author":"Ali Alaaeldin","year":"2021","unstructured":"Alaaeldin Ali , Hugo Touvron , Mathilde Caron , Piotr Bojanowski , Matthijs Douze , Armand Joulin , Ivan Laptev , Natalia Neverova , Gabriel Synnaeve , Jakob Verbeek , 2021 . Xcit: Cross-covariance image transformers. In NeurIPS. Alaaeldin Ali, Hugo Touvron, Mathilde Caron, Piotr Bojanowski, Matthijs Douze, Armand Joulin, Ivan Laptev, Natalia Neverova, Gabriel Synnaeve, Jakob Verbeek, et al. 2021. Xcit: Cross-covariance image transformers. In NeurIPS."},{"key":"e_1_3_2_2_2_1","volume-title":"Yusheng Xie, and R. Manmatha.","author":"Appalaraju Srikar","year":"2021","unstructured":"Srikar Appalaraju , Bhavan Jasani , Bhargava Urala Kota , Yusheng Xie, and R. Manmatha. 2021 . DocFormer: End-to- End Transformer for Document Understanding. In ICCV. Srikar Appalaraju, Bhavan Jasani, Bhargava Urala Kota, Yusheng Xie, and R. Manmatha. 2021. DocFormer: End-to-End Transformer for Document Understanding. In ICCV."},{"key":"e_1_3_2_2_3_1","unstructured":"Hangbo Bao Li Dong Songhao Piao and Furu Wei. 2022. BEiT: BERT Pre-Training of Image Transformers. In ICLR.  Hangbo Bao Li Dong Songhao Piao and Furu Wei. 2022. BEiT: BERT Pre-Training of Image Transformers. In ICLR."},{"key":"e_1_3_2_2_4_1","unstructured":"Zhaowei Cai and Nuno Vasconcelos. 2018. Cascade r-cnn: Delving into high quality object detection. In CVPR.  Zhaowei Cai and Nuno Vasconcelos. 2018. Cascade r-cnn: Delving into high quality object detection. In CVPR."},{"key":"e_1_3_2_2_5_1","volume-title":"Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu.","author":"Chen Yen-Chun","year":"2020","unstructured":"Yen-Chun Chen , Linjie Li , Licheng Yu , Ahmed El Kholy , Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu. 2020 . Uniter : Universal image-text representation learning. In ECCV. Yen-Chun Chen, Linjie Li, Licheng Yu, Ahmed El Kholy, Faisal Ahmed, Zhe Gan, Yu Cheng, and Jingjing Liu. 2020. Uniter: Universal image-text representation learning. In ECCV."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Jaemin Cho Jiasen Lu Dustin Schwenk Hannaneh Hajishirzi and Aniruddha Kembhavi. 2020. X-LXMERT: Paint Caption and Answer Questions with Multi-Modal Transformers. In EMNLP.  Jaemin Cho Jiasen Lu Dustin Schwenk Hannaneh Hajishirzi and Aniruddha Kembhavi. 2020. X-LXMERT: Paint Caption and Answer Questions with Multi-Modal Transformers. In EMNLP.","DOI":"10.18653\/v1\/2020.emnlp-main.707"},{"key":"e_1_3_2_2_7_1","volume-title":"Document AI: Benchmarks, Models and Applications. arXiv preprint arXiv:2111.08609","author":"Cui Lei","year":"2021","unstructured":"Lei Cui , Yiheng Xu , Tengchao Lv , and FuruWei. 2021 . Document AI: Benchmarks, Models and Applications. arXiv preprint arXiv:2111.08609 (2021). Lei Cui, Yiheng Xu, Tengchao Lv, and FuruWei. 2021. Document AI: Benchmarks, Models and Applications. arXiv preprint arXiv:2111.08609 (2021)."},{"key":"e_1_3_2_2_8_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL.","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL."},{"key":"e_1_3_2_2_9_1","volume-title":"Cogview: Mastering text-to-image generation via transformers. In NeurIPS.","author":"Ding Ming","year":"2021","unstructured":"Ming Ding , Zhuoyi Yang , Wenyi Hong , Wendi Zheng , Chang Zhou , Da Yin , Junyang Lin , Xu Zou , Zhou Shao , Hongxia Yang , 2021 . Cogview: Mastering text-to-image generation via transformers. In NeurIPS. Ming Ding, Zhuoyi Yang, Wenyi Hong, Wendi Zheng, Chang Zhou, Da Yin, Junyang Lin, Xu Zou, Zhou Shao, Hongxia Yang, et al. 2021. Cogview: Mastering text-to-image generation via transformers. In NeurIPS."},{"key":"e_1_3_2_2_10_1","unstructured":"Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly Jakob Uszkoreit and Neil Houlsby. 2021. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In ICLR.  Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly Jakob Uszkoreit and Neil Houlsby. 2021. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In ICLR."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"crossref","unstructured":"Zi-Yi Dou Yichong Xu Zhe Gan Jianfeng Wang Shuohang Wang Lijuan Wang Chenguang Zhu Zicheng Liu Michael Zeng etal 2021. An Empirical Study of Training End-to-End Vision-and-Language Transformers. arXiv preprint arXiv:2111.02387 (2021).  Zi-Yi Dou Yichong Xu Zhe Gan Jianfeng Wang Shuohang Wang Lijuan Wang Chenguang Zhu Zicheng Liu Michael Zeng et al. 2021. An Empirical Study of Training End-to-End Vision-and-Language Transformers. arXiv preprint arXiv:2111.02387 (2021).","DOI":"10.1109\/CVPR52688.2022.01763"},{"key":"e_1_3_2_2_12_1","volume-title":"LAMBERT: Layout-Aware Language Modeling for Information Extraction. In ICDAR.","author":"Garncarek Lukasz","year":"2021","unstructured":"Lukasz Garncarek , Rafal Powalski , Tomasz Stanislawek , Bartosz Topolski , Piotr Halama , Michal Turski , and Filip Grali'ski . 2021 . LAMBERT: Layout-Aware Language Modeling for Information Extraction. In ICDAR. Lukasz Garncarek, Rafal Powalski, Tomasz Stanislawek, Bartosz Topolski, Piotr Halama, Michal Turski, and Filip Grali'ski. 2021. LAMBERT: Layout-Aware Language Modeling for Information Extraction. In ICDAR."},{"key":"e_1_3_2_2_13_1","unstructured":"Jiuxiang Gu Jason Kuen Vlad Morariu Handong Zhao Rajiv Jain Nikolaos Barmpalios Ani Nenkova and Tong Sun. 2021. UniDoc: Unified Pretraining Framework for Document Understanding. In NeurIPS.  Jiuxiang Gu Jason Kuen Vlad Morariu Handong Zhao Rajiv Jain Nikolaos Barmpalios Ani Nenkova and Tong Sun. 2021. UniDoc: Unified Pretraining Framework for Document Understanding. In NeurIPS."},{"key":"e_1_3_2_2_14_1","unstructured":"Zhangxuan Gu Changhua Meng Ke Wang Jun Lan Weiqiang Wang Ming Gu and Liqing Zhang. 2022. XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understanding. In CVPR.  Zhangxuan Gu Changhua Meng Ke Wang Jun Lan Weiqiang Wang Ming Gu and Liqing Zhang. 2022. XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understanding. In CVPR."},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"crossref","unstructured":"Adam W Harley Alex Ufkes and Konstantinos G Derpanis. 2015. Evaluation of Deep Convolutional Nets for Document Image Classification and Retrieval. In ICDAR.  Adam W Harley Alex Ufkes and Konstantinos G Derpanis. 2015. Evaluation of Deep Convolutional Nets for Document Image Classification and Retrieval. In ICDAR.","DOI":"10.1109\/ICDAR.2015.7333910"},{"key":"e_1_3_2_2_16_1","volume-title":"BROS: A Pre-Trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents. In AAAI.","author":"Hong Teakgyu","year":"2022","unstructured":"Teakgyu Hong , DongHyun Kim , Mingi Ji , Wonseok Hwang , Daehyun Nam , and Sungrae Park . 2022 . BROS: A Pre-Trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents. In AAAI. Teakgyu Hong, DongHyun Kim, Mingi Ji, Wonseok Hwang, Daehyun Nam, and Sungrae Park. 2022. BROS: A Pre-Trained Language Model Focusing on Text and Layout for Better Key Information Extraction from Documents. In AAAI."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"crossref","unstructured":"Yupan Huang Hongwei Xue Bei Liu and Yutong Lu. 2021. Unifying multimodal transformer for bi-directional image and text generation. In ACM Multimedia.  Yupan Huang Hongwei Xue Bei Liu and Yutong Lu. 2021. Unifying multimodal transformer for bi-directional image and text generation. In ACM Multimedia.","DOI":"10.1145\/3474085.3481540"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"crossref","unstructured":"Zhicheng Huang Zhaoyang Zeng Yupan Huang Bei Liu Dongmei Fu and Jianlong Fu. 2021. Seeing out of the box: End-to-end pre-training for vision language representation learning. In CVPR.  Zhicheng Huang Zhaoyang Zeng Yupan Huang Bei Liu Dongmei Fu and Jianlong Fu. 2021. Seeing out of the box: End-to-end pre-training for vision language representation learning. In CVPR.","DOI":"10.1109\/CVPR46437.2021.01278"},{"key":"e_1_3_2_2_19_1","volume-title":"Hazim Kemal Ekenel, and Jean-Philippe Thiran","author":"Jaume Guillaume","year":"2019","unstructured":"Guillaume Jaume , Hazim Kemal Ekenel, and Jean-Philippe Thiran . 2019 . Funsd : A dataset for form understanding in noisy scanned documents. In ICDARW. Guillaume Jaume, Hazim Kemal Ekenel, and Jean-Philippe Thiran. 2019. Funsd: A dataset for form understanding in noisy scanned documents. In ICDARW."},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00300"},{"key":"e_1_3_2_2_21_1","volume-title":"Vilt: Vision-and-language transformer without convolution or region supervision. In ICML.","author":"Kim Wonjae","year":"2021","unstructured":"Wonjae Kim , Bokyung Son , and Ildoo Kim . 2021 . Vilt: Vision-and-language transformer without convolution or region supervision. In ICML. Wonjae Kim, Bokyung Son, and Ildoo Kim. 2021. Vilt: Vision-and-language transformer without convolution or region supervision. In ICML."},{"key":"e_1_3_2_2_22_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_2_2_23_1","unstructured":"Chen-Yu Lee Chun-Liang Li Timothy Dozat Vincent Perot Guolong Su Nan Hua Joshua Ainslie Renshen Wang Yasuhisa Fujii and Tomas Pfister. 2022. FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extraction. In ACL.  Chen-Yu Lee Chun-Liang Li Timothy Dozat Vincent Perot Guolong Su Nan Hua Joshua Ainslie Renshen Wang Yasuhisa Fujii and Tomas Pfister. 2022. FormNet: Structural Encoding beyond Sequential Modeling in Form Document Information Extraction. In ACL."},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"crossref","unstructured":"D. Lewis G. Agam S. Argamon O. Frieder D. Grossman and J. Heard. 2006. Building a Test Collection for Complex Document Information Processing. In SIGIR.  D. Lewis G. Agam S. Argamon O. Frieder D. Grossman and J. Heard. 2006. Building a Test Collection for Complex Document Information Processing. In SIGIR.","DOI":"10.1145\/1148170.1148307"},{"key":"e_1_3_2_2_25_1","volume-title":"BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In ACL.","author":"Lewis Mike","year":"2020","unstructured":"Mike Lewis , Yinhan Liu , Naman Goyal , Marjan Ghazvininejad , Abdelrahman Mohamed , Omer Levy , Veselin Stoyanov , and Luke Zettlemoyer . 2020 . BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In ACL. Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In ACL."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Chenliang Li Bin Bi Ming Yan WeiWang Songfang Huang Fei Huang and Luo Si. 2021. StructuralLM: Structural Pre-training for Form Understanding. In ACL.  Chenliang Li Bin Bi Ming Yan WeiWang Songfang Huang Fei Huang and Luo Si. 2021. StructuralLM: Structural Pre-training for Form Understanding. In ACL.","DOI":"10.18653\/v1\/2021.acl-long.493"},{"key":"e_1_3_2_2_27_1","unstructured":"Junnan Li Ramprasaath Selvaraju Akhilesh Gotmare Shafiq Joty Caiming Xiong and Steven Chu Hong Hoi. 2021. Align before fuse: Vision and language representation learning with momentum distillation. In NeurIPS.  Junnan Li Ramprasaath Selvaraju Akhilesh Gotmare Shafiq Joty Caiming Xiong and Steven Chu Hong Hoi. 2021. Align before fuse: Vision and language representation learning with momentum distillation. In NeurIPS."},{"key":"e_1_3_2_2_28_1","volume-title":"DiT: Self-supervised Pre-training for Document Image Transformer. arXiv preprint arXiv:2203.02378","author":"Li Junlong","year":"2022","unstructured":"Junlong Li , Yiheng Xu , Tengchao Lv , Lei Cui , Cha Zhang , and FuruWei. 2022. DiT: Self-supervised Pre-training for Document Image Transformer. arXiv preprint arXiv:2203.02378 ( 2022 ). Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, and FuruWei. 2022. DiT: Self-supervised Pre-training for Document Image Transformer. arXiv preprint arXiv:2203.02378 (2022)."},{"key":"e_1_3_2_2_29_1","unstructured":"Peizhao Li Jiuxiang Gu Jason Kuen Vlad I Morariu Handong Zhao Rajiv Jain Varun Manjunatha and Hongfu Liu. 2021. SelfDoc: Self-Supervised Document Representation Learning. In CVPR.  Peizhao Li Jiuxiang Gu Jason Kuen Vlad I Morariu Handong Zhao Rajiv Jain Varun Manjunatha and Hongfu Liu. 2021. SelfDoc: Self-Supervised Document Representation Learning. In CVPR."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"crossref","unstructured":"Yulin Li Yuxi Qian Yuechen Yu Xiameng Qin Chengquan Zhang Yan Liu Kun Yao Junyu Han Jingtuo Liu and Errui Ding. 2021. StrucTexT: Structured Text Understanding with Multi-Modal Transformers. In ACM Multimedia.  Yulin Li Yuxi Qian Yuechen Yu Xiameng Qin Chengquan Zhang Yan Liu Kun Yao Junyu Han Jingtuo Liu and Errui Ding. 2021. StrucTexT: Structured Text Understanding with Multi-Modal Transformers. In ACM Multimedia.","DOI":"10.1145\/3474085.3475345"},{"key":"e_1_3_2_2_31_1","volume-title":"Kaiming He, and Ross Girshick.","author":"Li Yanghao","year":"2021","unstructured":"Yanghao Li , Saining Xie , Xinlei Chen , Piotr Dollar , Kaiming He, and Ross Girshick. 2021 . Benchmarking de tection transfer learning with vision transformers. arXiv preprint arXiv:2111.11429 (2021). Yanghao Li, Saining Xie, Xinlei Chen, Piotr Dollar, Kaiming He, and Ross Girshick. 2021. Benchmarking detection transfer learning with vision transformers. arXiv preprint arXiv:2111.11429 (2021)."},{"key":"e_1_3_2_2_32_1","unstructured":"Tsung-Yi Lin Piotr Doll\u00e1r Ross Girshick Kaiming He Bharath Hariharan and Serge Belongie. 2017. Feature pyramid networks for object detection. In CVPR.  Tsung-Yi Lin Piotr Doll\u00e1r Ross Girshick Kaiming He Bharath Hariharan and Serge Belongie. 2017. Feature pyramid networks for object detection. In CVPR."},{"key":"e_1_3_2_2_33_1","volume-title":"Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu , Myle Ott , Naman Goyal , Jingfei Du , Mandar Joshi , Danqi Chen , Omer Levy , Mike Lewis , Luke Zettlemoyer , and Veselin Stoyanov . 2019 . Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019). Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692 (2019)."},{"key":"e_1_3_2_2_34_1","volume-title":"Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. In NeurIPS.","author":"Lu Jiasen","year":"2019","unstructured":"Jiasen Lu , Dhruv Batra , Devi Parikh , and Stefan Lee . 2019 . Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. In NeurIPS. Jiasen Lu, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019. Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks. In NeurIPS."},{"key":"e_1_3_2_2_35_1","volume-title":"Docvqa: A dataset for vqa on document images. In WACV.","author":"Mathew Minesh","year":"2021","unstructured":"Minesh Mathew , Dimosthenis Karatzas , and CV Jawahar . 2021 . Docvqa: A dataset for vqa on document images. In WACV. Minesh Mathew, Dimosthenis Karatzas, and CV Jawahar. 2021. Docvqa: A dataset for vqa on document images. In WACV."},{"key":"e_1_3_2_2_36_1","volume-title":"CORD: A Consolidated Receipt Dataset for Post-OCR Parsing. In Document Intelligence Workshop at Neural Information Processing Systems.","author":"Park Seunghyun","year":"2019","unstructured":"Seunghyun Park , Seung Shin , Bado Lee , Junyeop Lee , Jaeheung Surh , Minjoon Seo , and Hwalsuk Lee . 2019 . CORD: A Consolidated Receipt Dataset for Post-OCR Parsing. In Document Intelligence Workshop at Neural Information Processing Systems. Seunghyun Park, Seung Shin, Bado Lee, Junyeop Lee, Jaeheung Surh, Minjoon Seo, and Hwalsuk Lee. 2019. CORD: A Consolidated Receipt Dataset for Post-OCR Parsing. In Document Intelligence Workshop at Neural Information Processing Systems."},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"crossref","unstructured":"Rafal Powalski Lukasz Borchmann Dawid Jurkiewicz Tomasz Dwojak Michal Pietruszka and Gabriela Palka. 2021. Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformer. In ICDAR.  Rafal Powalski Lukasz Borchmann Dawid Jurkiewicz Tomasz Dwojak Michal Pietruszka and Gabriela Palka. 2021. Going Full-TILT Boogie on Document Understanding with Text-Image-Layout Transformer. In ICDAR.","DOI":"10.1007\/978-3-030-86331-9_47"},{"key":"e_1_3_2_2_38_1","volume-title":"Towards a multi-modal, multi-task learning based pre-training framework for document representation learning. arXiv preprint arXiv:2009.14457","author":"Pramanik Subhojeet","year":"2020","unstructured":"Subhojeet Pramanik , Shashank Mujumdar , and Hima Patel . 2020. Towards a multi-modal, multi-task learning based pre-training framework for document representation learning. arXiv preprint arXiv:2009.14457 ( 2020 ). Subhojeet Pramanik, Shashank Mujumdar, and Hima Patel. 2020. Towards a multi-modal, multi-task learning based pre-training framework for document representation learning. arXiv preprint arXiv:2009.14457 (2020)."},{"key":"e_1_3_2_2_39_1","unstructured":"Aditya Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen and Ilya Sutskever. 2021. Zero-shot text-to-image generation. In ICML.  Aditya Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen and Ilya Sutskever. 2021. Zero-shot text-to-image generation. In ICML."},{"key":"e_1_3_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"e_1_3_2_2_41_1","volume-title":"Kingma","author":"Salimans Tim","year":"2017","unstructured":"Tim Salimans , Andrej Karpathy , Xi Chen , and Diederik P . Kingma . 2017 . Pixel-CNN: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications. In ICLR. Tim Salimans, Andrej Karpathy, Xi Chen, and Diederik P. Kingma. 2017. Pixel-CNN: Improving the PixelCNN with Discretized Logistic Mixture Likelihood and Other Modifications. In ICLR."},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"crossref","unstructured":"Rico Sennrich Barry Haddow and Alexandra Birch. 2016. Neural Machine Translation of Rare Words with Subword Units. In ACL.  Rico Sennrich Barry Haddow and Alexandra Birch. 2016. Neural Machine Translation of Rare Words with Subword Units. In ACL.","DOI":"10.18653\/v1\/P16-1162"},{"key":"e_1_3_2_2_43_1","unstructured":"Weijie Su Xizhou Zhu Yue Cao Bin Li Lewei Lu Furu Wei and Jifeng Dai. 2019. VL-BERT: Pre-training of Generic Visual-Linguistic Representations. In ICLR.  Weijie Su Xizhou Zhu Yue Cao Bin Li Lewei Lu Furu Wei and Jifeng Dai. 2019. VL-BERT: Pre-training of Generic Visual-Linguistic Representations. In ICLR."},{"key":"e_1_3_2_2_44_1","volume-title":"LXMERT: Learning Cross-Modality Encoder Representations from Transformers. In EMNLP.","author":"Tan Hao","year":"2019","unstructured":"Hao Tan and Mohit Bansal . 2019 . LXMERT: Learning Cross-Modality Encoder Representations from Transformers. In EMNLP. Hao Tan and Mohit Bansal. 2019. LXMERT: Learning Cross-Modality Encoder Representations from Transformers. In EMNLP."},{"key":"e_1_3_2_2_45_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In NeurIPS.  Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In NeurIPS."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Jiapeng Wang Lianwen Jin and Kai Ding. 2022. LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding. In ACL.  Jiapeng Wang Lianwen Jin and Kai Ding. 2022. LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding. In ACL.","DOI":"10.18653\/v1\/2022.acl-long.534"},{"key":"e_1_3_2_2_47_1","volume-title":"Spurthi Amba Hombaiah, and Michael Bendersky","author":"Li Cheng","year":"2021","unstructured":"Te-LinWu, Cheng Li , Mingyang Zhang , Tao Chen , Spurthi Amba Hombaiah, and Michael Bendersky . 2021 . LAMPRET : Layout-Aware Multimodal PreTraining for Document Understanding . arXiv preprint arXiv:2104.08405 (2021). Te-LinWu, Cheng Li, Mingyang Zhang, Tao Chen, Spurthi Amba Hombaiah, and Michael Bendersky. 2021. LAMPRET: Layout-Aware Multimodal PreTraining for Document Understanding. arXiv preprint arXiv:2104.08405 (2021)."},{"key":"e_1_3_2_2_48_1","unstructured":"Yuxin Wu Alexander Kirillov Francisco Massa Wan-Yen Lo and Ross Girshick. 2019. Detectron2. https:\/\/github.com\/facebookresearch\/detectron2.  Yuxin Wu Alexander Kirillov Francisco Massa Wan-Yen Lo and Ross Girshick. 2019. Detectron2. https:\/\/github.com\/facebookresearch\/detectron2."},{"key":"e_1_3_2_2_49_1","volume-title":"Layoutlm: Pre-training of text and layout for document image understanding. In KDD.","author":"Xu Yiheng","year":"2020","unstructured":"Yiheng Xu , Minghao Li , Lei Cui , Shaohan Huang , FuruWei, and Ming Zhou . 2020 . Layoutlm: Pre-training of text and layout for document image understanding. In KDD. Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, FuruWei, and Ming Zhou. 2020. Layoutlm: Pre-training of text and layout for document image understanding. In KDD."},{"key":"e_1_3_2_2_50_1","volume-title":"LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding. arXiv preprint arXiv:2104.08836","author":"Xu Yiheng","year":"2021","unstructured":"Yiheng Xu , Tengchao Lv , Lei Cui , Guoxin Wang , Yijuan Lu , Dinei Florencio , Cha Zhang , and FuruWei. 2021. LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding. arXiv preprint arXiv:2104.08836 ( 2021 ). Yiheng Xu, Tengchao Lv, Lei Cui, Guoxin Wang, Yijuan Lu, Dinei Florencio, Cha Zhang, and FuruWei. 2021. LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding. arXiv preprint arXiv:2104.08836 (2021)."},{"key":"e_1_3_2_2_51_1","unstructured":"Yang Xu Yiheng Xu Tengchao Lv Lei Cui Furu Wei Guoxin Wang Yijuan Lu Dinei Florencio Cha Zhang Wanxiang Che Min Zhang and Lidong Zhou. 2021. LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding. In ACL.  Yang Xu Yiheng Xu Tengchao Lv Lei Cui Furu Wei Guoxin Wang Yijuan Lu Dinei Florencio Cha Zhang Wanxiang Che Min Zhang and Lidong Zhou. 2021. LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding. In ACL."},{"key":"e_1_3_2_2_52_1","volume-title":"Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training. In NeurIPS.","author":"Xue Hongwei","year":"2021","unstructured":"Hongwei Xue , Yupan Huang , Bei Liu , Houwen Peng , Jianlong Fu , Houqiang Li , and Jiebo Luo . 2021 . Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training. In NeurIPS. Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, and Jiebo Luo. 2021. Probing Inter-modality: Visual Parsing with Self-Attention for Vision-and-Language Pre-training. In NeurIPS."},{"key":"e_1_3_2_2_53_1","doi-asserted-by":"crossref","unstructured":"Xu Zhong Jianbin Tang and Antonio Jimeno Yepes. 2019. PubLayNet: largest dataset ever for document layout analysis. In ICDAR.  Xu Zhong Jianbin Tang and Antonio Jimeno Yepes. 2019. PubLayNet: largest dataset ever for document layout analysis. In ICDAR.","DOI":"10.1109\/ICDAR.2019.00166"}],"event":{"name":"MM '22: The 30th ACM International Conference on Multimedia","location":"Lisboa Portugal","acronym":"MM '22","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 30th ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3548112","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3503161.3548112","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:19Z","timestamp":1750186819000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3503161.3548112"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,10]]},"references-count":53,"alternative-id":["10.1145\/3503161.3548112","10.1145\/3503161"],"URL":"https:\/\/doi.org\/10.1145\/3503161.3548112","relation":{},"subject":[],"published":{"date-parts":[[2022,10,10]]},"assertion":[{"value":"2022-10-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}