{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T02:12:57Z","timestamp":1784081577990,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":29,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T00:00:00Z","timestamp":1597881600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,8,23]]},"DOI":"10.1145\/3394486.3403172","type":"proceedings-article","created":{"date-parts":[[2020,8,20]],"date-time":"2020-08-20T23:17:27Z","timestamp":1597965447000},"page":"1192-1200","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":623,"title":["LayoutLM: Pre-training of Text and Layout for Document Image Understanding"],"prefix":"10.1145","author":[{"given":"Yiheng","family":"Xu","sequence":"first","affiliation":[{"name":"Harbin Institute of Technology, Harbin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Minghao","family":"Li","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"Cui","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shaohan","family":"Huang","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Furu","family":"Wei","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Zhou","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,8,20]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2017.149"},{"key":"e_1_3_2_2_2_1","volume-title":"Document Image Classification with Intra-Domain Transfer Learning and Stacked Generalization of Deep Convolutional Neural Networks. 2018 24th International Conference on Pattern Recognition (ICPR)","author":"Das Arindam","year":"2018","unstructured":"Arindam Das , Saikat Roy , and Ujjwal Bhattacharya . 2018 . Document Image Classification with Intra-Domain Transfer Learning and Stacked Generalization of Deep Convolutional Neural Networks. 2018 24th International Conference on Pattern Recognition (ICPR) (2018), 3180--3185. Arindam Das, Saikat Roy, and Ujjwal Bhattacharya. 2018. Document Image Classification with Intra-Domain Transfer Learning and Stacked Generalization of Deep Convolutional Neural Networks. 2018 24th International Conference on Pattern Recognition (ICPR) (2018), 3180--3185."},{"key":"e_1_3_2_2_3_1","volume-title":"Modular Multimodal Architecture for Document Classification. ArXiv","author":"Dauphinee Tyler","year":"2019","unstructured":"Tyler Dauphinee , Nikunj Patel , and Mohammad Mehdi Rashidi . 2019. Modular Multimodal Architecture for Document Classification. ArXiv , Vol. abs\/ 1912 .04376 ( 2019 ). Tyler Dauphinee, Nikunj Patel, and Mohammad Mehdi Rashidi. 2019. Modular Multimodal Architecture for Document Classification. ArXiv, Vol. abs\/1912.04376 (2019)."},{"key":"e_1_3_2_2_4_1","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171--4186. https:\/\/doi.org\/10. 18653\/v1\/N19--1423 10.18653\/v1 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171--4186. https:\/\/doi.org\/10.18653\/v1\/N19--1423"},{"key":"e_1_3_2_2_5_1","volume-title":"Proceedings of 3rd International Conference on Document Analysis and Recognition","volume":"2","author":"Ha Jaekyu","year":"1995","unstructured":"Jaekyu Ha , Robert M Haralick , and Ihsin T Phillips . 1995 a. Document page decomposition by the bounding-box project . In Proceedings of 3rd International Conference on Document Analysis and Recognition , Vol. 2 . IEEE, 1119--1122. Jaekyu Ha, Robert M Haralick, and Ihsin T Phillips. 1995 a. Document page decomposition by the bounding-box project. In Proceedings of 3rd International Conference on Document Analysis and Recognition, Vol. 2. IEEE, 1119--1122."},{"key":"e_1_3_2_2_6_1","volume-title":"Proceedings of 3rd International Conference on Document Analysis and Recognition","volume":"2","author":"Ha Jaekyu","year":"1995","unstructured":"Jaekyu Ha , Robert M Haralick , and Ihsin T Phillips . 1995 b. Recursive XY cut using bounding boxes of connected components . In Proceedings of 3rd International Conference on Document Analysis and Recognition , Vol. 2 . IEEE, 952--955. Jaekyu Ha, Robert M Haralick, and Ihsin T Phillips. 1995 b. Recursive XY cut using bounding boxes of connected components. In Proceedings of 3rd International Conference on Document Analysis and Recognition, Vol. 2. IEEE, 952--955."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/DAS.2016.23"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDAR.2015.7333910"},{"key":"e_1_3_2_2_9_1","volume-title":"Piotr Doll\u00e1 r, and Ross B. Girshick","author":"He Kaiming","year":"2017","unstructured":"Kaiming He , Georgia Gkioxari , Piotr Doll\u00e1 r, and Ross B. Girshick . 2017 . Mask R-CNN. CoRR , Vol . abs\/1703.06870 (2017). arxiv: 1703.06870 http:\/\/arxiv.org\/abs\/1703.06870 Kaiming He, Georgia Gkioxari, Piotr Doll\u00e1 r, and Ross B. Girshick. 2017. Mask R-CNN. CoRR, Vol. abs\/1703.06870 (2017). arxiv: 1703.06870 http:\/\/arxiv.org\/abs\/1703.06870"},{"key":"e_1_3_2_2_10_1","volume-title":"FUNSD: A Dataset for Form Understanding in Noisy Scanned Documents. 2019 International Conference on Document Analysis and Recognition Workshops (ICDARW)","volume":"2","author":"Jaume Guillaume","year":"2019","unstructured":"Guillaume Jaume , Hazim Kemal Ekenel , and Jean-Philippe Thiran . 2019 . FUNSD: A Dataset for Form Understanding in Noisy Scanned Documents. 2019 International Conference on Document Analysis and Recognition Workshops (ICDARW) , Vol. 2 (2019), 1--6. Guillaume Jaume, Hazim Kemal Ekenel, and Jean-Philippe Thiran. 2019. FUNSD: A Dataset for Form Understanding in Noisy Scanned Documents. 2019 International Conference on Document Analysis and Recognition Workshops (ICDARW), Vol. 2 (2019), 1--6."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1476"},{"key":"e_1_3_2_2_12_1","volume-title":"Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations. https:\/\/arxiv.org\/abs\/1602.07332","author":"Krishna Ranjay","year":"2016","unstructured":"Ranjay Krishna , Yuke Zhu , Oliver Groth , Justin Johnson , Kenji Hata , Joshua Kravitz , Stephanie Chen , Yannis Kalantidis , Li-Jia Li , David A Shamma , Michael Bernstein , and Li Fei-Fei . 2016 . Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations. https:\/\/arxiv.org\/abs\/1602.07332 Ranjay Krishna, Yuke Zhu, Oliver Groth, Justin Johnson, Kenji Hata, Joshua Kravitz, Stephanie Chen, Yannis Kalantidis, Li-Jia Li, David A Shamma, Michael Bernstein, and Li Fei-Fei. 2016. Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations. https:\/\/arxiv.org\/abs\/1602.07332"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.1992.201771"},{"key":"e_1_3_2_2_14_1","volume-title":"Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Lewis D.","unstructured":"D. Lewis , G. Agam , S. Argamon , O. Frieder , D. Grossman , and J. Heard . 2006. Building a Test Collection for Complex Document Information Processing . In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval ( Seattle, Washington, USA) (SIGIR '06). ACM, New York, NY, USA, 665--666. https:\/\/doi.org\/10.1145\/1148170.1148307 10.1145\/1148170.1148307 D. Lewis, G. Agam, S. Argamon, O. Frieder, D. Grossman, and J. Heard. 2006. Building a Test Collection for Complex Document Information Processing. In Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Seattle, Washington, USA) (SIGIR '06). ACM, New York, NY, USA, 665--666. https:\/\/doi.org\/10.1145\/1148170.1148307"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-2005"},{"key":"e_1_3_2_2_16_1","volume-title":"2019 b. RoBERTa: A Robustly Optimized BERT Pretraining Approach. ArXiv","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu , Myle Ott , Naman Goyal , Jingfei Du , Mandar Joshi , Danqi Chen , Omer Levy , Mike Lewis , Luke S. Zettlemoyer , and Veselin Stoyanov . 2019 b. RoBERTa: A Robustly Optimized BERT Pretraining Approach. ArXiv , Vol. abs\/ 1907 .11692 ( 2019 ). Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke S. Zettlemoyer, and Veselin Stoyanov. 2019 b. RoBERTa: A Robustly Optimized BERT Pretraining Approach. ArXiv, Vol. abs\/1907.11692 (2019)."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.4"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.244677"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/466"},{"key":"e_1_3_2_2_21_1","volume-title":"DeepDeSRT: Deep Learning for Detection and Structure Recognition of Tables in Document Images. 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR)","volume":"01","author":"Schreiber Sebastian","year":"2017","unstructured":"Sebastian Schreiber , Stefan Agne , Ivo Wolf , Andreas Dengel , and Sheraz Ahmed . 2017 . DeepDeSRT: Deep Learning for Detection and Structure Recognition of Tables in Document Images. 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR) , Vol. 01 (2017), 1162--1167. Sebastian Schreiber, Stefan Agne, Ivo Wolf, Andreas Dengel, and Sheraz Ahmed. 2017. DeepDeSRT: Deep Learning for Detection and Structure Recognition of Tables in Document Images. 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR), Vol. 01 (2017), 1162--1167."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.140"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.584106"},{"key":"e_1_3_2_2_24_1","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Soto Carlos","year":"1865","unstructured":"Carlos Soto and Shinjae Yoo . 2019. Visual Detection with Context for Document Layout Analysis . In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) . Association for Computational Linguistics , Hong Kong , China, 3462--3468. https:\/\/doi.org\/10. 1865 3\/v1\/D19--1348 10.18653\/v1 Carlos Soto and Shinjae Yoo. 2019. Visual Detection with Context for Document Layout Analysis. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 3462--3468. https:\/\/doi.org\/10.18653\/v1\/D19--1348"},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Christian Szegedy Sergey Ioffe Vincent Vanhoucke and Alex Alemi. 2016. Inception-v4 Inception-ResNet and the Impact of Residual Connections on Learning. In AAAI .  Christian Szegedy Sergey Ioffe Vincent Vanhoucke and Alex Alemi. 2016. Inception-v4 Inception-ResNet and the Impact of Residual Connections on Learning. In AAAI .","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"e_1_3_2_2_26_1","volume-title":"Fast CNN-Based Document Layout Analysis. 2017 IEEE International Conference on Computer Vision Workshops (ICCVW)","author":"Viana Matheus Palhares","year":"2017","unstructured":"Matheus Palhares Viana and D\u00e1rio Augusto Borges Oliveira . 2017 . Fast CNN-Based Document Layout Analysis. 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) (2017), 1173--1180. Matheus Palhares Viana and D\u00e1rio Augusto Borges Oliveira. 2017. Fast CNN-Based Document Layout Analysis. 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) (2017), 1173--1180."},{"key":"e_1_3_2_2_27_1","volume-title":"MLP and GMM Classifiers for Layout Analysis of Historical Documents. In 2013 12th International Conference on Document Analysis and Recognition. 1220--1224","author":"Wei H.","year":"2013","unstructured":"H. Wei , M. Baechler , F. Slimane , and R. Ingold . 2013. Evaluation of SVM , MLP and GMM Classifiers for Layout Analysis of Historical Documents. In 2013 12th International Conference on Document Analysis and Recognition. 1220--1224 . https:\/\/doi.org\/10.1109\/ICDAR. 2013 .247 10.1109\/ICDAR.2013.247 H. Wei, M. Baechler, F. Slimane, and R. Ingold. 2013. Evaluation of SVM, MLP and GMM Classifiers for Layout Analysis of Historical Documents. In 2013 12th International Conference on Document Analysis and Recognition. 1220--1224. https:\/\/doi.org\/10.1109\/ICDAR.2013.247"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.462"},{"key":"e_1_3_2_2_29_1","volume-title":"PubLayNet: largest dataset ever for document layout analysis. ArXiv","author":"Zhong Xu","year":"2019","unstructured":"Xu Zhong , Jianbin Tang , and Antonio Jimeno-Yepes . 2019. PubLayNet: largest dataset ever for document layout analysis. ArXiv , Vol. abs\/ 1908 .07836 ( 2019 ). Xu Zhong, Jianbin Tang, and Antonio Jimeno-Yepes. 2019. PubLayNet: largest dataset ever for document layout analysis. ArXiv, Vol. abs\/1908.07836 (2019)."}],"event":{"name":"KDD '20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining","location":"Virtual Event CA USA","acronym":"KDD '20","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data"]},"container-title":["Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403172","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394486.3403172","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:34Z","timestamp":1750195894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394486.3403172"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,20]]},"references-count":29,"alternative-id":["10.1145\/3394486.3403172","10.1145\/3394486"],"URL":"https:\/\/doi.org\/10.1145\/3394486.3403172","relation":{},"subject":[],"published":{"date-parts":[[2020,8,20]]},"assertion":[{"value":"2020-08-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}