{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T14:31:08Z","timestamp":1774449068429,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,19]],"date-time":"2021-04-19T00:00:00Z","timestamp":1618790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,19]]},"DOI":"10.1145\/3442381.3450126","type":"proceedings-article","created":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T19:24:51Z","timestamp":1622748291000},"page":"3512-3523","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Knowledge-Aware Procedural Text Understanding with Multi-Stage Training"],"prefix":"10.1145","author":[{"given":"Zhihan","family":"Zhang","sequence":"first","affiliation":[{"name":"Peking University, China"}]},{"given":"Xiubo","family":"Geng","sequence":"additional","affiliation":[{"name":"STCA NLP Group, Microsoft, China"}]},{"given":"Tao","family":"Qin","sequence":"additional","affiliation":[{"name":"MSRA, China"}]},{"given":"Yunfang","family":"Wu","sequence":"additional","affiliation":[{"name":"Peking University, China"}]},{"given":"Daxin","family":"Jiang","sequence":"additional","affiliation":[{"name":"STCA NLP Group, Microsoft, China"}]}],"member":"320","published-online":{"date-parts":[[2021,6,3]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Contextual String Embeddings for Sequence Labeling. In International Conference on Computational Linguistics, COLING","author":"Akbik Alan","year":"2018","unstructured":"Alan Akbik , Duncan Blythe , and Roland Vollgraf . 2018 . Contextual String Embeddings for Sequence Labeling. In International Conference on Computational Linguistics, COLING 2018. Alan Akbik, Duncan Blythe, and Roland Vollgraf. 2018. Contextual String Embeddings for Sequence Labeling. In International Conference on Computational Linguistics, COLING 2018."},{"key":"e_1_3_2_1_2_1","volume-title":"Procedural Reading Comprehension with Attribute-Aware Context Flow. In Conference on Automated Knowledge Base Construction, AKBC","author":"Amini Aida","year":"2020","unstructured":"Aida Amini , Antoine Bosselut , Bhavana\u00a0Dalvi Mishra , Yejin Choi , and Hannaneh Hajishirzi . 2020 . Procedural Reading Comprehension with Attribute-Aware Context Flow. In Conference on Automated Knowledge Base Construction, AKBC 2020. Aida Amini, Antoine Bosselut, Bhavana\u00a0Dalvi Mishra, Yejin Choi, and Hannaneh Hajishirzi. 2020. Procedural Reading Comprehension with Attribute-Aware Context Flow. In Conference on Automated Knowledge Base Construction, AKBC 2020."},{"key":"e_1_3_2_1_3_1","volume-title":"Modeling Biological Processes for Reading Comprehension. In Conference on Empirical Methods in Natural Language Processing, EMNLP","author":"Berant Jonathan","year":"2014","unstructured":"Jonathan Berant , Vivek Srikumar , Pei-Chun Chen , Abby\u00a0Vander Linden , Brittany Harding , Brad Huang , Peter Clark , and Christopher\u00a0 D. Manning . 2014 . Modeling Biological Processes for Reading Comprehension. In Conference on Empirical Methods in Natural Language Processing, EMNLP 2014. Jonathan Berant, Vivek Srikumar, Pei-Chun Chen, Abby\u00a0Vander Linden, Brittany Harding, Brad Huang, Peter Clark, and Christopher\u00a0D. Manning. 2014. Modeling Biological Processes for Reading Comprehension. In Conference on Empirical Methods in Natural Language Processing, EMNLP 2014."},{"key":"e_1_3_2_1_4_1","volume-title":"Simulating Action Dynamics with Neural Process Networks. In International Conference on Learning Representations, ICLR","author":"Bosselut Antoine","year":"2018","unstructured":"Antoine Bosselut , Omer Levy , Ari Holtzman , Corin Ennis , Dieter Fox , and Yejin Choi . 2018 . Simulating Action Dynamics with Neural Process Networks. In International Conference on Learning Representations, ICLR 2018. Antoine Bosselut, Omer Levy, Ari Holtzman, Corin Ennis, Dieter Fox, and Yejin Choi. 2018. Simulating Action Dynamics with Neural Process Networks. In International Conference on Learning Representations, ICLR 2018."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1171"},{"key":"e_1_3_2_1_6_1","volume-title":"Neural Natural Language Inference Models Enhanced with External Knowledge. In The Annual Meeting of the Association for Computational Linguistics, ACL","author":"Chen Qian","year":"2018","unstructured":"Qian Chen , Xiaodan Zhu , Zhen-Hua Ling , Diana Inkpen , and Si Wei . 2018 . Neural Natural Language Inference Models Enhanced with External Knowledge. In The Annual Meeting of the Association for Computational Linguistics, ACL 2018. Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, Diana Inkpen, and Si Wei. 2018. Neural Natural Language Inference Models Enhanced with External Knowledge. In The Annual Meeting of the Association for Computational Linguistics, ACL 2018."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1457"},{"key":"e_1_3_2_1_8_1","volume-title":"International Conference on Learning Representations, ICLR","author":"Das Rajarshi","year":"2019","unstructured":"Rajarshi Das , Tsendsuren Munkhdalai , Xingdi Yuan , Adam Trischler , and Andrew McCallum . 2019 . Building Dynamic Knowledge Graphs from Text using Machine Reading Comprehension . In International Conference on Learning Representations, ICLR 2019. Rajarshi Das, Tsendsuren Munkhdalai, Xingdi Yuan, Adam Trischler, and Andrew McCallum. 2019. Building Dynamic Knowledge Graphs from Text using Machine Reading Comprehension. In International Conference on Learning Representations, ICLR 2019."},{"key":"e_1_3_2_1_9_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Conference of the North American","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1244"},{"key":"e_1_3_2_1_11_1","volume-title":"Story Ending Generation with Incremental Encoding and Commonsense Knowledge. In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI","author":"Guan Jian","year":"2019","unstructured":"Jian Guan , Yansen Wang , and Minlie Huang . 2019 . Story Ending Generation with Incremental Encoding and Commonsense Knowledge. In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019. Jian Guan, Yansen Wang, and Minlie Huang. 2019. Story Ending Generation with Incremental Encoding and Commonsense Knowledge. In The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1070"},{"key":"e_1_3_2_1_13_1","volume-title":"Tracking Discrete and Continuous Entity State for Process Understanding. In Workshop on Structured Prediction for NLP@NAACL-HLT","author":"Gupta Aditya","year":"2019","unstructured":"Aditya Gupta and Greg Durrett . 2019 . Tracking Discrete and Continuous Entity State for Process Understanding. In Workshop on Structured Prediction for NLP@NAACL-HLT 2019. Aditya Gupta and Greg Durrett. 2019. Tracking Discrete and Continuous Entity State for Process Understanding. In Workshop on Structured Prediction for NLP@NAACL-HLT 2019."},{"key":"e_1_3_2_1_14_1","volume-title":"Tracking the World State with Recurrent Entity Networks. In International Conference on Learning Representations, ICLR","author":"Henaff Mikael","year":"2017","unstructured":"Mikael Henaff , Jason Weston , Arthur Szlam , Antoine Bordes , and Yann LeCun . 2017 . Tracking the World State with Recurrent Entity Networks. In International Conference on Learning Representations, ICLR 2017. Mikael Henaff, Jason Weston, Arthur Szlam, Antoine Bordes, and Yann LeCun. 2017. Tracking the World State with Recurrent Entity Networks. In International Conference on Learning Representations, ICLR 2017."},{"key":"e_1_3_2_1_15_1","volume-title":"Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT","author":"Huang Lifu","year":"2018","unstructured":"Lifu Huang , Niket Tandon , Wen-tau Yih, and Peter Clark . 2018 . Tracking State Changes in Procedural Text: a Challenge Dataset and Models for Process Paragraph Comprehension . In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2018. Lifu Huang, Niket Tandon, Wen-tau Yih, and Peter Clark. 2018. Tracking State Changes in Procedural Text: a Challenge Dataset and Models for Process Paragraph Comprehension. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2018."},{"key":"e_1_3_2_1_16_1","volume-title":"Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations, ICLR","author":"P.","year":"2015","unstructured":"Diederik\u00a0 P. Kingma and Jimmy Ba. 2015 . Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations, ICLR 2015 . Diederik\u00a0P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In International Conference on Learning Representations, ICLR 2015."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1282"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1138"},{"key":"e_1_3_2_1_19_1","unstructured":"Sewon Min Danqi Chen Luke Zettlemoyer and Hannaneh Hajishirzi. 2019. Knowledge Guided Text Retrieval and Reading for Open Domain Question Answering. ArXiv preprint arXiv:1911.03868(2019).  Sewon Min Danqi Chen Luke Zettlemoyer and Hannaneh Hajishirzi. 2019. Knowledge Guided Text Retrieval and Reading for Open Domain Question Answering. ArXiv preprint arXiv:1911.03868(2019)."},{"key":"e_1_3_2_1_20_1","volume-title":"7th Annual Conference on Advances in Cognitive Systems.","author":"Ribeiro Danilo","year":"2019","unstructured":"Danilo Ribeiro , Thomas Hinrichs , Maxwell Crouse , Kenneth Forbus , Maria Chang , and Michael Witbrock . 2019 . Predicting state changes in procedural text using analogical question answering . In 7th Annual Conference on Advances in Cognitive Systems. Danilo Ribeiro, Thomas Hinrichs, Maxwell Crouse, Kenneth Forbus, Maria Chang, and Michael Witbrock. 2019. Predicting state changes in procedural text using analogical question answering. In 7th Annual Conference on Advances in Cognitive Systems."},{"key":"e_1_3_2_1_21_1","volume-title":"Query-Reduction Networks for Question Answering. In International Conference on Learning Representations, ICLR","author":"Seo Min\u00a0Joon","year":"2017","unstructured":"Min\u00a0Joon Seo , Sewon Min , Ali Farhadi , and Hannaneh Hajishirzi . 2017 . Query-Reduction Networks for Question Answering. In International Conference on Learning Representations, ICLR 2017. Min\u00a0Joon Seo, Sewon Min, Ali Farhadi, and Hannaneh Hajishirzi. 2017. Query-Reduction Networks for Question Answering. In International Conference on Learning Representations, ICLR 2017."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.11164"},{"key":"e_1_3_2_1_23_1","unstructured":"Shane Storks Qiaozi Gao and Joyce\u00a0Y Chai. 2019. Commonsense reasoning for natural language understanding: A survey of benchmarks resources and approaches. ArXiv preprint arXiv:1904.01172(2019).  Shane Storks Qiaozi Gao and Joyce\u00a0Y Chai. 2019. Commonsense reasoning for natural language understanding: A survey of benchmarks resources and approaches. ArXiv preprint arXiv:1904.01172(2019)."},{"key":"e_1_3_2_1_24_1","volume-title":"MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension. In The Annual Meeting of the Association for Computational Linguistics, ACL","author":"Talmor Alon","year":"2019","unstructured":"Alon Talmor and Jonathan Berant . 2019 . MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension. In The Annual Meeting of the Association for Computational Linguistics, ACL 2019. Alon Talmor and Jonathan Berant. 2019. MultiQA: An Empirical Investigation of Generalization and Transfer in Reading Comprehension. In The Annual Meeting of the Association for Computational Linguistics, ACL 2019."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1006"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.591"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Ruize Wang Duyu Tang Nan Duan Zhongyu Wei Xuanjing Huang Jianshu Ji Guihong Cao Daxin Jiang and Ming Zhou. 2020. K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters. ArXiv preprint arXiv:2002.01808(2020).  Ruize Wang Duyu Tang Nan Duan Zhongyu Wei Xuanjing Huang Jianshu Ji Guihong Cao Daxin Jiang and Ming Zhou. 2020. K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters. ArXiv preprint arXiv:2002.01808(2020).","DOI":"10.18653\/v1\/2021.findings-acl.121"},{"key":"e_1_3_2_1_28_1","volume-title":"Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks. In International Conference on Learning Representations, ICLR","author":"Weston Jason","year":"2016","unstructured":"Jason Weston , Antoine Bordes , Sumit Chopra , and Tomas Mikolov . 2016 . Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks. In International Conference on Learning Representations, ICLR 2016. Jason Weston, Antoine Bordes, Sumit Chopra, and Tomas Mikolov. 2016. Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks. In International Conference on Learning Representations, ICLR 2016."},{"key":"e_1_3_2_1_29_1","volume-title":"Transformers: State-of-the-Art Natural Language Processing. In Conference on Empirical Methods in Natural Language Processing: System Demonstration, EMNLP","author":"Wolf Thomas","year":"2020","unstructured":"Thomas Wolf , Lysandre Debut , Victor Sanh , Julien Chaumond , Clement Delangue , Anthony Moi , Pierric Cistac , Tim Rault , R\u00e9mi Louf , Morgan Funtowicz , Joe Davison , Sam Shleifer , Patrick von Platen , Clara Ma , Yacine Jernite , Julien Plu , Canwen Xu , Teven\u00a0Le Scao , Sylvain Gugger , Mariama Drame , Quentin Lhoest , and Alexander\u00a0 M. Rush . 2020 . Transformers: State-of-the-Art Natural Language Processing. In Conference on Empirical Methods in Natural Language Processing: System Demonstration, EMNLP 2020. Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, R\u00e9mi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven\u00a0Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander\u00a0M. Rush. 2020. Transformers: State-of-the-Art Natural Language Processing. In Conference on Empirical Methods in Natural Language Processing: System Demonstration, EMNLP 2020."},{"key":"e_1_3_2_1_30_1","volume-title":"Conference of the North American","author":"Xu Hu","year":"2019","unstructured":"Hu Xu , Bing Liu , Lei Shu , and Philip\u00a0 S. Yu. 2019. BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis . In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019 . Hu Xu, Bing Liu, Lei Shu, and Philip\u00a0S. Yu. 2019. BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019."},{"key":"e_1_3_2_1_31_1","volume-title":"Leveraging Knowledge Bases in LSTMs for Improving Machine Reading. In The Annual Meeting of the Association for Computational Linguistics, ACL","author":"Yang Bishan","year":"2017","unstructured":"Bishan Yang and Tom\u00a0 M. Mitchell . 2017 . Leveraging Knowledge Bases in LSTMs for Improving Machine Reading. In The Annual Meeting of the Association for Computational Linguistics, ACL 2017. 1436\u20131446. Bishan Yang and Tom\u00a0M. Mitchell. 2017. Leveraging Knowledge Bases in LSTMs for Improving Machine Reading. In The Annual Meeting of the Association for Computational Linguistics, ACL 2017. 1436\u20131446."},{"key":"e_1_3_2_1_32_1","unstructured":"Wenhao Yu Chenguang Zhu Zaitang Li Zhiting Hu Qingyun Wang Heng Ji and Meng Jiang. 2020. A Survey of Knowledge-Enhanced Text Generation. ArXiv preprint arXiv:2010.04389(2020).  Wenhao Yu Chenguang Zhu Zaitang Li Zhiting Hu Qingyun Wang Heng Ji and Meng Jiang. 2020. A Survey of Knowledge-Enhanced Text Generation. ArXiv preprint arXiv:2010.04389(2020)."},{"key":"e_1_3_2_1_33_1","unstructured":"Wanjun Zhong Duyu Tang Nan Duan Ming Zhou Jiahai Wang and Jian Yin. 2020. A Heterogeneous Graph with Factual Temporal and Logical Knowledge for Question Answering Over Dynamic Contexts. ArXiv preprint arXiv:2004.12057(2020).  Wanjun Zhong Duyu Tang Nan Duan Ming Zhou Jiahai Wang and Jian Yin. 2020. A Heterogeneous Graph with Factual Temporal and Logical Knowledge for Question Answering Over Dynamic Contexts. ArXiv preprint arXiv:2004.12057(2020)."}],"event":{"name":"WWW '21: The Web Conference 2021","location":"Ljubljana Slovenia","acronym":"WWW '21","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web"]},"container-title":["Proceedings of the Web Conference 2021"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3450126","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442381.3450126","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:28Z","timestamp":1750195468000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442381.3450126"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,19]]},"references-count":33,"alternative-id":["10.1145\/3442381.3450126","10.1145\/3442381"],"URL":"https:\/\/doi.org\/10.1145\/3442381.3450126","relation":{},"subject":[],"published":{"date-parts":[[2021,4,19]]},"assertion":[{"value":"2021-06-03","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}