{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:18:55Z","timestamp":1750220335591,"version":"3.41.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T00:00:00Z","timestamp":1651190400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61572120"],"award-info":[{"award-number":["61572120"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["N181602013"],"award-info":[{"award-number":["N181602013"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Asian Low-Resour. Lang. Inf. Process."],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:p>Most existing multi-document machine reading comprehension models mainly focus on understanding the interactions between the input question and documents, but ignore the following two kinds of understandings. First, to understand the semantic meaning of words in the input question and documents from the perspective of each other. Second, to understand the supporting cues for a correct answer from the perspective of intra-document and inter-documents. Ignoring these two kinds of important understandings would make the models overlook some important information that may be helpful for finding correct answers. To overcome this deficiency, we propose a deep understanding based model for multi-document machine reading comprehension. It has three cascaded deep understanding modules which are designed to understand the accurate semantic meaning of words, the interactions between the input question and documents, and the supporting cues for the correct answer. We evaluate our model on two large scale benchmark datasets, namely TriviaQA Web and DuReader. Extensive experiments show that our model achieves state-of-the-art results on both datasets.<\/jats:p>","DOI":"10.1145\/3519296","type":"journal-article","created":{"date-parts":[[2022,2,24]],"date-time":"2022-02-24T18:25:26Z","timestamp":1645727126000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Deep Understanding Based Multi-Document Machine Reading Comprehension"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6824-1191","authenticated-orcid":false,"given":"Feiliang","family":"Ren","sequence":"first","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongkang","family":"Liu","sequence":"additional","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bochao","family":"Li","sequence":"additional","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhibo","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Guo","sequence":"additional","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2976-6256","authenticated-orcid":false,"given":"Shilei","family":"Liu","sequence":"additional","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huimin","family":"Wu","sequence":"additional","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaqi","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunchao","family":"Liu","sequence":"additional","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bingchao","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, Heping Qu, Shenyang City, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,4,29]]},"reference":[{"key":"e_1_3_2_2_1","volume-title":"ICLR 2015: International Conference on Learning Representations 2015","author":"Bahdanau Dzmitry","year":"2015","unstructured":"Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In ICLR 2015: International Conference on Learning Representations 2015."},{"key":"e_1_3_2_3_1","article-title":"Self-supervised test-time learning for reading comprehension.","author":"Banerjee Pratyay","year":"2021","unstructured":"Pratyay Banerjee, Tejas Gokhale, and Chitta Baral. 2021. Self-supervised test-time learning for reading comprehension.arXiv preprint arXiv:2103.11263 (2021).","journal-title":"arXiv preprint arXiv:2103.11263"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.567"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.241"},{"key":"e_1_3_2_6_1","article-title":"Smarnet: Teaching machines to read and comprehend like human.","author":"Chen Zheqian","year":"2017","unstructured":"Zheqian Chen, Rongqin Yang, Bin Cao, Zhou Zhao, Deng Cai, and Xiaofei He. 2017. Smarnet: Teaching machines to read and comprehend like human.arXiv preprint arXiv:1710.02772 (2017).","journal-title":"arXiv preprint arXiv:1710.02772"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1078"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1055"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN48605.2020.9206859"},{"key":"e_1_3_2_10_1","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers)","author":"Devlin Jacob","year":"2018","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina N. Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 4171\u20134186."},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11432-020-2982-y"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.603"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.237"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.83"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-2605"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33016529"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.242"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1147"},{"key":"e_1_3_2_19_1","volume-title":"ICLR 2020: Eighth International Conference on Learning Representations","author":"Lan Zhenzhong","year":"2020","unstructured":"Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, and Radu Soricut. 2020. ALBERT: A lite BERT for self-supervised learning of language representations. In ICLR 2020: Eighth International Conference on Learning Representations."},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.111"},{"key":"e_1_3_2_21_1","first-page":"146","volume-title":"Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing: Student Research Workshop","author":"Li Hongyu","year":"2020","unstructured":"Hongyu Li, Tengyang Chen, Shuting Bai, Takehito Utsuro, and Yasuhide Kawada. 2020a. MRC examples answerable by BERT without a question are less effective in MRC model training. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing: Student Research Workshop. 146\u2013152."},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1157"},{"key":"e_1_3_2_23_1","article-title":"RoBERTa: A robustly optimized BERT pretraining approach","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. arXiv preprint arXiv:1907.11692 (2019).","journal-title":"arXiv preprint arXiv:1907.11692"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.329"},{"key":"e_1_3_2_25_1","first-page":"687","volume-title":"Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing","author":"Luo Huaishao","year":"2020","unstructured":"Huaishao Luo, Yu Shi, Ming Gong, Linjun Shou, and Tianrui Li. 2020. MaP: A matrix-based prediction approach to improve span extraction in machine reading comprehension. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing. 687\u2013695."},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.conll-1.11"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1257"},{"key":"e_1_3_2_28_1","volume-title":"CoCo@NIPS","author":"Nguyen Tri","year":"2016","unstructured":"Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016. MS MARCO: A human generated MAchine reading COmprehension dataset. In CoCo@NIPS."},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1220"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.235"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/D14-1162"},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-2124"},{"key":"e_1_3_2_34_1","volume-title":"ICLR (Poster)","author":"Seo Min Joon","year":"2016","unstructured":"Min Joon Seo, Aniruddha Kembhavi, Ali Farhadi, and Hannaneh Hajishirzi. 2016. Bidirectional attention flow for machine comprehension. In ICLR (Poster)."},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1270"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.247"},{"key":"e_1_3_2_37_1","first-page":"2692","volume-title":"NIPS\u201915 Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 2","volume":"28","author":"Vinyals Oriol","year":"2015","unstructured":"Oriol Vinyals, Meire Fortunato, and Navdeep Jaitly. 2015. Pointer networks. In NIPS\u201915 Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 2, Vol. 28. 2692\u20132700."},{"key":"e_1_3_2_38_1","first-page":"1","volume-title":"ICLR (Poster)","author":"Wang Shuohang","year":"2017","unstructured":"Shuohang Wang and Jing Jiang. 2017. Machine comprehension using match-LSTM and answer pointer. In ICLR (Poster). 1."},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1158"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-1018"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1178"},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.138"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P18-1159"},{"key":"e_1_3_2_44_1","article-title":"Fast Reading Comprehension With ConvNets","author":"Wu Felix","year":"2018","unstructured":"Felix Wu, Ni Lao, John Blitzer, Guandao Yang, and Kilian Q. Weinberger. 2018. Fast Reading Comprehension With ConvNets. arXiv preprint arXiv:1711.04352 (2018).","journal-title":"arXiv preprint arXiv:1711.04352"},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1271"},{"key":"e_1_3_2_46_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33017354"},{"key":"e_1_3_2_47_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1226"},{"key":"e_1_3_2_48_1","first-page":"72","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations)","author":"Yang Wei","year":"2019","unstructured":"Wei Yang, Yuqing Xie, Aileen Lin, Xingyu Li, Luchen Tan, Kun Xiong, Ming Li, and Jimmy Lin. 2019c. End-to-end open-domain question answering with BERTserini. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics (Demonstrations). 72\u201377."},{"key":"e_1_3_2_49_1","first-page":"5753","volume-title":"Advances in Neural Information Processing Systems","author":"Yang Zhilin","year":"2019","unstructured":"Zhilin Yang, Zihang Dai, Yiming Yang, Jaime G. Carbonell, Ruslan Salakhutdinov, and Quoc V. Le. 2019a. XLNet: Generalized autoregressive pretraining for language understanding. In Advances in Neural Information Processing Systems, Vol. 32. 5753\u20135763."},{"key":"e_1_3_2_50_1","volume-title":"International Conference on Learning Representations","author":"Yu Adams Wei","year":"2018","unstructured":"Adams Wei Yu, David Dohan, Minh-Thang Luong, Rui Zhao, Kai Chen, Mohammad Norouzi, and Quoc V. Le. 2018. QANet: Combining local convolution with global self-attention for reading comprehension. In International Conference on Learning Representations."},{"key":"e_1_3_2_51_1","article-title":"ReadTwice: Reading very large documents with memories","author":"Zemlyanskiy Yury","year":"2021","unstructured":"Yury Zemlyanskiy, Joshua Ainslie, Michiel de Jong, Philip Pham, Ilya Eckstein, and Fei Sha. 2021. ReadTwice: Reading very large documents with memories. arXiv preprint arXiv:2105.04241 (2021).","journal-title":"arXiv preprint arXiv:2105.04241"},{"key":"e_1_3_2_52_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.coling-main.236"},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6510"},{"key":"e_1_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v34i05.6511"},{"key":"e_1_3_2_55_1","volume-title":"AAAI 2021","author":"Zhang Zhuosheng","year":"2021","unstructured":"Zhuosheng Zhang, Junjie Yang, and Hai Zhao. 2021. Retrospective reader for machine reading comprehension. In AAAI 2021."},{"key":"e_1_3_2_56_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.599"}],"container-title":["ACM Transactions on Asian and Low-Resource Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3519296","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3519296","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:21Z","timestamp":1750191141000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3519296"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,29]]},"references-count":55,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,9,30]]}},"alternative-id":["10.1145\/3519296"],"URL":"https:\/\/doi.org\/10.1145\/3519296","relation":{},"ISSN":["2375-4699","2375-4702"],"issn-type":[{"type":"print","value":"2375-4699"},{"type":"electronic","value":"2375-4702"}],"subject":[],"published":{"date-parts":[[2022,4,29]]},"assertion":[{"value":"2020-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-04-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}