{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:52:08Z","timestamp":1760237528967,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,5,28]],"date-time":"2020-05-28T00:00:00Z","timestamp":1590624000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U1636208, NO 61862008, Grant NO. 61902013"],"award-info":[{"award-number":["U1636208, NO 61862008, Grant NO. 61902013"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Modern retrieval systems tend to deteriorate because of their large output of useless and even misleading information, especially for complex search requests on a large scale. Complex information retrieval (IR) tasks requiring multi-hop reasoning need to fuse multiple scattered text across two or more documents. However, there are two challenges for multi-hop retrieval. To be specific, the first challenge is that since some important supporting facts have little lexical or semantic relationship with the retrieval query, the retriever often omits them; the second challenge is that once a retriever chooses misinformation related to the query as the entities of cognitive graphs, the retriever will fail. In this study, in order to improve the performance of retrievers in complex tasks, an intelligent sensor technique was proposed based on a sub-scope with cognitive reasoning (2SCR-IR), a novel method of retrieving reasoning paths over the cognitive graph to provide users with verified multi-hop reasoning chains. Inspired by the users\u2019 process of step-by-step searching online, 2SCR-IR includes a dynamic fusion layer that starts from the entities mentioned in the given query, explores the cognitive graph dynamically built from the query and contexts, gradually finds relevant supporting entities mentioned in the given documents, and verifies the rationality of the retrieval facts. Our experimental results show that 2SCR-IR achieves competitive results on the HotpotQA full wiki and distractor settings, and outperforms the previous state-of-the-art methods by a more than two points absolute gain on the full wiki setting.<\/jats:p>","DOI":"10.3390\/s20113057","type":"journal-article","created":{"date-parts":[[2020,5,28]],"date-time":"2020-05-28T12:36:58Z","timestamp":1590669418000},"page":"3057","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["A Cognitive Method for Automatically Retrieving Complex Information on a Large Scale"],"prefix":"10.3390","volume":"20","author":[{"given":"Yongyue","family":"Wang","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Beijing Key Laboratory of Network Technology, Beihang University, Beijing 100191, China"}]},{"given":"Beitong","family":"Yao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Beijing Key Laboratory of Network Technology, Beihang University, Beijing 100191, China"}]},{"given":"Tianbo","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Cyber Science and Technology, Beihang University, Beijing 100191, China"}]},{"given":"Chunhe","family":"Xia","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Beijing Key Laboratory of Network Technology, Beihang University, Beijing 100191, China"},{"name":"School of Computer Science and Information Technology, Guangxi Normal University, Guilin, Guangxi 541004, China"}]},{"given":"Xianghui","family":"Zhao","sequence":"additional","affiliation":[{"name":"China Information Technology Security Evaluation Center, Beijing 100085, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,5,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Rajpurkar, P., Jia, R., and Liang, P. (2018). Know what you don\u2019t know: Unanswerable questions for SQuAD. arXiv, Available online: https:\/\/arxiv.org\/abs\/1806.03822.","DOI":"10.18653\/v1\/P18-2124"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yang, Z., Qi, P., Zhang, S., Bengio, Y., Cohen, W., Salakhutdinov, R., and Manning, C.D. (November, January 31). Hotpotqa: A dataset for diverse, explainable multi-hop question answering. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1259"},{"key":"ref_3","unstructured":"Nishida, K., Nishida, K., Nagata, M., Otsuka, A., Saito, I., Asano, H., and Tomota, J. (August, January 28). Answering while Summarizing: Multi-task Learning for Multi-hop QA with Evidence Extraction. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Min, S., Zhong, V., Xiong, C., and Socher, R. (2018, January 15\u201320). Efficient and Robust Question Answering from Minimal Context over Documents. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1160"},{"key":"ref_5","unstructured":"Seo, M., Lee, J., Kwiatkowski, T., Parikh, A.P., Farhadi, A., and Hajishirzi, H. (August, January 28). Real-time open-domain question answering with dense-sparse phrase index. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_6","unstructured":"Ding, M., Zhou, C., Chen, Q., Yang, H., and Tang, J. (August, January 28). Cognitive graph for multi-hop reading comprehension at scale. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_7","unstructured":"Feldman, Y., and Elyaniv, R. (August, January 28). Multi-Hop Paragraph Retrieval for Open-Domain Question Answering. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Qi, P., Lin, X., Mehr, L., Wang, Z., and Manning, C.D. (2019, January 3\u20137). Answering Complex Open-domain Questions Through Iterative Query Generation. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), Hong Kong, China.","DOI":"10.18653\/v1\/D19-1261"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yang, W., Xie, Y., Lin, A., Li, X., Tan, L., Xiong, K., Li, M., and Lin, J. (2019, January 2\u20137). End-to-end open-domain question answering with bertserini. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics, Minneapolis, MA, USA.","DOI":"10.18653\/v1\/N19-4013"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lee, J., Yun, S., Kim, H., Ko, M., and Kang, J. (November, January 31). Ranking paragraphs for improving answer recall in open-domain question answering. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1053"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wang, S., Yu, M., Guo, X., Wang, Z., Klinger, T., Zhang, W., Chang, S., Tesauro, G., Zhou, B., and Jiang, J. (2018, January 2\u20137). R3: Reinforced ranker-reader for open-domain question answering. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12053"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, J., Jiang, C., Zhang, H., Ren, Y., Chen, K.-C., and Hanzo, L. (2020). Thirty Years of Machine Learning: The Road to Pareto-Optimal Wireless Networks. IEEE Commun. Surv. Tutor.","DOI":"10.1109\/COMST.2020.2965856"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhang, W., and Lu, J. (2018, January 10\u201311). An online water army detection method based on network hot events. Proceedings of the 2018 10th International Conference on Measuring Technology and Mechatronics Automation (ICMTMA), Changsha, China.","DOI":"10.1109\/ICMTMA.2018.00053"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3309699","article-title":"The web of false information: Rumors, fake news, hoaxes, clickbait, and various other shenanigans","volume":"11","author":"Zannettou","year":"2019","journal-title":"J. Data Inf. Qual."},{"key":"ref_15","unstructured":"Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R., and Xiong, C. (May, January 26). Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answering. Proceedings of the International Conference on Learning Representations, Virtual Conference, Formerly Addis Ababa, Ethiopia."},{"key":"ref_16","unstructured":"Xiao, Y., Qu, Y., Qiu, L., Zhou, H., Li, L., Zhang, W., and Yu, Y. (August, January 28). Dynamically fused graph network for multi-hop reasoning. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_17","unstructured":"Godbole, A., Kavarthapu, D., Das, R., Gong, Z., Singhal, A., Zamani, H., Yu, M., Gao, T., Guo, X., and Zaheer, M. (2019). Multi-step Entity-centric Information Retrieval for Multi-Hop Question Answering. arXiv, Available online: https:\/\/arxiv.org\/abs\/1909.07598."},{"key":"ref_18","unstructured":"Hu, M., Peng, Y., Huang, Z., and Li, D. (August, January 28). Retrieve, Read, Rerank: Towards End-to-End Multi-Document Reading Comprehension. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy."},{"key":"ref_19","unstructured":"Wallenberg, M., and Arngren, T. (2019). Search Engine for Textual Content and Non-Textual Content. (No. 20160085860A1), U.S. Patent."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Guo, J., Fan, Y., Ai, Q., and Croft, W.B. (2016, January 24\u201328). A deep relevance matching model for ad-hoc retrieval. Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, Indianapolis, IN, USA.","DOI":"10.1145\/2983323.2983769"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yoneda, T., Mitchell, J., Welbl, J., Stenetorp, P., and Riedel, S. (2018, January 1). Ucl machine reading group: Four factor framework for fact finding (hexaf). Proceedings of the First Workshop on Fact. Extraction and VERification (FEVER), Brussels, Belgium.","DOI":"10.18653\/v1\/W18-5515"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Rajpurkar, P., Zhang, J., Lopyrev, K., and Liang, P. (2016, January 1\u20135). Squad: 100,000+ questions for machine comprehension of text. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1264"},{"key":"ref_23","unstructured":"Chen, D., Fisch, A., Weston, J., and Bordes, A. (August, January 30). Reading wikipedia to answer open-domain questions. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Vancouver, BC, Canada."},{"key":"ref_24","unstructured":"Dhingra, B., Mazaitis, K., and Cohen, W.W. (2017). Quasar: Datasets for question answering by search and reading. arXiv, Available online: https:\/\/arxiv.org\/abs\/1707.03904."},{"key":"ref_25","unstructured":"Wang, S., Yu, M., Jiang, J., Zhang, W., Guo, X., Chang, S., Wang, Z., Klinger, T., Tesauro, G., and Campbell, M. (2017). Evidence aggregation for answer re-ranking in open-domain question answering. arXiv, Available online: https:\/\/arxiv.org\/abs\/1711.05116."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kratzwald, B., and Feuerriegel, S. (November, January 31). Adaptive document retrieval for deep question answering. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.","DOI":"10.18653\/v1\/D18-1055"},{"key":"ref_27","first-page":"146","article-title":"Distributional structure","volume":"10","author":"Harris","year":"1954","journal-title":"World"},{"key":"ref_28","unstructured":"Le, Q., and Mikolov, T. (2014, January 21\u201326). Distributed representations of sentences and documents. Proceedings of the International conference on machine learning, Beijing, China."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Collins, M., and Duffy, N. (2002, January 7\u201312). New ranking algorithms for parsing and tagging: Kernels over discrete structures, and the voted perceptron. Proceedings of the 40th annual meeting on association for computational linguistics, Philadelphia, PA, USA.","DOI":"10.3115\/1073083.1073128"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1109\/TASL.2008.2012323","article-title":"Importance of high-order n-gram models in morph-based speech recognition","volume":"17","author":"Hirsimaki","year":"2009","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Dhingra, B., Jin, Q., Yang, Z., Cohen, W., and Salakhutdinov, R. (2018). Neural models for reasoning over multiple mentions using coreference. arXiv, Available online: https:\/\/arxiv.org\/abs\/1804.05922.","DOI":"10.18653\/v1\/N18-2007"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Song, L., Zhang, Y., Wang, Z., and Gildea, D. (2018, January 15\u201320). A graph-to-sequence model for amr-to-text generation. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, Melbourne, Australia.","DOI":"10.18653\/v1\/P18-1150"},{"key":"ref_33","unstructured":"Song, L., Wang, Z., Yu, M., Zhang, Y., Florian, R., and Gildea, D. (2018). Exploring graph-structured passage representation for multi-hop reading comprehension with graph neural networks. arXiv, Available online: https:\/\/arxiv.org\/abs\/1809.02040."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"De Cao, N., Aziz, W., and Titov, I. (2019, January 2\u20137). Question answering by reasoning across documents with graph convolutional networks. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics, Minneapolis, MA, USA.","DOI":"10.18653\/v1\/N19-1240"},{"key":"ref_35","unstructured":"Kipf, T.N., and Welling, M. (2017, January 24\u201326). Semi-supervised classification with graph convolutional networks. Proceedings of the International Conference on Learning Representations, Toulon, France."},{"key":"ref_36","unstructured":"Sukhbaatar, S., Weston, J., and Fergus, R. (2015, January 8\u201313). End-to-end memory networks. Proceedings of the 28th International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_37","unstructured":"Zhou, M., Huang, M., and Zhu, X. (2018). An interpretable reasoning network for multi-relation question answering. arXiv, Available online: https:\/\/arxiv.org\/abs\/1801.04726."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Singh, B., and Singh, H.K. (2011, January 15\u201318). Web Data Mining research: A survey. Proceedings of the IEEE International Conference on Computational Intelligence & Computing Research, Kanyakumari, India.","DOI":"10.1109\/ICCIC.2010.5705856"},{"key":"ref_39","unstructured":"Nie, Y., Chen, H., and Bansal, M. (February, January 27). Combining fact extraction and verification with neural semantic matching networks. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_40","unstructured":"Chen, J., Lin, S.-T., and Durrett, G. (2019). Multi-hop Question Answering via Reasoning Chains. arXiv."},{"key":"ref_41","unstructured":"Das, R., Dhuliawala, S., Zaheer, M., and McCallum, A. (2019, January 6\u20139). Multi-step Retriever-Reader Interaction for Scalable Open-domain Question Answering. Proceedings of the Seventh International Conference on Learning Representations, New Orleans, LA, USA."},{"key":"ref_42","unstructured":"Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv, Available online: https:\/\/arxiv.org\/abs\/1810.04805."},{"key":"ref_43","unstructured":"Seo, M., Kembhavi, A., Farhadi, A., and Hajishirzi, H. (2016). Bidirectional attention flow for machine comprehension. arXiv, Available online: https:\/\/arxiv.org\/abs\/1611.01603."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Manning, C.D., Surdeanu, M., Bauer, J., Finkel, J.R., Bethard, S., and McClosky, D. (2014, January 22\u201327). The Stanford CoreNLP natural language processing toolkit. Proceedings of the 52nd annual meeting of the association for computational linguistics: System demonstrations, Baltimore, MD, USA.","DOI":"10.3115\/v1\/P14-5010"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"121728","DOI":"10.1016\/j.physa.2019.121728","article-title":"Correlation analysis of short text based on network model","volume":"531","author":"Yan","year":"2019","journal-title":"Physica A"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wang, H., Yu, M., Guo, X., Das, R., Xiong, W., and Gao, T. (2019). Do Multi-hop Readers Dream of Reasoning Chains?. arXiv, Available online: https:\/\/arxiv.org\/abs\/1910.14520.","DOI":"10.18653\/v1\/D19-5813"},{"key":"ref_47","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Aberer, K., Choi, K.-S., Noy, N., Allemang, D., Lee, K.-I., Nixon, L., Golbeck, J., Mika, P., Maynard, D., and Mizoguchi, R. (2007). DBpedia: A nucleus for a web of open data. The Semantic Web, Springer.","DOI":"10.1007\/978-3-540-76298-0"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Wang, Z., Ng, P., Ma, X., Nallapati, R., and Xiang, B. (2019, January 3\u20137). Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answering. Proceedings of the international joint conference on natural language processing, Hong Kong, China.","DOI":"10.18653\/v1\/D19-1599"},{"key":"ref_50","unstructured":"Nogueira, R., and Cho, K. (2019). Passage Re-ranking with BERT. arXiv, Available online: https:\/\/arxiv.org\/abs\/1901.04085."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/11\/3057\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:33:28Z","timestamp":1760175208000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/11\/3057"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,28]]},"references-count":50,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["s20113057"],"URL":"https:\/\/doi.org\/10.3390\/s20113057","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2020,5,28]]}}}