{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T22:56:39Z","timestamp":1778540199485,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,8]]},"DOI":"10.1145\/3437963.3441753","type":"proceedings-article","created":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T04:36:17Z","timestamp":1615005377000},"page":"553-561","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":152,"title":["Improving Multi-hop Knowledge Base Question Answering by Learning Intermediate Supervision Signals"],"prefix":"10.1145","author":[{"given":"Gaole","family":"He","sequence":"first","affiliation":[{"name":"Renmin University of China & Beijing Key Laboratory of Big Data Management and Analysis Methods, Beijing, China"}]},{"given":"Yunshi","family":"Lan","sequence":"additional","affiliation":[{"name":"Singapore Management University, Singapore, Singapore"}]},{"given":"Jing","family":"Jiang","sequence":"additional","affiliation":[{"name":"Singapore Management University, Singapore, Singapore"}]},{"given":"Wayne Xin","family":"Zhao","sequence":"additional","affiliation":[{"name":"Renmin University of China & Beijing Key Laboratory of Big Data Management and Analysis Methods, Beijing, China"}]},{"given":"Ji-Rong","family":"Wen","sequence":"additional","affiliation":[{"name":"Renmin University of China & Beijing Key Laboratory of Big Data Management and Analysis Methods, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2021,3,8]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"FOCS 2006 .","author":"Andersen Reid","unstructured":"Reid Andersen , Fan R. K. Chung , and Kevin J. Lang . 2006. Local Graph Partitioning using PageRank Vectors . In FOCS 2006 . Reid Andersen, Fan R. K. Chung, and Kevin J. Lang. 2006. Local Graph Partitioning using PageRank Vectors. In FOCS 2006 ."},{"key":"e_1_3_2_2_2_1","volume-title":"EMNLP 2013 . 1533--1544","author":"Berant Jonathan","year":"2013","unstructured":"Jonathan Berant , Andrew Chou , Roy Frostig , and Percy Liang . 2013 . Semantic Parsing on Freebase from Question-Answer Pairs . In EMNLP 2013 . 1533--1544 . Jonathan Berant, Andrew Chou, Roy Frostig, and Percy Liang. 2013. Semantic Parsing on Freebase from Question-Answer Pairs. In EMNLP 2013 . 1533--1544."},{"key":"e_1_3_2_2_3_1","volume-title":"ICLR 2018 .","author":"Das Rajarshi","year":"2018","unstructured":"Rajarshi Das , Shehzaad Dhuliawala , Manzil Zaheer , Luke Vilnis , Ishan Durugkar , Akshay Krishnamurthy , Alex Smola , and Andrew McCallum . 2018 . Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learning . In ICLR 2018 . Rajarshi Das, Shehzaad Dhuliawala, Manzil Zaheer, Luke Vilnis, Ishan Durugkar, Akshay Krishnamurthy, Alex Smola, and Andrew McCallum. 2018. Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learning. In ICLR 2018 ."},{"key":"e_1_3_2_2_4_1","volume-title":"Compact Trilinear Interaction for Visual Question Answering. In ICCV 2019 .","author":"Do Tuong","unstructured":"Tuong Do , Huy Tran , Thanh-Toan Do , Erman Tjiputra , and Quang D. Tran . 2019 . Compact Trilinear Interaction for Visual Question Answering. In ICCV 2019 . Tuong Do, Huy Tran, Thanh-Toan Do, Erman Tjiputra, and Quang D. Tran. 2019. Compact Trilinear Interaction for Visual Question Answering. In ICCV 2019 ."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P15-1026"},{"key":"e_1_3_2_2_6_1","volume-title":"Benefits of Intermediate Annotations in Reading Comprehension. In ACL 2020 . 5627--5634","author":"Dua Dheeru","year":"2020","unstructured":"Dheeru Dua , Sameer Singh , and Matt Gardner . 2020 . Benefits of Intermediate Annotations in Reading Comprehension. In ACL 2020 . 5627--5634 . Dheeru Dua, Sameer Singh, and Matt Gardner. 2020. Benefits of Intermediate Annotations in Reading Comprehension. In ACL 2020 . 5627--5634."},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v31i3.2303"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISIT.2004.1365067"},{"key":"e_1_3_2_2_9_1","volume-title":"Born-Again Neural Networks. In ICML 2018 .","author":"Furlanello Tommaso","year":"2018","unstructured":"Tommaso Furlanello , Zachary Chase Lipton , Michael Tschannen , Laurent Itti , and Anima Anandkumar . 2018 . Born-Again Neural Networks. In ICML 2018 . Tommaso Furlanello, Zachary Chase Lipton, Michael Tschannen, Laurent Itti, and Anima Anandkumar. 2018. Born-Again Neural Networks. In ICML 2018 ."},{"key":"e_1_3_2_2_10_1","volume-title":"Distilling the Knowledge in a Neural Network. CoRR","author":"Hinton Geoffrey E.","year":"2015","unstructured":"Geoffrey E. Hinton , Oriol Vinyals , and Jeffrey Dean . 2015. Distilling the Knowledge in a Neural Network. CoRR , Vol. abs\/ 1503 .02531 ( 2015 ). Geoffrey E. Hinton, Oriol Vinyals, and Jeffrey Dean. 2015. Distilling the Knowledge in a Neural Network. CoRR , Vol. abs\/1503.02531 (2015)."},{"key":"e_1_3_2_2_11_1","volume-title":"Attention-Guided Answer Distillation for Machine Reading Comprehension. In EMNLP 2018 .","author":"Hu Minghao","year":"2018","unstructured":"Minghao Hu , Yuxing Peng , Furu Wei , Zhen Huang , Dongsheng Li , Nan Yang , and Ming Zhou . 2018 . Attention-Guided Answer Distillation for Machine Reading Comprehension. In EMNLP 2018 . Minghao Hu, Yuxing Peng, Furu Wei, Zhen Huang, Dongsheng Li, Nan Yang, and Ming Zhou. 2018. Attention-Guided Answer Distillation for Machine Reading Comprehension. In EMNLP 2018 ."},{"key":"e_1_3_2_2_12_1","volume-title":"Language-Conditioned Graph Networks for Relational Reasoning. In ICCV 2019 .","author":"Hu Ronghang","year":"2019","unstructured":"Ronghang Hu , Anna Rohrbach , Trevor Darrell , and Kate Saenko . 2019 . Language-Conditioned Graph Networks for Relational Reasoning. In ICCV 2019 . Ronghang Hu, Anna Rohrbach, Trevor Darrell, and Kate Saenko. 2019. Language-Conditioned Graph Networks for Relational Reasoning. In ICCV 2019 ."},{"key":"e_1_3_2_2_13_1","volume-title":"Compositional Attention Networks for Machine Reasoning. In ICLR 2018 .","author":"Drew","unstructured":"Drew A. Hudson and Christopher D. Manning. 2018 . Compositional Attention Networks for Machine Reasoning. In ICLR 2018 . Drew A. Hudson and Christopher D. Manning. 2018. Compositional Attention Networks for Machine Reasoning. In ICLR 2018 ."},{"key":"e_1_3_2_2_14_1","first-page":"5901","article-title":"Learning by Abstraction: The Neural State Machine","volume":"2019","author":"Hudson Drew A.","year":"2019","unstructured":"Drew A. Hudson and Christopher D. Manning . 2019 . Learning by Abstraction: The Neural State Machine . In NeurIPS 2019. 5901 -- 5914 . Drew A. Hudson and Christopher D. Manning. 2019. Learning by Abstraction: The Neural State Machine. In NeurIPS 2019. 5901--5914.","journal-title":"NeurIPS"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2020.2992393"},{"key":"e_1_3_2_2_16_1","volume-title":"Semi-Supervised Classification with Graph Convolutional Networks. In ICLR 2017 .","author":"Thomas","unstructured":"Thomas N. Kipf and Max Welling. 2017 . Semi-Supervised Classification with Graph Convolutional Networks. In ICLR 2017 . Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In ICLR 2017 ."},{"key":"e_1_3_2_2_17_1","first-page":"1184","article-title":"A Divide and Conquer Bidirectional Search","volume":"99","author":"Korf Richard E.","year":"1999","unstructured":"Richard E. Korf . 1999 . A Divide and Conquer Bidirectional Search : First Results. In IJCAI 99 . 1184 -- 1191 . Richard E. Korf. 1999. A Divide and Conquer Bidirectional Search: First Results. In IJCAI 99 . 1184--1191.","journal-title":"First Results. In IJCAI"},{"key":"e_1_3_2_2_18_1","volume-title":"On information and sufficiency. The annals of mathematical statistics","author":"Kullback Solomon","year":"1951","unstructured":"Solomon Kullback and Richard A Leibler . 1951. On information and sufficiency. The annals of mathematical statistics , Vol. 22 , 1 ( 1951 ), 79--86. Solomon Kullback and Richard A Leibler. 1951. On information and sufficiency. The annals of mathematical statistics , Vol. 22, 1 (1951), 79--86."},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.91"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2019.00046"},{"key":"e_1_3_2_2_21_1","first-page":"23","article-title":"Neural Symbolic Machines","volume":"2017","author":"Liang Chen","year":"2017","unstructured":"Chen Liang , Jonathan Berant , Quoc V. Le , Kenneth D. Forbus , and Ni Lao . 2017 . Neural Symbolic Machines : Learning Semantic Parsers on Freebase with Weak Supervision. In ACL 2017. 23 -- 33 . Chen Liang, Jonathan Berant, Quoc V. Le, Kenneth D. Forbus, and Ni Lao. 2017. Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision. In ACL 2017. 23--33.","journal-title":"Learning Semantic Parsers on Freebase with Weak Supervision. In ACL"},{"key":"e_1_3_2_2_22_1","volume-title":"Multi-Hop Knowledge Graph Reasoning with Reward Shaping. In EMNLP 2018 . 3243--3253","author":"Lin Xi Victoria","year":"2018","unstructured":"Xi Victoria Lin , Richard Socher , and Caiming Xiong . 2018 . Multi-Hop Knowledge Graph Reasoning with Reward Shaping. In EMNLP 2018 . 3243--3253 . Xi Victoria Lin, Richard Socher, and Caiming Xiong. 2018. Multi-Hop Knowledge Graph Reasoning with Reward Shaping. In EMNLP 2018 . 3243--3253."},{"key":"e_1_3_2_2_23_1","volume-title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR","author":"Liu Yinhan","year":"2019","unstructured":"Yinhan Liu , Myle Ott , Naman Goyal , Jingfei Du , Mandar Joshi , Danqi Chen , Omer Levy , Mike Lewis , Luke Zettlemoyer , and Veselin Stoyanov . 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR , Vol. abs\/ 1907 .11692 ( 2019 ). Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. CoRR , Vol. abs\/1907.11692 (2019)."},{"key":"e_1_3_2_2_24_1","volume-title":"Key-Value Memory Networks for Directly Reading Documents. In EMNLP 2016 .","author":"Miller Alexander H.","year":"2016","unstructured":"Alexander H. Miller , Adam Fisch , Jesse Dodge , Amir-Hossein Karimi , Antoine Bordes , and Jason Weston . 2016 . Key-Value Memory Networks for Directly Reading Documents. In EMNLP 2016 . Alexander H. Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Antoine Bordes, and Jason Weston. 2016. Key-Value Memory Networks for Directly Reading Documents. In EMNLP 2016 ."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1613"},{"key":"e_1_3_2_2_26_1","first-page":"1532","article-title":"Glove","volume":"2014","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington , Richard Socher , and Christopher D. Manning . 2014 . Glove : Global Vectors for Word Representation. In EMNLP 2014. 1532 -- 1543 . Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014. Glove: Global Vectors for Word Representation. In EMNLP 2014. 1532--1543.","journal-title":"Global Vectors for Word Representation. In EMNLP"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371812"},{"key":"e_1_3_2_2_28_1","volume-title":"FitNets: Hints for Thin Deep Nets. In ICLR 2015 .","author":"Romero Adriana","year":"2015","unstructured":"Adriana Romero , Nicolas Ballas , Samira Ebrahimi Kahou , Antoine Chassang , Carlo Gatta , and Yoshua Bengio . 2015 . FitNets: Hints for Thin Deep Nets. In ICLR 2015 . Adriana Romero, Nicolas Ballas, Samira Ebrahimi Kahou, Antoine Chassang, Carlo Gatta, and Yoshua Bengio. 2015. FitNets: Hints for Thin Deep Nets. In ICLR 2015 ."},{"key":"e_1_3_2_2_29_1","volume-title":"ACL","author":"Saxena Apoorv","year":"2020","unstructured":"Apoorv Saxena , Aditay Tripathi , and Partha P. Talukdar . 2020. Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base Embeddings . In ACL 2020 . 4498--4507. Apoorv Saxena, Aditay Tripathi, and Partha P. Talukdar. 2020. Improving Multi-hop Question Answering over Knowledge Graphs using Knowledge Base Embeddings. In ACL 2020. 4498--4507."},{"key":"e_1_3_2_2_30_1","volume-title":"PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Text. In EMNLP 2019 .","author":"Sun Haitian","unstructured":"Haitian Sun , Tania Bedrax-Weiss , and William W. Cohen . 2019 . PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Text. In EMNLP 2019 . Haitian Sun, Tania Bedrax-Weiss, and William W. Cohen. 2019. PullNet: Open Domain Question Answering with Iterative Retrieval on Knowledge Bases and Text. In EMNLP 2019 ."},{"key":"e_1_3_2_2_31_1","volume-title":"Open Domain Question Answering Using Early Fusion of Knowledge Bases and Text. In EMNLP 2018 . 4231--4242","author":"Sun Haitian","unstructured":"Haitian Sun , Bhuwan Dhingra , Manzil Zaheer , Kathryn Mazaitis , Ruslan Salakhutdinov , and William W. Cohen . 2018 . Open Domain Question Answering Using Early Fusion of Knowledge Bases and Text. In EMNLP 2018 . 4231--4242 . Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Kathryn Mazaitis, Ruslan Salakhutdinov, and William W. Cohen. 2018. Open Domain Question Answering Using Early Fusion of Knowledge Bases and Text. In EMNLP 2018 . 4231--4242."},{"key":"e_1_3_2_2_32_1","first-page":"641","article-title":"The Web as a Knowledge-Base for Answering Complex Questions","volume":"2018","author":"Talmor Alon","year":"2018","unstructured":"Alon Talmor and Jonathan Berant . 2018 . The Web as a Knowledge-Base for Answering Complex Questions . In NAACL-HLT 2018 . 641 -- 651 . Alon Talmor and Jonathan Berant. 2018. The Web as a Knowledge-Base for Answering Complex Questions. In NAACL-HLT 2018 . 641--651.","journal-title":"NAACL-HLT"},{"key":"e_1_3_2_2_33_1","volume-title":"ICLR 2018","author":"Petar Velivc","year":"2018","unstructured":"Petar Velivc kovi\u0107 , Guillem Cucurull , Arantxa Casanova , Adriana Romero , Pietro Li\u00f2 , and Yoshua Bengio . 2018 . Graph Attention Networks . ICLR 2018 (2018). Petar Velivc kovi\u0107 , Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li\u00f2 , and Yoshua Bengio. 2018. Graph Attention Networks . ICLR 2018 (2018)."},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1220"},{"key":"e_1_3_2_2_35_1","volume-title":"Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System. In WSDM","author":"Yang Ze","year":"2020","unstructured":"Ze Yang , Linjun Shou , Ming Gong , Wutao Lin , and Daxin Jiang . 2020 . Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System. In WSDM 2020. 690--698. Ze Yang, Linjun Shou, Ming Gong, Wutao Lin, and Daxin Jiang. 2020. Model Compression with Two-stage Multi-teacher Knowledge Distillation for Web Question Answering System. In WSDM 2020. 690--698."},{"key":"e_1_3_2_2_36_1","volume-title":"ACL 2015 .","author":"Chang Ming-Wei","year":"2015","unstructured":"Wen-tau Yih, Ming-Wei Chang , Xiaodong He , and Jianfeng Gao . 2015 . Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base . In ACL 2015 . Wen-tau Yih, Ming-Wei Chang, Xiaodong He, and Jianfeng Gao. 2015. Semantic Parsing via Staged Query Graph Generation: Question Answering with Knowledge Base. In ACL 2015 ."},{"key":"e_1_3_2_2_37_1","volume-title":"The Value of Semantic Parse Labeling for Knowledge Base Question Answering. In ACL 2016 .","author":"Richardson Matthew","year":"2016","unstructured":"Wen-tau Yih, Matthew Richardson , Christopher Meek , Ming-Wei Chang , and Jina Suh . 2016 . The Value of Semantic Parse Labeling for Knowledge Base Question Answering. In ACL 2016 . Wen-tau Yih, Matthew Richardson, Christopher Meek, Ming-Wei Chang, and Jina Suh. 2016. The Value of Semantic Parse Labeling for Knowledge Base Question Answering. In ACL 2016 ."},{"key":"e_1_3_2_2_38_1","volume-title":"Variational Reasoning for Question Answering with Knowledge Graph. In AAAI 2018 .","author":"Zhang Yuyu","year":"2018","unstructured":"Yuyu Zhang , Hanjun Dai , Zornitsa Kozareva , Alexander J Smola , and Le Song . 2018 a. Variational Reasoning for Question Answering with Knowledge Graph. In AAAI 2018 . Yuyu Zhang, Hanjun Dai, Zornitsa Kozareva, Alexander J Smola, and Le Song. 2018a. Variational Reasoning for Question Answering with Knowledge Graph. In AAAI 2018 ."},{"key":"e_1_3_2_2_39_1","volume-title":"Deep Mutual Learning. In CVPR","author":"Zhang Ying","year":"2018","unstructured":"Ying Zhang , Tao Xiang , Timothy M. Hospedales , and Huchuan Lu . 2018 b. Deep Mutual Learning. In CVPR 2018. 4320--4328. Ying Zhang, Tao Xiang, Timothy M. Hospedales, and Huchuan Lu. 2018b. Deep Mutual Learning. In CVPR 2018. 4320--4328."}],"event":{"name":"WSDM '21: The Fourteenth ACM International Conference on Web Search and Data Mining","location":"Virtual Event Israel","acronym":"WSDM '21","sponsor":["SIGMOD ACM Special Interest Group on Management of Data","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGKDD ACM Special Interest Group on Knowledge Discovery in Data","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 14th ACM International Conference on Web Search and Data Mining"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437963.3441753","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3437963.3441753","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:35Z","timestamp":1750193255000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3437963.3441753"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,8]]},"references-count":39,"alternative-id":["10.1145\/3437963.3441753","10.1145\/3437963"],"URL":"https:\/\/doi.org\/10.1145\/3437963.3441753","relation":{},"subject":[],"published":{"date-parts":[[2021,3,8]]},"assertion":[{"value":"2021-03-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}