{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T16:40:45Z","timestamp":1779122445080,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":14,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,7,25]],"date-time":"2020-07-25T00:00:00Z","timestamp":1595635200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2018YFC0831700"],"award-info":[{"award-number":["2018YFC0831700"]}]},{"name":"Beijing Academy of Artificial Intelligence?BAAI?"},{"name":"Natural Science Foundation of China","award":["Grant No. 61732008, 61532011, 61902209"],"award-info":[{"award-number":["Grant No. 61732008, 61532011, 61902209"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,7,25]]},"DOI":"10.1145\/3397271.3401325","type":"proceedings-article","created":{"date-parts":[[2020,7,25]],"date-time":"2020-07-25T07:50:08Z","timestamp":1595663408000},"page":"1941-1944","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["An Analysis of BERT in Document Ranking"],"prefix":"10.1145","author":[{"given":"Jingtao","family":"Zhan","sequence":"first","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology & Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiaxin","family":"Mao","sequence":"additional","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology & Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yiqun","family":"Liu","sequence":"additional","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology & Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min","family":"Zhang","sequence":"additional","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology & Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shaoping","family":"Ma","sequence":"additional","affiliation":[{"name":"Beijing National Research Center for Information Science and Technology & Tsinghua University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,7,25]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Understanding intermediate layers using linear classifier probes. arXiv preprint arXiv:1610.01644","author":"Alain Guillaume","year":"2016","unstructured":"Guillaume Alain and Yoshua Bengio . 2016. Understanding intermediate layers using linear classifier probes. arXiv preprint arXiv:1610.01644 ( 2016 ). Guillaume Alain and Yoshua Bengio. 2016. Understanding intermediate layers using linear classifier probes. arXiv preprint arXiv:1610.01644 (2016)."},{"key":"e_1_3_2_2_2_1","volume-title":"Manning","author":"Clark Kevin","year":"2019","unstructured":"Kevin Clark , Urvashi Khandelwal , Omer Levy , and Christopher D . Manning . 2019 . What Does BERT Look At? An Analysis of BERT's Attention. ArXiv , Vol. abs\/ 1906 .04341 (2019). Kevin Clark, Urvashi Khandelwal, Omer Levy, and Christopher D. Manning. 2019. What Does BERT Look At? An Analysis of BERT's Attention. ArXiv, Vol. abs\/1906.04341 (2019)."},{"key":"e_1_3_2_2_3_1","volume-title":"Deeper Text Understanding for IR with Contextual Neural Language Modeling. In SIGIR'19","author":"Dai Zhuyun","year":"2019","unstructured":"Zhuyun Dai and Jamie Callan . 2019 . Deeper Text Understanding for IR with Contextual Neural Language Modeling. In SIGIR'19 . Zhuyun Dai and Jamie Callan. 2019. Deeper Text Understanding for IR with Contextual Neural Language Modeling. In SIGIR'19."},{"key":"e_1_3_2_2_4_1","volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT.","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT. Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In NAACL-HLT."},{"key":"e_1_3_2_2_5_1","volume-title":"IJCNLP","author":"Ethayarajh Kawin","year":"2019","unstructured":"Kawin Ethayarajh . 2019 . How Contextual are Contextualized Word Representations . In IJCNLP 2019. Kawin Ethayarajh. 2019. How Contextual are Contextualized Word Representations. In IJCNLP 2019."},{"key":"e_1_3_2_2_6_1","volume-title":"A deep look into neural ranking models for information retrieval. Information Processing & Management","author":"Guo Jiafeng","year":"2019","unstructured":"Jiafeng Guo , Yixing Fan , Liang Pang , Liu Yang , Qingyao Ai , Hamed Zamani , Chen Wu , W Bruce Croft , and Xueqi Cheng . 2019. A deep look into neural ranking models for information retrieval. Information Processing & Management ( 2019 ), 102067. Jiafeng Guo, Yixing Fan, Liang Pang, Liu Yang, Qingyao Ai, Hamed Zamani, Chen Wu, W Bruce Croft, and Xueqi Cheng. 2019. A deep look into neural ranking models for information retrieval. Information Processing & Management (2019), 102067."},{"key":"e_1_3_2_2_7_1","volume-title":"Wallace","author":"Jain Sarthak","year":"2019","unstructured":"Sarthak Jain and Byron C . Wallace . 2019 . Attention is not Explanation. In NAACL-HLT. Sarthak Jain and Byron C. Wallace. 2019. Attention is not Explanation. In NAACL-HLT."},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Olga V. Kovaleva Alexey Romanov Anna Rogers and Anna Rumshisky. 2019. Revealing the Dark Secrets of BERT. In EMNLP\/IJCNLP.  Olga V. Kovaleva Alexey Romanov Anna Rogers and Anna Rumshisky. 2019. Revealing the Dark Secrets of BERT. In EMNLP\/IJCNLP.","DOI":"10.18653\/v1\/D19-1445"},{"key":"e_1_3_2_2_9_1","volume-title":"MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. ArXiv","author":"Nguyen Tri","year":"2016","unstructured":"Tri Nguyen , Mir Rosenberg , Xia Song , Jianfeng Gao , Saurabh Tiwary , Rangan Majumder , and Li Deng . 2016 . MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. ArXiv , Vol. abs\/ 1611 .09268 (2016). Tri Nguyen, Mir Rosenberg, Xia Song, Jianfeng Gao, Saurabh Tiwary, Rangan Majumder, and Li Deng. 2016. MS MARCO: A Human Generated MAchine Reading COmprehension Dataset. ArXiv, Vol. abs\/1611.09268 (2016)."},{"key":"e_1_3_2_2_10_1","volume-title":"Passage Re-ranking with BERT. ArXiv","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira and Kyunghyun Cho . 2019. Passage Re-ranking with BERT. ArXiv , Vol. abs\/ 1901 .04085 ( 2019 ). Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage Re-ranking with BERT. ArXiv, Vol. abs\/1901.04085 (2019)."},{"key":"e_1_3_2_2_11_1","volume-title":"Understanding the Behaviors of BERT in Ranking. ArXiv","author":"Qiao Yifan","year":"2019","unstructured":"Yifan Qiao , Chenyan Xiong , Zhenghao Liu , and Zhiyuan Liu . 2019. Understanding the Behaviors of BERT in Ranking. ArXiv , Vol. abs\/ 1904 .07531 ( 2019 ). Yifan Qiao, Chenyan Xiong, Zhenghao Liu, and Zhiyuan Liu. 2019. Understanding the Behaviors of BERT in Ranking. ArXiv, Vol. abs\/1904.07531 (2019)."},{"key":"e_1_3_2_2_12_1","unstructured":"Mukund Sundararajan Ankur Taly and Qiqi Yan. 2017. Axiomatic Attribution for Deep Networks. In ICML.  Mukund Sundararajan Ankur Taly and Qiqi Yan. 2017. Axiomatic Attribution for Deep Networks. In ICML."},{"key":"e_1_3_2_2_13_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is All you Need. In NIPS.  Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N. Gomez Lukasz Kaiser and Illia Polosukhin. 2017. Attention is All you Need. In NIPS."},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080721"}],"event":{"name":"SIGIR '20: The 43rd International ACM SIGIR conference on research and development in Information Retrieval","location":"Virtual Event China","acronym":"SIGIR '20","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397271.3401325","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3397271.3401325","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:41:39Z","timestamp":1750200099000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3397271.3401325"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,25]]},"references-count":14,"alternative-id":["10.1145\/3397271.3401325","10.1145\/3397271"],"URL":"https:\/\/doi.org\/10.1145\/3397271.3401325","relation":{},"subject":[],"published":{"date-parts":[[2020,7,25]]},"assertion":[{"value":"2020-07-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}