{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T05:16:05Z","timestamp":1784178965384,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,26]],"date-time":"2021-10-26T00:00:00Z","timestamp":1635206400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Italian Ministry of Education and Research"},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/R018634\/1"],"award-info":[{"award-number":["EP\/R018634\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,26]]},"DOI":"10.1145\/3459637.3482013","type":"proceedings-article","created":{"date-parts":[[2021,10,30]],"date-time":"2021-10-30T18:34:11Z","timestamp":1635618851000},"page":"4526-4533","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":97,"title":["PyTerrier: Declarative Experimentation in Python from BM25 to Dense Retrieval"],"prefix":"10.1145","author":[{"given":"Craig","family":"Macdonald","sequence":"first","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicola","family":"Tonellotto","sequence":"additional","affiliation":[{"name":"University of Pisa, Pisa, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sean","family":"MacAvaney","sequence":"additional","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Iadh","family":"Ounis","sequence":"additional","affiliation":[{"name":"University of Glasgow, Glasgow, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,10,30]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.21236\/ADA460118"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582416"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331398"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939785"},{"key":"e_1_3_2_1_6_1","volume-title":"Manning","author":"Clark Kevin","year":"2020","unstructured":"Kevin Clark , Minh-Thang Luong , Quoc V. Le , and Christopher D . Manning . 2020 . ELECTRA : Pre-training Text Encoders as Discriminators Rather Than Generators. ArXiv , Vol. abs\/ 2003 .10555 (2020). Kevin Clark, Minh-Thang Luong, Quoc V. Le, and Christopher D. Manning. 2020. ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators. ArXiv, Vol. abs\/2003.10555 (2020)."},{"key":"e_1_3_2_1_7_1","volume-title":"Proceedings of TREC.","author":"Craswell Nick","year":"2020","unstructured":"Nick Craswell , Bhaskar Mitra , Emine Yilmaz , and Daniel Campos . 2020 . Overview of the TREC 2020 Deep Learning Track . In Proceedings of TREC. Nick Craswell, Bhaskar Mitra, Emine Yilmaz, and Daniel Campos. 2020. Overview of the TREC 2020 Deep Learning Track. In Proceedings of TREC."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1571941.1571986"},{"key":"e_1_3_2_1_9_1","volume-title":"arXiv","author":"Dai Zhuyun","year":"1910","unstructured":"Zhuyun Dai and Jamie Callan . 2019. Context-Aware Sentence\/ Passage Term Importance Estimation For First Stage Retrieval . arXiv 1910 .10687 (2019). Zhuyun Dai and Jamie Callan. 2019. Context-Aware Sentence\/Passage Term Importance Estimation For First Stage Retrieval. arXiv 1910.10687 (2019)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380258"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/3026877.3026899"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3402426"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331403"},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of ECIR.","author":"Hashemi Helia","unstructured":"Helia Hashemi , Mohammad Aliannejadi , Hamed Zamani , and W. Croft . 2020. ANTIQUE: A Non-factoid Question Answering Benchmark . In Proceedings of ECIR. Helia Hashemi, Mohammad Aliannejadi, Hamed Zamani, and W. Croft. 2020. ANTIQUE: A Non-factoid Question Answering Benchmark. In Proceedings of ECIR."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.emnlp-main.550"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/3294996.3295074"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401075"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308774.3308781"},{"key":"e_1_3_2_1_19_1","volume-title":"Pyserini: An Easy-to-Use Python Toolkit to Support Replicable IR Research with Sparse and Dense Representations. arXiv 2102.10073","author":"Lin Jimmy","year":"2021","unstructured":"Jimmy Lin , Xueguang Ma , Sheng-Chieh Lin , Jheng-Hong Yang , Ronak Pradeep , and Rodrigo Nogueira . 2021 . Pyserini: An Easy-to-Use Python Toolkit to Support Replicable IR Research with Sparse and Dense Representations. arXiv 2102.10073 (2021). Jimmy Lin, Xueguang Ma, Sheng-Chieh Lin, Jheng-Hong Yang, Ronak Pradeep, and Rodrigo Nogueira. 2021. Pyserini: An Easy-to-Use Python Toolkit to Support Replicable IR Research with Sparse and Dense Representations. arXiv 2102.10073 (2021)."},{"key":"e_1_3_2_1_20_1","volume-title":"Foundations and Trends in Information Retrieval","volume":"3","author":"Liu Tie-Yan","year":"2009","unstructured":"Tie-Yan Liu . 2009 . Learning to Rank for Information Retrieval . Foundations and Trends in Information Retrieval , Vol. 3 , 3 (2009). Tie-Yan Liu. 2009. Learning to Rank for Information Retrieval. Foundations and Trends in Information Retrieval, Vol. 3, 3 (2009)."},{"key":"e_1_3_2_1_21_1","volume-title":"OpenMatch: An Open-Source Package for Information Retrieval. arXiv 2102.00166","author":"Liu Zhenghao","year":"2021","unstructured":"Zhenghao Liu , Kaitao Zhang , Chenyan Xiong , and Zhiyuan Liu . 2021. OpenMatch: An Open-Source Package for Information Retrieval. arXiv 2102.00166 ( 2021 ). Zhenghao Liu, Kaitao Zhang, Chenyan Xiong, and Zhiyuan Liu. 2021. OpenMatch: An Open-Source Package for Information Retrieval. arXiv 2102.00166 (2021)."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371864"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401093"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401262"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331317"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3463254"},{"key":"e_1_3_2_1_27_1","volume-title":"Proceedings of OSIR at SIGIR.","author":"Macdonald Craig","year":"2012","unstructured":"Craig Macdonald , Richard McCreadie , Rodrygo LT Santos , and Iadh Ounis . 2012 . From Puppy to Maturity: Experiences in Developing Terrier . Proceedings of OSIR at SIGIR. Craig Macdonald, Richard McCreadie, Rodrygo LT Santos, and Iadh Ounis. 2012. From Puppy to Maturity: Experiences in Developing Terrier. Proceedings of OSIR at SIGIR."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3409256.3409829"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076115"},{"key":"e_1_3_2_1_30_1","volume-title":"Passage Re-ranking with BERT. arXiv","author":"Nogueira Rodrigo","year":"1901","unstructured":"Rodrigo Nogueira and Kyunghyun Cho . 2019. Passage Re-ranking with BERT. arXiv 1901 .04085 (2019). Rodrigo Nogueira and Kyunghyun Cho. 2019. Passage Re-ranking with BERT. arXiv 1901.04085 (2019)."},{"key":"e_1_3_2_1_31_1","volume-title":"From doc2query to docTTTTTquery. Online preprint","author":"Nogueira Rodrigo","year":"2019","unstructured":"Rodrigo Nogueira , Jimmy Lin , and AI Epistemic . 2019. From doc2query to docTTTTTquery. Online preprint ( 2019 ). Rodrigo Nogueira, Jimmy Lin, and AI Epistemic. 2019. From doc2query to docTTTTTquery. Online preprint (2019)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331184.3331399"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3455008"},{"key":"e_1_3_2_1_34_1","volume-title":"Project Jupyter: Computational Narratives as the Engine of Collaborative Data Science. Technical Report","author":"Perez Fernando","year":"2015","unstructured":"Fernando Perez and Brian E Granger . 2015 . Project Jupyter: Computational Narratives as the Engine of Collaborative Data Science. Technical Report . http:\/\/archive.ipython.org\/JupyterGrantNarrative-2015.pdf Fernando Perez and Brian E Granger. 2015. Project Jupyter: Computational Narratives as the Engine of Collaborative Data Science. Technical Report. http:\/\/archive.ipython.org\/JupyterGrantNarrative-2015.pdf"},{"key":"e_1_3_2_1_35_1","volume-title":"Using Word Embeddings for Automatic Query Expansion. arXiv 1606.07608","author":"Roy Dwaipayan","year":"2016","unstructured":"Dwaipayan Roy , Debjyoti Paul , Mandar Mitra , and Utpal Garain . 2016. Using Word Embeddings for Automatic Query Expansion. arXiv 1606.07608 ( 2016 ). Dwaipayan Roy, Debjyoti Paul, Mandar Mitra, and Utpal Garain. 2016. Using Word Embeddings for Automatic Query Expansion. arXiv 1606.07608 (2016)."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1561\/1500000057"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209978.3210065"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3471158.3472250"},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of TREC.","author":"Westerveid Thijs","year":"2002","unstructured":"Thijs Westerveid , Wessel Kraaij , and Djoerd Hiemstra . 2002 . Retrieving Web Pages using Content, Links, Urls and Anchors . In Proceedings of TREC. Thijs Westerveid, Wessel Kraaij, and Djoerd Hiemstra. 2002. Retrieving Web Pages using Content, Links, Urls and Anchors. In Proceedings of TREC."},{"key":"e_1_3_2_1_40_1","volume-title":"HuggingFace's Transformers: State-of-the-art Natural Language Processing. ArXiv","author":"Wolf Thomas","year":"2019","unstructured":"Thomas Wolf , Lysandre Debut , Victor Sanh , Julien Chaumond , Clement Delangue , Anthony Moi , Pierric Cistac , Tim Rault , R'emi Louf , Morgan Funtowicz , and Jamie Brew . 2019. HuggingFace's Transformers: State-of-the-art Natural Language Processing. ArXiv , Vol. abs\/ 1910 .03771 ( 2019 ). Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, R'emi Louf, Morgan Funtowicz, and Jamie Brew. 2019. HuggingFace's Transformers: State-of-the-art Natural Language Processing. ArXiv, Vol. abs\/1910.03771 (2019)."},{"key":"e_1_3_2_1_41_1","volume-title":"Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval. arXiv","author":"Xiong Lee","year":"2007","unstructured":"Lee Xiong , Chenyan Xiong , Ye Li , Kwok-Fung Tang , Jialin Liu , Paul Bennett , Junaid Ahmed , and Arnold Overwijk . 2020. Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval. arXiv 2007 .00808 (2020). Lee Xiong, Chenyan Xiong, Ye Li, Kwok-Fung Tang, Jialin Liu, Paul Bennett, Junaid Ahmed, and Arnold Overwijk. 2020. Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval. arXiv 2007.00808 (2020)."},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3077136.3080721"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371868"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.findings-emnlp.424"}],"event":{"name":"CIKM '21: The 30th ACM International Conference on Information and Knowledge Management","location":"Virtual Event Queensland Australia","acronym":"CIKM '21","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 30th ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3459637.3482013","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3459637.3482013","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:11Z","timestamp":1750188611000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3459637.3482013"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,26]]},"references-count":43,"alternative-id":["10.1145\/3459637.3482013","10.1145\/3459637"],"URL":"https:\/\/doi.org\/10.1145\/3459637.3482013","relation":{},"subject":[],"published":{"date-parts":[[2021,10,26]]},"assertion":[{"value":"2021-10-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}