{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:17:34Z","timestamp":1750220254825,"version":"3.41.0"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,6,1]],"date-time":"2021-06-01T00:00:00Z","timestamp":1622505600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2021,6]]},"abstract":"<jats:p>The Information Retrieval Anthology, IR Anthology for short, is an endeavor to create a comprehensive collection of metadata and full texts of IR-related publications. We report on its first release, the use cases it can serve, as well as the challenges lying ahead to develop it towards a resource that serves the IR community for years to come. The IR Anthology's metadata browser and full text search engine are available at IR.webis.de.<\/jats:p>","DOI":"10.1145\/3476415.3476417","type":"journal-article","created":{"date-parts":[[2021,7,16]],"date-time":"2021-07-16T16:07:00Z","timestamp":1626451620000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["The information retrieval anthology 2021"],"prefix":"10.1145","volume":"55","author":[{"given":"Martin","family":"Potthast","sequence":"first","affiliation":[{"name":"Leipzig University"}]},{"given":"Benno","family":"Stein","sequence":"additional","affiliation":[{"name":"Bauhaus-Universit\u00e4t Weimar"}]},{"given":"Matthias","family":"Hagen","sequence":"additional","affiliation":[{"name":"Martin-Luther-Universit\u00e4t Halle-Wittenberg"}]}],"member":"320","published-online":{"date-parts":[[2021,7,16]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3166054.3166059"},{"key":"e_1_2_1_2_1","volume-title":"Digital Libraries","author":"Arms William Y.","year":"2000","unstructured":"William Y. Arms . Digital Libraries . MIT Press , 2000 . ISBN 0-262-01180-8. URL http:\/\/www.cs.cornell.edu\/wya\/DigLib\/. William Y. Arms. Digital Libraries. MIT Press, 2000. ISBN 0-262-01180-8. URL http:\/\/www.cs.cornell.edu\/wya\/DigLib\/."},{"key":"e_1_2_1_3_1","volume-title":"Common Conversational Community Prototype: Scholarly Conversational Assistant. CoRR, abs\/2001.06910","author":"Balog Krisztian","year":"2020","unstructured":"Krisztian Balog , Lucie Flekova , Matthias Hagen , Rosie Jones , Martin Potthast , Filip Radlinski , Mark Sanderson , Svitlana Vakulenko , and Hamed Zamani . Common Conversational Community Prototype: Scholarly Conversational Assistant. CoRR, abs\/2001.06910 , 2020 . URL https:\/\/arxiv.org\/abs\/2001.06910. Krisztian Balog, Lucie Flekova, Matthias Hagen, Rosie Jones, Martin Potthast, Filip Radlinski, Mark Sanderson, Svitlana Vakulenko, and Hamed Zamani. Common Conversational Community Prototype: Scholarly Conversational Assistant. CoRR, abs\/2001.06910, 2020. URL https:\/\/arxiv.org\/abs\/2001.06910."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00778-010-0208-4"},{"key":"e_1_2_1_5_1","volume-title":"Advances in Information Retrieval. 40th European Conference on IR Research (ECIR 2018","author":"Bevendorff Janek","year":"2018","unstructured":"Janek Bevendorff , Benno Stein , Matthias Hagen , and Martin Potthast . Elastic ChatNoir : Search Engine for the ClueWeb and the Common Crawl. In Leif Azzopardi, Allan Hanbury, Gabriella Pasi, and Benjamin Piwowarski, editors , Advances in Information Retrieval. 40th European Conference on IR Research (ECIR 2018 ), Lecture Notes in Computer Science, Berlin Heidelberg New York , March 2018 . Springer. Janek Bevendorff, Benno Stein, Matthias Hagen, and Martin Potthast. Elastic ChatNoir: Search Engine for the ClueWeb and the Common Crawl. In Leif Azzopardi, Allan Hanbury, Gabriella Pasi, and Benjamin Piwowarski, editors, Advances in Information Retrieval. 40th European Conference on IR Research (ECIR 2018), Lecture Notes in Computer Science, Berlin Heidelberg New York, March 2018. Springer."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1162\/qss\\_a\\_00018"},{"key":"e_1_2_1_7_1","first-page":"0036","article-title":"A Computer Program Just Ranked the Most Influential Bra","author":"Bohannon John","year":"2016","unstructured":"John Bohannon . A Computer Program Just Ranked the Most Influential Bra in Scientists of the Modern Era. Science , November 2016 . ISSN 0036 - 8075 , 1095--9203. doi: 10\/gh77gw. John Bohannon. A Computer Program Just Ranked the Most Influential Brain Scientists of the Modern Era. Science, November 2016. ISSN 0036-8075, 1095--9203. doi: 10\/gh77gw.","journal-title":"Scientists of the Modern Era. Science"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.699"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308558.3313685"},{"key":"e_1_2_1_10_1","volume-title":"As We May Think. The Atlantic Monthly, 176(1):101--108","author":"Bush Vannevar","year":"1945","unstructured":"Vannevar Bush . As We May Think. The Atlantic Monthly, 176(1):101--108 , 1945 . URL http:\/\/www.theatlantic.com\/unbound\/flashbks\/computer\/bushf.htm. Vannevar Bush. As We May Think. The Atlantic Monthly, 176(1):101--108, 1945. URL http:\/\/www.theatlantic.com\/unbound\/flashbks\/computer\/bushf.htm."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/227181.227186"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1038\/485564a"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054916.1054918"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/n19-4017"},{"issue":"3619","key":"e_1_2_1_15_1","first-page":"649","article-title":"Science Citation Index","volume":"144","author":"Garfield Eugene","year":"1964","unstructured":"Eugene Garfield . \" Science Citation Index \" -A New Dimension in Indexing. Science , 144 ( 3619 ): 649 -- 654 , May 1964 . ISSN 0036-8075, 1095--9203. doi: 10\/d9qt5m. Eugene Garfield. \"Science Citation Index\"-A New Dimension in Indexing. Science, 144(3619): 649--654, May 1964. ISSN 0036-8075, 1095--9203. doi: 10\/d9qt5m.","journal-title":"-A New Dimension in Indexing. Science"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-2504"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/276675.276685"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1038\/438554a"},{"key":"e_1_2_1_19_1","volume-title":"https:\/\/github.com\/kermitt2\/grobid","author":"GROBID.","year":"2008","unstructured":"GROBID. GROBID. https:\/\/github.com\/kermitt2\/grobid , 2008 -2021. GROBID. GROBID. https:\/\/github.com\/kermitt2\/grobid, 2008-2021."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-018-2958-5"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/2051073.2051108"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-30671-1\\_37"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3132847.3133097"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/337271.337274"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-019-03114-y"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1162\/qss\\_a\\_00022"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/eScience.2008.128"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1328964.1328966"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3451964.3451977"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3239570"},{"issue":"8","key":"e_1_2_1_31_1","first-page":"1002","article-title":"A Labor of Love","volume":"54","author":"Jackson Allyn","year":"2007","unstructured":"Allyn Jackson . A Labor of Love : The Mathematics Genealogy Project. Notices Of The American Mathematical Society , 54 ( 8 ): 1002 -- 1003 , 2007 . Allyn Jackson. A Labor of Love: The Mathematics Genealogy Project. Notices Of The American Mathematical Society, 54(8):1002--1003, 2007.","journal-title":"The Mathematics Genealogy Project. Notices Of The American Mathematical Society"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.3389\/fdigh.2019.00005"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.14778\/1687553.1687577"},{"issue":"5","key":"e_1_2_1_34_1","first-page":"256","article-title":"Internet Access to the National Library of Medicine. Effective clinical practice","volume":"3","author":"Lindberg D. A.","year":"2000","unstructured":"D. A. Lindberg . Internet Access to the National Library of Medicine. Effective clinical practice : ECP , 3 ( 5 ): 256 -- 260 , 2000 Sep-Oct. ISSN 1099-8128. D. A. Lindberg. Internet Access to the National Library of Medicine. Effective clinical practice: ECP, 3(5):256--260, 2000 Sep-Oct. ISSN 1099-8128.","journal-title":"ECP"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-main.447"},{"key":"e_1_2_1_36_1","volume-title":"The State of NLP Literature: A Diachronic Analysis of the ACL Anthology. CoRR, abs\/1911.03562","author":"Mohammad Saif M.","year":"2019","unstructured":"Saif M. Mohammad . The State of NLP Literature: A Diachronic Analysis of the ACL Anthology. CoRR, abs\/1911.03562 , 2019 . URL http:\/\/arxiv.org\/abs\/1911.03562. Saif M. Mohammad. The State of NLP Literature: A Diachronic Analysis of the ACL Anthology. CoRR, abs\/1911.03562, 2019. URL http:\/\/arxiv.org\/abs\/1911.03562."},{"key":"e_1_2_1_37_1","first-page":"868","volume-title":"Proceedings of The 12th Language Resources and Evaluation Conference, LREC","author":"Mohammad Saif M.","year":"2020","unstructured":"Saif M. Mohammad . NLP Scholar: A Dataset for Examining the State of NLP Research . In Nicoletta Calzolari, Fr\u00e9d\u00e9ric B\u00e9chet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, H\u00e9l\u00e8ne Mazo, Asunci\u00f3n Moreno, Jan Odijk, and Stelios Piperidis, editors, Proceedings of The 12th Language Resources and Evaluation Conference, LREC 2020 , Marseille, France, May 11-16, 2020, pages 868 -- 877 . European Language Resources Association , 2020a. URL https:\/\/www.aclweb.org\/anthology\/2020.lrec-1.109\/. Saif M. Mohammad. NLP Scholar: A Dataset for Examining the State of NLP Research. In Nicoletta Calzolari, Fr\u00e9d\u00e9ric B\u00e9chet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, H\u00e9l\u00e8ne Mazo, Asunci\u00f3n Moreno, Jan Odijk, and Stelios Piperidis, editors, Proceedings of The 12th Language Resources and Evaluation Conference, LREC 2020, Marseille, France, May 11-16, 2020, pages 868--877. European Language Resources Association, 2020a. URL https:\/\/www.aclweb.org\/anthology\/2020.lrec-1.109\/."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-demos.27"},{"key":"e_1_2_1_39_1","first-page":"218","volume-title":"Morrison. Explorations in Bibliography: Zotero Goes Public. Atla Summary of Proceedings","author":"Greg","year":"2019","unstructured":"Greg Morrison. Explorations in Bibliography: Zotero Goes Public. Atla Summary of Proceedings , pages 218 -- 221 , 2019 . ISSN 0066-0868. doi: 10\/gh77x8. Greg Morrison. Explorations in Bibliography: Zotero Goes Public. Atla Summary of Proceedings, pages 218--221, 2019. ISSN 0066-0868. doi: 10\/gh77x8."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1090\/noti1512"},{"key":"e_1_2_1_41_1","volume-title":"March","author":"Newbold Bryan","year":"2021","unstructured":"Bryan Newbold . Search Scholarly Materials Preserved in the Internet Archive , March 2021 . URL https:\/\/blog.archive.org\/2021\/03\/09\/search-scholarly-materials-preserved-in-the-internet-archive\/. Bryan Newbold. Search Scholarly Materials Preserved in the Internet Archive, March 2021. URL https:\/\/blog.archive.org\/2021\/03\/09\/search-scholarly-materials-preserved-in-the-internet-archive\/."},{"issue":"2","key":"e_1_2_1_42_1","first-page":"284","article-title":"ResearchGate","volume":"107","author":"O'Brien Kevin","year":"2019","unstructured":"Kevin O'Brien . Resource Review : ResearchGate . Journal of the Medical Library Association , 107 ( 2 ): 284 -- 285 , April 2019 . ISSN 1558-9439. doi: 10\/gh7rp4. Kevin O'Brien. Resource Review: ResearchGate. Journal of the Medical Library Association, 107(2):284--285, April 2019. ISSN 1558-9439. doi: 10\/gh7rp4.","journal-title":"Journal of the Medical Library Association"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-45442-5\\_61"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348429"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-22948-1\\_5"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3404835.3462798"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1031171.1031181"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/2002440.2002442"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740908.2742839"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5555\/3313195"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-12275-0_64"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.259.5099.1246"},{"key":"e_1_2_1_53_1","first-page":"49","volume-title":"Building an Argument Search Engine for the Web","author":"Wachsmuth Henning","year":"2017","unstructured":"Henning Wachsmuth , Martin Potthast , Khalid Al-Khatib , Yamen Ajjour , Jana Puschmann , Jiani Qu , Jonas Dorsch , Viorel Morari , Janek Bevendorff , and Benno Stein . Building an Argument Search Engine for the Web . In Kevin Ashley, Claire Cardie, Nancy Green, Iryna Gurevych, Ivan Habernal, Diane Litman, Georgios Petasis, Chris Reed, Noam Slonim, and Vern Walker, editors, 4th Workshop on Argument Mining (ArgMining 2017 ) at EMNLP, pages 49 -- 59 . Association for Computational Linguistics , September 2017. URL https:\/\/www.aclweb.org\/anthology\/W17-5106. Henning Wachsmuth, Martin Potthast, Khalid Al-Khatib, Yamen Ajjour, Jana Puschmann, Jiani Qu, Jonas Dorsch, Viorel Morari, Janek Bevendorff, and Benno Stein. Building an Argument Search Engine for the Web. In Kevin Ashley, Claire Cardie, Nancy Green, Iryna Gurevych, Ivan Habernal, Diane Litman, Georgios Petasis, Chris Reed, Noam Slonim, and Vern Walker, editors, 4th Workshop on Argument Mining (ArgMining 2017) at EMNLP, pages 49--59. Association for Computational Linguistics, September 2017. URL https:\/\/www.aclweb.org\/anthology\/W17-5106."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1162\/dint\\_a\\_00006"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359115.3359119"},{"key":"e_1_2_1_56_1","volume-title":"July","author":"Zaugg Holt","year":"2010","unstructured":"Holt Zaugg , Richard E. West , Isaku Tateishi , and Daniel L. Randall . Mendeley: Creating Communities of Scholarly Inquiry through Research Collaboration. TechTrends: Linking Research and Practice to Improve Learning, 55(1):32--36 , July 2010 . ISSN 8756-3894. doi: 10\/d4vbh8. Holt Zaugg, Richard E. West, Isaku Tateishi, and Daniel L. Randall. Mendeley: Creating Communities of Scholarly Inquiry through Research Collaboration. TechTrends: Linking Research and Practice to Improve Learning, 55(1):32--36, July 2010. ISSN 8756-3894. doi: 10\/d4vbh8."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.acl-demos.5"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-02511-3\\_2"}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476415.3476417","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3476415.3476417","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:30:45Z","timestamp":1750188645000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3476415.3476417"}},"subtitle":["inaugural status report and challenges ahead"],"short-title":[],"issued":{"date-parts":[[2021,6]]},"references-count":58,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,6]]}},"alternative-id":["10.1145\/3476415.3476417"],"URL":"https:\/\/doi.org\/10.1145\/3476415.3476417","relation":{},"ISSN":["0163-5840"],"issn-type":[{"type":"print","value":"0163-5840"}],"subject":[],"published":{"date-parts":[[2021,6]]},"assertion":[{"value":"2021-07-16","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}