{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,3]],"date-time":"2025-10-03T12:51:17Z","timestamp":1759495877351,"version":"3.40.3"},"publisher-location":"Berlin, Heidelberg","reference-count":22,"publisher":"Springer Berlin Heidelberg","isbn-type":[{"type":"print","value":"9783642192302"},{"type":"electronic","value":"9783642192319"}],"license":[{"start":{"date-parts":[[2011,1,1]],"date-time":"2011-01-01T00:00:00Z","timestamp":1293840000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"},{"start":{"date-parts":[[2011,1,1]],"date-time":"2011-01-01T00:00:00Z","timestamp":1293840000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springernature.com\/gp\/researchers\/text-and-data-mining"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2011]]},"DOI":"10.1007\/978-3-642-19231-9_3","type":"book-chapter","created":{"date-parts":[[2011,4,4]],"date-time":"2011-04-04T09:59:34Z","timestamp":1301911174000},"page":"69-85","source":"Crossref","is-referenced-by-count":16,"title":["Overview of Information Retrieval Evaluation"],"prefix":"10.1007","author":[{"given":"Ben","family":"Carterette","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ellen M.","family":"Voorhees","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","reference":[{"key":"3_CR1","first-page":"664","volume-title":"Proceedings of CIKM","author":"J Aslam","year":"2005","unstructured":"Aslam J, Yilmaz E, Pavlu V (2005) A geometric analysis and interpretation of R-precision. In: Proceedings of CIKM, pp 664\u2013671"},{"key":"3_CR2","unstructured":"Aslam JA, Pavlu V (2008) A practical sampling strategy for efficient retrieval evaluation. Northeastern University tech report"},{"key":"3_CR3","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1145\/860435.860507","volume-title":"SIGIR \u201903: Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval","author":"SM Beitzel","year":"2003","unstructured":"Beitzel SM, Jensen EC, Chowdhury A, Grossman D, Frieder O (2003) Using manually-built web directories for automatic evaluation of known-item retrieval. In: Callan J, Hawking D, Smeaton A (eds) SIGIR \u201903: Proceedings of the 26th annual international ACM SIGIR conference on research and development in information retrieval, July 28\u2013August 1. ACM, New York, pp 373\u2013374"},{"key":"3_CR4","doi-asserted-by":"crossref","unstructured":"Borlund P, Ruthven I (eds) (2008) Inf Process Manag 44(1). Special issue","DOI":"10.1016\/j.ipm.2007.03.006"},{"key":"3_CR5","doi-asserted-by":"publisher","first-page":"619","DOI":"10.1145\/1148170.1148284","volume-title":"SIGIR \u201906: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval","author":"C Buckley","year":"2006","unstructured":"Buckley C, Dimmick D, Soboroff I, Voorhees E (2006) Bias and the limits of pooling. In: Dumais ST, Efthimiadis EN, Hawking D, J\u00e4rvelin K (eds) SIGIR \u201906: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval, August 6\u2013August 11. ACM, New York, pp 619\u2013620"},{"key":"3_CR6","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1145\/1148170.1148219","volume-title":"SIGIR \u201906: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval","author":"B Carterette","year":"2006","unstructured":"Carterette B, Allan J, Sitaraman RK (2006) Minimal test collections for retrieval evaluation. In: Dumais ST, Efthimiadis EN, Hawking D, J\u00e4rvelin K (eds) SIGIR \u201906: Proceedings of the 29th annual international ACM SIGIR conference on research and development in information retrieval, August 6\u2013August 11. ACM, New York, pp 268\u2013275"},{"key":"3_CR7","volume-title":"Proceedings of the 18th text retrieval conference (TREC 2009)","author":"CLA Clarke","year":"2009","unstructured":"Clarke CLA, Craswell N, Soboroff I (2009) Overview of the TREC 2009 Web track. In: Voorhees EM, Buckland LP (eds) Proceedings of the 18th text retrieval conference (TREC 2009), Nov 2009. NIST, Gaithersburg"},{"key":"3_CR8","first-page":"98","volume-title":"Readings in information retrieval","author":"CW Cleverdon","year":"1997","unstructured":"Cleverdon CW, Mills J (1997) The testing of index language devices. In: Sp\u00e4rck Jones K, Willett P (eds) Readings in information retrieval. Morgan Kaufmann, San Francisco, pp 98\u2013110"},{"key":"3_CR9","doi-asserted-by":"publisher","first-page":"282","DOI":"10.1145\/290941.291009","volume-title":"SIGIR \u201998: Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval","author":"GV Cormack","year":"1998","unstructured":"Cormack GV, Palmer CR, Clarke CL (1998) Efficient construction of large test collections. In: Croft WB, Moffat A, van Rijsbergen CJ, Wilkinson R, Zobel J (eds) SIGIR \u201998: Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval, Aug 24\u201328. ACM, New York, pp 282\u2013289"},{"key":"3_CR10","first-page":"123","volume-title":"TREC: Experiment and evaluation in information retrieval","author":"ST Dumais","year":"2005","unstructured":"Dumais ST, Belkin NJ (2005) The TREC interactive tracks: Putting the user into search. In: Voorhees EM, Harman DK (eds) TREC: Experiment and evaluation in information retrieval. MIT Press, Cambridge, pp 123\u2013152"},{"key":"3_CR11","first-page":"247","volume-title":"Readings in information retrieval","author":"D Harman","year":"1997","unstructured":"Harman D (1997) The TREC conferences. In: Sp\u00e4rck Jones K, Willett P (eds) Readings in information retrieval. Morgan Kaufmann, San Francisco, pp 247\u2013256"},{"key":"3_CR12","first-page":"46","volume-title":"Proceedings of the 11th text retrieval conference (TREC 2002)","author":"D Harman","year":"2002","unstructured":"Harman D (2002) Overview of the TREC 2002 novelty track. In: Voorhees E (ed) Proceedings of the 11th text retrieval conference (TREC 2002), Nov 2002. NIST, Gaithersburg, pp 46\u201355"},{"key":"3_CR13","volume-title":"Proceedings of the 18th text retrieval conference (TREC 2009)","author":"M Lupu","year":"2009","unstructured":"Lupu M, Piroi F, Huang X, Zhu J, Tait J (2009) Overview of the TREC 2009 chemical IR track. In: Voorhees EM, Buckland LP (eds) Proceedings of the 18th text retrieval conference (TREC 2009), Nov 2009. NIST, Gaithersburg"},{"key":"3_CR14","volume-title":"Proceedings of the 9th text retrieval conference (TREC-9)","author":"S Robertson","year":"2000","unstructured":"Robertson S, Hull DA (2000) The TREC-9 filtering track final report. In: Voorhees EM, Harman DK (eds) Proceedings of the 9th text retrieval conference (TREC-9) Nov 2000. NIST, Gaithersburg"},{"key":"3_CR15","first-page":"60","volume-title":"Readings in information retrieval","author":"G Salton","year":"1997","unstructured":"Salton G, Lesk ME (1997) Computer evaluation of indexing and text processing. In: Sp\u00e4rck Jones K, Willett P (eds) Readings in information retrieval. Morgan Kaufmann, San Francisco, pp 60\u201384"},{"key":"3_CR16","first-page":"623","volume-title":"Proceedings of CIKM","author":"M Smucker","year":"2007","unstructured":"Smucker M, Allan J, Carterette B (2007) A comparison of statistical significance tests for information retrieval evaluation. In: Proceedings of CIKM, pp 623\u2013632"},{"issue":"1","key":"3_CR17","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1108\/eb026616","volume":"32","author":"K Sp\u00e4rck Jones","year":"1976","unstructured":"Sp\u00e4rck Jones K, van Rijsbergen CJ (1976) Information retrieval test collections. J Doc 32(1):59\u201375","journal-title":"J Doc"},{"key":"3_CR18","first-page":"59","volume-title":"Information retrieval experiment","author":"J Tague","year":"1981","unstructured":"Tague J (1981) The pragmatics of information retrieval evaluation. In: Sp\u00e4rck Jones K (ed) Information retrieval experiment. Buttersworth, London, pp 59\u2013102"},{"key":"3_CR19","first-page":"205","volume-title":"Readings in information retrieval","author":"J Tague-Sutcliffe","year":"1997","unstructured":"Tague-Sutcliffe J (1997) The pragmatics of information retrieval evaluation revisited. In: Sp\u00e4rck Jones K, Willett P (eds) Readings in information retrieval. Morgan Kaufmann, San Francisco, pp 205\u2013216"},{"key":"3_CR20","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1145\/290941.291017","volume-title":"SIGIR \u201998: Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval","author":"E Voorhees","year":"1998","unstructured":"Voorhees E (1998) Variations in relevance judgments and the measurement of retrieval effectiveness. In: Croft WB, Moffat A, van Rijsbergen CJ, Wilkinson R, Zobel J (eds) SIGIR \u201998: Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval, Aug 24\u201328. ACM, New York, pp 315\u2013323"},{"volume-title":"TREC: Experiment and evaluation in information retrieval","year":"2005","key":"3_CR21","unstructured":"Voorhees EM, Harman DK (eds) (2005) TREC: Experiment and evaluation in information retrieval. MIT Press, Cambridge"},{"key":"3_CR22","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1145\/290941.291014","volume-title":"SIGIR \u201998: Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval","author":"J Zobel","year":"1998","unstructured":"Zobel J (1998) How reliable are the results of large-scale information retrieval experiments? In: Croft WB, Moffat A, van Rijsbergen CJ, Wilkinson R, Zobel J (eds) SIGIR \u201998: Proceedings of the 21st annual international ACM SIGIR conference on research and development in information retrieval, Aug 24\u201328. ACM, New York, pp 307\u2013314"}],"container-title":["The Information Retrieval Series","Current Challenges in Patent Information Retrieval"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-642-19231-9_3","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,22]],"date-time":"2023-12-22T03:36:58Z","timestamp":1703216218000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-642-19231-9_3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011]]},"ISBN":["9783642192302","9783642192319"],"references-count":22,"URL":"https:\/\/doi.org\/10.1007\/978-3-642-19231-9_3","relation":{},"ISSN":["1387-5264"],"issn-type":[{"type":"print","value":"1387-5264"}],"subject":[],"published":{"date-parts":[[2011]]}}}