{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:21:58Z","timestamp":1750306918678,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":23,"publisher":"ACM","license":[{"start":{"date-parts":[[2012,10,29]],"date-time":"2012-10-29T00:00:00Z","timestamp":1351468800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2012,10,29]]},"DOI":"10.1145\/2396761.2396781","type":"proceedings-article","created":{"date-parts":[[2012,11,15]],"date-time":"2012-11-15T16:38:00Z","timestamp":1352997480000},"page":"125-134","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["Alternative assessor disagreement and retrieval depth"],"prefix":"10.1145","author":[{"given":"William","family":"Webber","sequence":"first","affiliation":[{"name":"University of Maryland, College Park, MD, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Praveen","family":"Chandar","sequence":"additional","affiliation":[{"name":"University of Delaware, Newark, DE, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ben","family":"Carterette","sequence":"additional","affiliation":[{"name":"University of Delaware, Newark, DE, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2012,10,29]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/383952.384007"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1076034.1076133"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1390334.1390447"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277805"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1277741.1277754"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835449.1835540"},{"key":"e_1_3_2_1_7_1","first-page":"303","volume-title":"Proc. 6th Text REtrieval Conference","author":"Cormack Gordon V.","year":"1997","unstructured":"Gordon V. Cormack , Charles L. A. Clarke , Christopher R. Palmer , and Samuel S. L. To . Passage-based refinement (MultiText experiments for TREC-6). In Ellen Voorhees and Donna Harman, editors , Proc. 6th Text REtrieval Conference , pages 303 -- 320 , Gaithersburg, Maryland, USA , November 1997 . NIST Special Publication 500--240. Gordon V. Cormack, Charles L. A. Clarke, Christopher R. Palmer, and Samuel S. L. To. Passage-based refinement (MultiText experiments for TREC-6). In Ellen Voorhees and Donna Harman, editors, Proc. 6th Text REtrieval Conference, pages 303--320, Gaithersburg, Maryland, USA, November 1997. NIST Special Publication 500--240."},{"key":"e_1_3_2_1_8_1","first-page":"95","article-title":"The relevance of relevance assessment","volume":"4","author":"Cuadra C.","year":"1967","unstructured":"C. Cuadra and R. Katter . The relevance of relevance assessment . Proc. American Documentation Institute , 4 : 95 -- 99 , 1967 . C. Cuadra and R. Katter. The relevance of relevance assessment. Proc. American Documentation Institute, 4: 95--99, 1967.","journal-title":"Proc. American Documentation Institute"},{"key":"e_1_3_2_1_9_1","first-page":"1","volume-title":"DESI IV: The ICAIL Workshop on Setting Standards for Searching Electronically Stored Information in Discovery Proceedings","author":"Maura","year":"2011","unstructured":"Maura R. Grossman and Gordon V. Cormack. Inconsistent assessment of responsiveness in e-discovery: difference of opinion or human error ? In DESI IV: The ICAIL Workshop on Setting Standards for Searching Electronically Stored Information in Discovery Proceedings , pages 1 -- 11 , Pittsburgh, PA, USA , June 2011 . Maura R. Grossman and Gordon V. Cormack. Inconsistent assessment of responsiveness in e-discovery: difference of opinion or human error? In DESI IV: The ICAIL Workshop on Setting Standards for Searching Electronically Stored Information in Discovery Proceedings, pages 1--11, Pittsburgh, PA, USA, June 2011."},{"key":"e_1_3_2_1_10_1","first-page":"1","volume-title":"Proc. 4th Text REtrieval Conference","author":"Harman Donna","year":"1995","unstructured":"Donna Harman . Overview of the fourth text REtrieval conference (TREC-4). In Donna Harman, editor , Proc. 4th Text REtrieval Conference , pages 1 -- 23 , Gaithersburg, Maryland, USA , November 1995 . NIST Special Publication 500--236. Donna Harman. Overview of the fourth text REtrieval conference (TREC-4). In Donna Harman, editor, Proc. 4th Text REtrieval Conference, pages 1--23, Gaithersburg, Maryland, USA, November 1995. NIST Special Publication 500--236."},{"key":"e_1_3_2_1_11_1","first-page":"965","article-title":"A comparison of goodness-of-fit tests for the logistic regression model. phStatistics","volume":"16","author":"Hosmer D. W.","year":"1997","unstructured":"D. W. Hosmer , T. Hosmer , S. le Cessie , and S. Lemeshow . A comparison of goodness-of-fit tests for the logistic regression model. phStatistics in Medicine , 16 : 965 -- 980 , 1997 . D. W. Hosmer, T. Hosmer, S. le Cessie, and S. Lemeshow. A comparison of goodness-of-fit tests for the logistic regression model. phStatistics in Medicine, 16: 965--980, 1997.","journal-title":"Medicine"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/258525.258587"},{"key":"e_1_3_2_1_13_1","first-page":"1","volume-title":"Baron. Overview of the TREC 2008 legal track. In Ellen Voorhees and Lori P. Buckland, editors, Proc. 17th Text REtrieval Conference","author":"Oard Douglas W.","year":"2008","unstructured":"Douglas W. Oard , Bruce Hedin , Stephen Tomlinson , and Jason R . Baron. Overview of the TREC 2008 legal track. In Ellen Voorhees and Lori P. Buckland, editors, Proc. 17th Text REtrieval Conference , pages 3: 1 -- 45 , Gaithersburg, Maryland, USA , November 2008 . NIST Special Publication 500--277. Douglas W. Oard, Bruce Hedin, Stephen Tomlinson, and Jason R. Baron. Overview of the TREC 2008 legal track. In Ellen Voorhees and Lori P. Buckland, editors, Proc. 17th Text REtrieval Conference, pages 3:1--45, Gaithersburg, Maryland, USA, November 2008. NIST Special Publication 500--277."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.v61:1"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.v58:13"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(97)00027-7"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401890.1401965"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/383952.383961"},{"key":"e_1_3_2_1_19_1","first-page":"9","volume-title":"Proc. 12th Australasian Document Computing Symposium","author":"Trotman Andrew","year":"2007","unstructured":"Andrew Trotman and Dylan Jenkinson . IR evaluation using multiple assessors per topic. In MingFang Wu, Andrew Turpin, and Amanda Spink, editors , Proc. 12th Australasian Document Computing Symposium , pages 9 -- 16 , Melbourne , December 2007 . Andrew Trotman and Dylan Jenkinson. IR evaluation using multiple assessors per topic. In MingFang Wu, Andrew Turpin, and Amanda Spink, editors, Proc. 12th Australasian Document Computing Symposium, pages 9--16, Melbourne, December 2007."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291017"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(00)00010-8"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1871437.1871508"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348465"}],"event":{"name":"CIKM'12: 21st ACM International Conference on Information and Knowledge Management","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Maui Hawaii USA","acronym":"CIKM'12"},"container-title":["Proceedings of the 21st ACM international conference on Information and knowledge management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2396761.2396781","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2396761.2396781","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:35:18Z","timestamp":1750235718000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2396761.2396781"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,10,29]]},"references-count":23,"alternative-id":["10.1145\/2396761.2396781","10.1145\/2396761"],"URL":"https:\/\/doi.org\/10.1145\/2396761.2396781","relation":{},"subject":[],"published":{"date-parts":[[2012,10,29]]},"assertion":[{"value":"2012-10-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}