{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T16:11:46Z","timestamp":1769098306929,"version":"3.49.0"},"reference-count":22,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2008,9,3]],"date-time":"2008-09-03T00:00:00Z","timestamp":1220400000000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Digit Imaging"],"published-print":{"date-parts":[[2009,12]]},"DOI":"10.1007\/s10278-008-9154-8","type":"journal-article","created":{"date-parts":[[2008,9,2]],"date-time":"2008-09-02T19:49:53Z","timestamp":1220384993000},"page":"648-655","source":"Crossref","is-referenced-by-count":43,"title":["The ImageCLEFmed Medical Image Retrieval Task Test Collection"],"prefix":"10.1007","volume":"22","author":[{"given":"William","family":"Hersh","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Henning","family":"M\u00fcller","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jayashree","family":"Kalpathy-Cramer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2008,9,3]]},"reference":[{"key":"9154_CR1","unstructured":"Hersh WR et al: A qualitative task analysis of biomedical image use and retrieval. In: MUSCLE\/ImageCLEF Workshop on Image and Video Retrieval Evaluation. Vienna, Austria, 2005. http:\/\/muscle.prip.tuwien.ac.at\/workshop2005_proceedings\/hersh.pdf"},{"key":"9154_CR2","unstructured":"M\u00fcller H et al: Health care professionals\u2019 image use and search behaviour. In: Proceedings of Medical Informatics Europe 2006, Maastricht, The Netherlands, 2006, pp 24\u201332. http:\/\/www.sim.hcuge.ch\/medgift\/publications\/MIE2006_Mueller.pdf"},{"key":"9154_CR3","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1197\/jamia.M2082","volume":"13","author":"WR Hersh","year":"2006","unstructured":"Hersh WR, et al: Advancing biomedical image retrieval: Development and analysis of a test collection. J Am Med Inform Assoc 13:488\u2013496, 2006","journal-title":"J Am Med Inform Assoc"},{"key":"9154_CR4","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/B:INRT.0000009438.69013.fa","volume":"7","author":"M Braschler","year":"2004","unstructured":"Braschler M, Peters C: Cross-language evaluation forum: Objectives, results, achievements. Inf Retr 7:7\u201331, 2004","journal-title":"Inf Retr"},{"key":"9154_CR5","unstructured":"Voorhees EM, Harman DK, eds. TREC: Experiment and evaluation in information retrieval, Cambridge, MA: MIT, 2005"},{"key":"9154_CR6","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/0306-4573(94)00048-8","volume":"31","author":"K Sparck-Jones","year":"1995","unstructured":"Sparck-Jones K: Reflections on TREC. Inf Process Manag 31:291\u2013314, 1995","journal-title":"Inf Process Manag"},{"key":"9154_CR7","first-page":"53","volume-title":"TREC: Experiment and Evaluation in Information Retrieval","author":"C Buckley","year":"2005","unstructured":"Buckley C, Voorhees EM: Retrieval system evaluation. In: Voorhees EM, Harman DK Eds. TREC: Experiment and Evaluation in Information Retrieval. Cambridge, MA: MIT, 2005, pp. 53\u201375"},{"key":"9154_CR8","doi-asserted-by":"crossref","unstructured":"Hersh WR et al: OHSUMED: An interactive retrieval evaluation and new large test collection for research. In: Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. Springer, Dublin, Ireland, 1994, pp 192\u2013201","DOI":"10.1007\/978-1-4471-2099-5_20"},{"key":"9154_CR9","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/S0306-4573(00)00052-2","volume":"37","author":"WR Hersh","year":"2001","unstructured":"Hersh WR: Interactivity at the Text Retrieval Conference (TREC). Inf Process Manag 37:365\u2013366, 2001","journal-title":"Inf Process Manag"},{"key":"9154_CR10","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1186\/1747-5333-1-3","volume":"1","author":"WR Hersh","year":"2006","unstructured":"Hersh WR, et al: Enhancing access to the bibliome: The TREC 2004 Genomics Track. J Biomed Discov Collab 1:3, 2006. http:\/\/www.j-biomed-discovery.com\/content\/1\/1\/3","journal-title":"J Biomed Discov Collab"},{"key":"9154_CR11","unstructured":"Clough P et al: Overview of the ImageCLEF 2006 photographic retrieval and object annotation tasks. In: Evaluation of Multilingual and Multi-modal Information Retrieval\u2014Seventh Workshop of the Cross-Language Evaluation Forum, CLEF 2006. Springer Lecture Notes in Computer Science, Alicante, Spain, 2006. http:\/\/www.clef-campaign.org\/2006\/working_notes\/workingnotes2006\/cloughOCLEF2006.pdf"},{"key":"9154_CR12","volume-title":"Lucene in Action","author":"O Gospodnetic","year":"2005","unstructured":"Gospodnetic O, Hatcher E: Lucene in Action, Greenwich, CT: Manning, 2005"},{"key":"9154_CR13","doi-asserted-by":"crossref","unstructured":"M\u00fcller H et al: The use of MedGIFT and EasyIR for ImageCLEF 2005. In: Accessing Multilingual Information Repositories\u20146th Workshop of the Cross-Language Evaluation Forum, CLEF 2005. Springer Lecture Notes in Computer Science, Vienna, Austria, 2005, pp 724\u2013732","DOI":"10.1007\/11878773_79"},{"key":"9154_CR14","unstructured":"Kalpathy-Cramer J, Hersh W. Medical image retrieval and automatic annotation: OHSU at ImageCLEF 2007. In: Working Notes for the CLEF 2007 Workshop, Budapest, Hungary, 2007. http:\/\/www.billhersh.info\/imageclef-07-ohsu.pdf"},{"key":"9154_CR15","unstructured":"Kalpathy-Cramer J, Hersh W. Automatic image modality based classification and annotation to improve medical image retrieval. In: MEDINFO 2007\u2014Proceedings of the Twelfth World Congress on Health (Medical) Informatics. IOS, Brisbane, Australia, 2007, pp 1334\u20131338"},{"key":"9154_CR16","doi-asserted-by":"crossref","unstructured":"Chevallet JP, Lim JH, Radhouani S. A structured visual learning approach mixed with ontology dimensions for medical queries. In: 6th Workshop of the Cross-Language Evaluation Forum, CLEF 2005, Springer Lecture Notes in Computer Science, Springer, Vienna, Austria, 2005","DOI":"10.1007\/11878773_71"},{"key":"9154_CR17","unstructured":"Lacoste C, et al. IPAL knowledge-based medical Image retrieval in ImageCLEFmed 2006. In: Evaluation of Multilingual and Multi-modal Information Retrieval\u2014Seventh Workshop of the Cross-Language Evaluation Forum, CLEF 2006. Springer Lecture Notes in Computer Science, Alicante, Spain, 2006. http:\/\/www.clef-campaign.org\/2006\/working_notes\/workingnotes2006\/lacosteCLEF2006.pdf"},{"key":"9154_CR18","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1109\/TCSVT.2007.897114","volume":"17","author":"C Lacoste","year":"2007","unstructured":"Lacoste C, et al: Medical image retrieval based on knowledge-assisted text and image indexing. IEEE Trans Circ Syst Video Technol 17:889\u2013900, 2007","journal-title":"IEEE Trans Circ Syst Video Technol"},{"key":"9154_CR19","unstructured":"Deselaers T et al. FIRE in ImageCLEF 2007. In: Working Notes for the CLEF 2007 Workshop, Budapest, Hungary, 2007. http:\/\/www.clef-campaign.org\/2007\/working_notes\/deselaersCLEF2007.pdf"},{"key":"9154_CR20","doi-asserted-by":"crossref","unstructured":"Jensen J, Hersh W: Manual query modification and data fusion for medical image retrieval. In: Accessing Multilingual Information Repositories\u20146th Workshop of the Cross-Language Evaluation Forum, CLEF 2005. Springer Lecture Notes in Computer Science, Vienna, Austria, 2005, pp 673\u2013679. http:\/\/medir.ohsu.edu\/~hersh\/imageclef-OHSU-05.pdf .","DOI":"10.1007\/11878773_74"},{"key":"9154_CR21","doi-asserted-by":"crossref","unstructured":"Hersh W, Kalpathy-Cramer J, Jensen J. Medical image retrieval and automated annotation: OHSU at ImageCLEF 2006. In: Evaluation of Multilingual and Multi-modal Information Retrieval\u2014Seventh Workshop of the Cross-Language Evaluation Forum, CLEF 2006. Springer Lecture Notes in Computer Science, Alicante, Spain, 2006, pp 660\u2013669. http:\/\/www.clef-campaign.org\/2006\/working_notes\/workingnotes2006\/hershCLEF2006.pdf","DOI":"10.1007\/978-3-540-74999-8_81"},{"key":"9154_CR22","doi-asserted-by":"crossref","first-page":"1475","DOI":"10.2214\/AJR.06.1740","volume":"188","author":"CE Kahn","year":"2007","unstructured":"Kahn CE, Thao C: GoldMiner: A radiology image search engine. Am J Roentgenol 188:1475\u20131478, 2007","journal-title":"Am J Roentgenol"}],"container-title":["Journal of Digital Imaging"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-008-9154-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10278-008-9154-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10278-008-9154-8","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,5,29]],"date-time":"2019-05-29T12:01:44Z","timestamp":1559131304000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10278-008-9154-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,9,3]]},"references-count":22,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2009,12]]}},"alternative-id":["9154"],"URL":"https:\/\/doi.org\/10.1007\/s10278-008-9154-8","relation":{},"ISSN":["0897-1889","1618-727X"],"issn-type":[{"value":"0897-1889","type":"print"},{"value":"1618-727X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2008,9,3]]}}}