{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:42:01Z","timestamp":1750308121204,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":46,"publisher":"ACM","license":[{"start":{"date-parts":[[2005,11,6]],"date-time":"2005-11-06T00:00:00Z","timestamp":1131235200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2005,11,6]]},"DOI":"10.1145\/1101149.1101358","type":"proceedings-article","created":{"date-parts":[[2006,2,6]],"date-time":"2006-02-06T15:52:40Z","timestamp":1139241160000},"page":"1014-1022","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":15,"title":["Evaluation axes for medical image retrieval systems"],"prefix":"10.1145","author":[{"given":"Henning","family":"M\u00fcller","sequence":"first","affiliation":[{"name":"University and Hospitals of Geneva, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Clough","sequence":"additional","affiliation":[{"name":"Sheffield University, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William","family":"Hersh","sequence":"additional","affiliation":[{"name":"OHSU, Portland, OR"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Deselaers","sequence":"additional","affiliation":[{"name":"Computer Science and Medical Informatics, RWTH Aachen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Lehmann","sequence":"additional","affiliation":[{"name":"Computer Science and Medical Informatics, RWTH Aachen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antoine","family":"Geissbuhler","sequence":"additional","affiliation":[{"name":"University and Hospitals of Geneva, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2005,11,6]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.895972"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/76.718510"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/938978.939161"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/253769.253798"},{"issue":"2","key":"e_1_3_2_1_5_1","first-page":"1","article-title":"a digital teaching files authoring environment","volume":"19","author":"Rosset Antoine","year":"2004","unstructured":"Antoine Rosset , Henning M\u00fcller , Martina Martins , Natalia Dfouni , Jean-Paul Vall\u00e9e , and Osman Ratib . Casimage project - a digital teaching files authoring environment . Journal of Thoracic Imaging , 19 ( 2 ): 1 -- 6 , 2004 .]] Antoine Rosset, Henning M\u00fcller, Martina Martins, Natalia Dfouni, Jean-Paul Vall\u00e9e, and Osman Ratib. Casimage project - a digital teaching files authoring environment. Journal of Thoracic Imaging, 19(2):1--6, 2004.]]","journal-title":"Journal of Thoracic Imaging"},{"key":"e_1_3_2_1_6_1","first-page":"882","volume-title":"Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA)","author":"Lowe Henry J.","year":"1998","unstructured":"Henry J. Lowe , Ilya Antipov , William Hersh , and Catherine Arnott Smith . Towards knowledge-based retrieval of medical images. The role of semantic indexing, image content representation and knowledge-based retrieval . In Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA) , pages 882 -- 886 , Nashville, TN, USA , October 1998 .]] Henry J. Lowe, Ilya Antipov, William Hersh, and Catherine Arnott Smith. Towards knowledge-based retrieval of medical images. The role of semantic indexing, image content representation and knowledge-based retrieval. In Proceedings of the Annual Symposium of the American Society for Medical Informatics (AMIA), pages 882--886, Nashville, TN, USA, October 1998.]]"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0895-6111(96)00013-4"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1136\/jamia.1997.0040184"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4379(95)98556-S"},{"issue":"2","key":"e_1_3_2_1_10_1","first-page":"171","article-title":"Content-based retrieval of medical images","volume":"11","author":"Petrakis Euripides G. M.","year":"2002","unstructured":"Euripides G. M. Petrakis . Content-based retrieval of medical images . International Journal of Computer Research , 11 ( 2 ): 171 -- 182 , 2002 .]] Euripides G. M. Petrakis. Content-based retrieval of medical images. International Journal of Computer Research, 11(2):171--182, 2002.]]","journal-title":"International Journal of Computer Research"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2281020126"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1055\/s-0038-1633877"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2003.11.024"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/146045829900500107"},{"key":"e_1_3_2_1_15_1","volume-title":"ASLIB Cranfield Research Project","author":"Cleverdon C. W.","year":"1966","unstructured":"C. W. Cleverdon , L. Mills , and M. Keen . Factors determining the performance of indexing systems. Technical report , ASLIB Cranfield Research Project , Cranfield , 1966 .]] C. W. Cleverdon, L. Mills, and M. Keen. Factors determining the performance of indexing systems. Technical report, ASLIB Cranfield Research Project, Cranfield, 1966.]]"},{"key":"e_1_3_2_1_16_1","volume-title":"Report on the need for and provision of an ideal information retrieval test collection","author":"Sparck Jones K.","year":"1975","unstructured":"K. Sparck Jones and C.J. van Rijsbergen . Report on the need for and provision of an ideal information retrieval test collection . British Library Research and Development Report 5266, Computer Laboratory, University of Cambridge , 1975 .]] K. Sparck Jones and C.J. van Rijsbergen. Report on the need for and provision of an ideal information retrieval test collection. British Library Research and Development Report 5266, Computer Laboratory, University of Cambridge, 1975.]]"},{"key":"e_1_3_2_1_17_1","first-page":"1","volume-title":"Proceedings of the first Text REtrieval Conference (TREC-1)","author":"Harman Donna","year":"1992","unstructured":"Donna Harman . Overview of the first Text REtrieval Conference (TREC-1) . In Proceedings of the first Text REtrieval Conference (TREC-1) , pages 1 -- 20 , Washington DC, USA , 1992 .]] Donna Harman. Overview of the first Text REtrieval Conference (TREC-1). In Proceedings of the first Text REtrieval Conference (TREC-1), pages 1--20, Washington DC, USA, 1992.]]"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1027527.1027678"},{"key":"e_1_3_2_1_19_1","volume-title":"Clough and Mark Sanderson. The CLEF 2003 cross language image retrieval task. In Proceedings of the Cross Language Evaluation Forum (CLEF 2003)","author":"Paul","year":"2004","unstructured":"Paul Clough and Mark Sanderson. The CLEF 2003 cross language image retrieval task. In Proceedings of the Cross Language Evaluation Forum (CLEF 2003) , 2004 - to appear.]] Paul Clough and Mark Sanderson. The CLEF 2003 cross language image retrieval task. In Proceedings of the Cross Language Evaluation Forum (CLEF 2003), 2004 - to appear.]]"},{"key":"e_1_3_2_1_20_1","volume-title":"The Challenge of Image and Video Retrieval (CIVR 2004","author":"Clough Paul","year":"2004","unstructured":"Paul Clough , Mark Sanderson , and Henning M\u00fcller . A proposal for the CLEF cross language image retrieval track (ImageCLEF) 2004 . In The Challenge of Image and Video Retrieval (CIVR 2004 ), Dublin, Ireland , July 2004 . Springer LNCS 3115.]] Paul Clough, Mark Sanderson, and Henning M\u00fcller. A proposal for the CLEF cross language image retrieval track (ImageCLEF) 2004. In The Challenge of Image and Video Retrieval (CIVR 2004), Dublin, Ireland, July 2004. Springer LNCS 3115.]]"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8655(00)00118-5"},{"key":"e_1_3_2_1_22_1","volume-title":"Proceedings of the Conference on Visual Information Systems (VISUAL 2004","author":"Grubinger Michael","year":"2004","unstructured":"Michael Grubinger and Clement Leung . Incremental benchmark development and administration . In Proceedings of the Conference on Visual Information Systems (VISUAL 2004 ), San Francisco, CA, USA , 2004 .]] Michael Grubinger and Clement Leung. Incremental benchmark development and administration. In Proceedings of the Conference on Visual Information Systems (VISUAL 2004), San Francisco, CA, USA, 2004.]]"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/521772.791886"},{"key":"e_1_3_2_1_24_1","volume-title":"Final MIRA Conference, Electronic Workshops in Computing, Glasgow, 14--16","author":"Sormunen Eero","year":"1999","unstructured":"Eero Sormunen , Marjo Markkula , and Kalervo J\u00e4rvelin . The perceived similarity of photos - seeking a solid basis for the evaluation of content-based retrieval algorithms . In Final MIRA Conference, Electronic Workshops in Computing, Glasgow, 14--16 April 1999 . The British Computer Society.]] Eero Sormunen, Marjo Markkula, and Kalervo J\u00e4rvelin. The perceived similarity of photos - seeking a solid basis for the evaluation of content-based retrieval algorithms. In Final MIRA Conference, Electronic Workshops in Computing, Glasgow, 14--16 April 1999. The British Computer Society.]]"},{"key":"e_1_3_2_1_25_1","first-page":"35","volume-title":"Image Databases and Multi-Media Search","author":"Mokhtarian Farzin","year":"1996","unstructured":"Farzin Mokhtarian , Sadegh Abbasi , and Josef Kittler . Efficient and robust retrieval by shape content through curvature scale space . In A. W. M. Smeulders and R. Jain, editors, Image Databases and Multi-Media Search , pages 35 -- 42 , Kruislaan 403, 1098 SJ Amsterdam, The Netherlands, August 1996 . Amsterdam University Press .]] Farzin Mokhtarian, Sadegh Abbasi, and Josef Kittler. Efficient and robust retrieval by shape content through curvature scale space. In A. W. M. Smeulders and R. Jain, editors, Image Databases and Multi-Media Search, pages 35--42, Kruislaan 403, 1098 SJ Amsterdam, The Netherlands, August 1996. Amsterdam University Press.]]"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026946"},{"key":"e_1_3_2_1_27_1","first-page":"276","volume-title":"Recherche d'Informations Assist\u00e9e par Ordinateur (RIAO'2000) Computer-Assisted Information Retrieval","author":"Westerveld Thijs","year":"2000","unstructured":"Thijs Westerveld . Image retrieval: Content versus context . In Recherche d'Informations Assist\u00e9e par Ordinateur (RIAO'2000) Computer-Assisted Information Retrieval , volume 1 , pages 276 -- 284 , Paris , France , April 12-14 2000 .]] Thijs Westerveld. Image retrieval: Content versus context. In Recherche d'Informations Assist\u00e9e par Ordinateur (RIAO'2000) Computer-Assisted Information Retrieval, volume 1, pages 276--284, Paris, France, April12-14 2000.]]"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/11519645_70"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/1018428.1020760"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/647060.714153"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/519931.791921"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.589215"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(95)00023-2"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.280.15.1347"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.5555\/647061.714444"},{"key":"e_1_3_2_1_36_1","article-title":"A review of and a framework for the thinking on the notion in information science","volume":"321","author":"Saracevic Tefko","year":"1975","unstructured":"Tefko Saracevic . Relevance : A review of and a framework for the thinking on the notion in information science . Journal of the American Society for Information Science, November\/December : 321-343 , 1975 .]] Tefko Saracevic. Relevance: A review of and a framework for the thinking on the notion in information science. Journal of the American Society for Information Science, November\/December:321-343, 1975.]]","journal-title":"Journal of the American Society for Information Science, November\/December"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(90)90050-C"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2001.990452"},{"key":"e_1_3_2_1_39_1","first-page":"2004","volume-title":"Jahrestagung der deutschen Gesellschaft f\u00fcr medizinische Informatik (GMDS","author":"M\u00fcller Henning","year":"2004","unstructured":"Henning M\u00fcller , Patrick Ruch , and Antoine Geissbuhler . Enriching content-based medical image retrieval with automatically extracted mesh terms . In Jahrestagung der deutschen Gesellschaft f\u00fcr medizinische Informatik (GMDS 2004 ), Innsbruck , Austria , sep 2004 .]] Henning M\u00fcller, Patrick Ruch, and Antoine Geissbuhler. Enriching content-based medical image retrieval with automatically extracted mesh terms. In Jahrestagung der deutschen Gesellschaft f\u00fcr medizinische Informatik (GMDS 2004), Innsbruck, Austria, sep 2004.]]"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-200303000-00002"},{"issue":"8","key":"e_1_3_2_1_41_1","first-page":"1520","article-title":"An internet-based nuclear medicine teaching file","volume":"36","author":"Wallis J. W.","year":"1995","unstructured":"J. W. Wallis , M. M. Miller , T. R. Miller , and T. H. Vreeland . An internet-based nuclear medicine teaching file . Journal of Nuclear Medicine , 36 ( 8 ): 1520 -- 1527 , 1995 .]] J. W. Wallis, M. M. Miller, T. R. Miller, and T. H. Vreeland. An internet-based nuclear medicine teaching file. Journal of Nuclear Medicine, 36(8):1520--1527, 1995.]]","journal-title":"Journal of Nuclear Medicine"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00292-003-0614-0"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compmedimag.2004.09.010"},{"key":"e_1_3_2_1_44_1","series-title":"Lecture Notes in Computer Science","volume-title":"Overview of the CLEF cross--language image retrieval track (ImageCLEF)","author":"Clough Paul","year":"2004","unstructured":"Paul Clough , Henning M\u00fcller , and Mark Sanderson . Overview of the CLEF cross--language image retrieval track (ImageCLEF) 2004 . In Carol Peters, Paul D. Clough, Gareth J. F. Jones, Julio Gonzalo, M. Kluck, and B. Magnini, editors, Multilingual Information Access for Text, Speech and Images: Result of the fifth CLEF evaluation campaign, Lecture Notes in Computer Science , Bath, England, 2005. Springer-Verlag .]] Paul Clough, Henning M\u00fcller, and Mark Sanderson. Overview of the CLEF cross--language image retrieval track (ImageCLEF) 2004. In Carol Peters, Paul D. Clough, Gareth J. F. Jones, Julio Gonzalo, M. Kluck, and B. Magnini, editors, Multilingual Information Access for Text, Speech and Images: Result of the fifth CLEF evaluation campaign, Lecture Notes in Computer Science, Bath, England, 2005. Springer-Verlag.]]"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1117\/12.480677"},{"key":"e_1_3_2_1_46_1","volume-title":"Slice of Life conference on Multimedia in Medical Education (SOL 2005","author":"Hersh William","year":"2005","unstructured":"William Hersh , Henning M\u00fcller , Paul Gorman , and Jeffery Jensen . Task analysis for evaluating image retrieval systems in the ImageCLEF biomedical image retrieval task . In Slice of Life conference on Multimedia in Medical Education (SOL 2005 ), Portland, OR, USA , June 2005 .]] William Hersh, Henning M\u00fcller, Paul Gorman, and Jeffery Jensen. Task analysis for evaluating image retrieval systems in the ImageCLEF biomedical image retrieval task. In Slice of Life conference on Multimedia in Medical Education (SOL 2005), Portland, OR, USA, June 2005.]]"}],"event":{"name":"MM05: 2005 13th Annual ACM International Conference on Multimedia","sponsor":["SIGGRAPH ACM Special Interest Group on Computer Graphics and Interactive Techniques","ACM Association for Computing Machinery","SIGMM ACM Special Interest Group on Multimedia"],"location":"Hilton Singapore","acronym":"MM05"},"container-title":["Proceedings of the 13th annual ACM international conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1101149.1101358","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1101149.1101358","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:08:20Z","timestamp":1750262900000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1101149.1101358"}},"subtitle":["the imageCLEF experience"],"short-title":[],"issued":{"date-parts":[[2005,11,6]]},"references-count":46,"alternative-id":["10.1145\/1101149.1101358","10.1145\/1101149"],"URL":"https:\/\/doi.org\/10.1145\/1101149.1101358","relation":{},"subject":[],"published":{"date-parts":[[2005,11,6]]},"assertion":[{"value":"2005-11-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}