{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:29:41Z","timestamp":1750307381724,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":31,"publisher":"ACM","license":[{"start":{"date-parts":[[2010,3,29]],"date-time":"2010-03-29T00:00:00Z","timestamp":1269820800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2010,3,29]]},"DOI":"10.1145\/1743384.1743398","type":"proceedings-article","created":{"date-parts":[[2010,3,30]],"date-time":"2010-03-30T12:32:28Z","timestamp":1269952348000},"page":"35-44","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["Performance measures for multilabel evaluation"],"prefix":"10.1145","author":[{"given":"Stefanie","family":"Nowak","sequence":"first","affiliation":[{"name":"Fraunhofer IDMT, Ilmenau, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hanna","family":"Lukashevich","sequence":"additional","affiliation":[{"name":"Fraunhofer IDMT, Ilmenau, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Dunker","sequence":"additional","affiliation":[{"name":"Gracenote, Inc, Emeryville, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefan","family":"R\u00fcger","sequence":"additional","affiliation":[{"name":"Open University, Milton Keynes, England UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2010,3,29]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-7908-1624-8_71"},{"key":"e_1_3_2_1_2_1","volume-title":"Fraunhofer FIRST' Submission to ImageCLEF2009 Photo Annotation Task: Non-sparse Multiple Kernel Learning. CLEF working notes","author":"Binder A.","year":"2009","unstructured":"A. Binder and M. Kawanabe . Fraunhofer FIRST' Submission to ImageCLEF2009 Photo Annotation Task: Non-sparse Multiple Kernel Learning. CLEF working notes , 2009 . A. Binder and M. Kawanabe. Fraunhofer FIRST' Submission to ImageCLEF2009 Photo Annotation Task: Non-sparse Multiple Kernel Learning. CLEF working notes, 2009."},{"key":"e_1_3_2_1_3_1","first-page":"21","volume-title":"SIGKDD Workshop on Multi-Relational Data Mining","author":"Blockeel H.","year":"2002","unstructured":"H. Blockeel , M. Bruynooghe , S. Dzeroski , J. Ramon , and J. Struyf . Hierarchical multi-classification . In SIGKDD Workshop on Multi-Relational Data Mining , pages 21 -- 35 , 2002 . H. Blockeel, M. Bruynooghe, S. Dzeroski, J. Ramon, and J. Struyf. Hierarchical multi-classification. In SIGKDD Workshop on Multi-Relational Data Mining, pages 21--35, 2002."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248547.1248549"},{"key":"e_1_3_2_1_5_1","volume-title":"SZTAKI @ ImageCLEF","author":"Daroczy B.","year":"2009","unstructured":"B. Daroczy , I. Petras , A. Benczur , Z. Fekete , D. Nemeskey , D. Siklosi , and Z. Weiner . SZTAKI @ ImageCLEF 2009 . CLEF working notes, 2009. B. Daroczy, I. Petras, A. Benczur, Z. Fekete, D. Nemeskey, D. Siklosi, and Z. Weiner. SZTAKI @ ImageCLEF 2009. CLEF working notes, 2009."},{"key":"e_1_3_2_1_6_1","volume-title":"INRIA-LEARs participation to ImageCLEF","author":"Douze M.","year":"2009","unstructured":"M. Douze , M. Guillaumin , T. Mensink , C. Schmid , and J. Verbeek . INRIA-LEARs participation to ImageCLEF 2009 . CLEF working notes, 2009. M. Douze, M. Guillaumin, T. Mensink, C. Schmid, and J. Verbeek. INRIA-LEARs participation to ImageCLEF 2009. CLEF working notes, 2009."},{"key":"e_1_3_2_1_7_1","volume-title":"TIA-INAOE's Participation at ImageCLEF","author":"Escalante H.","year":"2009","unstructured":"H. Escalante , J. Gonzalez , C. Hernandez , A. Lopez , M. Montex , E. Morales , E. Ruiz , L. Sucar , and L. Villasenor . TIA-INAOE's Participation at ImageCLEF 2009 . CLEF working notes, 2009. H. Escalante, J. Gonzalez, C. Hernandez, A. Lopez, M. Montex, E. Morales, E. Ruiz, L. Sucar, and L. Villasenor. TIA-INAOE's Participation at ImageCLEF 2009. CLEF working notes, 2009."},{"key":"e_1_3_2_1_8_1","volume-title":"UPMC\/LIP6 at ImageCLEF annotation >2009: Large Scale Visual Concept Detection and Annotation. CLEF working notes","author":"Fakeri-Tabrizi A.","year":"2009","unstructured":"A. Fakeri-Tabrizi , S. Tollari , L. Denoyer , and P. Gallinari . UPMC\/LIP6 at ImageCLEF annotation >2009: Large Scale Visual Concept Detection and Annotation. CLEF working notes , 2009 . A. Fakeri-Tabrizi, S. Tollari, L. Denoyer, and P. Gallinari. UPMC\/LIP6 at ImageCLEF annotation >2009: Large Scale Visual Concept Detection and Annotation. CLEF working notes, 2009."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2007.911775"},{"key":"e_1_3_2_1_10_1","volume-title":"TELECOM ParisTech at ImageClef 2009: Large Scale Visual Concept Detection and Annotation Task. CLEF working notes","author":"Ferecatu M.","year":"2009","unstructured":"M. Ferecatu and H. Sahbi . TELECOM ParisTech at ImageClef 2009: Large Scale Visual Concept Detection and Annotation Task. CLEF working notes , 2009 . M. Ferecatu and H. Sahbi. TELECOM ParisTech at ImageClef 2009: Large Scale Visual Concept Detection and Annotation Task. CLEF working notes, 2009."},{"key":"e_1_3_2_1_11_1","volume-title":"Methodologies","author":"Freitas A.","year":"2007","unstructured":"A. Freitas and A. de Carvalho . A tutorial on hierarchical classification with applications in bioinformatics. Intelligent Information Technologies: Concepts , Methodologies , Tools and Applications , 2007 . A. Freitas and A. de Carvalho. A tutorial on hierarchical classification with applications in bioinformatics. Intelligent Information Technologies: Concepts, Methodologies, Tools and Applications, 2007."},{"key":"e_1_3_2_1_12_1","volume-title":"Comparison of Various AVEIR Visual Concept Detectors with an Index of Carefulness. CLEF working notes","author":"Glotin H.","year":"2009","unstructured":"H. Glotin , A. Fakeri-Tabrizi , P. Mulhem , M. Ferecatu , Z. Zhao , S. Tollari , G. Quenot , H. Sahbi , E. Dumont , and P. Gallinari . Comparison of Various AVEIR Visual Concept Detectors with an Index of Carefulness. CLEF working notes , 2009 . H. Glotin, A. Fakeri-Tabrizi, P. Mulhem, M. Ferecatu, Z. Zhao, S. Tollari, G. Quenot, H. Sahbi, E. Dumont, and P. Gallinari. Comparison of Various AVEIR Visual Concept Detectors with an Index of Carefulness. CLEF working notes, 2009."},{"key":"e_1_3_2_1_13_1","volume-title":"IAM@ImageCLEF Photo Annotation 2009: Naive application of a linear algebraic semantic space. CLEF working notes","author":"Hare J.","year":"2009","unstructured":"J. Hare and P. Lewis . IAM@ImageCLEF Photo Annotation 2009: Naive application of a linear algebraic semantic space. CLEF working notes , 2009 . J. Hare and P. Lewis. IAM@ImageCLEF Photo Annotation 2009: Naive application of a linear algebraic semantic space. CLEF working notes, 2009."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460096.1460104"},{"key":"e_1_3_2_1_15_1","volume-title":"UAIC at ImageCLEF 2009 Photo Annotation Task. CLEF working notes","author":"Iftene A.","year":"2009","unstructured":"A. Iftene , L. Vamanu , and C. Croitoru . UAIC at ImageCLEF 2009 Photo Annotation Task. CLEF working notes , 2009 . A. Iftene, L. Vamanu, and C. Croitoru. UAIC at ImageCLEF 2009 Photo Annotation Task. CLEF working notes, 2009."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2007.367194"},{"key":"e_1_3_2_1_17_1","volume-title":"MMIS at ImageCLEF 2009: Non-parametric Density Estimation Algorithms. CLEF working notes","author":"Llorente A.","year":"2009","unstructured":"A. Llorente , S. Little , and S. R\u00fcger . MMIS at ImageCLEF 2009: Non-parametric Density Estimation Algorithms. CLEF working notes , 2009 . A. Llorente, S. Little, and S. R\u00fcger. MMIS at ImageCLEF 2009: Non-parametric Density Estimation Algorithms. CLEF working notes, 2009."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btg153"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/850924.851523"},{"key":"e_1_3_2_1_20_1","volume-title":"An Introduction to Information Retrieval {Draft}","author":"Manning C.","year":"2009","unstructured":"C. Manning , P. Raghavan , and H. Sch\u00fctze . An Introduction to Information Retrieval {Draft} . Cambridge, UK : Cambridge University Press , April 2009 . http:\/\/www.informationretrieval.org\/. C. Manning, P. Raghavan, and H. Sch\u00fctze. An Introduction to Information Retrieval {Draft}. Cambridge, UK: Cambridge University Press, April 2009. http:\/\/www.informationretrieval.org\/."},{"key":"e_1_3_2_1_21_1","volume-title":"MRIM-LIG at ImageCLEF 2009: Photo Retrieval and Photo Annotation tasks. CLEF working notes","author":"Mulhem P.","year":"2009","unstructured":"P. Mulhem , J.-P. Chevallet , G. Quenon , and R. Al Batal . MRIM-LIG at ImageCLEF 2009: Photo Retrieval and Photo Annotation tasks. CLEF working notes , 2009 . P. Mulhem, J.-P. Chevallet, G. Quenon, and R. Al Batal. MRIM-LIG at ImageCLEF 2009: Photo Retrieval and Photo Annotation tasks. CLEF working notes, 2009."},{"key":"e_1_3_2_1_22_1","volume-title":"I2R ImageCLEF Photo Annotation 2009 Working Notes. CLEF working notes","author":"Ngiam J.","year":"2009","unstructured":"J. Ngiam and H. Goh . I2R ImageCLEF Photo Annotation 2009 Working Notes. CLEF working notes , 2009 . J. Ngiam and H. Goh. I2R ImageCLEF Photo Annotation 2009 Working Notes. CLEF working notes, 2009."},{"key":"e_1_3_2_1_23_1","volume-title":"THESEUS\/ImageCLEF Pre-Workshop","author":"Nowak S.","year":"2009","unstructured":"S. Nowak and P. Dunker . A Consumer Photo Tagging Ontology: Concepts and Annotations . In THESEUS\/ImageCLEF Pre-Workshop , 2009 . S. Nowak and P. Dunker. A Consumer Photo Tagging Ontology: Concepts and Annotations. In THESEUS\/ImageCLEF Pre-Workshop, 2009."},{"key":"e_1_3_2_1_24_1","volume-title":"Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task. CLEF working notes","author":"Nowak S.","year":"2009","unstructured":"S. Nowak and P. Dunker . Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task. CLEF working notes , 2009 . S. Nowak and P. Dunker. Overview of the CLEF 2009 Large-Scale Visual Concept Detection and Annotation Task. CLEF working notes, 2009."},{"key":"e_1_3_2_1_25_1","volume-title":"Proc. of IRMLeS Workshop, ESWC","author":"Nowak S.","year":"2009","unstructured":"S. Nowak and H. Lukashevich . Multilabel Classification Evaluation using Ontology Information . In Proc. of IRMLeS Workshop, ESWC , 2009 . S. Nowak and H. Lukashevich. Multilabel Classification Evaluation using Ontology Information. In Proc. of IRMLeS Workshop, ESWC, 2009."},{"key":"e_1_3_2_1_26_1","volume-title":"Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language. Journal of artificial intelligence research","author":"Resnik P.","year":"1999","unstructured":"P. Resnik . Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language. Journal of artificial intelligence research , 1999 . P. Resnik. Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language. Journal of artificial intelligence research, 1999."},{"key":"e_1_3_2_1_27_1","volume-title":"Joint Contribution of Global and Local Features for Image Annotation. CLEF working notes","author":"Sarin S.","year":"2009","unstructured":"S. Sarin and W. Kameyama . Joint Contribution of Global and Local Features for Image Annotation. CLEF working notes , 2009 . S. Sarin and W. Kameyama. Joint Contribution of Global and Local Features for Image Annotation. CLEF working notes, 2009."},{"key":"e_1_3_2_1_28_1","volume-title":"Intern. Symp. on Electronic Imaging","author":"Shen X.","year":"2004","unstructured":"X. Shen , M. Boutell , J. Luo , and C. Brown . Multi-label machine learning and its application to semantic scene classification . In Intern. Symp. on Electronic Imaging , San Jose, CA , 2004 . X. Shen, M. Boutell, J. Luo, and C. Brown. Multi-label machine learning and its application to semantic scene classification. In Intern. Symp. on Electronic Imaging, San Jose, CA, 2004."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-74958-5_38"},{"key":"e_1_3_2_1_30_1","volume-title":"The University of Amsterdam's Concept Detection System at ImageCLEF","author":"van de Sande K.","year":"2009","unstructured":"K. van de Sande , T. Gevers , and A. Smeulders . The University of Amsterdam's Concept Detection System at ImageCLEF 2009 . CLEF working notes, 2009. K. van de Sande, T. Gevers, and A. Smeulders. The University of Amsterdam's Concept Detection System at ImageCLEF 2009. CLEF working notes, 2009."},{"key":"e_1_3_2_1_31_1","volume-title":"LSIS Scale Photo Annotations: Discriminant Features SVM versus Visual Dictionary based on Image Frequency. CLEF working notes","author":"Zhao Z.-Q.","year":"2009","unstructured":"Z.-Q. Zhao , H. Glotin , and E. Dumont . LSIS Scale Photo Annotations: Discriminant Features SVM versus Visual Dictionary based on Image Frequency. CLEF working notes , 2009 . Z.-Q. Zhao, H. Glotin, and E. Dumont. LSIS Scale Photo Annotations: Discriminant Features SVM versus Visual Dictionary based on Image Frequency. CLEF working notes, 2009."}],"event":{"name":"MIR '10: International Conference on Multimedia Information Retrieval","sponsor":["SIGMM ACM Special Interest Group on Multimedia"],"location":"Philadelphia Pennsylvania USA","acronym":"MIR '10"},"container-title":["Proceedings of the international conference on Multimedia information retrieval"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1743384.1743398","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1743384.1743398","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:23:18Z","timestamp":1750245798000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1743384.1743398"}},"subtitle":["a case study in the area of image classification"],"short-title":[],"issued":{"date-parts":[[2010,3,29]]},"references-count":31,"alternative-id":["10.1145\/1743384.1743398","10.1145\/1743384"],"URL":"https:\/\/doi.org\/10.1145\/1743384.1743398","relation":{},"subject":[],"published":{"date-parts":[[2010,3,29]]},"assertion":[{"value":"2010-03-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}