{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:15:04Z","timestamp":1750306504312,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":23,"publisher":"ACM","license":[{"start":{"date-parts":[[2015,10,30]],"date-time":"2015-10-30T00:00:00Z","timestamp":1446163200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2015,10,30]]},"DOI":"10.1145\/2814815.2814819","type":"proceedings-article","created":{"date-parts":[[2016,10,25]],"date-time":"2016-10-25T12:46:35Z","timestamp":1477399595000},"page":"7-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Toward an Automatic Evaluation of Retrieval Performance with Large Scale Image Collections"],"prefix":"10.1145","author":[{"given":"Adrian","family":"Popescu","sequence":"first","affiliation":[{"name":"CEA LIST, Gif-sur-Yvette, France"}]},{"given":"Eleftherios","family":"Spyromitros-Xioufis","sequence":"additional","affiliation":[{"name":"CERTH-ITI, Thermi-Thessaloniki, Greece"}]},{"given":"Symeon","family":"Papadopoulos","sequence":"additional","affiliation":[{"name":"CERTH-ITI, Thermi-Thessaloniki, Greece"}]},{"given":"Herv\u00e9","family":"Le Borgne","sequence":"additional","affiliation":[{"name":"CEA LIST, Gif-sur-Yvette, France"}]},{"given":"Ioannis","family":"Kompatsiaris","sequence":"additional","affiliation":[{"name":"CERTH-ITI, Thermi-Thessaloniki, Greece"}]}],"member":"320","published-online":{"date-parts":[[2015,10,30]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2007.09.014"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661118.2661125"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1646396.1646452"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-014-0733-5"},{"key":"e_1_3_2_1_5_1","volume-title":"LREC","author":"Grubinger M.","year":"2006","unstructured":"M. Grubinger , P. Clough , H. M\u00fcller , and T. Deselaers . The iapr benchmark: A new evaluation resource for visual information systems . In LREC , Genoa, Italy , May 2006 . M. Grubinger, P. Clough, H. M\u00fcller, and T. Deselaers. The iapr benchmark: A new evaluation resource for visual information systems. In LREC, Genoa, Italy, May 2006."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1743384.1743475"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/2964398.2964456"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88682-2_24"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540039"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.235"},{"key":"e_1_3_2_1_11_1","volume-title":"Overview of the TAC2011 knowledge base population track. In TAC 2011 Proceedings Papers","author":"Ji H.","year":"2011","unstructured":"H. Ji , R. Grishman , and H. Dang . Overview of the TAC2011 knowledge base population track. In TAC 2011 Proceedings Papers , 2011 . H. Ji, R. Grishman, and H. Dang. Overview of the TAC2011 knowledge base population track. In TAC 2011 Proceedings Papers, 2011."},{"key":"e_1_3_2_1_12_1","volume-title":"Rank correlation methods","author":"Kendall M. G.","year":"1948","unstructured":"M. G. Kendall . Rank correlation methods . 1948 . M. G. Kendall. Rank correlation methods. 1948."},{"key":"e_1_3_2_1_13_1","series-title":"CEUR Workshop Proceedings","volume-title":"Working Notes Proceedings of the MediaEval 2014 Workshop","author":"Larson M. A.","year":"2014","unstructured":"M. A. Larson and al , editors. Working Notes Proceedings of the MediaEval 2014 Workshop , volume 1263 of CEUR Workshop Proceedings . CEUR-WS. org, 2014 . M. A. Larson and al, editors. Working Notes Proceedings of the MediaEval 2014 Workshop, volume 1263 of CEUR Workshop Proceedings. CEUR-WS.org, 2014."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029664.99615.94"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5540009"},{"key":"e_1_3_2_1_16_1","volume-title":"Cnn features off-the-shelf: an astounding baseline for recognition. CoRR, abs\/1403.6382","author":"Razavian A. S.","year":"2014","unstructured":"A. S. Razavian , H. Azizpour , J. Sullivan , and S. Carlsson . Cnn features off-the-shelf: an astounding baseline for recognition. CoRR, abs\/1403.6382 , 2014 . A. S. Razavian, H. Azizpour, J. Sullivan, and S. Carlsson. Cnn features off-the-shelf: an astounding baseline for recognition. CoRR, abs\/1403.6382, 2014."},{"key":"e_1_3_2_1_17_1","volume-title":"Imagenet large scale visual recognition challenge","author":"Russakovsky O.","year":"2014","unstructured":"O. Russakovsky and al. Imagenet large scale visual recognition challenge , 2014 . O. Russakovsky and al. Imagenet large scale visual recognition challenge, 2014."},{"key":"e_1_3_2_1_18_1","volume-title":"CoRR","author":"Simonyan K.","year":"2014","unstructured":"K. Simonyan and A. Zisserman . Very deep convolutional networks for large-scale image recognition . CoRR , 2014 . K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. CoRR, 2014."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.5555\/946247.946751"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2014.2329648"},{"key":"e_1_3_2_1_21_1","volume-title":"CLEF 2012 Evaluation Labs and Workshop","author":"Thomee B.","year":"2012","unstructured":"B. Thomee and A. Popescu . Overview of the imageclef 2012 flickr photo annotation and retrieval task . In CLEF 2012 Evaluation Labs and Workshop , Working Notes , 2012 . B. Thomee and A. Popescu. Overview of the imageclef 2012 flickr photo annotation and retrieval task. In CLEF 2012 Evaluation Labs and Workshop, Working Notes, 2012."},{"key":"e_1_3_2_1_22_1","volume-title":"The new data and new challenges in multimedia research. arXiv preprint arXiv:1503.01817","author":"Thomee B.","year":"2015","unstructured":"B. Thomee , D. A. Shamma , G. Friedland , B. Elizalde , K. Ni , D. Poland , D. Borth , and L.-J. Li . The new data and new challenges in multimedia research. arXiv preprint arXiv:1503.01817 , 2015 . B. Thomee, D. A. Shamma, G. Friedland, B. Elizalde, K. Ni, D. Poland, D. Borth, and L.-J. Li. The new data and new challenges in multimedia research. arXiv preprint arXiv:1503.01817, 2015."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2012.17"}],"event":{"name":"MM '15: ACM Multimedia Conference","sponsor":["SIGMM ACM Special Interest Group on Multimedia"],"location":"Brisbane Australia","acronym":"MM '15"},"container-title":["Proceedings of the 2015 Workshop on Community-Organized Multimodal Mining: Opportunities for Novel Solutions"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2814815.2814819","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2814815.2814819","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:48:53Z","timestamp":1750225733000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2814815.2814819"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,10,30]]},"references-count":23,"alternative-id":["10.1145\/2814815.2814819","10.1145\/2814815"],"URL":"https:\/\/doi.org\/10.1145\/2814815.2814819","relation":{},"subject":[],"published":{"date-parts":[[2015,10,30]]},"assertion":[{"value":"2015-10-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}