{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:49:52Z","timestamp":1750308592478,"version":"3.41.0"},"reference-count":14,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2016,1,29]],"date-time":"2016-01-29T00:00:00Z","timestamp":1454025600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2016,1,29]]},"abstract":"<jats:p>This is a report on the sixth edition of the Conference and Labs of the Evaluation Forum (CLEF 2015), held in early September 2015, in Toulouse, France. CLEF was a four day event combining a Conference and an Evaluation Forum. The focus of the Conference is \"Experimental IR\" as carried out in the CLEF Labs and other evaluation forums, it featured keynotes by Greg Greffenstette, Mounia Lalmas, and Doug Oard, and 43 papers have been presented, covering a wide range of topics. There were a total of eight Labs: eHealth, ImageCLEF, LifeCLEF, Living Labs for IR, NEWSREEL, PAN, QA, and Social Book Search, addressing a wide range of tasks, media, languages, and ways to go beyond standard test collections.<\/jats:p>","DOI":"10.1145\/2888422.2888428","type":"journal-article","created":{"date-parts":[[2016,2,1]],"date-time":"2016-02-01T20:37:54Z","timestamp":1454359074000},"page":"47-56","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Report on CLEF 2015"],"prefix":"10.1145","volume":"49","author":[{"given":"Linda","family":"Cappellato","sequence":"first","affiliation":[{"name":"University of Padua, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicola","family":"Ferro","sequence":"additional","affiliation":[{"name":"University of Padua, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gareth J.F.","family":"Jones","sequence":"additional","affiliation":[{"name":"Dublin City University, Ireland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jaap","family":"Kamps","sequence":"additional","affiliation":[{"name":"University of Amsterdam, The Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Josiane","family":"Mothe","sequence":"additional","affiliation":[{"name":"IRIT, Universit\u00e9 de Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karen","family":"Pinel-Sauvagnat","sequence":"additional","affiliation":[{"name":"IRIT, Universit\u00e9 de Toulouse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric","family":"San Juan","sequence":"additional","affiliation":[{"name":"Universit\u00e9 d'Avignon et des Pays du Vaucluse, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jacques","family":"Savoy","sequence":"additional","affiliation":[{"name":"University of Neuch\u00e2tel, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2016,1,29]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"193","volume-title":"Mothe et al. {9}","author":"Abnar S.","unstructured":"S. Abnar , M. Dehghani , and A. Shakery . Meta text aligner: Text alignment based on predicted plagiarism relation . In Mothe et al. {9} , pages 193 -- 199 . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_16. 10.1007\/978-3-319-24027-5_16 S. Abnar, M. Dehghani, and A. Shakery. Meta text aligner: Text alignment based on predicted plagiarism relation. In Mothe et al. {9}, pages 193--199. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_16."},{"key":"e_1_2_1_2_1","first-page":"327","volume-title":"Mothe et al. {9}","author":"Bud\u00edkov\u00e1 P.","unstructured":"P. Bud\u00edkov\u00e1 , M. Batko , J. Botorek , and P. Zezula . Search-based image annotation: Extracting semantics from similar images . In Mothe et al. {9} , pages 327 -- 339 . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_36. 10.1007\/978-3-319-24027-5_36 P. Bud\u00edkov\u00e1, M. Batko, J. Botorek, and P. Zezula. Search-based image annotation: Extracting semantics from similar images. In Mothe et al. {9}, pages 327--339. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_36."},{"key":"e_1_2_1_3_1","series-title":"CEUR Workshop Proceedings","volume-title":"Working Notes of CLEF 2015 - Conference and Labs of the Evaluation forum","author":"Cappellato L.","year":"2015","unstructured":"L. Cappellato , N. Ferro , G. J. F. Jones , and E. SanJuan , editors. Working Notes of CLEF 2015 - Conference and Labs of the Evaluation forum , Toulouse, France , September 8-11, 2015 , volume 1391 of CEUR Workshop Proceedings , 2015. CEUR-WS.org. URL http:\/\/ceur-ws.org\/Vol-1391. L. Cappellato, N. Ferro, G. J. F. Jones, and E. SanJuan, editors. Working Notes of CLEF 2015 - Conference and Labs of the Evaluation forum, Toulouse, France, September 8-11, 2015, volume 1391 of CEUR Workshop Proceedings, 2015. CEUR-WS.org. URL http:\/\/ceur-ws.org\/Vol-1391."},{"key":"e_1_2_1_4_1","first-page":"352","volume-title":"Mothe et al. {9}","author":"Ermakova L.","unstructured":"L. Ermakova . A method for short message contextualization: Experiments at CLEF\/INEX . In Mothe et al. {9} , pages 352 -- 363 . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_38. 10.1007\/978-3-319-24027-5_38 L. Ermakova. A method for short message contextualization: Experiments at CLEF\/INEX. In Mothe et al. {9}, pages 352--363. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_38."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2701583.2701587"},{"key":"e_1_2_1_6_1","first-page":"31","volume-title":"CLEF 2014, Sheffield, UK, September 15-18, 2014. Proceedings","author":"Ferro N.","year":"2014","unstructured":"N. Ferro and G. Silvello . CLEF 15th birthday: What can we learn from ad hoc retrieval? In Information Access Evaluation. Multilinguality, Multimodality, and Interaction - 5th International Conference of the CLEF Initiative , CLEF 2014, Sheffield, UK, September 15-18, 2014. Proceedings , pages 31 -- 43 , 2014 . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-11382-1_4. 10.1007\/978-3-319-11382-1_4 N. Ferro and G. Silvello. CLEF 15th birthday: What can we learn from ad hoc retrieval? In Information Access Evaluation. Multilinguality, Multimodality, and Interaction - 5th International Conference of the CLEF Initiative, CLEF 2014, Sheffield, UK, September 15-18, 2014. Proceedings, pages 31--43, 2014. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-11382-1_4."},{"key":"e_1_2_1_7_1","first-page":"78","volume-title":"Mothe et al. {9}","author":"Grotov A.","unstructured":"A. Grotov , A. Chuklin , I. Markov , L. Stout , F. Xumara , and M. de Rijke . A comparative study of click models for web search . In Mothe et al. {9} , pages 78 -- 90 . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_7. 10.1007\/978-3-319-24027-5_7 A. Grotov, A. Chuklin, I. Markov, L. Stout, F. Xumara, and M. de Rijke. A comparative study of click models for web search. In Mothe et al. {9}, pages 78--90. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_7."},{"key":"e_1_2_1_8_1","first-page":"65","volume-title":"Mothe et al. {9}","author":"McMinn A. J.","unstructured":"A. J. McMinn and J. M. Jose . Real-time entity-based event detection for twitter . In Mothe et al. {9} , pages 65 -- 77 . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_6. 10.1007\/978-3-319-24027-5_6 A. J. McMinn and J. M. Jose. Real-time entity-based event detection for twitter. In Mothe et al. {9}, pages 65--77. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_6."},{"key":"e_1_2_1_9_1","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-24027-5","volume-title":"CLEF","author":"Mothe J.","year":"2015","unstructured":"J. Mothe , J. Savoy , J. Kamps , K. Pinel-Sauvagnat , G. J. F. Jones , E. SanJuan , L. Cappellato , and N. Ferro , editors . Experimental IR Meets Multilinguality, Multimodality, and Interaction - 6th International Conference of the CLEF Association , CLEF 2015 , Toulouse, France, September 8-11, 2015, Proceedings, volume 9283 of Lecture Notes in Computer Science , 2015. Springer . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5. 10.1007\/978-3-319-24027-5 J. Mothe, J. Savoy, J. Kamps, K. Pinel-Sauvagnat, G. J. F. Jones, E. SanJuan, L. Cappellato, and N. Ferro, editors. Experimental IR Meets Multilinguality, Multimodality, and Interaction - 6th International Conference of the CLEF Association, CLEF 2015, Toulouse, France, September 8-11, 2015, Proceedings, volume 9283 of Lecture Notes in Computer Science, 2015. Springer. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5."},{"key":"e_1_2_1_10_1","first-page":"281","volume-title":"Is concept mapping useful for biomedical information retrieval? In Mothe et al. {9}","author":"Shen W.","unstructured":"W. Shen and J. Nie . Is concept mapping useful for biomedical information retrieval? In Mothe et al. {9} , pages 281 -- 286 . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_29. 10.1007\/978-3-319-24027-5_29 W. Shen and J. Nie. Is concept mapping useful for biomedical information retrieval? In Mothe et al. {9}, pages 281--286. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_29."},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/978-3-642-23708-9_12","volume-title":"Multilingual and Multimodal Information Access Evaluation - Second International Conference of the Cross-Language Evaluation Forum, CLEF","author":"Tsikrika T.","year":"2011","unstructured":"T. Tsikrika , A. G. S. de Herrera , and H. M\u00fcller . Assessing the scholarly impact of imageclef . In Multilingual and Multimodal Information Access Evaluation - Second International Conference of the Cross-Language Evaluation Forum, CLEF 2011 , Amsterdam, The Netherlands , September 19-22, 2011. Proceedings, pages 95 -- 106 , 2011. URL http:\/\/dx.doi.org\/10.1007\/978-3-642-23708-9_12. 10.1007\/978-3-642-23708-9_12 T. Tsikrika, A. G. S. de Herrera, and H. M\u00fcller. Assessing the scholarly impact of imageclef. In Multilingual and Multimodal Information Access Evaluation - Second International Conference of the Cross-Language Evaluation Forum, CLEF 2011, Amsterdam, The Netherlands, September 19-22, 2011. Proceedings, pages 95--106, 2011. URL http:\/\/dx.doi.org\/10.1007\/978-3-642-23708-9_12."},{"key":"e_1_2_1_12_1","first-page":"1","volume-title":"CLEF 2013, Valencia, Spain, September 23-26, 2013. Proceedings","author":"Tsikrika T.","year":"2013","unstructured":"T. Tsikrika , B. Larsen , H. M\u00fcller , S. Endrullis , and E. Rahm . The scholarly impact of CLEF (2000-2009). In Information Access Evaluation. Multilinguality, Multimodality, and Visualization - 4th International Conference of the CLEF Initiative , CLEF 2013, Valencia, Spain, September 23-26, 2013. Proceedings , pages 1 -- 12 , 2013 . URL http:\/\/dx.doi.org\/10.1007\/978-3-642-40802-1_1. 10.1007\/978-3-642-40802-1_1 T. Tsikrika, B. Larsen, H. M\u00fcller, S. Endrullis, and E. Rahm. The scholarly impact of CLEF (2000-2009). In Information Access Evaluation. Multilinguality, Multimodality, and Visualization - 4th International Conference of the CLEF Initiative, CLEF 2013, Valencia, Spain, September 23-26, 2013. Proceedings, pages 1--12, 2013. URL http:\/\/dx.doi.org\/10.1007\/978-3-642-40802-1_1."},{"key":"e_1_2_1_13_1","first-page":"306","volume-title":"Mothe et al. {9}","author":"Wakeling S.","unstructured":"S. Wakeling and P. D. Clough . Integrating mixed-methods for evaluating information access systems . In Mothe et al. {9} , pages 306 -- 311 . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_33. 10.1007\/978-3-319-24027-5_33 S. Wakeling and P. D. Clough. Integrating mixed-methods for evaluating information access systems. In Mothe et al. {9}, pages 306--311. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_33."},{"key":"e_1_2_1_14_1","first-page":"414","volume-title":"Mothe et al. {9}","author":"Xu K.","unstructured":"K. Xu , Y. Feng , S. Huang , and D. Zhao . Question answering via phrasal semantic parsing . In Mothe et al. {9} , pages 414 -- 426 . URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_43. 10.1007\/978-3-319-24027-5_43 K. Xu, Y. Feng, S. Huang, and D. Zhao. Question answering via phrasal semantic parsing. In Mothe et al. {9}, pages 414--426. URL http:\/\/dx.doi.org\/10.1007\/978-3-319-24027-5_43."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2888422.2888428","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2888422.2888428","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:05:25Z","timestamp":1750273525000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2888422.2888428"}},"subtitle":["Experimental IR Meets Multilinguality, Multimodality, and Interaction"],"short-title":[],"issued":{"date-parts":[[2016,1,29]]},"references-count":14,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,1,29]]}},"alternative-id":["10.1145\/2888422.2888428"],"URL":"https:\/\/doi.org\/10.1145\/2888422.2888428","relation":{},"ISSN":["0163-5840"],"issn-type":[{"type":"print","value":"0163-5840"}],"subject":[],"published":{"date-parts":[[2016,1,29]]},"assertion":[{"value":"2016-01-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}