{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,7]],"date-time":"2026-01-07T07:46:45Z","timestamp":1767772005148,"version":"3.41.0"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2010,9,1]],"date-time":"2010-09-01T00:00:00Z","timestamp":1283299200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Transactions on Asian Language Information Processing"],"published-print":{"date-parts":[[2010,9]]},"abstract":"<jats:p>The aim of the Forum for Information Retrieval Evaluation (FIRE) is to create an evaluation framework in the spirit of TREC (Text REtrieval Conference), CLEF (Cross-Language Evaluation Forum), and NTCIR (NII Test Collection for IR Systems), for Indian language Information Retrieval. The first evaluation exercise conducted by FIRE was completed in 2008. This article describes the test collections used at FIRE 2008, summarizes the approaches adopted by various participants, discusses the limitations of the datasets, and outlines the tasks planned for the next iteration of FIRE.<\/jats:p>","DOI":"10.1145\/1838745.1838747","type":"journal-article","created":{"date-parts":[[2010,9,22]],"date-time":"2010-09-22T11:55:58Z","timestamp":1285156558000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["The FIRE 2008 Evaluation Exercise"],"prefix":"10.1145","volume":"9","author":[{"given":"Prasenjit","family":"Majumder","sequence":"first","affiliation":[{"name":"Indian Statistical Institute"}]},{"given":"Mandar","family":"Mitra","sequence":"additional","affiliation":[{"name":"Indian Statistical Institute"}]},{"given":"Dipasree","family":"Pal","sequence":"additional","affiliation":[{"name":"Indian Statistical Institute"}]},{"given":"Ayan","family":"Bandyopadhyay","sequence":"additional","affiliation":[{"name":"Indian Statistical Institute"}]},{"given":"Samaresh","family":"Maiti","sequence":"additional","affiliation":[{"name":"Indian Statistical Institute"}]},{"given":"Sukomal","family":"Pal","sequence":"additional","affiliation":[{"name":"Indian Statistical Institute"}]},{"given":"Deboshree","family":"Modak","sequence":"additional","affiliation":[{"name":"Indian Statistical Institute"}]},{"given":"Sucharita","family":"Sanyal","sequence":"additional","affiliation":[{"name":"Indian Statistical Institute"}]}],"member":"320","published-online":{"date-parts":[[2010,9]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/582415.582416"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:INRT.0000009438.69013.fa"},{"key":"e_1_2_1_3_1","unstructured":"}}Dolamic L. and Savoy J. 2008. UniNE at FIRE 2008: Hindi Bengali and Marathi IR. In Working Notes from FIRE 2008 (FIRE\u201908).  }} Dolamic L. and Savoy J. 2008. UniNE at FIRE 2008: Hindi Bengali and Marathi IR. In Working Notes from FIRE 2008 (FIRE\u201908) ."},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(94)00047-7"},{"key":"e_1_2_1_5_1","unstructured":"}}Hiemstra D. 2001. Using language models for information retrieval. Ph.D. thesis University of Twente.  }} Hiemstra D. 2001. Using language models for information retrieval. Ph.D. thesis University of Twente."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1362782.1362783"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281485.1281489"},{"key":"e_1_2_1_8_1","unstructured":"}}McNamee P. 2008. N-gram Tokenization for Indian Language Text Retrieval. In Working Notes from FIRE 2008 (FIRE\u201908).  }} McNamee P. 2008. N-gram Tokenization for Indian Language Text Retrieval. In Working Notes from FIRE 2008 (FIRE\u201908) ."},{"volume-title":"Overview of FIRE 2008. In Working Notes from FIRE 2008 (FIRE\u201908)","year":"2008","author":"Mitra M.","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1111667.1111668"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/974740.974741"},{"volume-title":"Proceedings of the ACM Workshop on Open Source Information Retrieval (OSIR\u201906)","author":"Ounis I.","key":"e_1_2_1_12_1"},{"key":"e_1_2_1_13_1","unstructured":"}}Padariya N. Chinnakotla M. Nagesh A. and Damani O. P. 2008. Evaluation of Hindi to English Marathi to English and English to Hindi CLIR at FIRE 2008. In Working Notes from FIRE 2008 (FIRE\u201908).  }} Padariya N. Chinnakotla M. Nagesh A. and Damani O. P. 2008. Evaluation of Hindi to English Marathi to English and English to Hindi CLIR at FIRE 2008. In Working Notes from FIRE 2008 (FIRE\u201908) ."},{"key":"e_1_2_1_14_1","unstructured":"}}Paik J. H. and Parui S. K. 2008. A simple stemmer for inflectional languages. In Working Notes from FIRE 2008 (FIRE\u201908).  }} Paik J. H. and Parui S. K. 2008. A simple stemmer for inflectional languages. In Working Notes from FIRE 2008 (FIRE\u201908) ."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460027.1460044"},{"key":"e_1_2_1_16_1","unstructured":"}}Peters C. 2010. Personal communication.  }} Peters C. 2010. Personal communication."},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"}}Peters C. Jijkoun V. Mandl T. M\u00fcller H. Oard D. Pe\u00f1as A. Petras V. and Santos D. Eds. 2008. In Advances in Multilingual and Multimodal Information Retrieval the 8th Workshop of the Cross-Language Evaluation Forum (CLEF\u201907). Lecture Notes in Computer Science. Springer-Verlag.   }} Peters C. Jijkoun V. Mandl T. M\u00fcller H. Oard D. Pe\u00f1as A. Petras V. and Santos D. Eds. 2008. In Advances in Multilingual and Multimodal Information Retrieval the 8th Workshop of the Cross-Language Evaluation Forum (CLEF\u201907) . Lecture Notes in Computer Science. Springer-Verlag.","DOI":"10.1007\/978-3-540-85760-0"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1135777.1135898"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291008"},{"volume-title":"Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics (EACL\u201903)","author":"Ramanathan A.","key":"e_1_2_1_20_1"},{"key":"e_1_2_1_21_1","unstructured":"}}Rao P. R. and Sobha L. 2008. AU-KBC FIRE2008 submission - Cross lingual information retrieval track: Tamil-English. In Working Notes from FIRE 2008 (FIRE\u201908).  }} Rao P. R. and Sobha L. 2008. AU-KBC FIRE2008 submission - Cross lingual information retrieval track: Tamil-English. In Working Notes from FIRE 2008 (FIRE\u201908) ."},{"volume-title":"Proceedings of the NII Test Collection for Information Retrieval Workshop (NTCIR\u201908)","author":"Sakai T.","key":"e_1_2_1_22_1"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/11519645_24"},{"key":"e_1_2_1_24_1","unstructured":"}}Sethuramalingam S. and Varma V. 2008. IIIT Hyderabad\u2019s CLIR experiments for FIRE-2008. In Working Notes from FIRE 2008 (FIRE\u201908).  }} Sethuramalingam S. and Varma V. 2008. IIIT Hyderabad\u2019s CLIR experiments for FIRE-2008. In Working Notes from FIRE 2008 (FIRE\u201908) ."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1108\/eb026616"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(00)00015-7"},{"volume-title":"Proceedings of the International Conference on Digital Libraries (ICDL\u201904)","author":"Surve M.","key":"e_1_2_1_27_1"},{"key":"e_1_2_1_28_1","unstructured":"}}Udupa R. Jagarlamudi J. and Saravanan K. 2008. Hindi-English cross-language information retrieval. In Working Notes from FIRE 2008 (FIRE\u201908).  }} Udupa R. Jagarlamudi J. and Saravanan K. 2008. Hindi-English cross-language information retrieval. In Working Notes from FIRE 2008 (FIRE\u201908) ."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-00958-7_39"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.6028\/NIST.SP.500-246"},{"key":"e_1_2_1_31_1","unstructured":"}}Voorhees E. M. and Harman D. K. Eds. 2005. TREC Experiment and Evaluation in Information Retrieval. MIT Press Cambridge MA.   }} Voorhees E. M. and Harman D. K. Eds. 2005. TREC Experiment and Evaluation in Information Retrieval . MIT Press Cambridge MA."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/290941.291014"}],"container-title":["ACM Transactions on Asian Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1838745.1838747","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1838745.1838747","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T11:39:49Z","timestamp":1750246789000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1838745.1838747"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,9]]},"references-count":32,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2010,9]]}},"alternative-id":["10.1145\/1838745.1838747"],"URL":"https:\/\/doi.org\/10.1145\/1838745.1838747","relation":{},"ISSN":["1530-0226","1558-3430"],"issn-type":[{"type":"print","value":"1530-0226"},{"type":"electronic","value":"1558-3430"}],"subject":[],"published":{"date-parts":[[2010,9]]},"assertion":[{"value":"2009-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-03-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2010-09-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}