{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:41:42Z","timestamp":1750308102511,"version":"3.41.0"},"reference-count":37,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2005,6,1]],"date-time":"2005-06-01T00:00:00Z","timestamp":1117584000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Transactions on Asian Language Information Processing"],"published-print":{"date-parts":[[2005,6]]},"abstract":"<jats:p>\n            At the NTCIR-4 workshop, Justsystem Corporation (JSC) and Clairvoyance Corporation (CC) collaborated in the cross-language retrieval task (CLIR). Our goal was to evaluate the performance and robustness of our recently developed commercial-grade CLIR systems for English and Asian languages. The main contribution of this article is the investigation of different strategies, their interactions in both monolingual and bilingual retrieval tasks, and their respective contributions to operational retrieval systems in the context of NTCIR-4. We report results of Japanese and English monolingual retrieval and results of Japanese-to-English bilingual retrieval. In monolingual retrieval analysis, we examine two special properties of the NTCIR experimental design (two levels of relevance and identical queries in multiple languages) and explore how they interact with strategies of our retrieval system, including pseudo-relevance feedback, multi-word term down-weighting, and term weight merging strategies. Our analysis shows that the choice of language (English or Japanese) does not have a significant impact on retrieval performance. Query expansion is slightly more effective with\n            <jats:italic>relaxed<\/jats:italic>\n            judgments than with\n            <jats:italic>rigid<\/jats:italic>\n            judgments. For better retrieval performance, weights of multi-word terms should be lowered. In the bilingual retrieval analysis, we aim to identify robust strategies that are effective when used alone and when used in combination with other strategies. We examine cross-lingual specific strategies such as translation disambiguation and translation structuring, as well as general strategies such as pseudo-relevance feedback and multi-word term down-weighting. For shorter title topics, pseudo-relevance feedback is a major performance enhancer, but translation structuring affects retrieval performance negatively when used alone or in combination with other strategies. All experimented strategies improve retrieval performance for the longer description topics, with pseudo-relevance feedback and translation structuring as the major contributors.\n          <\/jats:p>","DOI":"10.1145\/1105696.1105698","type":"journal-article","created":{"date-parts":[[2006,2,6]],"date-time":"2006-02-06T15:07:09Z","timestamp":1139238429000},"page":"78-110","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Towards effective strategies for monolingual and bilingual information retrieval"],"prefix":"10.1145","volume":"4","author":[{"given":"Yan","family":"Qu","sequence":"first","affiliation":[{"name":"Clairvoyance Corporation, Pittsburgh, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David A.","family":"Hull","sequence":"additional","affiliation":[{"name":"Clairvoyance Corporation, Pittsburgh, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gregory","family":"Grefenstette","sequence":"additional","affiliation":[{"name":"Clairvoyance Corporation, Pittsburgh, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David A.","family":"Evans","sequence":"additional","affiliation":[{"name":"Clairvoyance Corporation, Pittsburgh, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Motoko","family":"Ishikawa","sequence":"additional","affiliation":[{"name":"Justsystem Corporation, Tokushima-city, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Setsuko","family":"Nara","sequence":"additional","affiliation":[{"name":"Justsystem Corporation, Tokushima-city, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Toshiya","family":"Ueda","sequence":"additional","affiliation":[{"name":"Justsystem Corporation, Tokushima-city, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daisuke","family":"Noda","sequence":"additional","affiliation":[{"name":"Justsystem Corporation, Tokushima-city, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kousaku","family":"Arita","sequence":"additional","affiliation":[{"name":"Justsystem Corporation, Tokushima-city, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuki","family":"Funakoshi","sequence":"additional","affiliation":[{"name":"Justsystem Corporation, Tokushima-city, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hiroshi","family":"Matsuda","sequence":"additional","affiliation":[{"name":"Justsystem Corporation, Tokushima-city, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2005,6]]},"reference":[{"volume-title":"Proceedings of the 9th Text REtrieval Conference (TREC","year":"2000","author":"Allan J.","key":"e_1_2_1_1_1"},{"volume-title":"Proceedings of the 7th International Conference on Database and Expert Systems Applications","author":"Ballesteros L.","key":"e_1_2_1_2_1"},{"volume-title":"Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Ballesteros L.","key":"e_1_2_1_3_1"},{"volume-title":"Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Chen A.","key":"e_1_2_1_4_1"},{"volume-title":"Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Davis M. W.","key":"e_1_2_1_5_1"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4573(94)00054-7"},{"volume-title":"Proceedings of the 34th Annual Meeting of the Association for Computational Linguistics","year":"1863","author":"Evans D. A.","key":"e_1_2_1_7_1"},{"volume-title":"Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. National Center for Science Information Systems (NACSIS)","year":"1999","author":"Fujita S.","key":"e_1_2_1_8_1"},{"volume-title":"Cross-Language Information Retrieval. G. Grefenstette (ed)","author":"Grefenstette G.","key":"e_1_2_1_9_1"},{"volume-title":"Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Hull D. A.","key":"e_1_2_1_10_1"},{"volume-title":"Proceedings of the First NTCIR Workshop on Research in Japanese Text Retrieval and Term Recognition. National Center for Science Information Systems (NACSIS)","author":"Kando N.","key":"e_1_2_1_11_1"},{"volume-title":"Workshop Meeting: Working Notes of the Fourth NTCIR Workshop Meeting","year":"2004","author":"Kishida K.","key":"e_1_2_1_12_1"},{"volume-title":"4th Workshop of the Cross-Language Evaluation Forum, CLEF 2003","year":"2003","author":"Kishida K.","key":"e_1_2_1_13_1"},{"volume-title":"Proceedings of the 20th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","year":"1997","author":"Kwok K. L.","key":"e_1_2_1_14_1"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(1999)50:8%3C709::AID-ASI8%3E3.0.CO;2-V"},{"volume-title":"Proceedings of the16th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Fujii H.","key":"e_1_2_1_16_1"},{"key":"e_1_2_1_17_1","unstructured":"Lindman H. R. 1974. Analysis of Variances in Complex Experimental Designs. Freeman New York.]]  Lindman H. R. 1974. Analysis of Variances in Complex Experimental Designs. Freeman New York.]]"},{"key":"e_1_2_1_18_1","doi-asserted-by":"crossref","unstructured":"Littman M. L. Dumais S. T. and Landauer T. K. 1998. Automatic cross-language information retrieval using latent semantic indexing. In Cross-Language Information Retrieval. G. Grefenstette (ed). Kluwer Academic Boston MA 51--62.]]  Littman M. L. Dumais S. T. and Landauer T. K. 1998. Automatic cross-language information retrieval using latent semantic indexing. In Cross-Language Information Retrieval. G. Grefenstette (ed). Kluwer Academic Boston MA 51--62.]]","DOI":"10.1007\/978-1-4615-5661-9_5"},{"key":"e_1_2_1_19_1","unstructured":"Manning C. D. and Sch\u00fctze H. 1999. Foundations of Statistical Natural Language Processing. MIT Press Cambridge MA.]]   Manning C. D. and Sch\u00fctze H. 1999. Foundations of Statistical Natural Language Processing. MIT Press Cambridge MA.]]"},{"volume-title":"Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics","year":"1999","author":"McCarley J. S.","key":"e_1_2_1_20_1"},{"volume-title":"Workshop Meeting: Working Notes of the Fourth NTCIR Workshop Meeting","year":"2004","author":"Nakagawa T.","key":"e_1_2_1_21_1"},{"volume-title":"NTCIR Workshop 3: Proceedings of the Third NTCIR Workshop on Research in Information Retrieval, Automatic Text Summarization and Question Answering, National Institute of Informatics","author":"Oyama K.","key":"e_1_2_1_22_1"},{"volume-title":"Proceedings of Machine Translation and the Information Soup, Third Conference of the Association for Machine Translation in the Americas. AMTA '98","year":"1998","author":"Oard D. W.","key":"e_1_2_1_23_1"},{"volume-title":"Proceedings of the 2nd NTCIR Workshop on Research in Chinese & Japanese Text Retrieval and Text Summarization. National Institute of Informatics","author":"Oard D. W.","key":"e_1_2_1_24_1"},{"volume-title":"Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","year":"1998","author":"Pirkola A.","key":"e_1_2_1_25_1"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4573(02)00091-2"},{"volume-title":"Advances in Cross-Language Information Retrieval: Third Workshop of the Cross-Language Evaluation Forum (CLEF 2002","year":"2002","author":"Qu Y.","key":"e_1_2_1_27_1"},{"volume-title":"Proceedings of the 17th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval","author":"Robertson S. E.","key":"e_1_2_1_28_1"},{"volume-title":"NTCIR-4 Workshop Meeting: Working Notes of the Fourth NTCIR Workshop Meeting","author":"Savoy J.","key":"e_1_2_1_29_1"},{"volume-title":"Proceedings of the 23rd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Sperer R.","key":"e_1_2_1_30_1"},{"volume-title":"CLIR: Monolingual\/bilingual IR and flexible feedback. In NTCIR-4 Workshop Meeting: Working Notes of the Fourth NTCIR Workshop Meeting","year":"2004","author":"Sakai T.","key":"e_1_2_1_31_1"},{"volume-title":"Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Sheridan P.","key":"e_1_2_1_32_1"},{"volume-title":"Proceedings of the Fifth Text REtrieval Conference (TREC-5","author":"Tong X.","key":"e_1_2_1_33_1"},{"volume-title":"Proceedings of the 41st Annual Meeting of the Association for Computational Linguistics","year":"2003","author":"Utiyama M.","key":"e_1_2_1_34_1"},{"volume-title":"Evaluation of Cross-Language Information Retrieval Systems: CLEF 2001 Workshop Revised Papers. C. Peters, et al. (eds)","series-title":"Lecture Notes in Computer Science 2406","author":"Voorhees E.","key":"e_1_2_1_35_1"},{"volume-title":"Proceedings of the 6th Applied Natural Language Processing Conference","author":"Yamashita T.","key":"e_1_2_1_36_1"},{"volume-title":"Workshop Meeting: Working Notes of the Fourth NTCIR Workshop Meeting","year":"2004","author":"Yang L.","key":"e_1_2_1_37_1"}],"container-title":["ACM Transactions on Asian Language Information Processing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1105696.1105698","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1105696.1105698","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T16:08:03Z","timestamp":1750262883000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1105696.1105698"}},"subtitle":["Lessons learned from NTCIR-4"],"short-title":[],"issued":{"date-parts":[[2005,6]]},"references-count":37,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2005,6]]}},"alternative-id":["10.1145\/1105696.1105698"],"URL":"https:\/\/doi.org\/10.1145\/1105696.1105698","relation":{},"ISSN":["1530-0226","1558-3430"],"issn-type":[{"type":"print","value":"1530-0226"},{"type":"electronic","value":"1558-3430"}],"subject":[],"published":{"date-parts":[[2005,6]]},"assertion":[{"value":"2005-06-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}