{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:20:02Z","timestamp":1750220402953,"version":"3.41.0"},"reference-count":9,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>This is a report on the NTCIR-15 conference held online in December 2020. NTCIR is a sesquiannual research project designed to evaluate various information access technologies, including information retrieval, information recommendation, question answering, natural language processing, etc. 55 active research groups from 22 countries\\regions have participated in one or more of the seven tasks in NTCIR-15. This report introduces the highlights of the conference, describes the scope and task designs of the seven tasks organized at NTCIR-15.<\/jats:p>\n          <jats:p>\n            <jats:bold>Date<\/jats:bold>\n            : 8--11 December, 2020.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Website<\/jats:bold>\n            : http:\/\/research.nii.ac.jp\/ntcir\/ntcir-15\/.\n          <\/jats:p>","DOI":"10.1145\/3527546.3527570","type":"journal-article","created":{"date-parts":[[2022,3,17]],"date-time":"2022-03-17T23:24:36Z","timestamp":1647559476000},"page":"1-6","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Report on the 15th round of NII testbeds and community for information access research (NTCIR-15)"],"prefix":"10.1145","volume":"55","author":[{"given":"Makoto P.","family":"Kato","sequence":"first","affiliation":[{"name":"University of Tsukuba, Japan"}]},{"given":"Yiqun","family":"Liu","sequence":"additional","affiliation":[{"name":"Tsinghua University, China"}]},{"given":"Noriko","family":"Kando","sequence":"additional","affiliation":[{"name":"National Institute of Informatics, Japan"}]},{"given":"Charles L. A.","family":"Clarke","sequence":"additional","affiliation":[{"name":"University of Waterloo, Canada"}]}],"member":"320","published-online":{"date-parts":[[2022,3,17]]},"reference":[{"issue":"194","key":"e_1_2_1_1_1","first-page":"1","volume":"850","author":"Chen Chung-Chi","year":"2020","unstructured":"Chung-Chi Chen , Hen-Hsen Huang , Hiroya Takamura , and Hsin-Hsi Chen . Overview of the ntcir-15 finnum-2 task: Numeral attachment in financial tweets. Proceedings of the NTCIR-15 Conference , 850 ( 194 ): 1 -- 44 , 2020 . Chung-Chi Chen, Hen-Hsen Huang, Hiroya Takamura, and Hsin-Hsi Chen. Overview of the ntcir-15 finnum-2 task: Numeral attachment in financial tweets. Proceedings of the NTCIR-15 Conference, 850(194):1--44, 2020.","journal-title":"Conference"},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the 15th ntcir conference on evaluation of information access technologies. In Proceedings of the NTCIR-15 Conference","author":"Clarke Charles L. A.","year":"2020","unstructured":"Charles L. A. Clarke , Noriko Kando , Yiqun Liu , and editors. Makoto P. Kato . Proceedings of the 15th ntcir conference on evaluation of information access technologies. In Proceedings of the NTCIR-15 Conference , 2020 . Charles L. A. Clarke, Noriko Kando, Yiqun Liu, and editors. Makoto P. Kato. Proceedings of the 15th ntcir conference on evaluation of information access technologies. In Proceedings of the NTCIR-15 Conference, 2020."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the NTCIR-15 Conference. Sheffield","author":"Healy Graham","year":"2020","unstructured":"Graham Healy , T-K Le , Hideo Joho , Frank Hopfgartner , and Cathal Gurrin . Overview of ntcir-15 mart . In Proceedings of the NTCIR-15 Conference. Sheffield , 2020 . Graham Healy, T-K Le, Hideo Joho, Frank Hopfgartner, and Cathal Gurrin. Overview of ntcir-15 mart. In Proceedings of the NTCIR-15 Conference. Sheffield, 2020."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the NTCIR-15 Conference","author":"Kato Makoto P","year":"2020","unstructured":"Makoto P Kato , Hiroaki Ohshima , Ying-Hsang Liu , and Hsin-Liang Chen . Overview of the ntcir-15 data search task . In Proceedings of the NTCIR-15 Conference , 2020 . Makoto P Kato, Hiroaki Ohshima, Ying-Hsang Liu, and Hsin-Liang Chen. Overview of the ntcir-15 data search task. In Proceedings of the NTCIR-15 Conference, 2020."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the NTCIR-15 Conference","author":"Kimura Yasutomo","year":"2020","unstructured":"Yasutomo Kimura , Hideyuki Shibuki , Hokuto Ototake , Yuzu Uchida , Keiichi Takamaru , Madoka Ishioroshi , Teruko Mitamura , Masaharu Yoshioka , Tomoyoshi Akiba , Yasuhiro Ogawa , Overview of the ntcir-15 qa lab-poliinfo-2 task . In Proceedings of the NTCIR-15 Conference , 2020 . Yasutomo Kimura, Hideyuki Shibuki, Hokuto Ototake, Yuzu Uchida, Keiichi Takamaru, Madoka Ishioroshi, Teruko Mitamura, Masaharu Yoshioka, Tomoyoshi Akiba, Yasuhiro Ogawa, et al. Overview of the ntcir-15 qa lab-poliinfo-2 task. In Proceedings of the NTCIR-15 Conference, 2020."},{"key":"e_1_2_1_6_1","volume-title":"In Proceedings of the NTCIR-15 Conference","author":"Liu Yiqun","year":"2020","unstructured":"Yiqun Liu , Makoto P. Kato , and Noriko Kando . Overview of NTCIR-15 . In In Proceedings of the NTCIR-15 Conference , 2020 . Yiqun Liu, Makoto P. Kato, and Noriko Kando. Overview of NTCIR-15. In In Proceedings of the NTCIR-15 Conference, 2020."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the NTCIR-15 Conference","author":"Sakai Tetsuya","year":"2020","unstructured":"Tetsuya Sakai , Sijie Tao , Zhaohao Zeng , Yukun Zheng , Jiaxin Mao , Zhumin Chu , Yiqun Liu , Maria Maistro , Zhicheng Dou , Nicola Ferro , Overview of the ntcir-15 we want web with centre (www-3) task . In Proceedings of the NTCIR-15 Conference , 2020 . Tetsuya Sakai, Sijie Tao, Zhaohao Zeng, Yukun Zheng, Jiaxin Mao, Zhumin Chu, Yiqun Liu, Maria Maistro, Zhicheng Dou, Nicola Ferro, et al. Overview of the ntcir-15 we want web with centre (www-3) task. In Proceedings of the NTCIR-15 Conference, 2020."},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the NTCIR-15 Conference","author":"Sekine Satoshi","year":"2020","unstructured":"Satoshi Sekine , Masako Nomoto , Kouta Nakayama , Asuka Sumida , Koji Matsuda , and Maya Ando . Overview of shinra2020-ml task . In Proceedings of the NTCIR-15 Conference , 2020 . Satoshi Sekine, Masako Nomoto, Kouta Nakayama, Asuka Sumida, Koji Matsuda, and Maya Ando. Overview of shinra2020-ml task. In Proceedings of the NTCIR-15 Conference, 2020."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the NTCIR-15 Conference","author":"Zeng Zhaohao","year":"2020","unstructured":"Zhaohao Zeng , Sosuke Kato , Tetsuya Sakai , and Inho Kang . Overview of the ntcir-15 dialogue evaluation (dialeval-1) task . In Proceedings of the NTCIR-15 Conference , 2020 . Zhaohao Zeng, Sosuke Kato, Tetsuya Sakai, and Inho Kang. Overview of the ntcir-15 dialogue evaluation (dialeval-1) task. In Proceedings of the NTCIR-15 Conference, 2020."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3527546.3527570","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3527546.3527570","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:53Z","timestamp":1750191533000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3527546.3527570"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":9,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1145\/3527546.3527570"],"URL":"https:\/\/doi.org\/10.1145\/3527546.3527570","relation":{},"ISSN":["0163-5840"],"issn-type":[{"type":"print","value":"0163-5840"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"2022-03-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}