{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:30:45Z","timestamp":1750221045360,"version":"3.41.0"},"reference-count":12,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2018,8,31]],"date-time":"2018-08-31T00:00:00Z","timestamp":1535673600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2018,8,31]]},"abstract":"<jats:p>This is a report on the NTCIR-13 conference held in December 2017, in Tokyo, Japan. NTCIR is a series of parallel and collective evaluation efforts designed to enhance research on diverse information access technologies, including, but not limited to, cross-language and multimedia information access, question-answering, text mining and summarization, with an emphasis on East Asian languages such as Chinese, Korean, and Japanese, as well as English. 105 different research groups from 20 countries\/regions participated in one or more of the nine different tasks in NTCIR-13, to compete and collaborate on a common ground and thereby advance the state of the art. This report introduces the highlights of the conference, describes the scope and task designs of nine tasks organized at NTCIR-13, and provides a brief introduction to NTCIR-14, which started from January 2018 and will be closed in June 2019, which will be the 20th anniversary since the first NTCIR Conference in the summer of 1999.<\/jats:p>","DOI":"10.1145\/3274784.3274791","type":"journal-article","created":{"date-parts":[[2018,9,4]],"date-time":"2018-09-04T12:37:30Z","timestamp":1536064650000},"page":"102-110","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Report on NTCIR-13"],"prefix":"10.1145","volume":"52","author":[{"given":"Yiqun","family":"LIU","sequence":"first","affiliation":[{"name":"Tsinghua University, China"}]},{"given":"Makoto P.","family":"Kato","sequence":"additional","affiliation":[{"name":"Kyoto University, Japan"}]},{"given":"Charles L.A.","family":"Clarke","sequence":"additional","affiliation":[{"name":"Facebook, USA"}]},{"given":"Noriko","family":"Kando","sequence":"additional","affiliation":[{"name":"National Institute of Informatics, Japan"}]},{"given":"Tetsuya","family":"Sakai","sequence":"additional","affiliation":[{"name":"Waseda University, Japan"}]}],"member":"320","published-online":{"date-parts":[[2018,8,31]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the NTCIR-13 Conference","author":"Blanco R.","year":"2017","unstructured":"R. Blanco , H. Joho , A. Jatowt , H.-T. Yu , and S. Yamamoto . Overview of ntcir-13 actionable knowledge graph (akg) task . In Proceedings of the NTCIR-13 Conference , 2017 . R. Blanco, H. Joho, A. Jatowt, H.-T. Yu, and S. Yamamoto. Overview of ntcir-13 actionable knowledge graph (akg) task. In Proceedings of the NTCIR-13 Conference, 2017."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the Eighth International Workshop on Evaluating Information Access (EVIA 2016), a Satellite Workshop of the NTCIR-12 Conference. National Institute of Informatics, 2017","author":"Ferro N.","year":"2008","unstructured":"N. Ferro and I. Soboroff , editors . Proceedings of the Eighth International Workshop on Evaluating Information Access (EVIA 2016), a Satellite Workshop of the NTCIR-12 Conference. National Institute of Informatics, 2017 . http:\/\/ceur-ws.org\/Vol- 2008 \/. N. Ferro and I. Soboroff, editors. Proceedings of the Eighth International Workshop on Evaluating Information Access (EVIA 2016), a Satellite Workshop of the NTCIR-12 Conference. National Institute of Informatics, 2017. http:\/\/ceur-ws.org\/Vol-2008\/."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the NTCIR-13 Conference.","author":"Gao Q.","year":"2017","unstructured":"Q. Gao , H. Jiannan , X. Ruifeng , G. Lin , Y. He , K.-F. Wong , and Q. Lu . Overview of NTCIR-13 ECA task . In Proceedings of the NTCIR-13 Conference. , 2017 . Q. Gao, H. Jiannan, X. Ruifeng, G. Lin, Y. He, K.-F. Wong, and Q. Lu. Overview of NTCIR-13 ECA task. In Proceedings of the NTCIR-13 Conference., 2017."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the NTCIR-13 Conference","author":"Gurrin C.","year":"2017","unstructured":"C. Gurrin , H. Joho , F. Hopfgartner , L. Zhou , D.-T. Dang-Nguyen , R. Gupta , and R. Albatal . Overview of NTCIR-13 Lifelog-2 task . In Proceedings of the NTCIR-13 Conference , 2017 . C. Gurrin, H. Joho, F. Hopfgartner, L. Zhou, D.-T. Dang-Nguyen, R. Gupta, and R. Albatal. Overview of NTCIR-13 Lifelog-2 task. In Proceedings of the NTCIR-13 Conference, 2017."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the NTCIR-13 Conference","author":"Healy G.","year":"2017","unstructured":"G. Healy , T. Ward , C. Gurrin , and A. Smeaton . Overview of the NTCIR-13 NAILS task . In Proceedings of the NTCIR-13 Conference , 2017 . G. Healy, T. Ward, C. Gurrin, and A. Smeaton. Overview of the NTCIR-13 NAILS task. In Proceedings of the NTCIR-13 Conference, 2017."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the 13th NTCIR Conference on Evaluation of Information Access Technologies. National Institute of Informatics","author":"Kando N.","year":"2017","unstructured":"N. Kando , C. L. A. Clarke , T. Sakai , M. P. Kato , and Y. Liu , editors . Proceedings of the 13th NTCIR Conference on Evaluation of Information Access Technologies. National Institute of Informatics , 2017 . http:\/\/research.nii.ac.jp\/ntcir\/workshop\/ OnlineProceedings13\/NTCIR\/toc_ntcir.html. N. Kando, C. L. A. Clarke, T. Sakai, M. P. Kato, and Y. Liu, editors. Proceedings of the 13th NTCIR Conference on Evaluation of Information Access Technologies. National Institute of Informatics, 2017. http:\/\/research.nii.ac.jp\/ntcir\/workshop\/ OnlineProceedings13\/NTCIR\/toc_ntcir.html."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the NTCIR-13 Conference","author":"Kato M. P.","year":"2017","unstructured":"M. P. Kato , T. Yamamoto , T. Manabe , A. Nishida , and S. Fujita . Overview of the NTCIR-13 OpenLiveQ task . In Proceedings of the NTCIR-13 Conference , 2017 . M. P. Kato, T. Yamamoto, T. Manabe, A. Nishida, and S. Fujita. Overview of the NTCIR-13 OpenLiveQ task. In Proceedings of the NTCIR-13 Conference, 2017."},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the NTCIR-13 Conference","author":"Luo C.","year":"2017","unstructured":"C. Luo , T. Sakai , Y. Liu , Z. Dou , C. Xiong , and J. Xu . Overview of the NTCIR-13 We Want Web task . In Proceedings of the NTCIR-13 Conference , 2017 . C. Luo, T. Sakai, Y. Liu, Z. Dou, C. Xiong, and J. Xu. Overview of the NTCIR-13 We Want Web task. In Proceedings of the NTCIR-13 Conference, 2017."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the NTCIR-13 Conference","author":"Kato M. P.","year":"2017","unstructured":"M. P. Kato and Y. Liu . Overview of NTCIR-13 . In Proceedings of the NTCIR-13 Conference , 2017 . M. P. Kato and Y. Liu. Overview of NTCIR-13. In Proceedings of the NTCIR-13 Conference, 2017."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the NTCIR- 13 Conference","author":"Shang L.","year":"2017","unstructured":"L. Shang , T. Sakai , H. Li , R. Higashinaka , Y. Miyao , Y. Arase , and M. Nomoto . Overview of the NTCIR-13 Short Text Conversation task . In Proceedings of the NTCIR- 13 Conference , 2017 . L. Shang, T. Sakai, H. Li, R. Higashinaka, Y. Miyao, Y. Arase, and M. Nomoto. Overview of the NTCIR-13 Short Text Conversation task. In Proceedings of the NTCIR- 13 Conference, 2017."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the NTCIR-13 Conference","author":"Shibuki H.","year":"2017","unstructured":"H. Shibuki , K. Sakamoto , M. Ishioroshi , Y. Kano , T. Mitamura , T. Mori , and N. Kando . Overview of the NTCIR-13 QALab-3 task . In Proceedings of the NTCIR-13 Conference , 2017 . H. Shibuki, K. Sakamoto, M. Ishioroshi, Y. Kano, T. Mitamura, T. Mori, and N. Kando. Overview of the NTCIR-13 QALab-3 task. In Proceedings of the NTCIR-13 Conference, 2017."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the NTCIR-13 Conference","author":"Wakamiya S.","year":"2017","unstructured":"S. Wakamiya , M. Morita , Y. Kano , T. Ohkuma , and E. Aramaki . Overview of the ntcir-13: MedWeb task . In Proceedings of the NTCIR-13 Conference , 2017 . S. Wakamiya, M. Morita, Y. Kano, T. Ohkuma, and E. Aramaki. Overview of the ntcir-13: MedWeb task. In Proceedings of the NTCIR-13 Conference, 2017."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274784.3274791","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3274784.3274791","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:44:03Z","timestamp":1750207443000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3274784.3274791"}},"subtitle":["The Thirteenth Round of NII Testbeds and Community for Information Access Research"],"short-title":[],"issued":{"date-parts":[[2018,8,31]]},"references-count":12,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2018,8,31]]}},"alternative-id":["10.1145\/3274784.3274791"],"URL":"https:\/\/doi.org\/10.1145\/3274784.3274791","relation":{},"ISSN":["0163-5840"],"issn-type":[{"type":"print","value":"0163-5840"}],"subject":[],"published":{"date-parts":[[2018,8,31]]},"assertion":[{"value":"2018-08-31","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}