{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:07:36Z","timestamp":1750306056070,"version":"3.41.0"},"reference-count":13,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2017,2,14]],"date-time":"2017-02-14T00:00:00Z","timestamp":1487030400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2017,2,14]]},"abstract":"<jats:p>This is a report on the NTCIR-12 conference held in June 2016, in Tokyo, Japan. NTCIR-12 is the twelfth sesquiannual research project for evaluating information access technologies that organizes a diverse set of tasks related to information retrieval, question answering, and natural language processing. The NTCIR-12 conference is a venue in which task organizers and task participants presented their effort on their participating tasks, and attracted 236 participants from 21 countries\/regions in this round. This report introduces the highlights of the conference, describes the scope and task designs of nine tasks organized at NTCIR-12, and provides a brief introduction to NTCIR-13, which started from June 2016 and will be closed in December 2017.<\/jats:p>","DOI":"10.1145\/3053408.3053413","type":"journal-article","created":{"date-parts":[[2017,2,16]],"date-time":"2017-02-16T15:18:48Z","timestamp":1487258328000},"page":"18-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Report on NTCIR-12"],"prefix":"10.1145","volume":"50","author":[{"given":"Makoto P.","family":"Kato","sequence":"first","affiliation":[{"name":"Kyoto University, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kazuaki","family":"Kishida","sequence":"additional","affiliation":[{"name":"Keio University, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Noriko","family":"Kando","sequence":"additional","affiliation":[{"name":"National Institute of Informatics, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tetsuya","family":"Saka","sequence":"additional","affiliation":[{"name":"Waseda University, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Sanderson","sequence":"additional","affiliation":[{"name":"RMIT University, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2017,2,14]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Proceedings of the NTCIR-12 Conference","author":"Akiba T.","year":"2016","unstructured":"T. Akiba , H. Nishizaki , H. Nanjo , and G. J. F. Jones . Overview of the NTCIR-12 SpokenQuery&Doc-2 task . In Proceedings of the NTCIR-12 Conference , 2016 . T. Akiba, H. Nishizaki, H. Nanjo, and G. J. F. Jones. Overview of the NTCIR-12 SpokenQuery&Doc-2 task. In Proceedings of the NTCIR-12 Conference, 2016."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of the NTCIR-12 Conference","author":"Aramaki E.","year":"2016","unstructured":"E. Aramaki , M. Morita , Y. Kano , and T. Ohkuma . Overview of the NTCIR-12MedNLPDoctask . In Proceedings of the NTCIR-12 Conference , 2016 . E. Aramaki, M.Morita, Y. Kano, and T. Ohkuma. Overview of the NTCIR-12MedNLPDoctask. In Proceedings of the NTCIR-12 Conference, 2016."},{"key":"e_1_2_1_3_1","volume-title":"Proceedings of the NTCIR-12 Conference","author":"Gurrin C.","year":"2016","unstructured":"C. Gurrin , H. Joho , F. Hopfgartner , L. Zhou , and R. Albatal . Overview of NTCIR-12 Lifelog task . In Proceedings of the NTCIR-12 Conference , 2016 . C. Gurrin, H. Joho, F. Hopfgartner, L. Zhou, and R. Albatal. Overview of NTCIR-12 Lifelog task. In Proceedings of the NTCIR-12 Conference, 2016."},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the NTCIR-12 Conference","author":"Joho H.","year":"2016","unstructured":"H. Joho , A. Jatowt , R. Blanco , H. Yu , and S. Yamamoto . Overview of NTCIR-12 Temporal Information Access (Temporalia-2) task . In Proceedings of the NTCIR-12 Conference , 2016 . H. Joho, A. Jatowt, R. Blanco, H. Yu, and S. Yamamoto. Overview of NTCIR-12 Temporal Information Access (Temporalia-2) task. In Proceedings of the NTCIR-12 Conference, 2016."},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies. National Institute of Informatics","author":"Kando N.","year":"2016","unstructured":"N. Kando , K. Kishida , M. P. Kato , and S. Yamamoto , editors . Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies. National Institute of Informatics , 2016 . http:\/\/research.nii.ac.jp\/ntcir\/workshop\/ OnlineProceedings12\/NTCIR\/toc_ntcir.html. N. Kando, K. Kishida, M. P. Kato, and S. Yamamoto, editors. Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies. National Institute of Informatics, 2016. http:\/\/research.nii.ac.jp\/ntcir\/workshop\/ OnlineProceedings12\/NTCIR\/toc_ntcir.html."},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the NTCIR-12 Conference","author":"Kishida K.","year":"2016","unstructured":"K. Kishida and M. P. Kato . Overview of NTCIR-12 . In Proceedings of the NTCIR-12 Conference , 2016 . K. Kishida and M. P. Kato. Overview of NTCIR-12. In Proceedings of the NTCIR-12 Conference, 2016."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3053408.3053418"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the Seventh International Workshop on Evaluating Information Access (EVIA 2016), a Satellite Workshop of the NTCIR-12 Conference. National Institute of Informatics","author":"Clarke C. L. A.","year":"2016","unstructured":"C. L. A. Clarke and E. Yilmaz , editors . Proceedings of the Seventh International Workshop on Evaluating Information Access (EVIA 2016), a Satellite Workshop of the NTCIR-12 Conference. National Institute of Informatics , 2016 . http:\/\/research.nii.ac.jp\/ntcir\/workshop\/OnlineProceedings12\/EVIA\/toc_evia.html. C. L. A. Clarke and E. Yilmaz, editors. Proceedings of the Seventh International Workshop on Evaluating Information Access (EVIA 2016), a Satellite Workshop of the NTCIR-12 Conference. National Institute of Informatics, 2016. http:\/\/research.nii.ac.jp\/ntcir\/workshop\/OnlineProceedings12\/EVIA\/toc_evia.html."},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the NTCIR-12 Conference.","author":"Kato M. P.","year":"2016","unstructured":"M. P. Kato , T. Sakai , T. Yamamoto , V. Pavlu , H. Morita , and S. Fujita . Overview of the NTCIR-12 MobileClick-2 task . In Proceedings of the NTCIR-12 Conference. , 2016 . M. P. Kato, T. Sakai, T. Yamamoto, V. Pavlu, H. Morita, and S. Fujita. Overview of the NTCIR-12 MobileClick-2 task. In Proceedings of the NTCIR-12 Conference., 2016."},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the NTCIR-12 Conference","author":"Shang L.","year":"2016","unstructured":"L. Shang , T. Sakai , Z. Lu , H. Li , R. Higashinaka , and Y. Miyao . Overview of theNTCIR-12 Short Text Conversation task . In Proceedings of the NTCIR-12 Conference , 2016 . L. Shang, T. Sakai, Z. Lu, H. Li, R. Higashinaka, and Y. Miyao. Overview of theNTCIR-12 Short Text Conversation task. In Proceedings of the NTCIR-12 Conference, 2016."},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the NTCIR-12 Conference","author":"Shibuki H.","year":"2016","unstructured":"H. Shibuki , K. Samamoto , M. Ishioroshi , A. Fujita , Y. Kano , T. Mitamura , T. Mori , and N. Kando . Overview of the NTCIR-12 QA Lab-2 task . In Proceedings of the NTCIR-12 Conference , 2016 . H. Shibuki, K. Samamoto, M. Ishioroshi, A. Fujita, Y. Kano, T. Mitamura, T. Mori, and N. Kando. Overview of the NTCIR-12 QA Lab-2 task. In Proceedings of the NTCIR-12 Conference, 2016."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the NTCIR-12 Conference","author":"Yamamoto T.","year":"2016","unstructured":"T. Yamamoto , Y. Liu , M. Zhang , Z. Dou , K. Zhou , I. Markov , M. P. Kato , H. Ohshima , and S. Fujita . Overview of the NTCIR-12 IMine-2 task . In Proceedings of the NTCIR-12 Conference , 2016 . T. Yamamoto, Y. Liu, M. Zhang, Z. Dou, K. Zhou, I. Markov, M. P. Kato, H. Ohshima, and S. Fujita. Overview of the NTCIR-12 IMine-2 task. In Proceedings of the NTCIR-12 Conference, 2016."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of the NTCIR-12 Conference","author":"Zanibbi R.","year":"2016","unstructured":"R. Zanibbi , A. Aizawa , M. Kohlhase , I. Ounis , G. Topi , and K. Davila . NTCIR-12 MathIR task overview . In Proceedings of the NTCIR-12 Conference , 2016 . R. Zanibbi, A. Aizawa, M. Kohlhase, I. Ounis, G. Topi, and K. Davila. NTCIR-12 MathIR task overview. In Proceedings of the NTCIR-12 Conference, 2016."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3053408.3053413","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3053408.3053413","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:03:35Z","timestamp":1750215815000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3053408.3053413"}},"subtitle":["The Twelfth Round of NII Testbeds and Community for Information Access Research"],"short-title":[],"issued":{"date-parts":[[2017,2,14]]},"references-count":13,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2017,2,14]]}},"alternative-id":["10.1145\/3053408.3053413"],"URL":"https:\/\/doi.org\/10.1145\/3053408.3053413","relation":{},"ISSN":["0163-5840"],"issn-type":[{"type":"print","value":"0163-5840"}],"subject":[],"published":{"date-parts":[[2017,2,14]]},"assertion":[{"value":"2017-02-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}