{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,4]],"date-time":"2025-07-04T05:56:48Z","timestamp":1751608608697,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,5,11]],"date-time":"2024-05-11T00:00:00Z","timestamp":1715385600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,5,11]]},"DOI":"10.1145\/3613905.3650975","type":"proceedings-article","created":{"date-parts":[[2024,5,11]],"date-time":"2024-05-11T08:15:21Z","timestamp":1715415321000},"page":"1-9","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Comparing ChatGPT and Humans on World Knowledge and Common-sense Reasoning Tasks: A case study of the Japanese Winograd Schema Challenge"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-3136-9416","authenticated-orcid":false,"given":"May Lynn","family":"Reese","sequence":"first","affiliation":[{"name":"Department of English Language and Literature, Linguistics, San Francisco State University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3640-2688","authenticated-orcid":false,"given":"Anastasia","family":"Smirnova","sequence":"additional","affiliation":[{"name":"Department of English Language and Literature, Linguistics Program, San Francisco State University, United States"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,5,11]]},"reference":[{"key":"e_1_3_3_3_1_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.emnlp-main.258"},{"key":"e_1_3_3_3_2_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-1504"},{"key":"e_1_3_3_3_3_1","volume-title":"Proceedings of the 26th Modern AI and Cognitive Science Conference 2015, Greensboro, NC, USA, April 25-26, 2015(CEUR Workshop Proceedings, Vol.\u00a01353)","author":"Bender David","year":"2015","unstructured":"David Bender. 2015. Establishing a Human Baseline for the Winograd Schema Challenge. In Proceedings of the 26th Modern AI and Cognitive Science Conference 2015, Greensboro, NC, USA, April 25-26, 2015(CEUR Workshop Proceedings, Vol.\u00a01353), Michael Glass and Jung\u00a0Hee Kim (Eds.). CEUR-WS.org, 39\u201345. https:\/\/ceur-ws.org\/Vol-1353\/paper_30.pdf"},{"key":"e_1_3_3_3_4_1","unstructured":"Timoth\u00e9e Bernard and Ting Han. 2020. Mandarinograd: A Chinese Collection of Winograd Schemas. In Proceedings of the Twelfth Language Resources and Evaluation Conference Nicoletta Calzolari Fr\u00e9d\u00e9ric B\u00e9chet Philippe Blache Khalid Choukri Christopher Cieri Thierry Declerck Sara Goggi Hitoshi Isahara Bente Maegaard Joseph Mariani H\u00e9l\u00e8ne Mazo Asuncion Moreno Jan Odijk and Stelios Piperidis (Eds.). European Language Resources Association Marseille France 21\u201326. https:\/\/aclanthology.org\/2020.lrec-1.3"},{"key":"e_1_3_3_3_5_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1"},{"key":"e_1_3_3_3_6_1","volume-title":"Language models are few-shot learners. Advances in neural information processing systems 33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared\u00a0D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877\u20131901."},{"key":"e_1_3_3_3_7_1","unstructured":"Zhenguang\u00a0G. Cai David\u00a0A. Haslett Xufeng Duan Shuqi Wang and Martin\u00a0J. Pickering. 2023. Does ChatGPT resemble humans in language use?arxiv:2303.08014\u00a0[cs.CL]"},{"key":"e_1_3_3_3_8_1","volume-title":"Proceedings of the Annual Meeting of the Cognitive Science Society.","author":"Collins M.","year":"2022","unstructured":"Katherine\u00a0M. Collins, Catherine Wong, Jiahai Feng, Megan Wei, and Josh Tenenbaum. 2022. Structured, flexible, and robust: benchmarking and improving large language models towards more human-like behavior in out-of-distribution reasoning tasks. In Proceedings of the Annual Meeting of the Cognitive Science Society."},{"key":"e_1_3_3_3_9_1","volume-title":"Retrieved","author":"Davis Ernest","year":"2024","unstructured":"Ernest Davis, Leora Morgenstern, and Charles Ortiz. [n. d.]. The Winograd Schema Challenge. Retrieved March 18, 2024 from https:\/\/cs.nyu.edu\/\u00a0davise\/papers\/WinogradSchemas\/WS.html"},{"key":"e_1_3_3_3_10_1","unstructured":"J\u00f6rg Frohberg and Frank Binder. 2022. CRASS: A Novel Data Set and Benchmark to Test Counterfactual Reasoning of Large Language Models. In Proceedings of the Thirteenth Language Resources and Evaluation Conference Nicoletta Calzolari Fr\u00e9d\u00e9ric B\u00e9chet Philippe Blache Khalid Choukri Christopher Cieri Thierry Declerck Sara Goggi Hitoshi Isahara Bente Maegaard Joseph Mariani H\u00e9l\u00e8ne Mazo Jan Odijk and Stelios Piperidis (Eds.). European Language Resources Association Marseille France 2126\u20132140. https:\/\/aclanthology.org\/2022.lrec-1.229"},{"key":"e_1_3_3_3_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/cogs.13386"},{"key":"e_1_3_3_3_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2023.103971"},{"key":"e_1_3_3_3_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/3031843.3031909"},{"key":"e_1_3_3_3_14_1","doi-asserted-by":"publisher","unstructured":"Gabriela Melo Vinicius Imaizumi and F\u00e1bio Cozman. 2019. Winograd Schemas in Portuguese. In Anais do XVI Encontro Nacional de Intelig\u00eancia Artificial e Computacional (Salvador). SBC Porto Alegre RS Brasil 787\u2013798. https:\/\/doi.org\/10.5753\/eniac.2019.9334","DOI":"10.5753\/eniac.2019.9334"},{"key":"e_1_3_3_3_15_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v37i1.2639"},{"key":"e_1_3_3_3_16_1","volume-title":"Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC","author":"Nakamura Tetsuaki","year":"2018","unstructured":"Tetsuaki Nakamura and Daisuke Kawahara. 2018. JFCKB: Japanese Feature Change Knowledge Base. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), Nicoletta Calzolari, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Koiti Hasida, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, H\u00e9l\u00e8ne Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis, and Takenobu Tokunaga (Eds.). European Language Resources Association (ELRA), Miyazaki, Japan. https:\/\/aclanthology.org\/L18-1223"},{"key":"e_1_3_3_3_17_1","doi-asserted-by":"crossref","unstructured":"Nikita Nangia and Samuel\u00a0R. Bowman. 2020. Human vs. Muppet: A conservative estimate of human performance on the GLUE benchmark. In ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics Proceedings of the Conference(ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics Proceedings of the Conference). Association for Computational Linguistics (ACL) 4566\u20134575.","DOI":"10.18653\/v1\/P19-1449"},{"volume-title":"Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Jun\u2019ichi Tsujii, James Henderson, and Marius Pa\u015fca (Eds.)","author":"Rahman Altaf","key":"e_1_3_3_3_18_1","unstructured":"Altaf Rahman and Vincent Ng. 2012. Resolving Complex Cases of Definite Pronouns: The Winograd Schema Challenge. In Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, Jun\u2019ichi Tsujii, James Henderson, and Marius Pa\u015fca (Eds.). Association for Computational Linguistics, Jeju Island, Korea, 777\u2013789. https:\/\/aclanthology.org\/D12-1071"},{"key":"e_1_3_3_3_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3474381"},{"key":"e_1_3_3_3_20_1","first-page":"1","article-title":"Shizen Gengo Shori Gijutsu no Genjo to Tenbo -era bunseki purojekuto o toshite-:[Kiso Gijutsu]3.7 Chishiki Kakutoko","volume":"57","author":"Shibata Tomohide","year":"2015","unstructured":"Tomohide Shibata. 2015. Shizen Gengo Shori Gijutsu no Genjo to Tenbo -era bunseki purojekuto o toshite-:[Kiso Gijutsu]3.7 Chishiki Kakutoko. Johoshori 57, 1 (dec 2015), 22\u201323.","journal-title":"Johoshori"},{"key":"e_1_3_3_3_21_1","volume-title":"Proceedings of the 21th Annual Meeting of the Association for Natural Language Processing. The Association for Natural Language Processing, Kyoto, 493\u2013496","author":"Shibata Tomohide","year":"2015","unstructured":"Tomohide Shibata, Shotaro Kohama, and Sadao Kurohashi. 2015. Nihon Go Winograd Schema Challenge no Kochiku to Bunseki. In Proceedings of the 21th Annual Meeting of the Association for Natural Language Processing. The Association for Natural Language Processing, Kyoto, 493\u2013496."},{"volume-title":"The languages of Japan","author":"Shibatani Masayoshi","key":"e_1_3_3_3_22_1","unstructured":"Masayoshi Shibatani. 1990. The languages of Japan. Cambridge University Press."},{"key":"e_1_3_3_3_23_1","doi-asserted-by":"publisher","DOI":"10.20965\/jaciii.2023.p0511"},{"key":"e_1_3_3_3_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1"},{"key":"e_1_3_3_3_25_1","volume-title":"On the Planning Abilities of Large Language Models - A Critical Investigation. In Thirty-seventh Conference on Neural Information Processing Systems.","author":"Valmeekam Karthik","year":"2023","unstructured":"Karthik Valmeekam, Matthew Marquez, Sarath Sreedharan, and Subbarao Kambhampati. 2023. On the Planning Abilities of Large Language Models - A Critical Investigation. In Thirty-seventh Conference on Neural Information Processing Systems."},{"volume-title":"SuperGLUE: a stickier benchmark for general-purpose language understanding systems","author":"Wang Alex","key":"e_1_3_3_3_26_1","unstructured":"Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel\u00a0R. Bowman. 2019. SuperGLUE: a stickier benchmark for general-purpose language understanding systems. Curran Associates Inc., Red Hook, NY, USA."},{"key":"e_1_3_3_3_27_1","doi-asserted-by":"publisher","unstructured":"Alex Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy and Samuel Bowman. 2018. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding. In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP Tal Linzen Grzegorz Chrupa\u0142a and Afra Alishahi (Eds.). Association for Computational Linguistics Brussels Belgium 353\u2013355. https:\/\/doi.org\/10.18653\/v1\/W18-5446","DOI":"10.18653\/v1"}],"event":{"name":"CHI '24: CHI Conference on Human Factors in Computing Systems","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction","SIGACCESS ACM Special Interest Group on Accessible Computing"],"location":"Honolulu HI USA","acronym":"CHI '24"},"container-title":["Extended Abstracts of the CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3613905.3650975","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3613905.3650975","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T23:56:52Z","timestamp":1750291012000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3613905.3650975"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,11]]},"references-count":27,"alternative-id":["10.1145\/3613905.3650975","10.1145\/3613905"],"URL":"https:\/\/doi.org\/10.1145\/3613905.3650975","relation":{},"subject":[],"published":{"date-parts":[[2024,5,11]]},"assertion":[{"value":"2024-05-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}