{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,19]],"date-time":"2026-09-19T12:01:26Z","timestamp":1789819286087,"version":"4.0.1"},"reference-count":63,"publisher":"Wiley","issue":"12","license":[{"start":{"date-parts":[[2023,2,7]],"date-time":"2023-02-07T00:00:00Z","timestamp":1675728000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32161143022"],"award-info":[{"award-number":["32161143022"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32171080"],"award-info":[{"award-number":["32171080"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["71942003"],"award-info":[{"award-number":["71942003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32100886"],"award-info":[{"award-number":["32100886"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32200914"],"award-info":[{"award-number":["32200914"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31900766"],"award-info":[{"award-number":["31900766"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["advanced.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Advanced Science"],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Natural language processing (NLP) is central to the communication with machines and among ourselves, and NLP research field has long sought to produce human\u2010quality language. Identification of informative criteria for measuring NLP\u2010produced language quality will support development of ever\u2010better NLP tools. The authors hypothesize that mentalizing network neural activity may be used to distinguish NLP\u2010produced language from human\u2010produced language, even for cases where human judges cannot subjectively distinguish the language source. Using the social chatbots Google Meena in English and Microsoft XiaoIce in Chinese to generate NLP\u2010produced language, behavioral tests which reveal that variance of personality perceived from chatbot chats is larger than for human chats are conducted, suggesting that chatbot language usage patterns are not stable. Using an identity rating task with functional magnetic resonance imaging, neuroimaging analyses which reveal distinct patterns of brain activity in the mentalizing network including the DMPFC and rTPJ in response to chatbot versus human chats that cannot be distinguished subjectively are conducted. This study illustrates a promising empirical basis for measuring the quality of NLP\u2010produced language: adding a judge's implicit perception as an additional criterion.<\/jats:p>","DOI":"10.1002\/advs.202203990","type":"journal-article","created":{"date-parts":[[2023,2,7]],"date-time":"2023-02-07T04:26:05Z","timestamp":1675743965000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Implicit Perception of Differences between NLP\u2010Produced and Human\u2010Produced Language in the Mentalizing Network"],"prefix":"10.1002","volume":"10","author":[{"given":"Zhengde","family":"Wei","sequence":"first","affiliation":[{"name":"Department of Psychology School of Humanities &amp; Social Science University of Science &amp; Technology of China  Hefei Anhui 230026 China"},{"name":"Department of Radiology the First Affiliated Hospital of USTC School of Life Science Division of Life Science and Medicine University of Science &amp; Technology of China  Hefei 230027 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Psychology School of Humanities &amp; Social Science University of Science &amp; Technology of China  Hefei Anhui 230026 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qian","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Radiology the First Affiliated Hospital of USTC School of Life Science Division of Life Science and Medicine University of Science &amp; Technology of China  Hefei 230027 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pengyu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Radiology the First Affiliated Hospital of USTC School of Life Science Division of Life Science and Medicine University of Science &amp; Technology of China  Hefei 230027 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Longxi","family":"Zhou","sequence":"additional","affiliation":[{"name":"Computational Bioscience Research Center (CBRC) King Abdullah University of Science and Technology (KAUST)  Thuwal 4700 Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiecheng","family":"Ren","sequence":"additional","affiliation":[{"name":"Department of Radiology the First Affiliated Hospital of USTC School of Life Science Division of Life Science and Medicine University of Science &amp; Technology of China  Hefei 230027 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi","family":"Piao","sequence":"additional","affiliation":[{"name":"Department of Radiology the First Affiliated Hospital of USTC School of Life Science Division of Life Science and Medicine University of Science &amp; Technology of China  Hefei 230027 China"},{"name":"Application Technology Center of Physical Therapy to Brain Disorders Institute of Advanced Technology University of Science &amp; Technology of China  Hefei 230026 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bensheng","family":"Qiu","sequence":"additional","affiliation":[{"name":"Centers for Biomedical Engineering School of Information Science and Technology University of Science &amp; Technology of China  Hefei Anhui 230027 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xing","family":"Xie","sequence":"additional","affiliation":[{"name":"Microsoft Research Asia  Beijing 100080 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suiping","family":"Wang","sequence":"additional","affiliation":[{"name":"Philosophy and Social Science Laboratory of Reading and Development in Children and Adolescents (South China Normal University) Ministry of Education  Guangzhou 510631 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jia","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Cognitive Neuroscience and Learning Beijing Normal University  Beijing 100875 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daren","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Psychology School of Humanities &amp; Social Science University of Science &amp; Technology of China  Hefei Anhui 230026 China"},{"name":"Department of Radiology the First Affiliated Hospital of USTC School of Life Science Division of Life Science and Medicine University of Science &amp; Technology of China  Hefei 230027 China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roi Cohen","family":"Kadosh","sequence":"additional","affiliation":[{"name":"Faculty of Health &amp; Medical Sciences University of Surrey  30AD04 Elizabeth Fry Building Guildford GU2 7XH UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7541-0130","authenticated-orcid":false,"given":"Xiaochu","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Psychology School of Humanities &amp; Social Science University of Science &amp; Technology of China  Hefei Anhui 230026 China"},{"name":"Department of Radiology the First Affiliated Hospital of USTC School of Life Science Division of Life Science and Medicine University of Science &amp; Technology of China  Hefei 230027 China"},{"name":"Centers for Biomedical Engineering School of Information Science and Technology University of Science &amp; Technology of China  Hefei Anhui 230027 China"},{"name":"Application Technology Center of Physical Therapy to Brain Disorders Institute of Advanced Technology University of Science &amp; Technology of China  Hefei 230026 China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2023,2,7]]},"reference":[{"key":"e_1_2_10_1_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.253.5025.1242"},{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0958344008000815"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1075\/ijcl.10.4.06sha"},{"key":"e_1_2_10_4_1","unstructured":"D.Adiwardana M. T.Luong D. R.So J.Hall N.Fiedel R.Thoppilan Z.Yang A.Kulshreshtha G.Nemade Y.Lu arXiv:2001.09977v32020."},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2018.10.006"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2016.01.004"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2018.05.007"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1159\/000475716"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.2147\/CIA.S114100"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8295.1990.tb02342.x"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.0956-7976.2004.00760.x"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12978-018-0494-7"},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0196821"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sxmr.2020.06.005"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2011.01.005"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.54.101601.145225"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.54.101601.145041"},{"key":"e_1_2_10_18_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-neuro-071013-013847"},{"key":"e_1_2_10_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2017.11.006"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.77.6.1296"},{"key":"e_1_2_10_21_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.84.4.857"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1631\/FITEE.1700826"},{"key":"e_1_2_10_23_1","doi-asserted-by":"publisher","DOI":"10.2991\/nlpr.d.210223.001"},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1094"},{"key":"e_1_2_10_25_1","unstructured":"C.Park Y.Jang S.Lee S.Park H.Lim arXiv:2112.04126 2021."},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10475"},{"key":"e_1_2_10_27_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-09927-y"},{"key":"e_1_2_10_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.0956-7976.2004.00760.x"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tree.2012.09.003"},{"key":"e_1_2_10_30_1","first-page":"47","volume-title":"Ro\u2010Man 2004: 13th IEEE Int. Workshop Robot Human Interactive Commun., Proc.","author":"Woods S.","year":"2004"},{"key":"e_1_2_10_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropsychologia.2005.07.017"},{"key":"e_1_2_10_32_1","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhu116"},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cortex.2019.12.031"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.1093\/scan\/nst048"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X00046185"},{"key":"e_1_2_10_36_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2018.0033"},{"key":"e_1_2_10_37_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0011577"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2012.00103"},{"key":"e_1_2_10_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.rasd.2014.10.015"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0002597"},{"key":"e_1_2_10_41_1","doi-asserted-by":"publisher","DOI":"10.1162\/coli_a_00368"},{"key":"e_1_2_10_42_1","unstructured":"M.\u2010T. L.Daniel Adiwardana D. R.So J.Hall N.Fiedel R.Thoppilan Z.iYang A.Kulshreshtha G.Nemade Y.Lu Q. V.Le arXiv:2001.09977v3 2020."},{"key":"e_1_2_10_43_1","doi-asserted-by":"publisher","DOI":"10.2466\/pr0.2002.91.2.407"},{"key":"e_1_2_10_44_1","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.5547-11.2012"},{"key":"e_1_2_10_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2016.03.020"},{"key":"e_1_2_10_46_1","doi-asserted-by":"publisher","DOI":"10.2307\/2182440"},{"key":"e_1_2_10_47_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.27.070203.144230"},{"key":"e_1_2_10_48_1","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bht112"},{"key":"e_1_2_10_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0277(95)00692-R"},{"key":"e_1_2_10_50_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001756-199509000-00009"},{"key":"e_1_2_10_51_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2002.1218"},{"key":"e_1_2_10_52_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.55.090902.142044"},{"key":"e_1_2_10_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.02.067"},{"key":"e_1_2_10_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tics.2004.10.003"},{"key":"e_1_2_10_55_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-psych-010418-103244"},{"key":"e_1_2_10_56_1","doi-asserted-by":"publisher","DOI":"10.1037\/pspp0000066"},{"key":"e_1_2_10_57_1","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen J.","year":"1988"},{"key":"e_1_2_10_58_1","doi-asserted-by":"publisher","DOI":"10.1002\/1097-4679(195904)15:2<182::AID-JCLP2270150219>3.0.CO;2-7"},{"key":"e_1_2_10_59_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327752jpa5004_7"},{"key":"e_1_2_10_60_1","doi-asserted-by":"publisher","DOI":"10.2147\/JMDH.S104807"},{"key":"e_1_2_10_61_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2006.03.040"},{"key":"e_1_2_10_62_1","doi-asserted-by":"publisher","DOI":"10.1162\/08989290260138672"},{"key":"e_1_2_10_63_1","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.2001.0789"}],"container-title":["Advanced Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/advs.202203990","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/advs.202203990","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/advs.202203990","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,6]],"date-time":"2025-10-06T23:21:43Z","timestamp":1759792903000},"score":1,"resource":{"primary":{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/10.1002\/advs.202203990"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,7]]},"references-count":63,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["10.1002\/advs.202203990"],"URL":"https:\/\/doi.org\/10.1002\/advs.202203990","archive":["Portico"],"relation":{},"ISSN":["2198-3844","2198-3844"],"issn-type":[{"value":"2198-3844","type":"print"},{"value":"2198-3844","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,7]]},"assertion":[{"value":"2022-07-12","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-02-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2203990"}}