{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,21]],"date-time":"2026-10-21T20:12:35Z","timestamp":1792613555310,"version":"4.5.0"},"reference-count":37,"publisher":"BMJ","license":[{"start":{"date-parts":[[2024,12,19]],"date-time":"2024-12-19T00:00:00Z","timestamp":1734566400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ"],"accepted":{"date-parts":[[2024,10,27]]},"abstract":"<jats:title>Abstract<\/jats:title>\n<jats:sec>\n<jats:title>Objective<\/jats:title>\n<jats:p>To evaluate the cognitive abilities of the leading large language models and identify their susceptibility to cognitive impairment, using the Montreal Cognitive Assessment (MoCA) and additional tests.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Design<\/jats:title>\n<jats:p>Cross sectional analysis.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Setting<\/jats:title>\n<jats:p>Online interaction with large language models via text based prompts.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Participants<\/jats:title>\n<jats:p>Publicly available large language models, or \u201cchatbots\u201d: ChatGPT versions 4 and 4o (developed by OpenAI), Claude 3.5 \u201cSonnet\u201d (developed by Anthropic), and Gemini versions 1 and 1.5 (developed by Alphabet).<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Assessments<\/jats:title>\n<jats:p>The MoCA test (version 8.1) was administered to the leading large language models with instructions identical to those given to human patients. Scoring followed official guidelines and was evaluated by a practising neurologist. Additional assessments included the Navon figure, cookie theft picture, Poppelreuter figure, and Stroop test.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Main outcome measures<\/jats:title>\n<jats:p>MoCA scores, performance in visuospatial\/executive tasks, and Stroop test results.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>ChatGPT 4o achieved the highest score on the MoCA test (26\/30), followed by ChatGPT 4 and Claude (25\/30), with Gemini 1.0 scoring lowest (16\/30). All large language models showed poor performance in visuospatial\/executive tasks. Gemini models failed at the delayed recall task. Only ChatGPT 4o succeeded in the incongruent stage of the Stroop test.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title>Conclusions<\/jats:title>\n<jats:p>With the exception of ChatGPT 4o, almost all large language models subjected to the MoCA test showed signs of mild cognitive impairment. Moreover, as in humans, age is a key determinant of cognitive decline: \u201colder\u201d chatbots, like older patients, tend to perform worse on the MoCA test. These findings challenge the assumption that artificial intelligence will soon replace human doctors, as the cognitive impairment evident in leading chatbots may affect their reliability in medical diagnostics and undermine patients\u2019 confidence.<\/jats:p>\n<\/jats:sec>","DOI":"10.1136\/bmj-2024-081948","type":"journal-article","created":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T18:14:37Z","timestamp":1734718477000},"page":"e081948","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":14,"title":["Age against the machine\u2014susceptibility of large language models to cognitive impairment: cross sectional analysis"],"prefix":"10.1136","author":[{"given":"Roy","family":"Dayan","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Uliel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4906-0779","authenticated-orcid":false,"given":"Gal","family":"Koplewitz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2024,12,19]]},"reference":[{"key":"2024122011200815000_387.dec18_11.e081948.1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra2302038"},{"key":"2024122011200815000_387.dec18_11.e081948.2","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.k4563"},{"key":"2024122011200815000_387.dec18_11.e081948.3","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-41032-5"},{"key":"2024122011200815000_387.dec18_11.e081948.4","doi-asserted-by":"publisher","DOI":"10.1056\/AIdbp2300192"},{"key":"2024122011200815000_387.dec18_11.e081948.5","doi-asserted-by":"publisher","DOI":"10.1093\/ehjdh\/ztad029"},{"key":"2024122011200815000_387.dec18_11.e081948.6","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjms.2023.08.001"},{"key":"2024122011200815000_387.dec18_11.e081948.7","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2023.1296615"},{"key":"2024122011200815000_387.dec18_11.e081948.8","doi-asserted-by":"publisher","DOI":"10.1136\/bmjno-2023-000530"},{"key":"2024122011200815000_387.dec18_11.e081948.9","doi-asserted-by":"publisher","DOI":"10.1136\/bmj-2022-072826"},{"key":"2024122011200815000_387.dec18_11.e081948.10","first-page":"192","article-title":"Can ChatGPT pass the \u201cIranian Endodontics Specialist Board\u201d exam?","volume":"18","author":"Farajollahi","year":"2023","journal-title":"Iran Endod J"},{"key":"2024122011200815000_387.dec18_11.e081948.11","doi-asserted-by":"publisher","DOI":"10.1097\/JCMA.0000000000000928"},{"key":"2024122011200815000_387.dec18_11.e081948.12","doi-asserted-by":"publisher","DOI":"10.1016\/j.jse.2024.02.029"},{"key":"2024122011200815000_387.dec18_11.e081948.13","unstructured":"Baker P. Biden Drops Out of Race, Scrambling the Campaign for the White House. 2024. https:\/\/www.nytimes.com\/2024\/07\/21\/us\/politics\/biden-drops-out.html."},{"key":"2024122011200815000_387.dec18_11.e081948.14","unstructured":"Baker P. \u2018Person. Woman. Man. Camera. TV.\u2019 Didn\u2019t Mean What Trump Hoped It Did. 2020. https:\/\/www.nytimes.com\/2020\/07\/23\/us\/politics\/person-woman-man-camera-tv-trump.html."},{"key":"2024122011200815000_387.dec18_11.e081948.15","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-024-03097-1"},{"key":"2024122011200815000_387.dec18_11.e081948.16","doi-asserted-by":"publisher","DOI":"10.1136\/bmj-2023-078538"},{"key":"2024122011200815000_387.dec18_11.e081948.17","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-023-34518-9"},{"key":"2024122011200815000_387.dec18_11.e081948.18","doi-asserted-by":"publisher","DOI":"10.1111\/j.1532-5415.2005.53221.x"},{"key":"2024122011200815000_387.dec18_11.e081948.19","doi-asserted-by":"publisher","DOI":"10.1177\/0145482X1010400606"},{"key":"2024122011200815000_387.dec18_11.e081948.20","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(77)90012-3"},{"key":"2024122011200815000_387.dec18_11.e081948.21","doi-asserted-by":"publisher","DOI":"10.1037\/t27208-000"},{"key":"2024122011200815000_387.dec18_11.e081948.22","unstructured":"Poppelreuter W . Die psychischen Sch\u00e4digungen durch Kopfschuss im Kriege 1914\/17. Verlag Leopold Voss, 1917."},{"key":"2024122011200815000_387.dec18_11.e081948.23","doi-asserted-by":"publisher","DOI":"10.1016\/0887-6177(94)00049-V"},{"key":"2024122011200815000_387.dec18_11.e081948.24","doi-asserted-by":"publisher","DOI":"10.1037\/h0054651"},{"key":"2024122011200815000_387.dec18_11.e081948.25","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2014.00265"},{"key":"2024122011200815000_387.dec18_11.e081948.26","doi-asserted-by":"publisher","DOI":"10.1212\/CON.0000000000001089"},{"key":"2024122011200815000_387.dec18_11.e081948.27","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-4422(11)70289-7"},{"key":"2024122011200815000_387.dec18_11.e081948.28","doi-asserted-by":"publisher","DOI":"10.1038\/srep00411"},{"key":"2024122011200815000_387.dec18_11.e081948.29","doi-asserted-by":"publisher","DOI":"10.1017\/S1355617704104037"},{"key":"2024122011200815000_387.dec18_11.e081948.30","unstructured":"Apple. The future is here: iPhone X. 2017. https:\/\/www.apple.com\/newsroom\/2017\/09\/the-future-is-here-iphone-x\/."},{"key":"2024122011200815000_387.dec18_11.e081948.31","doi-asserted-by":"publisher","DOI":"10.1590\/S1980-57642011DN05040002"},{"key":"2024122011200815000_387.dec18_11.e081948.32","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/10776.001.0001"},{"key":"2024122011200815000_387.dec18_11.e081948.33","doi-asserted-by":"crossref","unstructured":"Hodges JR . Cognitive assessment for clinicians. 3rd ed. Oxford University Press, 2018.","DOI":"10.1093\/med\/9780198749189.001.0001"},{"key":"2024122011200815000_387.dec18_11.e081948.34","doi-asserted-by":"publisher","DOI":"10.1038\/s41531-022-00304-z"},{"key":"2024122011200815000_387.dec18_11.e081948.35","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2021.706695"},{"key":"2024122011200815000_387.dec18_11.e081948.36","doi-asserted-by":"publisher","DOI":"10.1177\/0891988719834349"},{"key":"2024122011200815000_387.dec18_11.e081948.37","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1716381"}],"container-title":["BMJ"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/data.bmj.org\/tdm\/10.1136\/bmj-2024-081948","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmj-2024-081948","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,24]],"date-time":"2024-12-24T01:44:45Z","timestamp":1735004685000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.bmj.com\/lookup\/doi\/10.1136\/bmj-2024-081948"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,19]]},"references-count":37,"alternative-id":["10.1136\/bmj-2024-081948"],"URL":"https:\/\/doi.org\/10.1136\/bmj-2024-081948","relation":{},"ISSN":["1756-1833"],"issn-type":[{"value":"1756-1833","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,19]]}}}