{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T12:06:49Z","timestamp":1777550809191,"version":"3.51.4"},"reference-count":46,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2025,5,1]],"date-time":"2025-05-01T00:00:00Z","timestamp":1746057600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["72174130"],"award-info":[{"award-number":["72174130"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["DIGITAL HEALTH"],"published-print":{"date-parts":[[2025,5]]},"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To investigate the performance (accuracy, comprehensiveness, consistency, and the necessary information ratio) of large language models (LLMs) in providing knowledge related to respiratory aspiration, and to explore the potential of using LLMs as training tools.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This study was a non-human-subject evaluative research. Two LLMs (GPT-3.5 and GPT-4) were asked 36 questions (32 objective questions and four subjective questions) about respiratory aspiration in English and Chinese. Responses were scored by two experts against gold standards derived from authoritative books. The accuracy of the two LLMs\u2019 responses of objective questions were compared by chi-square test or Fisher exact probability method. For subjective questions, the t-test or Mann\u2013Whitney U test was used to compare the differences between two LLMs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      There was no significant difference in the ratings provided by the two experts. The accuracy scores of objective questions of two LLMs were high. LLMs also performed well on subjective questions, showing high levels of accuracy, comprehensiveness, consistency, and necessary information ratio. And no significant differences were found in the accuracy of the English and Chinese responses to subjective questions between the two LLMs (z\u2009=\u20090.331,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.886; z\u2009=\u20091.703,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.114). There was no significant difference in the comprehensiveness of the English and Chinese responses between the two LLMs (t\u2009=\u20090.787,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.461; t\u2009=\u20091.175,\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.285).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>LLMs demonstrated promising performance in delivering respiratory aspiration-related knowledge and showed promise as supportive tools in training, particularly when their limitations were well understood.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/20552076251349616","type":"journal-article","created":{"date-parts":[[2025,7,11]],"date-time":"2025-07-11T06:27:10Z","timestamp":1752215230000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["To take a different approach: Can large language models provide knowledge related to respiratory aspiration?"],"prefix":"10.1177","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8439-8057","authenticated-orcid":false,"given":"Yirou","family":"Niu","sequence":"first","affiliation":[{"name":"School of Nursing, Capital Medical University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3176-1139","authenticated-orcid":false,"given":"Shuojin","family":"Fu","sequence":"additional","affiliation":[{"name":"School of Nursing, Capital Medical University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5898-9415","authenticated-orcid":false,"given":"Zehui","family":"Xuan","sequence":"additional","affiliation":[{"name":"School of Nursing, Capital Medical University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruifu","family":"Kang","sequence":"additional","affiliation":[{"name":"School of Nursing, Capital Medical University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9460-0063","authenticated-orcid":false,"given":"Zhifang","family":"Ren","sequence":"additional","affiliation":[{"name":"School of Nursing, Capital Medical University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2469-0563","authenticated-orcid":false,"given":"Shuai","family":"Jin","sequence":"additional","affiliation":[{"name":"School of Nursing, Capital Medical University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1295-4245","authenticated-orcid":false,"given":"Yanling","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Nursing, Capital Medical University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5657-2863","authenticated-orcid":false,"given":"Qian","family":"Xiao","sequence":"additional","affiliation":[{"name":"School of Nursing, Capital Medical University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2025,7,10]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12931-023-02354-0"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1097\/EA9.0000000000000070"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1186\/2110-5820-4-7"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1177\/01945998211049114"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/s41999-022-00689-3"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1513\/AnnalsATS.201709-728OC"},{"key":"e_1_3_2_8_2","first-page":"171","article-title":"Determinants of hospital stay, mortality, and readmission in aspiration pneumonia patients","volume":"6","author":"Y\u0131ld\u0131zeli \u015eO","year":"2024","unstructured":"Y\u0131ld\u0131zeli \u015eO. Determinants of hospital stay, mortality, and readmission in aspiration pneumonia patients. Eur J Geriatric Gerontol 2024; 6: 171\u2013177.","journal-title":"Eur J Geriatric Gerontol"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.resinv.2021.09.012"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1111\/1460-6984.12725"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijnurstu.2023.104468"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1111\/iwj.14219"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1093\/geront\/gnac162"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00455-022-10548-9"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-023-02289-5"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.2337\/dc23-0197"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.3350\/cmh.2023.0089"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.230922"},{"key":"e_1_3_2_19_2","first-page":"48","article-title":"Exploring new educational approaches in neuropathic pain: assessing accuracy and consistency of AI responses from GPT-3.5 and GPT-4","volume":"1","author":"Garc\u00eda-Rudolph A","year":"2024","unstructured":"Garc\u00eda-Rudolph A, Sanchez-Pinsach D, Opisso E, et al. Exploring new educational approaches in neuropathic pain: assessing accuracy and consistency of AI responses from GPT-3.5 and GPT-4. Pain Med 2024; 1: 48\u201350. 2024\/10\/10.","journal-title":"Pain Med"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1055\/b-006-149650"},{"key":"e_1_3_2_21_2","volume-title":"Assessment and treatment of dysphagia","author":"Zulin D","year":"2017","unstructured":"Zulin D. Assessment and treatment of dysphagia. Beijing, China: People's Medical Publishing House, 2017."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.3390\/jcm13226913"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1097\/MOU.0000000000001272"},{"key":"e_1_3_2_24_2","first-page":"20250413","article-title":"Comparative performance analysis of global and Chinese-domain large language models for myopia","author":"Jiang Z","year":"2025","unstructured":"Jiang Z, Xu Y, Lim ZW, et al. Comparative performance analysis of global and Chinese-domain large language models for myopia. Eye (Lond) 2025 20250413.","journal-title":"Eye (Lond)"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1097\/BOR.0000000000000981"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1002\/alr.23310"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.seizure.2023.11.013"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-023-06647-8"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajem.2023.11.063"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2313790120"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.3389\/frai.2023.1130913"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.2196\/48009"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1080\/15265161.2023.2233356"},{"key":"e_1_3_2_34_2","article-title":"Harnessing large language models in nursing care planning: opportunities, challenges, and ethical considerations","volume":"15","author":"Nashwan AJ","year":"2023","unstructured":"Nashwan AJ, Abujaber AA. Harnessing large language models in nursing care planning: opportunities, challenges, and ethical considerations. Cureus 2023; 15: e40542. 2023\/07\/19.","journal-title":"Cureus"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.3389\/fsurg.2022.862322"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1080\/15265161.2023.2233357"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-023-01744-0"},{"key":"e_1_3_2_38_2","article-title":"Can LLMs improve existing scenario of healthcare?","volume":"80","author":"Ray PP","year":"2023","unstructured":"Ray PP. Can LLMs improve existing scenario of healthcare? J Hepatol 2023; 80: e28\u2013e29. 2023\/08\/19.","journal-title":"J Hepatol"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1002\/path.6232"},{"key":"e_1_3_2_40_2","first-page":"1","article-title":"Pre-train, prompt, and predict: a systematic survey of prompting methods in natural language processing","volume":"55","author":"Liu PF","year":"2023","unstructured":"Liu PF, Yuan WZ, Fu JL, et al. Pre-train, prompt, and predict: a systematic survey of prompting methods in natural language processing. ACM Comput Surv 2023; 55: 1\u201335. 2023\/03\/01.","journal-title":"ACM Comput Surv"},{"key":"e_1_3_2_41_2","first-page":"1","article-title":"Twelve tips to leverage AI for efficient and effective medical question generation: a guide for educators using Chat GPT","volume":"46","author":"Indran IR","year":"2023","unstructured":"Indran IR, Paramanathan P, Gupta N, et al. Twelve tips to leverage AI for efficient and effective medical question generation: a guide for educators using Chat GPT. Med Teach 2023; 46: 1\u20136. 2023\/12\/26.","journal-title":"Med Teach"},{"key":"e_1_3_2_42_2","article-title":"A mathematical investigation of hallucination and creativity in GPT models","volume":"11","author":"Lee M","year":"2023","unstructured":"Lee M. A mathematical investigation of hallucination and creativity in GPT models. Mathematics 2023; 11: 2320. 2023\/06\/10.","journal-title":"Mathematics"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2316205120"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-023-03023-4"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.2196\/50638"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3296144"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-023-02681-3"}],"container-title":["DIGITAL HEALTH"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20552076251349616","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/20552076251349616","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20552076251349616","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T17:52:19Z","timestamp":1777398739000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/20552076251349616"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5]]},"references-count":46,"alternative-id":["10.1177\/20552076251349616"],"URL":"https:\/\/doi.org\/10.1177\/20552076251349616","relation":{},"ISSN":["2055-2076","2055-2076"],"issn-type":[{"value":"2055-2076","type":"print"},{"value":"2055-2076","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5]]},"article-number":"20552076251349616"}}