{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T20:35:45Z","timestamp":1790627745455,"version":"4.1.0"},"reference-count":30,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["DIGITAL HEALTH"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To compare ten large language models (LLMs) from seven AI companies, across free and paid tiers, on inhaler technique instruction accuracy for ten devices, benchmarked against GINA 2025 and GOLD 2026 strategy reports.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>In a cross-sectional, blinded evaluation, ten LLMs (ChatGPT Free\/Plus, Claude Free\/Pro, Gemini, Google AI Pro, DeepSeek, Microsoft Copilot, Perplexity AI, Meta AI) were queried between 10\u201317 March 2026 via each vendor\u2019s official web interface. Fifty standardised prompts (10 devices \u00d7 5 question types) were submitted in triplicate on different days, yielding 1500 outputs. Two pulmonologists and one allergist scored seven metrics step-completion rate, critical and non-critical error counts, step-sequencing accuracy, safety-warning score, and Likert-scaled overall accuracy and patient comprehensibility against a gold standard derived from GINA 2025, GOLD 2026, the ERS\/ISAM Task Force consensus, and manufacturer leaflets.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Paid tiers outperformed free tiers on five of seven metrics (Mann\u2013Whitney U; all\n                      <jats:italic toggle=\"yes\">p<\/jats:italic>\n                      &lt; 0.001), with a 24-fold reduction in critical errors (0.48 \u2192 0.02) and a 12.9-point gain in safety-warning coverage (62.4% \u2192 75.3%). Google AI Pro achieved the highest overall accuracy (4.98 \u00b1 0.13); Microsoft Copilot (3.23) and Perplexity AI (2.83) ranked lowest. Claude Free surpassed Claude Pro on safety warnings (99.2% vs. 66.7%;\n                      <jats:italic toggle=\"yes\">r<\/jats:italic>\n                      = 0.86). Test-retest reliability met ICC \u2265 0.75 for only two metrics.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Paid subscriptions yield meaningful but non-uniform gains in inhaler-instruction accuracy. Safety-warning omissions and test-retest variability argue against autonomous LLM use; these tools are best deployed as adjuncts to clinician- and pharmacist-led teach-back education.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/20552076261478506","type":"journal-article","created":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T23:30:30Z","timestamp":1786750230000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Large language model accuracy in inhaler technique counselling for asthma and COPD: A comparison of free and paid models across ten devices"],"prefix":"10.1177","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4462-0944","authenticated-orcid":false,"given":"Abdurrahman","family":"Ko\u00e7","sequence":"first","affiliation":[{"name":"Meram State Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3752-8469","authenticated-orcid":false,"given":"Ferhat","family":"Sa\u011fun","sequence":"additional","affiliation":[{"name":"Necmettin Erbakan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-4346-4794","authenticated-orcid":false,"given":"Necmettin","family":"\u00d6\u011fe","sequence":"additional","affiliation":[{"name":"Kayseri City Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-2561-5613","authenticated-orcid":false,"given":"Sami","family":"Avcil","sequence":"additional","affiliation":[{"name":"Uzunmehmet Chest and Occupational Diseases Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1261-2771","authenticated-orcid":false,"given":"Ali Tolga","family":"\u00c7elik","sequence":"additional","affiliation":[{"name":"Alanya Training and Research Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-2268-0627","authenticated-orcid":false,"given":"Muhammet Ali","family":"Take\u015f","sequence":"additional","affiliation":[{"name":"Tatvan State Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9328-8039","authenticated-orcid":false,"given":"Bekir","family":"Sunay","sequence":"additional","affiliation":[{"name":"Bitlis State Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,8,14]]},"reference":[{"key":"e_1_3_7_2_2","unstructured":"Global Initiative for Asthma (GINA). Global Strategy for Asthma Management and Prevention 2026. Available from: https:\/\/ginasthma.org\/ (accessed 10 May 2026."},{"key":"e_1_3_7_3_2","unstructured":"Global Initiative for Chronic Obstructive Lung Disease (GOLD). Global Strategy for Prevention Diagnosis and Management of COPD: 2026 Report. Available from: https:\/\/goldcopd.org\/ accessed 10 May 2026."},{"key":"e_1_3_7_4_2","doi-asserted-by":"publisher","DOI":"10.3390\/jcm14196848"},{"key":"e_1_3_7_5_2","doi-asserted-by":"publisher","DOI":"10.1111\/crj.13353"},{"key":"e_1_3_7_6_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41533-020-00189-6"},{"key":"e_1_3_7_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chest.2016.03.041"},{"key":"e_1_3_7_8_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2024.21700"},{"key":"e_1_3_7_9_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-024-01157-x"},{"key":"e_1_3_7_10_2","doi-asserted-by":"publisher","DOI":"10.5455\/aim.2024.33.4-10"},{"key":"e_1_3_7_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaip.2025.04.051"},{"key":"e_1_3_7_12_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12931-025-03438-9"},{"key":"e_1_3_7_13_2","first-page":"e65365","article-title":"Assessing the role of large language models between ChatGPT and DeepSeek in asthma education for bilingual individuals","volume":"13","author":"Liu Y","year":"2025","unstructured":"Liu Y, Yu F, Zhang X, et al. Assessing the role of large language models between ChatGPT and DeepSeek in asthma education for bilingual individuals. J Med Internet Res 2025; 13: e65365. https:\/\/doi.org\/10.2196\/65365","journal-title":"J Med Internet Res"},{"key":"e_1_3_7_14_2","doi-asserted-by":"publisher","DOI":"10.1136\/ejhpharm-2024-004245"},{"key":"e_1_3_7_15_2","doi-asserted-by":"publisher","DOI":"10.1080\/17476348.2020.1754800"},{"key":"e_1_3_7_16_2","volume-title":"Global Strategy for Asthma Management and Prevention","author":"Global Initiative for Asthma (GINA)","year":"2025","unstructured":"Global Initiative for Asthma (GINA). Global Strategy for Asthma Management and Prevention, 2025. Available from: https:\/\/ginasthma.org\/ (accessed during data collection, March 2026."},{"key":"e_1_3_7_17_2","doi-asserted-by":"publisher","DOI":"10.1183\/09031936.00166410"},{"key":"e_1_3_7_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaip.2017.01.004"},{"key":"e_1_3_7_19_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12931-017-0710-y"},{"key":"e_1_3_7_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcm.2016.02.012"},{"key":"e_1_3_7_21_2","doi-asserted-by":"publisher","DOI":"10.2147\/COPD.S103335"},{"key":"e_1_3_7_22_2","doi-asserted-by":"publisher","DOI":"10.3390\/pharmaceutics14081565"},{"key":"e_1_3_7_23_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12890-020-01246-z"},{"key":"e_1_3_7_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.rmed.2007.11.003"},{"key":"e_1_3_7_25_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaip.2017.12.032"},{"key":"e_1_3_7_26_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.40969"},{"key":"e_1_3_7_27_2","doi-asserted-by":"publisher","DOI":"10.1111\/jcpt.13126"},{"key":"e_1_3_7_28_2","first-page":"8572636","article-title":"Effect of a multidimensional pharmaceutical care intervention on inhalation technique in patients with asthma and COPD","volume":"2020","author":"Wang W","year":"2020","unstructured":"Wang W, Xu T, Qin Q, et al. Effect of a multidimensional pharmaceutical care intervention on inhalation technique in patients with asthma and COPD. Can Respir J 2020; 2020: 8572636. https:\/\/doi.org\/10.1155\/2020\/8572636","journal-title":"Can Respir J"},{"key":"e_1_3_7_29_2","doi-asserted-by":"publisher","DOI":"10.2147\/COPD.S117196"},{"key":"e_1_3_7_30_2","doi-asserted-by":"publisher","DOI":"10.52202\/079017-2205"},{"key":"e_1_3_7_31_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2024.findings-emnlp.108"}],"container-title":["DIGITAL HEALTH"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20552076261478506","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/20552076261478506","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20552076261478506","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T03:46:12Z","timestamp":1787024772000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/20552076261478506"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2]]},"references-count":30,"alternative-id":["10.1177\/20552076261478506"],"URL":"https:\/\/doi.org\/10.1177\/20552076261478506","relation":{},"ISSN":["2055-2076","2055-2076"],"issn-type":[{"value":"2055-2076","type":"print"},{"value":"2055-2076","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2]]},"article-number":"20552076261478506"}}