{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T05:41:04Z","timestamp":1792388464427,"version":"4.4.0"},"reference-count":34,"publisher":"Wiley","issue":"10","license":[{"start":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T00:00:00Z","timestamp":1791590400000},"content-version":"vor","delay-in-days":9,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"},{"start":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T00:00:00Z","timestamp":1790812800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Health Science Reports"],"published-print":{"date-parts":[[2026,10]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background and Aims<\/jats:title>\n                    <jats:p>Generative artificial intelligence chatbots are increasingly used for health information, but their reliability, readability, and safety in osteoporosis counseling remain uncertain. This study compared four widely available chatbots under standardized conditions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Twenty\u2010five standardized osteoporosis questions were submitted once to ChatGPT\u20105, Gemini 2.5 Pro, Copilot, and Perplexity Pro, generating 100 responses. Two model\u2010blinded specialists evaluated the final responses using DISCERN, EQIP, the Global Quality Scale, JAMA benchmarks, and the NOHARM framework. Six automated indices assessed readability. Because each question was answered by all four models, outcomes were compared using Friedman tests, followed by paired Wilcoxon signed\u2010rank tests with Holm adjustment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      DISCERN scores differed across models (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001; Kendall's W\u2009=\u20090.82, 95% CI 0.76\u20130.89). Median scores were 55.0 for Perplexity Pro, 54.0 for Copilot, 44.0 for Gemini 2.5 Pro, and 42.0 for ChatGPT\u20105. JAMA benchmark scores did not differ significantly (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009=\u20090.63). All six readability indices differed across models (all\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001). Perplexity Pro had the highest median Flesch\u2013Kincaid Grade Level score at 16.18, whereas Copilot had the lowest at 9.49; all models exceeded the sixth\u2010grade benchmark. The qualitative safety assessment also identified clinically relevant omissions and an unsupported claim.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>In this set of osteoporosis questions, retrieval\u2010enabled systems achieved higher scores on selected information\u2010quality measures but produced more difficult text. These findings are limited to the tested models, prompts, and evaluation period and do not establish a universal effect of retrieval augmentation.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/hsr2.73381","type":"journal-article","created":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T08:43:50Z","timestamp":1791621830000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Reliability, Readability, and Safety of Generative AI Chatbots for Osteoporosis Health Counseling: A Multidimensional Cross\u2010Sectional Comparative Study"],"prefix":"10.1002","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0006-9958-2283","authenticated-orcid":false,"given":"Huimin","family":"Xu","sequence":"first","affiliation":[{"name":"Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine Shanghai China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Guo","sequence":"additional","affiliation":[{"name":"Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine Shanghai China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Li","family":"Shen","sequence":"additional","affiliation":[{"name":"Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine Shanghai China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ting","family":"Zhu","sequence":"additional","affiliation":[{"name":"Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine Shanghai China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaona","family":"Huang","sequence":"additional","affiliation":[{"name":"Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine Shanghai China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-3251-4106","authenticated-orcid":false,"given":"Liwen","family":"Ding","sequence":"additional","affiliation":[{"name":"Yueyang Hospital of Integrated Traditional Chinese and Western Medicine, Shanghai University of Traditional Chinese Medicine Shanghai China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2026,10,10]]},"reference":[{"key":"e_1_2_15_2_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2025.6003"},{"key":"e_1_2_15_3_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2024.27154"},{"key":"e_1_2_15_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00198-022-06657-8"},{"key":"e_1_2_15_5_1","doi-asserted-by":"publisher","DOI":"10.18502\/ijph.v53i5.15581"},{"key":"e_1_2_15_6_1","doi-asserted-by":"publisher","DOI":"10.3389\/fmed.2024.1477898"},{"key":"e_1_2_15_7_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.57879"},{"key":"e_1_2_15_8_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2023.9651"},{"key":"e_1_2_15_9_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-025-01519-z"},{"key":"e_1_2_15_10_1","doi-asserted-by":"publisher","DOI":"10.2196\/69955"},{"key":"e_1_2_15_11_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpubh.2024.1447747"},{"key":"e_1_2_15_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00590-024-03990-y"},{"key":"e_1_2_15_13_1","doi-asserted-by":"publisher","DOI":"10.2147\/CIA.S551572"},{"key":"e_1_2_15_14_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjmed-2025-001632"},{"key":"e_1_2_15_15_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2024.21700"},{"key":"e_1_2_15_16_1","doi-asserted-by":"publisher","DOI":"10.1038\/s43856-024-00717-2"},{"key":"e_1_2_15_17_1","doi-asserted-by":"publisher","DOI":"10.2196\/55318"},{"key":"e_1_2_15_18_1","doi-asserted-by":"publisher","DOI":"10.4183\/aeb.2024.121"},{"key":"e_1_2_15_19_1","doi-asserted-by":"publisher","DOI":"10.4274\/tod.galenos.2025.01488"},{"key":"e_1_2_15_20_1","doi-asserted-by":"publisher","DOI":"10.1136\/jech.53.2.105"},{"key":"e_1_2_15_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pec.2007.11.018"},{"key":"e_1_2_15_22_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1572-0241.2007.01325.x"},{"key":"e_1_2_15_23_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1997.03540390074039"},{"key":"e_1_2_15_24_1","unstructured":"D.Wu F.Nateghi Haredasht S. K.Maharaj et al. \u201cFirst Do NOHARM: Towards Clinically Safe Large Language Models \u201d arXiv (2025) 10.48550\/arXiv.2512.01241."},{"key":"e_1_2_15_25_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_15_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eururo.2018.12.014"},{"key":"e_1_2_15_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijnurstu.2014.09.006"},{"key":"e_1_2_15_28_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000877"},{"key":"e_1_2_15_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/imj.16607"},{"key":"e_1_2_15_30_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2024.0357"},{"key":"e_1_2_15_31_1","doi-asserted-by":"publisher","DOI":"10.1002\/ohn.927"},{"key":"e_1_2_15_32_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-025-01670-7"},{"key":"e_1_2_15_33_1","doi-asserted-by":"publisher","DOI":"10.1038\/s43856-025-01021-3"},{"key":"e_1_2_15_34_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-025-09138-0"},{"key":"e_1_2_15_35_1","unstructured":"National Health and Family Planning Commission of the People's Republic of China. Measures for the Ethical Review of Biomedical Research Involving Humans: Order 11 of the National Health and Family Planning Commission. Published October 12 2016 accessed September 9 2026."}],"container-title":["Health Science Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/hsr2.73381","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/hsr2.73381","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/hsr2.73381","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T04:54:22Z","timestamp":1792385662000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/hsr2.73381"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10]]},"references-count":34,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2026,10]]}},"alternative-id":["10.1002\/hsr2.73381"],"URL":"https:\/\/doi.org\/10.1002\/hsr2.73381","archive":["Portico"],"relation":{},"ISSN":["2398-8835","2398-8835"],"issn-type":[{"value":"2398-8835","type":"print"},{"value":"2398-8835","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10]]},"assertion":[{"value":"2026-03-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-10-03","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-10-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e73381"}}