{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T13:22:50Z","timestamp":1787491370272,"version":"build-2736575974"},"reference-count":46,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T00:00:00Z","timestamp":1769904000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["DIGITAL HEALTH"],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Patients are increasingly turning to online resources and artificial intelligence (AI)-based tools to obtain information about orthopedic conditions and surgical options. Large language models, such as ChatGPT, are becoming prominent in patient education; however, their reliability and readability remain uncertain. This study evaluated the quality and readability of responses generated by ChatGPT-4o and ChatGPT-5 to frequently asked patient questions regarding hallux rigidus fusion surgery.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Twenty commonly asked patient questions were compiled and presented to ChatGPT-4o and ChatGPT-5. Readability was assessed using the Flesch\u2013Kincaid Grade Level, Gunning Fog, Coleman\u2013Liau, and Simple Measure of Gobbledygook indices. Quality was evaluated with the DISCERN tool, response accuracy scores, and Journal of the American Medical Association (JAMA) criteria. Interrater agreement was measured using the Intraclass Correlation Coefficient (ICC).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>ChatGPT-4o generated longer responses (802 vs. 242 words; p&lt;0.001) with slightly higher readability grade levels (10.81 vs. 10.37; p=0.031). Accuracy (2.00 vs. 1.85; p=0.323) and DISCERN scores (49.35 vs. 48.93; p=0.747) showed no significant differences. All responses received a JAMA score of 0 due to the absence of citations, authorship, or transparency indicators. Interrater reliability indicated moderate to good agreement (ICC: 0.68\u20130.80).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>ChatGPT-4o and ChatGPT-5 provide generally satisfactory yet non-comprehensive, limited-quality information at a level above tenth-grade regarding hallux rigidus fusion surgery. Although linguistically coherent, responses lack evidence-based detail and individualized guidance. These models may supplement, but cannot replace, expert orthopedic counseling. Ensuring physician oversight and integrating validated, updated clinical content remain essential for safe implementation of AI-generated patient information.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/20552076261481386","type":"journal-article","created":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T14:21:27Z","timestamp":1787322087000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["ChatGPT as a source of surgical information: Evaluation of responses to patient questions on hallux rigidus fusion"],"prefix":"10.1177","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5179-2058","authenticated-orcid":false,"given":"Kamil","family":"Balaban","sequence":"first","affiliation":[{"name":"Ministry of Health Finike State Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mehmet Batu","family":"Ertan","sequence":"additional","affiliation":[{"name":"Atilim University School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mahmut","family":"Kalem","sequence":"additional","affiliation":[{"name":"Ankara University School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,8,21]]},"reference":[{"key":"e_1_3_6_2_2","doi-asserted-by":"publisher","DOI":"10.1177\/107110078000100104"},{"key":"e_1_3_6_3_2","doi-asserted-by":"publisher","DOI":"10.5312\/wjo.v8.i5.364"},{"key":"e_1_3_6_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0268-0033(01)00070-5"},{"key":"e_1_3_6_5_2","doi-asserted-by":"publisher","DOI":"10.1053\/j.jfas.2025.03.009"},{"key":"e_1_3_6_6_2","doi-asserted-by":"publisher","DOI":"10.1053\/j.jfas.2024.07.006"},{"key":"e_1_3_6_7_2","doi-asserted-by":"publisher","DOI":"10.1177\/24730114251324184"},{"key":"e_1_3_6_8_2","doi-asserted-by":"publisher","DOI":"10.1302\/2633-1462.59.BJO-2024-0031.R1"},{"key":"e_1_3_6_9_2","doi-asserted-by":"publisher","DOI":"10.2106\/00004623-200311000-00003"},{"key":"e_1_3_6_10_2","doi-asserted-by":"publisher","DOI":"10.1053\/j.jfas.2023.07.002"},{"key":"e_1_3_6_11_2","doi-asserted-by":"publisher","DOI":"10.2471\/BLT.21.287654"},{"key":"e_1_3_6_12_2","doi-asserted-by":"publisher","DOI":"10.1053\/j.jfas.2024.06.009"},{"key":"e_1_3_6_13_2","doi-asserted-by":"publisher","DOI":"10.1002\/jeo2.70281"},{"key":"e_1_3_6_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.arthro.2023.07.048"},{"key":"e_1_3_6_15_2","doi-asserted-by":"publisher","DOI":"10.2106\/JBJS.OA.23.00129"},{"key":"e_1_3_6_16_2","doi-asserted-by":"publisher","DOI":"10.1177\/19386400241235834"},{"key":"e_1_3_6_17_2","doi-asserted-by":"publisher","DOI":"10.1177\/24730114231209919"},{"key":"e_1_3_6_18_2","doi-asserted-by":"publisher","DOI":"10.1002\/jeo2.70138"},{"key":"e_1_3_6_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.fas.2025.05.001"},{"key":"e_1_3_6_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.fas.2024.08.002"},{"key":"e_1_3_6_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.fas.2023.12.002"},{"key":"e_1_3_6_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.fas.2025.08.001"},{"key":"e_1_3_6_23_2","doi-asserted-by":"publisher","DOI":"10.5114\/areh.2021.106434"},{"key":"e_1_3_6_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2025.103222"},{"key":"e_1_3_6_25_2","volume-title":"In mixed company: communicating in small groups and teams","author":"Rothwell JD","year":"2016","unstructured":"Rothwell JD. In mixed company: communicating in small groups and teams. Cengage Learning, 2016. https:\/\/archive.org\/details\/inmixedcompanyco0000roth_09ed (accessed 5 June 2025)."},{"key":"e_1_3_6_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.foot.2023.101985"},{"issue":"12","key":"e_1_3_6_27_2","first-page":"e75826","article-title":"A Study of Orthopedic Patient Leaflets and Readability of AI-Generated Text in Foot and Ankle Surgery (SOLE-AI)","volume":"16","author":"Jaques A","year":"2024","unstructured":"Jaques A, Abdelghafour K, Perkins O, et al. A Study of Orthopedic Patient Leaflets and Readability of AI-Generated Text in Foot and Ankle Surgery (SOLE-AI). Cureus 2024; 16(12): e75826. https:\/\/doi.org\/10.7759\/cureus.75826, Epub ahead of print 16 December 2024.","journal-title":"Cureus"},{"key":"e_1_3_6_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2024.105743"},{"key":"e_1_3_6_29_2","doi-asserted-by":"publisher","DOI":"10.1136\/jech.53.2.105"},{"key":"e_1_3_6_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jseint.2023.09.009"},{"key":"e_1_3_6_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2025.105871"},{"key":"e_1_3_6_32_2","doi-asserted-by":"publisher","DOI":"10.2106\/JBJS.23.00209"},{"key":"e_1_3_6_33_2","doi-asserted-by":"publisher","DOI":"10.3390\/app10093214"},{"key":"e_1_3_6_34_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.1997.03550080042024"},{"key":"e_1_3_6_35_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11999-010-1380-y"},{"key":"e_1_3_6_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2025.105787"},{"key":"e_1_3_6_37_2","doi-asserted-by":"publisher","DOI":"10.1177\/19386400241249810"},{"key":"e_1_3_6_38_2","first-page":"e78313","article-title":"Evaluating the Quality and Readability of Generative Artificial Intelligence (AI) Chatbot Responses in the Management of Achilles Tendon Rupture","volume":"17","author":"Collins CE","year":"2025","unstructured":"Collins CE, Giammanco PA, Guirgus M, et al. Evaluating the Quality and Readability of Generative Artificial Intelligence (AI) Chatbot Responses in the Management of Achilles Tendon Rupture. Cureus 2025; 17: e78313. https:\/\/doi.org\/10.7759\/cureus.78313","journal-title":"Cureus"},{"key":"e_1_3_6_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jseint.2024.11.012"},{"key":"e_1_3_6_40_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-025-03105-5"},{"key":"e_1_3_6_41_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-025-03202-5"},{"key":"e_1_3_6_42_2","doi-asserted-by":"publisher","DOI":"10.5152\/j.aott.2025.25428"},{"key":"e_1_3_6_43_2","doi-asserted-by":"publisher","DOI":"10.3390\/japma116030033"},{"key":"e_1_3_6_44_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jisako.2024.100323"},{"key":"e_1_3_6_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.otsr.2014.07.012"},{"key":"e_1_3_6_46_2","first-page":"e2021010","article-title":"May footwear be a predisposing factor for the development of hallux rigidus? A review of recent findings","volume":"92","author":"Col\u00f2 G","year":"2021","unstructured":"Col\u00f2 G, Fusini F, Zoccola K, et al. May footwear be a predisposing factor for the development of hallux rigidus? A review of recent findings. Acta Biomed 2021; 92: e2021010.","journal-title":"Acta Biomed"},{"key":"e_1_3_6_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-025-02207-x"}],"container-title":["DIGITAL HEALTH"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20552076261481386","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/20552076261481386","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/20552076261481386","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,23]],"date-time":"2026-08-23T13:17:23Z","timestamp":1787491043000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/20552076261481386"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2]]},"references-count":46,"alternative-id":["10.1177\/20552076261481386"],"URL":"https:\/\/doi.org\/10.1177\/20552076261481386","relation":{},"ISSN":["2055-2076","2055-2076"],"issn-type":[{"value":"2055-2076","type":"print"},{"value":"2055-2076","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2]]},"article-number":"20552076261481386"}}