{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T15:29:52Z","timestamp":1787671792890,"version":"build-2736575974"},"reference-count":32,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"23","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":["J Am Acad Orthop Surg","JAAOS"],"published-print":{"date-parts":[[2025,12,1]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction:<\/jats:title>\n                    <jats:p>Carpal tunnel surgery (CTS) accounts for approximately 577,000 surgeries in the United States annually. This high frequency raises concerns over the dissemination of medical information through artificial intelligence chatbots, Google, and healthcare professionals. The objectives of this study are to determine whether GPT-4 and Google differ in (1) the type of questions asked, (2) the readability of responses, and (3) the accuracy of numerical responses for the top 10 most frequently asked questions (FAQs) about CTS.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>\n                      A Google search was conducted to identify the top 10 FAQs related to CTS, which were then queried in GPT-4. Responses were categorized using the Rothwell classification system and evaluated for readability using Flesch Reading Ease and Flesch-Kincaid grade level scores. Statistical analyses included Cohen kappa coefficients for interobserver reliability and Student\n                      <jats:italic toggle=\"yes\">t<\/jats:italic>\n                      -tests for comparing response characteristics. Statistical significance was set at the 0.05 level.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      This study found that 70% of Google's FAQs were fact based, predominantly focusing on technical details (40%) and specific activities (40%). GPT-4's FAQs were mainly factual (50%), with technical details (40%) being the most queried topic. Complete agreement in interobserver reliability was observed. Google's answers were more readable than GPT-4's, with a Flesch Reading Ease score of 56.40 vs. 34.19 (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = 0.001) and a Flesch-Kincaid grade level of 9.93 vs. 12.85 (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = 0.007). Google responses were shorter, with an average word count of 91.50 compared with GPT-4's 162.90 (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = 0.013). For numerical responses to FAQs, GPT-4 and Google differed in nine out of 10 questions, with GPT-4 often providing broader time frames.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>GPT-4 offers a more detailed and technically oriented approach to addressing patient queries about CTS when compared with Google. This suggests that GPT-4 can offer detailed insights where patients seek more in-depth information, enhancing the quality of healthcare education.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Level of Evidence:<\/jats:title>\n                    <jats:p>NA<\/jats:p>\n                  <\/jats:sec>","DOI":"10.5435\/jaaos-d-24-00249","type":"journal-article","created":{"date-parts":[[2025,3,29]],"date-time":"2025-03-29T21:10:02Z","timestamp":1743282602000},"page":"e1429-e1439","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":1,"title":["GPT-4 as a Source of Patient Information for Carpal Tunnel Surgery: A Comparative Analysis Against Google Web Search"],"prefix":"10.5435","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1196-517X","authenticated-orcid":false,"given":"Paul G.","family":"Mastrokostas","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aaron B.","family":"Lavi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bruce B.","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leonidas E.","family":"Mastrokostas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Scott","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katherine M.","family":"Connors","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Hashem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2025,3,25]]},"reference":[{"key":"R1-20251201","doi-asserted-by":"crossref","first-page":"38","DOI":"10.21037\/mhealth.2017.08.07","article-title":"Digital health is a cultural transformation of traditional healthcare","volume":"3","author":"Mesk\u00f3","year":"2017","journal-title":"Mhealth"},{"key":"R2-20251201","doi-asserted-by":"crossref","first-page":"1214","DOI":"10.3390\/jpm13081214","article-title":"Advancing patient care: How artificial intelligence is transforming healthcare","volume":"13","author":"Poalelungi","year":"2023","journal-title":"J Pers Med"},{"key":"R3-20251201","first-page":"1018","article-title":"Beyond ChatGPT: What does GPT-4 add to healthcare? The dawn of a new era","volume":"30","author":"W\u00f3jcik","year":"2023","journal-title":"Cardiol J"},{"key":"R6-20251201","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1007\/s00270-023-03563-2","article-title":"Feasibility of GPT-3 and GPT-4 for in-depth patient education prior to interventional radiological procedures: A comparative analysis","volume":"47","author":"Scheschenja","year":"2024","journal-title":"Cardiovasc Intervent Radiol"},{"key":"R7-20251201","doi-asserted-by":"crossref","first-page":"1322","DOI":"10.1093\/cid\/ciad407","article-title":"ChatGPT, GPT-4, and other large language models: The next revolution for clinical microbiology?","volume":"77","author":"Egli","year":"2023","journal-title":"Clin Infect Dis"},{"key":"R8-20251201","doi-asserted-by":"crossref","first-page":"16492","DOI":"10.1038\/s41598-023-43436-9","article-title":"Comparing ChatGPT and GPT-4 performance in USMLE soft skill assessments","volume":"13","author":"Brin","year":"2023","journal-title":"Sci Rep"},{"key":"R9-20251201","doi-asserted-by":"crossref","first-page":"307","DOI":"10.2967\/jnmt.123.266151","article-title":"ChatGPT and patient information in nuclear medicine: GPT-3.5 versus GPT-4","volume":"51","author":"Currie","year":"2023","journal-title":"J Nucl Med Technol"},{"key":"R10-20251201","first-page":"e43926","article-title":"Artificial intelligence in ophthalmology: A comparative analysis of GPT-3.5, GPT-4, and human expertise in answering StatPearls questions","volume":"15","author":"Moshirfar","year":"2023","journal-title":"Cureus"},{"key":"R11-20251201","doi-asserted-by":"crossref","first-page":"20512","DOI":"10.1038\/s41598-023-46995-z","article-title":"Evaluation of the performance of GPT-3.5 and GPT-4 on the polish medical final examination","volume":"13","author":"Roso\u0142","year":"2023","journal-title":"Sci Rep"},{"key":"R15-20251201","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1016\/j.jhsa.2023.07.003","article-title":"Exploring the role of a large language model on carpal tunnel syndrome management: An observation study of ChatGPT","volume":"48","author":"Seth","year":"2023","journal-title":"J Hand Surg Am"},{"key":"R16-20251201","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.jhsa.2023.10.019","article-title":"Appropriateness and reliability of an online artificial intelligence platform's responses to common questions regarding distal radius fractures","volume":"49","author":"Christy","year":"2024","journal-title":"J Hand Surg Am"},{"key":"R17-20251201","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1016\/j.jhsa.2023.08.003","article-title":"Evaluation of online artificial intelligence-generated information on common hand procedures","volume":"48","author":"Crook","year":"2023","journal-title":"J Hand Surg"},{"key":"R18-20251201","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1177\/15589447231211608","article-title":"Incidence and risk factors for revision within 1 year of primary carpal tunnel release","volume":"20","author":"Schloemann","year":"2025","journal-title":"Hand (N Y)"},{"key":"R19-20251201","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.1177\/15589447231168977","article-title":"Long-term trends in open vs endoscopic carpal tunnel release among the Medicare population in the United States","volume":"19","author":"Haglin","year":"2024","journal-title":"Hand (N Y)"},{"key":"R20-20251201","first-page":"15589447241247332","article-title":"Evaluation of patient education materials from large-language artificial intelligence models on carpal tunnel release","author":"Croen","year":"2024","journal-title":"Hand (N Y)"},{"key":"R21-20251201","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1016\/j.arth.2023.04.007","article-title":"Using a Google web search analysis to assess the utility of ChatGPT in total joint arthroplasty","volume":"38","author":"Dubin","year":"2023","journal-title":"J Arthroplasty"},{"key":"R22-20251201","first-page":"e35586","article-title":"Online information related to symptoms of carpal tunnel syndrome: A Google search analysis","volume":"15","author":"Foster","year":"2023","journal-title":"Cureus"},{"key":"R23-20251201","first-page":"25","article-title":"Rotator cuff repair: What questions are patients asking online and where are they getting their answers?","volume":"26","author":"Hodakowski","year":"2023","journal-title":"Clin Shoulder Elb"},{"key":"R24-20251201","first-page":"55","article-title":"Internet search analytics for shoulder arthroplasty: What questions are patients asking?","volume":"26","author":"McCormick","year":"2023","journal-title":"Clin Shoulder Elb"},{"key":"R25-20251201","doi-asserted-by":"crossref","first-page":"1224","DOI":"10.1016\/j.arth.2020.10.024","article-title":"Modern internet search analytics and total joint arthroplasty: What are patients asking and reading online?","volume":"36","author":"Shen","year":"2021","journal-title":"J Arthroplasty"},{"key":"R26-20251201","doi-asserted-by":"crossref","first-page":"2245","DOI":"10.1016\/j.jse.2023.04.021","article-title":"What are patients asking and reading online? An analysis of online patient searches for rotator cuff repair","volume":"32","author":"Khalil","year":"2023","journal-title":"J Shoulder Elbow Surg"},{"key":"R27-20251201","first-page":"100214","article-title":"Modern internet search analytics and spine: What are patients asking and reading online?","volume":"14","author":"Kasthuri","year":"2023","journal-title":"N Am Spine Soc J"},{"key":"R28-20251201","doi-asserted-by":"crossref","first-page":"1244","DOI":"10.1001\/jama.1997.03540390074039","article-title":"Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor\u2014Let the reader and viewer beware","volume":"277","author":"Silberg","year":"1997","journal-title":"JAMA"},{"key":"R29-20251201","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1097\/BRS.0000000000002870","article-title":"Evaluating the quality, content, and readability of online resources for failed back spinal surgery","volume":"44","author":"Guo","year":"2019","journal-title":"Spine (Phila Pa 1976)"},{"key":"R30-20251201","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1097\/BRS.0000000000000689","article-title":"Discectomy-related information on the internet: Does the quality follow the surge?","volume":"40","author":"Elhassan","year":"2015","journal-title":"Spine (Phila Pa 1976)"},{"key":"R31-20251201","doi-asserted-by":"crossref","first-page":"54","DOI":"10.14444\/8566","article-title":"Quality assessment of degenerative cervical myelopathy information on the internet","volume":"18","author":"Chong","year":"2024","journal-title":"Int J Spine Surg"},{"key":"R32-20251201","doi-asserted-by":"crossref","first-page":"E1364","DOI":"10.1097\/BRS.0b013e31826619b5","article-title":"Scoliosis-specific information on the internet: Has the \u201cinformation highway\u201d led to better information provision?","volume":"37","author":"Nason","year":"2012","journal-title":"Spine (Phila Pa 1976)"},{"key":"R33-20251201","doi-asserted-by":"crossref","first-page":"2826","DOI":"10.1097\/BRS.0b013e3181b4bb0c","article-title":"Readability of spine-related patient education materials from subspecialty organization and spine practitioner websites","volume":"34","author":"Vives","year":"2009","journal-title":"Spine (Phila Pa 1976)"},{"key":"R34-20251201","doi-asserted-by":"crossref","first-page":"e640","DOI":"10.1016\/j.wneu.2022.03.091","article-title":"Readability of online spine patient education resources","volume":"162","author":"Luciani","year":"2022","journal-title":"World Neurosurg"},{"key":"R35-20251201","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.1097\/BRS.0000000000001446","article-title":"Is the readability of spine-related patient education material improving? An assessment of subspecialty websites","volume":"41","author":"Eltorai","year":"2016","journal-title":"Spine (Phila Pa 1976)"},{"key":"R36-20251201","doi-asserted-by":"crossref","first-page":"e48291","DOI":"10.2196\/48291","article-title":"Large language models in medical education: Opportunities, challenges, and future directions","volume":"9","author":"Abd-Alrazaq","year":"2023","journal-title":"JMIR Med Educ"},{"key":"R37-20251201","doi-asserted-by":"crossref","first-page":"818","DOI":"10.1016\/j.jhsg.2023.07.015","article-title":"Patient-directed online education for carpal tunnel syndrome and release: Analysis of what patients ask and quality of resources","volume":"5","author":"Smith","year":"2023","journal-title":"J Hand Surg Glob Online"}],"container-title":["Journal of the American Academy of Orthopaedic Surgeons"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ovid.com\/10.5435\/JAAOS-D-24-00249","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T14:51:17Z","timestamp":1787669477000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.5435\/JAAOS-D-24-00249"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,25]]},"references-count":32,"journal-issue":{"issue":"23","published-print":{"date-parts":[[2025]]}},"URL":"https:\/\/doi.org\/10.5435\/jaaos-d-24-00249","relation":{},"ISSN":["1067-151X","1940-5480"],"issn-type":[{"value":"1067-151X","type":"print"},{"value":"1940-5480","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,25]]},"assertion":[{"value":"2024-03-02","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-02-09","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}