{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T22:26:46Z","timestamp":1781130406409,"version":"3.54.1"},"reference-count":34,"publisher":"SAGE Publications","issue":"5","license":[{"start":{"date-parts":[[2025,4,12]],"date-time":"2025-04-12T00:00:00Z","timestamp":1744416000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Hand (New York, N,Y.)"],"published-print":{"date-parts":[[2026,5]]},"abstract":"<jats:sec>\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>ChatGPT is a natural language processing tool with potential to increase accessibility of health information. This study aimed to: (1) assess usability of online medical information for hand surgery topics; and (2) evaluate the influence of medical consensus.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>\n                      Three phrases were posed 20 times each to Google, ChatGPT-3.5, and ChatGPT\u20134.0: \u201cWhat is the cause of carpal tunnel syndrome?\u201d (high consensus), \u201cWhat is the cause of tennis elbow?\u201d (moderate consensus), and \u201cPlatelet-rich plasma for thumb arthritis?\u201d (low consensus). Readability was assessed by grade level while reliability and accuracy were scored based on predetermined rubrics. Scores were compared via Mann\u2013Whitney\n                      <jats:italic toggle=\"yes\">U<\/jats:italic>\n                      tests with alpha set to .05.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      Google responses had superior readability for moderate-high consensus topics (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .0001) with an average eighth-grade reading level compared to college sophomore level for ChatGPT. Low consensus topics had poor readability throughout. ChatGPT-4 responses had similar reliability but significantly inferior readability to ChatGPT-3.5 for low medical consensus topics (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .01). There was no significant difference in accuracy between sources. ChatGPT-4 and Google had differing coverage of cause of disease (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .05) and procedure details\/efficacy\/alternatives (\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; .05) with similar coverage of anatomy and pathophysiology.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>Compared to Google, ChatGPT does not provide readable responses when providing reliable medical information. While patients can modulate ChatGPT readability with prompt engineering, this requires insight into their health literacy and is an additional barrier to accessing medical information. Medical consensus influences usability of online medical information for both Google and ChatGPT. Providers should remain aware of ChatGPT limitations in distributing medical information.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/15589447251329584","type":"journal-article","created":{"date-parts":[[2025,4,12]],"date-time":"2025-04-12T07:01:06Z","timestamp":1744441266000},"page":"833-839","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":1,"title":["Assessing the Usability of ChatGPT Responses Compared to Other Online Information in Hand Surgery"],"prefix":"10.1177","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1197-747X","authenticated-orcid":false,"given":"Ophelie Z.","family":"Lavoie-Gagne","sequence":"first","affiliation":[{"name":"Harvard Medical School, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oscar Y.","family":"Shen","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neal C.","family":"Chen","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abhiram R.","family":"Bhashyam","sequence":"additional","affiliation":[{"name":"Harvard Medical School, Boston, MA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,4,12]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Fox S. The Social Life of Health Information. Pew Research Center; 2011. Accessed March 19 2025. https:\/\/www.pewresearch.org\/2011\/05\/12\/the-social-life-of-health-information-2011\/"},{"key":"e_1_3_2_3_2","unstructured":"Increase the Proportion of Adults Who Use IT to Track Health Care Data or Communicate with Providers \u2014 HC\/HIT\u201107. Office of Disease Prevention and Health Promotion. U.S. Department of Health and Human Services; n.d. Accessed March 19 2025. https:\/\/odphp.health.gov\/healthypeople\/objectives-and-data\/browse-objectives\/health-it\/increase-proportion-adults-who-use-it-track-health-care-data-or-communicate-providers-hchit-07"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhsa.2015.01.010"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhsa.2020.08.008"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.e256"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.hcl.2008.09.003"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhsa.2016.07.096"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhsa.2024.05.007"},{"key":"e_1_3_2_10_2","volume-title":"Health Literacy: A Manual for Clinicians","author":"Weiss B.","year":"2003","unstructured":"Weiss B. Health Literacy: A Manual for Clinicians. American Medical Association Foundation and American Medical Association; 2003."},{"key":"e_1_3_2_11_2","unstructured":"How to Write Easy-to-Read Health Materials. National Institute of Health; 2016"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.hansur.2024.101723"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhsg.2024.03.008"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1177\/15589447241232095"},{"key":"e_1_3_2_15_2","unstructured":"Management of Carpal Tunnel Syndrome. American Academy of Orthopaedic Surgeons; 2024. Accessed March 19 2025. https:\/\/www.aaos.org\/quality\/quality-programs\/upper-extremity-programs\/carpal-tunnel-syndrome\/"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.2106\/JBJS.RVW.22.00170"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jseint.2021.11.010"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11552-014-9642-x"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0264203"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1177\/1947603518805230"},{"key":"e_1_3_2_21_2","unstructured":"Concentration of Autograft PRP for Regeneration Purposes Delivered as an Intra-Articular Injection. American Academy of Orthopaedic Surgeons; 2020. Accessed March 19 2025. https:\/\/www.aaos.org\/quality\/biologics\/biologics-dashboard\/"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.3390\/ijms241914909"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamaoncol.2023.2947"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","unstructured":"OpenAI Achiam J Adler S et al. GPT-4 technical report. Published online March 2023. doi:10.48550\/ARXIV.2303.08774","DOI":"10.48550\/ARXIV.2303.08774"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0057532"},{"key":"e_1_3_2_27_2","volume-title":"The Technique of Clear Writing","author":"Gunning R","year":"1968","unstructured":"Gunning R. The Technique of Clear Writing. Rev. ed. Mcgraw-Hill; 1968."},{"key":"e_1_3_2_28_2","first-page":"1","article-title":"Automated readability index","author":"Smith EA","unstructured":"Smith EA, Senter RJ. Automated readability index. AMRL-TR Aerosp Med Res Lab US. Published online May 1967:1-14.","journal-title":"AMRL-TR Aerosp Med Res Lab US"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2009.02.010"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra1411250"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1177\/1558944717725384"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1056\/AIp2400889"},{"key":"e_1_3_2_33_2","unstructured":"PAI Staff. Managing the risks of AI research: six recommendations for responsible publication. Accessed March 19 2025. https:\/\/partnershiponai.org\/paper\/responsible-publication-recommendations\/."},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jhsa.2009.04.008"},{"key":"e_1_3_2_35_2","unstructured":"Introducing GPT-4o and More Tools to ChatGPT Free Users. OpenAI; 2024. Accessed March 19 2025. https:\/\/openai.com\/index\/gpt-4o-and-more-tools-to-chatgpt-free\/"}],"container-title":["HAND"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15589447251329584","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/15589447251329584","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/15589447251329584","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T07:30:05Z","timestamp":1777447805000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/15589447251329584"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,12]]},"references-count":34,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2026,5]]}},"alternative-id":["10.1177\/15589447251329584"],"URL":"https:\/\/doi.org\/10.1177\/15589447251329584","relation":{},"ISSN":["1558-9447","1558-9455"],"issn-type":[{"value":"1558-9447","type":"print"},{"value":"1558-9455","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,12]]}}}