{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T15:29:54Z","timestamp":1791646194341,"version":"4.3.4"},"reference-count":30,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T00:00:00Z","timestamp":1767657600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Healthcare"],"abstract":"<jats:p>Background\/Objectives: Caregivers of infants with congenital muscular torticollis (CMT) frequently seek information online, although the accuracy, clarity, and safety of web-based content remain variable. As large language models (LLMs) are increasingly used as health information tools, their reliability for caregiver education requires systematic evaluation. This study aimed to assess the reproducibility and quality of ChatGPT-5.1 responses to caregiver-centered questions regarding CMT. Methods: A set of 17 questions was developed through a Delphi process involving clinicians and caregivers to ensure relevance and comprehensiveness. ChatGPT generated responses in two independent sessions. Reproducibility was assessed using TF\u2013IDF cosine similarity and embedding-based semantic similarity. Ten clinical experts evaluated each response for accuracy, readability, safety, and overall quality using a 4-point Likert scale. Results: ChatGPT demonstrated moderate lexical consistency (mean TF\u2013IDF similarity 0.75) and high semantic stability (mean embedding similarity 0.92). Expert ratings indicated moderate to good performance across domains, with mean scores of 3.0 for accuracy, 3.6 for readability, 3.1 for safety, and 3.1 for overall quality. However, several responses exhibited deficiencies, particularly due to omission of key cautions, oversimplification, or insufficient clinical detail. Conclusions: While ChatGPT provides fluent and generally accurate information about CMT, the observed variability across topics underscores the importance of human oversight and content refinement prior to integration into caregiver-facing educational materials.<\/jats:p>","DOI":"10.3390\/healthcare14020140","type":"journal-article","created":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T12:35:47Z","timestamp":1767702947000},"page":"140","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Evaluating the Accuracy, Usefulness, and Safety of ChatGPT for Caregivers Seeking Information on Congenital Muscular Torticollis"],"prefix":"10.3390","volume":"14","author":[{"given":"Siyun","family":"Kim","sequence":"first","affiliation":[{"name":"Department of Rehabilitation Medicine, Ewha Womans University Seoul Hospital, College of Medicine, Ewha Womans University, Seoul 07804, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seoyon","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Rehabilitation Medicine, Ewha Womans University Seoul Hospital, College of Medicine, Ewha Womans University, Seoul 07804, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jaewon","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Rehabilitation Medicine, Incheon St. Mary\u2019s Hospital, College of Medicine, The Catholic University of Korea, Seoul 06591, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sunyoung","family":"Joo","sequence":"additional","affiliation":[{"name":"Department of Rehabilitation Medicine, Incheon St. Mary\u2019s Hospital, College of Medicine, The Catholic University of Korea, Seoul 06591, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hoo Young","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Physical Medicine and Rehabilitation, National Health Insurance Service Ilsan Hospital, Goyang 10444, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6731-4376","authenticated-orcid":false,"given":"Hye Jung","family":"Park","sequence":"additional","affiliation":[{"name":"Department of Rehabilitation Medicine, Seoul St. Mary\u2019s Hospital, College of Medicine, The Catholic University of Korea, Seoul 06591, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jongwook","family":"Jeon","sequence":"additional","affiliation":[{"name":"Department of Orthopedic Surgery, Dongbu Jeil Hospital, Seoul 02399, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1791-1831","authenticated-orcid":false,"given":"You Gyoung","family":"Yi","sequence":"additional","affiliation":[{"name":"Department of Rehabilitation Medicine, Ewha Womans University Seoul Hospital, College of Medicine, Ewha Womans University, Seoul 07804, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2704","DOI":"10.1097\/SCS.0000000000008781","article-title":"Basement Membrane Changes of Myofiber and Fibrosis in Sternocleidomastoid Muscle of Congenital Muscular Torticollis","volume":"33","author":"Gao","year":"2022","journal-title":"J. Craniofac. Surg."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1097\/00003086-200210000-00026","article-title":"Longitudinal Followup Study of Ultrasonography in Congenital Muscular Torticollis","volume":"403","author":"Tang","year":"2002","journal-title":"Clin. Orthop. Relat. Res."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Hwang, D., Shin, Y.J., Choi, J.Y., Jung, S.J., and Yang, S.S. (2019). Changes in Muscle Stiffness in Infants with Congenital Muscular Torticollis. Diagnostics, 9.","DOI":"10.3390\/diagnostics9040158"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"183","DOI":"10.5535\/arm.2013.37.2.183","article-title":"The Cervical Range of Motion as a Factor Affecting Outcome in Patients with Congenital Muscular Torticollis","volume":"37","author":"Lee","year":"2013","journal-title":"Ann. Rehabil. Med."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1589\/jpts.27.461","article-title":"Outcomes of Asymmetry in Infants with Congenital Muscular Torticollis","volume":"27","author":"Lee","year":"2015","journal-title":"J. Phys. Ther. Sci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1589\/jpts.29.543","article-title":"A Comparison of Outcomes of Asymmetry in Infants with Congenital Muscular Torticollis According to Age upon Starting Treatment","volume":"29","author":"Lee","year":"2017","journal-title":"J. Phys. Ther. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1097\/PEP.0000000000000544","article-title":"Physical Therapy Management of Congenital Muscular Torticollis: A 2018 Evidence-Based Clinical Practice Guideline from the APTA Academy of Pediatric Physical Therapy","volume":"30","author":"Kaplan","year":"2018","journal-title":"Pediatr. Phys. Ther."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1111\/j.1469-8749.2008.03195.x","article-title":"Are Infants with Torticollis at Risk of a Delay in Early Motor Milestones Compared with a Control Group of Healthy Infants?","volume":"51","author":"Nilsson","year":"2009","journal-title":"Dev. Med. Child Neurol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"312","DOI":"10.3345\/cep.2021.01417","article-title":"Neurodevelopmental Outcomes and Comorbidities of Children with Congenital Muscular Torticollis: Evaluation Using the National Health Screening Program for Infants and Children Database","volume":"65","author":"Kim","year":"2022","journal-title":"Clin. Exp. Pediatr."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e36","DOI":"10.1097\/j.pbj.0000000000000036","article-title":"Congenital Muscular Torticollis: Where Are We Today? A Retrospective Analysis at a Tertiary Hospital","volume":"4","author":"Amaral","year":"2019","journal-title":"Porto Biomed. J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1526","DOI":"10.1016\/j.jpedsurg.2011.02.040","article-title":"Clinical Features and Outcome of Physiotherapy in Early Presenting Congenital Muscular Torticollis with Severe Fibrosis on Ultrasonography: A Prospective Study","volume":"46","author":"Lee","year":"2011","journal-title":"J. Pediatr. Surg."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1589\/jpts.29.48","article-title":"A Study on Asymmetry in Infants with Congenital Muscular Torticollis According to Head Rotation","volume":"29","author":"Lee","year":"2017","journal-title":"J. Phys. Ther. Sci."},{"key":"ref_13","first-page":"539","article-title":"Early Rehabilitation Treatment in Newborns with Congenital Muscular Torticollis","volume":"51","author":"Carenzio","year":"2015","journal-title":"Eur. J. Phys. Rehabil. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.jemermed.2019.06.043","article-title":"Quality, Trustworthiness, Readability, and Accuracy of Medical Information Regarding Common Pediatric Emergency Medicine-Related Complaints on the Web","volume":"57","author":"Rothrock","year":"2019","journal-title":"J. Emerg. Med."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2400163","DOI":"10.1183\/13993003.00163-2024","article-title":"ChatGPT versus Bing: A Clinician Assessment of the Accuracy of AI Platforms When Responding to COPD Questions","volume":"63","author":"Imtiaz","year":"2024","journal-title":"Eur. Respir. J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1161\/HYPERTENSIONAHA.124.19468","article-title":"AI, Machine Learning, and ChatGPT in Hypertension","volume":"81","author":"Layton","year":"2024","journal-title":"Hypertension"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chlorogiannis, D.D., Apostolos, A., Chlorogiannis, A., Palaiodimos, L., Giannakoulas, G., Pargaonkar, S., Xesfingi, S., and Kokkinidis, D.G. (2023). The Role of ChatGPT in the Advancement of Diagnosis, Management, and Prognosis of Cardiovascular and Cerebrovascular Disease. Healthcare, 11.","DOI":"10.20944\/preprints202310.0276.v1"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e38445","DOI":"10.1097\/MD.0000000000038445","article-title":"The Assessment of the Validity, Safety, and Utility of ChatGPT for Patients with Herniated Lumbar Disc: A Preliminary Study","volume":"103","author":"Yang","year":"2024","journal-title":"Medicine"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"102693","DOI":"10.1016\/j.artmed.2023.102693","article-title":"Artificial Intelligence in Physical Rehabilitation: A Systematic Review","volume":"146","author":"Sumner","year":"2023","journal-title":"Artif. Intell. Med."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"9554590","DOI":"10.1155\/bmri\/9554590","article-title":"Artificial Intelligence and Its Revolutionary Role in Physical and Mental Rehabilitation: A Review of Recent Advancements","volume":"2024","author":"Rasa","year":"2024","journal-title":"Biomed Res. Int."},{"key":"ref_21","first-page":"e53441","article-title":"Generative Artificial Intelligence in Patient Education: ChatGPT Takes on Hypertension Questions","volume":"16","author":"Almagazzachi","year":"2024","journal-title":"Cureus"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e71219","DOI":"10.1002\/hsr2.71219","article-title":"Advantages and Limitations of ChatGPT in Healthcare: A Scoping Review","volume":"8","author":"Ghasemi","year":"2025","journal-title":"Health Sci. Rep."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, Z., Zhang, L., Wu, Z., Yu, X., Cao, C., Dai, H., Liu, N., Liu, J., Liu, W., and Li, Q. (2023). Surviving ChatGPT in Healthcare. Front. Radiol., 3.","DOI":"10.3389\/fradi.2023.1224682"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1097\/PEP.0b013e3182a778d2","article-title":"Physical Therapy Management of Congenital Muscular Torticollis: An Evidence-Based Clinical Practice Guideline: From the Section on Pediatrics of the American Physical Therapy Association","volume":"25","author":"Kaplan","year":"2013","journal-title":"Pediatr. Phys. Ther."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"80","DOI":"10.7181\/acfs.2020.00059","article-title":"Diagnosis and Treatment of Positional Plagiocephaly","volume":"21","author":"Jung","year":"2020","journal-title":"Arch. Craniofacial Surg."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1097\/01.mop.0001110932.74171.b7","article-title":"Congenital Muscular Torticollis: Current Concepts and Review of Treatment","volume":"18","author":"Do","year":"2006","journal-title":"Curr. Opin. Pediatr."},{"key":"ref_27","first-page":"1989","article-title":"Evaluating ChatGPT Responses on Obstructive Sleep Apnea for Patient Education","volume":"19","author":"Campbell","year":"2023","journal-title":"J. Clin. Sleep Med. JCSM Off. Publ. Am. Acad. Sleep Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e379","DOI":"10.1016\/S2589-7500(24)00060-8","article-title":"The Effect of Using a Large Language Model to Respond to Patient Messages","volume":"6","author":"Chen","year":"2024","journal-title":"Lancet Digit. Health"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Aydin, S., Karabacak, M., Vlachos, V., and Margetis, K. (2024). Large Language Models in Patient Education: A Scoping Review of Applications in Medicine. Front. Med., 11.","DOI":"10.3389\/fmed.2024.1477898"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e39305","DOI":"10.1097\/MD.0000000000039305","article-title":"Assessment of Readability, Reliability, and Quality of ChatGPT\u00ae, BARD\u00ae, Gemini\u00ae, Copilot\u00ae, Perplexity\u00ae Responses on Palliative Care","volume":"103","author":"Hanci","year":"2024","journal-title":"Medicine"}],"container-title":["Healthcare"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9032\/14\/2\/140\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T12:44:48Z","timestamp":1767703488000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9032\/14\/2\/140"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,6]]},"references-count":30,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["healthcare14020140"],"URL":"https:\/\/doi.org\/10.3390\/healthcare14020140","relation":{},"ISSN":["2227-9032"],"issn-type":[{"value":"2227-9032","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,6]]}}}