{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,20]],"date-time":"2026-11-20T04:21:37Z","timestamp":1795148497026,"version":"4.10.3"},"reference-count":34,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"6","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,11]]},"abstract":"<jats:sec>\n                    <jats:title\/>\n                    <jats:p>\n                      To systematically evaluate the accuracy, reliability, and clinical applicability of artificial intelligence and large language models (LLMs) in pediatric orthopedics, comparing their performance against established clinical guidelines and assessing their utility for patient education and clinical decision support. A search of PubMed and ScienceDirect (2020\u20132025) identified 2624 articles using the keywords \u2018ChatGPT\u2019, \u2018Gemini\u2019, \u2018Claude\u2019 and \u2018orthopedic pediatrics\u2019. After screening and refinement using Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 guidelines, 15 studies met inclusion criteria. Studies evaluated ChatGPT, Google Gemini, Meta AI, Microsoft Copilot, and Claude across multiple pediatric orthopedic conditions across conditions like developmental dysplasia of the hip, slipped capital femoral epiphysis, and scoliosis. Heterogeneity was assessed using Cochran\u2019s\n                      <jats:italic toggle=\"yes\">Q<\/jats:italic>\n                      and\n                      <jats:italic toggle=\"yes\">I<\/jats:italic>\n                      <jats:sup>2<\/jats:sup>\n                      statistics, and publication bias was evaluated using funnel plots and Egger\u2019s test. LLM accuracy ranged from 44.3 to 93% (pooled: 74.1%), with pooled accuracy of 74.1%. Reproducibility was moderate, with ChatGPT demonstrating a Spearman coefficient of 0.55 for complex queries. Regional expert consensus scores varied significantly (Europe: 80, North America: 65;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = 0.034; Fleiss\\kappa = 0.113). Up to 33% of responses to guideline-based questions were rated neutral or inaccurate. Reading complexity was elevated (Flesch\u2013Kincaid grade: 12.7), exceeding the recommended sixth-grade level. Parent surveys indicated 82% trust in artificial intelligence as supplementary tools with professional oversight. Minimal statistical heterogeneity was observed (\n                      <jats:italic toggle=\"yes\">I<\/jats:italic>\n                      <jats:sup>2<\/jats:sup>\n                      = 0.00%), though publication bias was detected (Egger\u2019s test\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = 0.0001). LLMs show potential for education and triage but lack consistency in complex scenarios, elevated reading complexity, and significant regional variability in expert assessments. These tools should be used as educational supplements under professional medical supervision rather than for independent clinical decision-making. Broader clinical application requires domain-specific tuning, standardized evaluation, and readability optimization.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Level of Evidence<\/jats:title>\n                    <jats:p>Level V\u2013 systematic review.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1097\/bpb.0000000000001368","type":"journal-article","created":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T06:00:08Z","timestamp":1781935208000},"page":"599-606","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":1,"title":["Clinical accuracy and applications of large language models in pediatric orthopedics: a systematic review"],"prefix":"10.1097","volume":"35","author":[{"given":"Ibraheem","family":"Qureshi","sequence":"first","affiliation":[{"name":"New York Institute of Technology College of Osteopathic Medicine, Glen Head"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nithya","family":"Thomas","sequence":"additional","affiliation":[{"name":"New York Institute of Technology College of Osteopathic Medicine, Glen Head"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Heffelfinger","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, Nassau University Medical Center, East Meadow, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dennis","family":"Murphy","sequence":"additional","affiliation":[{"name":"Department of Orthopedics, Nassau University Medical Center, East Meadow, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2026,6,23]]},"reference":[{"key":"R1-20260930","doi-asserted-by":"crossref","first-page":"7196","DOI":"10.1007\/s00330-022-08956-4","article-title":"Diagnostic accuracy and potential covariates of artificial intelligence for diagnosing orthopedic fractures: a systematic literature review and meta-analysis.","volume":"32","author":"Zhang","year":"2022","journal-title":"Eur Radiol"},{"key":"R2-20260930","doi-asserted-by":"crossref","first-page":"2369","DOI":"10.3390\/jcm12062369","article-title":"Approaching artificial intelligence in orthopaedics: predictive analytics and machine learning to prognosticate arthroscopic rotator cuff surgical outcomes.","volume":"12","author":"Potty","year":"2023","journal-title":"J Clin Med"},{"key":"R3-20260930","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1016\/j.arthro.2024.12.011","article-title":"Ethical application of generative artificial intelligence in medicine.","volume":"41","author":"Hasan","year":"2025","journal-title":"Arthroscopy"},{"key":"R4-20260930","doi-asserted-by":"crossref","first-page":"e194","DOI":"10.2106\/JBJS.N.00043","article-title":"Quality of online pediatric orthopaedic education materials.","volume":"96","author":"Feghhi","year":"2014","journal-title":"J Bone Joint Surg Am"},{"key":"R5-20260930","doi-asserted-by":"crossref","first-page":"e47","DOI":"10.2106\/JBJS.20.01347","article-title":"Readability of patient educational materials in pediatric orthopaedics.","volume":"103","author":"\u00d3 Doinn","year":"2021","journal-title":"J Bone Joint Surg Am"},{"key":"R6-20260930","doi-asserted-by":"crossref","first-page":"721","DOI":"10.3350\/cmh.2023.0089","article-title":"Assessing the performance of ChatGPT in answering questions regarding cirrhosis and hepatocellular carcinoma.","volume":"29","author":"Yeo","year":"2023","journal-title":"Clin Mol Hepatol"},{"key":"R7-20260930","doi-asserted-by":"crossref","first-page":"1256459","DOI":"10.3389\/fonc.2023.1256459","article-title":"Is ChatGPT accurate and reliable in answering questions regarding head and neck cancer?","volume":"13","author":"Ku\u015fcu","year":"2023","journal-title":"Front Oncol"},{"key":"R8-20260930","first-page":"e789","article-title":"AI = Appropriate Insight? ChatGPT appropriately answers parents\u2019 questions for common pediatric orthopaedic conditions.","volume":"43","author":"Zusman","year":"2023","journal-title":"J Pediatr Orthop"},{"key":"R9-20260930","first-page":"e512","article-title":"Do ChatGPT and gemini provide appropriate recommendations for pediatric orthopaedic conditions?","volume":"44","author":"Pirkle","year":"2024","journal-title":"J Pediatr Orthop"},{"key":"R10-20260930","doi-asserted-by":"crossref","first-page":"e312","DOI":"10.1097\/BPO.0000000000002695","article-title":"Evaluating chat generative pre-trained transformer responses to pediatric in-toeing questions.","volume":"44","author":"Amaral","year":"2024","journal-title":"J Pediatr Orthop"},{"key":"R11-20260930","first-page":"234","article-title":"Google bard and ChatGPT in orthopedics: AI for patient education.","volume":"19","author":"Giorgino","year":"2024","journal-title":"J Orthop Surg Res"},{"key":"R12-20260930","first-page":"e189","article-title":"A survey of patient acceptability of the use of artificial intelligence in pediatric fractures.","volume":"44","author":"Roberts","year":"2024","journal-title":"J Pediatr Orthop"},{"key":"R13-20260930","doi-asserted-by":"crossref","first-page":"1659812","DOI":"10.3389\/fped.2025.1659812","article-title":"Reliability of ChatGPT answers to common questions on developmental dysplasia of the hip as an information source for parents.","volume":"13","author":"Vertesich","year":"2025","journal-title":"Front Pediatr"},{"key":"R14-20260930","doi-asserted-by":"crossref","first-page":"e504","DOI":"10.1097\/BPO.0000000000002682","article-title":"Are generative pretrained transformer 4 responses to developmental dysplasia of the hip clinical scenarios universal? an international review.","volume":"44","author":"Luo","year":"2024","journal-title":"J Pediatr Orthop"},{"key":"R15-20260930","doi-asserted-by":"crossref","first-page":"663","DOI":"10.5435\/JAAOS-D-24-01274","article-title":"Evaluating the accuracy, clarity, and safety of artificial intelligence-generated information on clubfoot.","volume":"33","author":"Al Ramlawi","year":"2025","journal-title":"J Am Acad Orthop Surg"},{"key":"R16-20260930","doi-asserted-by":"crossref","first-page":"222","DOI":"10.5152\/j.aott.2025.25279","article-title":"Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini.","volume":"59","author":"Ya\u015f","year":"2025","journal-title":"Acta Orthop Traumatol Turc"},{"key":"R17-20260930","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1186\/s13018-025-05981-z","article-title":"Is it a pediatric orthopaedic urgency or not? Can ChatGPT answer this question?","volume":"20","author":"Birsel","year":"2025","journal-title":"J Orthop Surg Res"},{"key":"R18-20260930","first-page":"245","article-title":"Evaluation of large language models in providing information for developmental dysplasia of the hip.","volume":"19","author":"Ouyang","year":"2025","journal-title":"J Child Orthop"},{"key":"R19-20260930","first-page":"156","article-title":"Artificial intelligence chatbots in pediatric orthopedics: parent-focused questions about bowlegs and knock knees.","volume":"34","author":"Kamal","year":"2025","journal-title":"J Pediatr Orthop B"},{"key":"R20-20260930","doi-asserted-by":"crossref","first-page":"100135","DOI":"10.1016\/j.jposna.2024.100135","article-title":"ChatGPT and google gemini are clinically inadequate in providing recommendations on management of developmental dysplasia of the hip compared to American Academy of Orthopaedic Surgeons Clinical Practice guidelines.","volume":"10","author":"Nian","year":"2025","journal-title":"J Pediatr Soc North Am"},{"key":"R21-20260930","doi-asserted-by":"crossref","first-page":"e456","DOI":"10.1097\/BPO.0000000000002681","article-title":"ChatGPT responses to FAQs about slipped capital femoral epiphysis (SCFE).","volume":"44","author":"Adelstein","year":"2024","journal-title":"J Pediatr Orthop"},{"key":"R22-20260930","doi-asserted-by":"crossref","first-page":"e230922","DOI":"10.1148\/radiol.230922","article-title":"How AI responds to common lung cancer questions: ChatGPT vs Google Bard.","volume":"307","author":"Rahsepar","year":"2023","journal-title":"Radiology"},{"key":"R23-20260930","first-page":"e98","article-title":"A comparison of ChatGPT and expert consensus on surgical site infection prevention in pediatric spine surgery.","volume":"44","author":"Chester","year":"2024","journal-title":"J Pediatr Orthop"},{"key":"R24-20260930","doi-asserted-by":"crossref","first-page":"e036979","DOI":"10.1161\/JAHA.124.036979","article-title":"Comparative analysis of the accuracy of large language models in addressing common pulmonary embolism patient questions.","volume":"13","author":"Rosenzveig","year":"2024","journal-title":"J Am Heart Assoc"},{"key":"R25-20260930","doi-asserted-by":"crossref","first-page":"952","DOI":"10.1159\/000534005","article-title":"Trends in accuracy and appropriateness of alopecia areata information obtained from a popular online large language model, ChatGPT.","volume":"239","author":"Hagan","year":"2023","journal-title":"Dermatology"},{"key":"R26-20260930","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1136\/jme-2024-110240","article-title":"Assessing the performance of ChatGPT in medical ethical decision-making: a comparative study with USMLE-based scenarios.","volume":"51","author":"Khan","year":"2025","journal-title":"J Med Ethics"},{"key":"R27-20260930","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1007\/s00345-024-05137-4","article-title":"Performance of ChatGPT-3.5 and ChatGPT-4 on the European Board of Urology (EBU) exams: a comparative analysis.","volume":"42","author":"Schoch","year":"2024","journal-title":"World J Urol"},{"key":"R28-20260930","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1097\/JCMA.0000000000000946","article-title":"ChatGPT failed Taiwan\u2019s Family Medicine Board Exam.","volume":"86","author":"Weng","year":"2023","journal-title":"J Chin Med Assoc"},{"key":"R29-20260930","first-page":"e61067","article-title":"Evaluating ChatGPT-3.5 and ChatGPT-4.0 responses on hyperlipidemia for patient education.","volume":"16","author":"Lee","year":"2024","journal-title":"Cureus"},{"key":"R30-20260930","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1002\/pros.24699","article-title":"Performance of large language models on benign prostatic hyperplasia frequently asked questions.","volume":"84","author":"Zhang","year":"2024","journal-title":"Prostate"},{"key":"R31-20260930","first-page":"e57348","article-title":"Performance of google\u2019s artificial intelligence chatbot \u201cBard\u201d (Now \u201cGemini\u201d) on ophthalmology board exam practice questions.","volume":"16","author":"Botross","year":"2024","journal-title":"Cureus"},{"key":"R32-20260930","doi-asserted-by":"crossref","first-page":"1751","DOI":"10.1002\/ohn.927","article-title":"Enhancing health literacy: evaluating the readability of patient handouts revised by ChatGPT\u2019s large language model.","volume":"171","author":"Swisher","year":"2024","journal-title":"Otolaryngol Head Neck Surg"},{"key":"R33-20260930","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1080\/08820538.2024.2326058","article-title":"Google vs. Dr. ChatGPT: exploring the use of artificial intelligence in ophthalmology by comparing the accuracy, safety, and readability of responses to frequently asked patient questions regarding cataracts and cataract surgery.","volume":"39","author":"Cohen","year":"2024","journal-title":"Semin Ophthalmol"},{"key":"R34-20260930","first-page":"16","article-title":"Challenges of artificial intelligence in medicine.","volume":"323","author":"Aldosari","year":"2025","journal-title":"Stud Health Technol Inform"}],"container-title":["Journal of Pediatric Orthopaedics B"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ovid.com\/10.1097\/BPB.0000000000001368","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T06:00:28Z","timestamp":1790748028000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.1097\/BPB.0000000000001368"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,23]]},"references-count":34,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2026]]}},"URL":"https:\/\/doi.org\/10.1097\/bpb.0000000000001368","relation":{},"ISSN":["1060-152X","1473-5865"],"issn-type":[{"value":"1060-152X","type":"print"},{"value":"1473-5865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,23]]},"assertion":[{"value":"2026-01-13","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-04-12","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}