{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T16:25:58Z","timestamp":1794327958446,"version":"4.9.0"},"reference-count":32,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"12","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2026,12]]},"abstract":"<jats:sec>\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>Large language models (LLMs) are increasingly used by patients and caregivers to obtain medical information. In pediatric acute bacterial arthritis, non-guideline-concordant information may be clinically important because timely diagnosis and management are essential. This study evaluated the concordance of LLM-generated responses to parent-oriented reformulations of Pediatric Infectious Diseases Society\/Infectious Diseases Society of America (PIDS\/IDSA) guideline recommendations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>In this exploratory cross-sectional benchmarking study, 27 PIDS\/IDSA guideline-derived recommendations and good practice statements were reformulated into standardized parent-oriented prompts. The same prompts were submitted to GPT-5.4 Thinking, Gemini 3 Thinking and Claude 4.6 Sonnet through browser-based interfaces on April 12, 2026. Responses were anonymized and independently assessed by 3 blinded reviewers. Each response was classified as concordant or discordant; final classifications were determined by majority decision. Interrater agreement was assessed using Fleiss\u2019 kappa, and model differences were evaluated using Cochran\u2019s Q test.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>\n                      Overall, 75 of 81 responses (92.6%) were concordant with PIDS\/IDSA recommendations. Gemini 3 Thinking achieved concordance in 27\/27 responses (100.0%), Claude 4.6 Sonnet in 25\/27 (92.6%) and GPT-5.4 Thinking in 23\/27 (85.2%). Cochran\u2019s Q test showed no significant difference among models (Q = 4.800, df = 2,\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      = 0.091). No unsupported or hallucinated content was identified. Interrater agreement was moderate (\u03ba = 0.580; 95% CI, 0.454\u20130.706;\n                      <jats:italic toggle=\"yes\">P<\/jats:italic>\n                      &lt; 0.001).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>LLMs showed high guideline concordance, but selected item-level discordance persisted. Because these models may have been trained on guideline-derived content, high concordance should not be equated with independent clinical reasoning. These tools may support caregiver-oriented education but should not replace clinician assessment or guideline-based care.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1097\/inf.0000000000005335","type":"journal-article","created":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T04:02:59Z","timestamp":1785211379000},"page":"1036-1041","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":0,"title":["Guideline Concordance of Large Language Model Responses to Parent-oriented Guideline Prompts About Pediatric Acute Bacterial Arthritis"],"prefix":"10.1097","volume":"45","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-7505-8449","authenticated-orcid":false,"given":"Ahmet Murat","family":"\u00c7\u00f6rekci","sequence":"first","affiliation":[{"name":"Department of Orthopaedics and Traumatology"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4525-8764","authenticated-orcid":false,"given":"Belen","family":"Ate\u015f","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, University of Health Sciences T\u00fcrkiye, Istanbul Prof. Dr. Cemil Ta\u015fc\u0131o\u011flu City Hospital, Istanbul, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-4823-0042","authenticated-orcid":false,"given":"Orkun","family":"Din\u00e7","sequence":"additional","affiliation":[{"name":"Department of Pediatric Hematology and Oncology, Van Training and Research Hospital, Van, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1777-9060","authenticated-orcid":false,"given":"Ahmet Alperen","family":"\u00d6zt\u00fcrk","sequence":"additional","affiliation":[{"name":"Department of Orthopaedics and Traumatology, Sancaktepe \u015eehit Prof. Dr. \u0130lhan Varank Training and Research Hospital, Istanbul, Turkey."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2026,7,28]]},"reference":[{"key":"R1-20261110","doi-asserted-by":"crossref","first-page":"122","DOI":"10.5312\/wjo.v13.i2.122","article-title":"Developments in diagnosis and treatment of paediatric septic arthritis.","volume":"13","author":"Donders","year":"2022","journal-title":"World J Orthop"},{"key":"R2-20261110","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1097\/BPO.0000000000002453","article-title":"What\u2019s new in pediatric septic arthritis? a review of pertinent clinical questions.","volume":"43","author":"Hachem","year":"2023","journal-title":"J Pediatr Orthop"},{"key":"R3-20261110","doi-asserted-by":"crossref","first-page":"65","DOI":"10.2147\/PHMT.S115429","article-title":"Septic arthritis in children: diagnosis and treatment.","volume":"8","author":"P\u00e4\u00e4kk\u00f6nen","year":"2017","journal-title":"Pediatric Health Med Ther"},{"key":"R4-20261110","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1097\/BPO.0b013e3181cfcd4f","article-title":"Comparison of bacteriologically proven septic arthritis of the hip and knee in children, a preliminary study.","volume":"30","author":"Joshy","year":"2010","journal-title":"J Pediatr Orthop"},{"key":"R5-20261110","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/jpids\/piad089","article-title":"Clinical practice guideline by the Pediatric Infectious Diseases Society (PIDS) and the Infectious Diseases Society of America (IDSA): 2023 guideline on diagnosis and management of acute bacterial arthritis in pediatrics.","volume":"13","author":"Woods","year":"2023","journal-title":"J. Pediatric Infect Dis Soc"},{"key":"R6-20261110","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1038\/s43856-024-00717-2","article-title":"Current applications and challenges in large language models for patient care: a systematic review.","volume":"5","author":"Busch","year":"2025","journal-title":"Commun Med (Lond)"},{"key":"R7-20261110","doi-asserted-by":"crossref","first-page":"1367","DOI":"10.1093\/jamia\/ocae052","article-title":"Leveraging large language models for generating responses to patient messages-a subjective analysis.","volume":"31","author":"Liu","year":"2024","journal-title":"J Am Med Inform Assoc"},{"key":"R8-20261110","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1038\/s43856-023-00370-1","article-title":"The future landscape of large language models in medicine.","volume":"3","author":"Clusmann","year":"2023","journal-title":"Commun Med (Lond)"},{"key":"R9-20261110","doi-asserted-by":"crossref","first-page":"210","DOI":"10.5694\/mja2.52598","article-title":"Use of ChatGPT to obtain health information in Australia, 2024: insights from a nationally representative survey.","volume":"222","author":"Ayre","year":"2025","journal-title":"Med J Aust"},{"key":"R10-20261110","doi-asserted-by":"crossref","first-page":"e19985","DOI":"10.2196\/19985","article-title":"Online health information seeking by parents for their children: systematic review and agenda for further research.","volume":"22","author":"Kubb","year":"2020","journal-title":"J Med Internet Res"},{"key":"R11-20261110","doi-asserted-by":"crossref","first-page":"e17","DOI":"10.2196\/ijmr.5075","article-title":"Internet usage by parents prior to seeking care at a pediatric emergency department: observational study.","volume":"6","author":"Shroff","year":"2017","journal-title":"Interact J Med Res"},{"key":"R12-20261110","doi-asserted-by":"crossref","first-page":"108013","DOI":"10.1016\/j.cmpb.2024.108013","article-title":"ChatGPT in healthcare: a taxonomy and systematic review.","volume":"245","author":"Li","year":"2024","journal-title":"Comput Methods Programs Biomed"},{"key":"R13-20261110","doi-asserted-by":"crossref","first-page":"762","DOI":"10.55275\/JPOSNA-2023-762","article-title":"AI = appropriate insight? ChatGPT Appropriately answers parents\u2019 questions for common pediatric orthopaedic conditions.","volume":"5","author":"Zusman","year":"2023","journal-title":"J Pediatr Soc North Am"},{"key":"R14-20261110","doi-asserted-by":"crossref","first-page":"1659812","DOI":"10.3389\/fped.2025.1659812","article-title":"Reliability of ChatGPT answers to common questions on developmental dysplasia of the hip as an information source for parents.","volume":"13","author":"Vertesich","year":"2025","journal-title":"Front Pediatr"},{"key":"R15-20261110","doi-asserted-by":"crossref","first-page":"100135","DOI":"10.1016\/j.jposna.2024.100135","article-title":"ChatGPT and Google Gemini are clinically inadequate in providing recommendations on management of developmental dysplasia of the hip compared to American Academy of Orthopaedic Surgeons Clinical Practice Guidelines.","volume":"10","author":"Nian","year":"2024","journal-title":"J Pediatr Soc North Am"},{"key":"R16-20261110","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1097\/BPO.0000000000002681","article-title":"ChatGPT responses to common questions about slipped capital femoral epiphysis: a reliable resource for parents?.","volume":"44","author":"Adelstein","year":"2024","journal-title":"J Pediatr Orthop"},{"key":"R17-20261110","doi-asserted-by":"crossref","first-page":"100196","DOI":"10.1016\/j.jposna.2025.100196","article-title":"Artificial intelligence-based large language models can facilitate patient education.","volume":"12","author":"Bryson","year":"2025","journal-title":"J Pediatr Soc North Am"},{"key":"R18-20261110","first-page":"e37938","article-title":"Capacity of ChatGPT to identify guideline-based treatments for advanced solid tumors.","volume":"15","author":"Schulte","year":"2023","journal-title":"Cureus"},{"key":"R19-20261110","doi-asserted-by":"crossref","first-page":"2086","DOI":"10.1007\/s00415-023-12168-1","article-title":"ChatGPT fails challenging the recent ESCMID brain abscess guideline.","volume":"271","author":"Dyckhoff-Shen","year":"2024","journal-title":"J Neurol"},{"key":"R20-20261110","doi-asserted-by":"crossref","first-page":"415","DOI":"10.5152\/j.aott.2025.25428","article-title":"Comparative evaluation of large language model-based chatbots in a septic arthritis scenario: ChatGPT, Claude, and Perplexity.","volume":"59","author":"Bayrak","year":"2025","journal-title":"Acta Orthop Traumatol Turc"},{"key":"R21-20261110","doi-asserted-by":"crossref","first-page":"e338","DOI":"10.1097\/BPO.0000000000002890","article-title":"Pediatric supracondylar humerus and diaphyseal femur fractures: a comparative analysis of chat generative pretrained transformer and Google Gemini recommendations versus American Academy of Orthopaedic Surgeons Clinical Practice Guidelines.","volume":"45","author":"Nian","year":"2025","journal-title":"J Pediatr Orthop"},{"key":"R22-20261110","doi-asserted-by":"crossref","first-page":"104620","DOI":"10.1016\/j.jbi.2024.104620","article-title":"Evaluation of ChatGPT-generated medical responses: a systematic review and meta-analysis.","volume":"151","author":"Wei","year":"2024","journal-title":"J Biomed Inform"},{"key":"R23-20261110","doi-asserted-by":"crossref","first-page":"104427","DOI":"10.1016\/j.knee.2026.104427","article-title":"Concordance of ChatGPT, Gemini, Claude, and OpenEvidence with the 2024 AAOS guidelines on acute isolated meniscal pathology.","volume":"61","author":"Hsu","year":"2026","journal-title":"Knee"},{"key":"R24-20261110","doi-asserted-by":"crossref","first-page":"159","DOI":"10.2307\/2529310","article-title":"The measurement of observer agreement for categorical data.","volume":"33","author":"Landis","year":"1977","journal-title":"Biometrics"},{"key":"R25-20261110","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters.","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychol Bull"},{"key":"R26-20261110","first-page":"912","article-title":"Acute arthritis in children: how to discern between septic and non-septic arthritis?","volume":"8","author":"Gamalero","year":"2021","journal-title":"Children (Basel)"},{"key":"R27-20261110","article-title":"Risk factors and clinical features of septic arthritis in children: a systematic review and meta-analysis.","author":"Hutaif","journal-title":"Res Sq"},{"key":"R28-20261110","doi-asserted-by":"crossref","first-page":"2002","DOI":"10.1016\/j.arthro.2024.09.020","article-title":"Artificial intelligence large language models address anterior cruciate ligament reconstruction: superior clarity and completeness by Gemini compared with ChatGPT\u20104 in response to American Academy of Orthopaedic Surgeons Clinical Practice Guidelines.","volume":"41","author":"Quinn","year":"2024","journal-title":"Arthroscopy"},{"key":"R29-20261110","doi-asserted-by":"crossref","first-page":"2753","DOI":"10.1016\/j.arthro.2025.01.039","article-title":"ChatGPT and Gemini are not consistently concordant with the 2020 American Academy of orthopaedic surgeons clinical practice guidelines when evaluating rotator cuff injury.","volume":"41","author":"Megafu","year":"2025","journal-title":"Arthroscopy"},{"key":"R30-20261110","doi-asserted-by":"crossref","first-page":"2098","DOI":"10.1097\/CORR.0000000000003234","article-title":"\u201cDr. AI Will See You Now\u201d: How Do ChatGPT-4 treatment recommendations align with orthopaedic clinical practice guidelines?","volume":"482","author":"Dagher","year":"2024","journal-title":"Clin Orthop Relat Res"},{"key":"R31-20261110","doi-asserted-by":"crossref","first-page":"1504","DOI":"10.1002\/ksa.70315","article-title":"Deep research capabilities in GPT\u20105 thinking and Gemini 2.5 Pro improve citation integrity and concordance with American Academy of Orthopaedic Surgeons anterior cruciate ligament and rotator cuff guidelines.","volume":"34","author":"Sengul","year":"2026","journal-title":"Knee Surg Sports Traumatol Arthrosc"},{"key":"R32-20261110","doi-asserted-by":"crossref","first-page":"887","DOI":"10.3390\/healthcare11060887","article-title":"ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns.","volume":"11","author":"Sallam","year":"2023","journal-title":"Healthcare (Basel)"}],"container-title":["Pediatric Infectious Disease Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.ovid.com\/10.1097\/INF.0000000000005335","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T16:01:11Z","timestamp":1794326471000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ovid.com\/10.1097\/INF.0000000000005335"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,28]]},"references-count":32,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2026]]}},"URL":"https:\/\/doi.org\/10.1097\/inf.0000000000005335","relation":{},"ISSN":["0891-3668","1532-0987"],"issn-type":[{"value":"0891-3668","type":"print"},{"value":"1532-0987","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,28]]},"assertion":[{"value":"2026-05-11","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-12","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}