{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T00:45:37Z","timestamp":1791765937523,"version":"4.3.4"},"reference-count":25,"publisher":"American Academy of Pediatrics (AAP)","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:sec>\n                    <jats:title>OBJECTIVE<\/jats:title>\n                    <jats:p>To evaluate the quality, safety, and citation characteristics of OpenEvidence across pediatric subspecialties.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>METHODS<\/jats:title>\n                    <jats:p>Guideline-anchored clinical questions spanning high, moderate, and low evidence certainty across 6 pediatric subspecialties were submitted to OpenEvidence. Expert reviewer pairs independently scored responses using the validated Quality Analysis of Medical Artificial Intelligence (QAMAI) instrument (6\u201330 range, higher scores indicate better quality) and a modified Agency for Healthcare Research and Quality harm assessment (0\u20137 range, higher scores indicate more harm), followed by consensus reconciliation. Citation analysis examined overlap with guideline references, claim substantiation, and pediatric specificity. Response consistency was assessed across 5 repeated queries.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>RESULTS<\/jats:title>\n                    <jats:p>Seventeen questions were evaluated. The median QAMAI score was 27\/30 (IQR, 24\u201329; \u201cvery good\u201d quality). Potential harm was low (median 0\/7, range 0\u20133), though 6 of 17 responses carried nonzero harm potential. OpenEvidence cited the primary guideline in 15 of 17 questions, yet only 17.6% of responses showed strong citation overlap (\u226575% shared references) with the corresponding guidelines. OpenEvidence\u2019s citations reliably supported the claims they accompanied (88.2% with high substantiation), and 70.8% of reviewer assessments rated the evidence base as comparable in quality to that of the corresponding guidelines. In total, 35.3% of responses cited studies lacking pediatric specificity. Responses were clinically consistent across repeated queries (77.9% had no meaningful or only minor variation); no contradictory recommendations were observed.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>CONCLUSIONS<\/jats:title>\n                    <jats:p>OpenEvidence produced high-quality responses with low expert-rated potential for harm across multiple pediatric subspecialties. The pediatric specificity of cited evidence warrants attention, reflecting the broader challenge of applying artificial intelligence tools that are trained on adult-predominant literature to pediatric populations.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1542\/hpeds.2026-009588","type":"journal-article","created":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T00:03:03Z","timestamp":1791763383000},"source":"Crossref","is-referenced-by-count":0,"title":["Evaluating OpenEvidence Across Pediatric Subspecialties: A Guideline-Anchored Expert Review"],"prefix":"10.1542","author":[{"given":"R Brandon","family":"Hunter","sequence":"first","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren M","family":"Hess","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Douglas","family":"Wells","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Duy M","family":"Dinh","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hani","family":"Abou Hatab","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mikael C","family":"Guzman-Karlsson","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sutapa","family":"Khatua","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Denver","family":"Niles","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bradford","family":"Nguyen","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shawki","family":"Qasim","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marla BK","family":"Sammer","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ila","family":"Singh","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sanjiv","family":"Mehta","sequence":"additional","affiliation":[{"name":"2Children\u2019s Hospital of Philadelphia and the University of Pennsylvania, Philadelphia, Pennsylvania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andy","family":"Tsai","sequence":"additional","affiliation":[{"name":"3Boston Children\u2019s Hospital and Harvard Medical School, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rajkumar","family":"Venkatramani","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer","family":"Benjamin","sequence":"additional","affiliation":[{"name":"1Texas Children\u2019s Hospital and Baylor College of Medicine, Houston, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"417","published-online":{"date-parts":[[2026,10,12]]},"reference":[{"issue":"11","key":"2026101120025864900_r1","doi-asserted-by":"crossref","first-page":"e2544672","DOI":"10.1001\/jamanetworkopen.2025.44672","article-title":"Public Interest in an AI-Enabled Clinical Decision Support Tool","volume":"8","author":"Patel","year":"2025","journal-title":"JAMA Netw Open."},{"key":"2026101120025864900_r2","article-title":"OpenEvidence Achieves Historic Milestone: 1 Million Clinical Consultations between Verified Doctors and an Artificial Intelligence System in a Single Day","author":"OpenEvidence"},{"key":"2026101120025864900_r3","doi-asserted-by":"crossref","first-page":"20552076251348850","DOI":"10.1177\/20552076251348850","article-title":"Answering real-world clinical questions using large language model, retrieval-augmented generation, and agentic systems","volume":"11","author":"Low","year":"2025","journal-title":"Digit Health."},{"key":"2026101120025864900_r4","article-title":"OpenEvidence Clinical Question-Answering Platform: Systematic Review of Early Evaluations","author":"Artsi","journal-title":"Research Square."},{"key":"2026101120025864900_r5","article-title":"Arkangel AI, OpenEvidence, ChatGPT, Medisearch: are they objectively up to medical standards? A real-life assessment of LLMs in healthcare","author":"Castano-Villegas","journal-title":"medRxiv."},{"issue":"3\u20134","key":"2026101120025864900_r6","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1080\/08880018.2026.2618260","article-title":"Leveraging artificial intelligence for decision-making in pediatric progressive and refractory solid tumors","volume":"43","author":"Mordechai","year":"2026","journal-title":"Pediatr Hematol Oncol."},{"issue":"2","key":"2026101120025864900_r7","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1001\/jamapediatrics.2024.5437","article-title":"US FDA Approval of Pediatric Artificial Intelligence and Machine Learning-Enabled Medical Devices","volume":"179","author":"Brewster","year":"2025","journal-title":"JAMA Pediatr."},{"issue":"8","key":"2026101120025864900_r8","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1016\/j.jacr.2023.06.003","article-title":"Use of Artificial Intelligence in Radiology: Impact on Pediatric Patients, a White Paper From the ACR Pediatric AI Workgroup","volume":"20","author":"Sammer","year":"2023","journal-title":"J Am Coll Radiol."},{"issue":"1","key":"2026101120025864900_r9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/ped4.12407","article-title":"Will artificial intelligence widen the therapeutic gap between children and adults?","volume":"8","author":"Nagy","year":"2023","journal-title":"Pediatr Investig."},{"issue":"11","key":"2026101120025864900_r10","doi-asserted-by":"crossref","first-page":"6123","DOI":"10.1007\/s00405-024-08710-0","article-title":"Validation of the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool: a new tool to assess the quality of health information provided by AI platforms","volume":"281","author":"Vaira","year":"2024","journal-title":"Eur Arch Oto-Rhino-Laryngol."},{"issue":"6","key":"2026101120025864900_r11","doi-asserted-by":"crossref","first-page":"e0000899","DOI":"10.1371\/journal.pdig.0000899","article-title":"Evaluating large language models for drafting emergency department encounter summaries","volume":"4","author":"Williams","year":"2025","journal-title":"PLOS Digit Health."},{"issue":"1","key":"2026101120025864900_r12","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1097\/PTS.0b013e3182948ef9","article-title":"The reliability of AHRQ Common Format Harm Scales in rating patient safety events","volume":"11","author":"Williams","year":"2015","journal-title":"J Patient Saf."},{"issue":"5","key":"2026101120025864900_r13","doi-asserted-by":"crossref","first-page":"1286","DOI":"10.1007\/s11606-025-09888-7","article-title":"Variation in Large Language Model Recommendations in Challenging Inpatient Management Scenarios","volume":"41","author":"Landon","year":"2026","journal-title":"J Gen Intern Med."},{"issue":"7","key":"2026101120025864900_r14","doi-asserted-by":"crossref","first-page":"2405","DOI":"10.1038\/s41591-026-04431-5","article-title":"General-purpose large language models outperform specialized clinical AI tools on medical benchmarks","volume":"32","author":"Vishwanath","year":"2026","journal-title":"Nat Med."},{"key":"2026101120025864900_r15","article-title":"Expert Evaluation of Clinical AI Tools on Real Point-of-Care Clinical Queries","author":"Feng","year":"2026","journal-title":"arXiv."},{"issue":"11S","key":"2026101120025864900_r16","doi-asserted-by":"crossref","first-page":"S473","DOI":"10.1016\/j.jacr.2022.09.013","article-title":"ACR Appropriateness Criteria\u00ae Suspected Osteomyelitis, Septic Arthritis, or Soft Tissue Infection (Excluding Spine and Diabetic Foot): 2022 Update","volume":"19","author":"Pierce","year":"2022","journal-title":"J Am Coll Radiol."},{"issue":"5S","key":"2026101120025864900_r17","doi-asserted-by":"crossref","first-page":"S121","DOI":"10.1016\/j.jacr.2022.02.017","article-title":"ACR Appropriateness Criteria\u00ae Osteomyelitis or Septic Arthritis-Child (Excluding Axial Skeleton)","volume":"19","author":"Shet","year":"2022","journal-title":"J Am Coll Radiol."},{"issue":"10","key":"2026101120025864900_r18","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/s11912-019-0840-0","article-title":"Latest Update on Prevention of Acute Chemotherapy-Induced Nausea and Vomiting in Pediatric Cancer Patients","volume":"21","author":"Sherani","year":"2019","journal-title":"Curr Oncol Rep."},{"issue":"8","key":"2026101120025864900_r19","doi-asserted-by":"crossref","first-page":"e30395","DOI":"10.1002\/pbc.30395","article-title":"Treatment of breakthrough and prevention of refractory chemotherapy-induced nausea and vomiting in pediatric cancer patients: Clinical practice guideline update","volume":"70","author":"Patel","year":"2023","journal-title":"Pediatr Blood Cancer."},{"issue":"7","key":"2026101120025864900_r20","doi-asserted-by":"crossref","first-page":"883","DOI":"10.6004\/jnccn.2017.0117","article-title":"NCCN Guidelines Insights: Antiemesis, Version 2.2017","volume":"15","author":"Berger","year":"2017","journal-title":"J Natl Compr Canc Netw."},{"key":"2026101120025864900_r21","author":"About OpenEvidence"},{"key":"2026101120025864900_r22","article-title":"Lack of children in public medical imaging data points to growing age bias in biomedical AI","author":"Hua","journal-title":"medRxiv."},{"issue":"1","key":"2026101120025864900_r23","doi-asserted-by":"crossref","first-page":"10215","DOI":"10.1038\/s41598-022-14519-w","article-title":"Diagnostic performance of artificial intelligence approved for adults for the interpretation of pediatric chest radiographs","volume":"12","author":"Shin","year":"2022","journal-title":"Sci Rep."},{"key":"2026101120025864900_r24","article-title":"US Food and Drug Administration","author":"Clinical Decision Support Software: Guidance for Industry and Food and Drug Administration Staff","year":"2026"},{"issue":"5","key":"2026101120025864900_r25","doi-asserted-by":"crossref","first-page":"AIoa2501001","DOI":"10.1056\/AIoa2501001","article-title":"Automation Bias in Large Language Model\u2013Assisted Diagnostic Reasoning among Physicians Trained in AI Literacy \u2014 A Randomized Clinical Trial","volume":"3","author":"Qazi","year":"2026","journal-title":"NEJM AI."}],"container-title":["Hospital Pediatrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/publications.aap.org\/hospitalpediatrics\/article-pdf\/doi\/10.1542\/hpeds.2026-009588\/1977595\/hosppeds.2026009588.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/publications.aap.org\/hospitalpediatrics\/article-pdf\/doi\/10.1542\/hpeds.2026-009588\/1977595\/hosppeds.2026009588.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,12]],"date-time":"2026-10-12T00:03:06Z","timestamp":1791763386000},"score":1,"resource":{"primary":{"URL":"https:\/\/publications.aap.org\/hospitalpediatrics\/article\/doi\/10.1542\/hpeds.2026-009588\/210929\/Evaluating-OpenEvidence-Across-Pediatric"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10,12]]},"references-count":25,"URL":"https:\/\/doi.org\/10.1542\/hpeds.2026-009588","relation":{},"ISSN":["2154-1663","2154-1671"],"issn-type":[{"value":"2154-1663","type":"print"},{"value":"2154-1671","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10,12]]},"article-number":"e2026009588"}}