{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T11:29:51Z","timestamp":1769599791163,"version":"3.49.0"},"reference-count":30,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T00:00:00Z","timestamp":1761177600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100006093","name":"PCORI","doi-asserted-by":"publisher","award":["RI-CHOP-01-PS1"],"award-info":[{"award-number":["RI-CHOP-01-PS1"]}],"id":[{"id":"10.13039\/100006093","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006093","name":"PCORI","doi-asserted-by":"publisher","award":["ME-2020C3-21199"],"award-info":[{"award-number":["ME-2020C3-21199"]}],"id":[{"id":"10.13039\/100006093","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Researching COVID to Enhance Recovery"},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["OT2HL161847-01"],"award-info":[{"award-number":["OT2HL161847-01"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To construct a data quality (DQ) system that incorporates combinations of methods to evaluate data characteristics and analytic fitness across research questions for multiple uses.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>Drawing from experience of other data quality programs, network data extraction needs, and recurring study requirements, we developed 5 standards to guide development of a modular, multifaceted data quality system. These included annotation and documentation, ability to measure research readiness, reproducibility across networks, flexibility for the user, and interpretability to research and project teams. Implementation of checks based on these principles focused on reusability and interactive visualization of results.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We identified 10 check types producing over 444 check applications and deployed them in 2 multi-institutional networks. Check types span structural conformance to a data model, utility for common research needs, and study-specific customization. All check types are customizable without dependencies between them. A dashboard visualizes results, permitting adjustments based on number of data sources, need for source masking, and the user\u2019s focus. All components can be applied as written to any data source using OMOP and are readily modified for other data models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>We have extended previous work through our novel and multifaceted approach to data quality assessment, addressing needs in both network data improvement and research usage. We developed a capable and deployable system rather than tailoring to specific use cases.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Our novel DQ assessment system provides essential components for future standardization and collaboration to improve fitness of clinical data for intended use.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocaf181","type":"journal-article","created":{"date-parts":[[2025,10,4]],"date-time":"2025-10-04T11:50:51Z","timestamp":1759578651000},"page":"371-382","source":"Crossref","is-referenced-by-count":0,"title":["A multifaceted approach to advancing data quality and fitness standards in multi-institutional networks"],"prefix":"10.1093","volume":"33","author":[{"given":"Hanieh","family":"Razzaghi","sequence":"first","affiliation":[{"name":"Applied Clinical Research Center, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]},{"name":"Department of Pediatrics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19104,","place":["United States"]},{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]}]},{"given":"Kimberley","family":"Dickinson","sequence":"additional","affiliation":[{"name":"Applied Clinical Research Center, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]},{"name":"Department of Pediatrics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19104,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7477-2601","authenticated-orcid":false,"given":"Kaleigh","family":"Wieand","sequence":"additional","affiliation":[{"name":"Applied Clinical Research Center, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]},{"name":"Department of Pediatrics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19104,","place":["United States"]}]},{"given":"Samuel","family":"Boss","sequence":"additional","affiliation":[{"name":"Applied Clinical Research Center, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]},{"name":"Department of Pediatrics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19104,","place":["United States"]}]},{"given":"Hunter","family":"Weidlich","sequence":"additional","affiliation":[{"name":"Applied Clinical Research Center, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]},{"name":"Department of Pediatrics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19104,","place":["United States"]}]},{"given":"Yungui","family":"Huang","sequence":"additional","affiliation":[{"name":"IT Research and Innovation, Nationwide Children\u2019s Hospital , Columbus, OH 43205,","place":["United States"]}]},{"given":"Keith","family":"Morse","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Stanford University School of Medicine , Palo Alto, CA 94305,","place":["United States"]}]},{"given":"Sujan Kumar","family":"Mutyala","sequence":"additional","affiliation":[{"name":"Information Services, Texas Children\u2019s Hospital , Houston, TX 77030,","place":["United States"]}]},{"given":"Jyothi Priya Alekapatti","family":"Nandagopal","sequence":"additional","affiliation":[{"name":"IS Research Data & Technology Services, Cincinnati Children\u2019s Hospital Medical Center , Cincinnati, OH 45229,","place":["United States"]}]},{"given":"Karthik","family":"Viswanathan","sequence":"additional","affiliation":[{"name":"Biomedical Research Informatics Center, Nemours Children\u2019s Hospital , Wilmington, DE 19803,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1252-068X","authenticated-orcid":false,"given":"Christopher B","family":"Forrest","sequence":"additional","affiliation":[{"name":"Applied Clinical Research Center, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]},{"name":"Department of Pediatrics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19104,","place":["United States"]},{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]},{"name":"Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania , Philadelphia, PA 19104,","place":["United States"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8967-0662","authenticated-orcid":false,"given":"L Charles","family":"Bailey","sequence":"additional","affiliation":[{"name":"Applied Clinical Research Center, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]},{"name":"Department of Pediatrics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19104,","place":["United States"]},{"name":"Department of Biomedical and Health Informatics, Children\u2019s Hospital of Philadelphia , Philadelphia, PA 19146,","place":["United States"]},{"name":"Department of Pediatrics, Perelman School of Medicine at the University of Pennsylvania , Philadelphia, PA 19104,","place":["United States"]}]}],"member":"286","published-online":{"date-parts":[[2025,10,23]]},"reference":[{"key":"2026012716173878500_ocaf181-B1","doi-asserted-by":"publisher","first-page":"S80","DOI":"10.1097\/MLR.0b013e31829b1d48","article-title":"Challenges in using electronic health record data for CER: experience of 4 learning organizations and solutions applied","volume":"51","author":"Bayley","year":"2013","journal-title":"Med Care"},{"key":"2026012716173878500_ocaf181-B2","doi-asserted-by":"publisher","first-page":"S30","DOI":"10.1097\/MLR.0b013e31829b1dbd","article-title":"Caveats for the use of operational electronic health record data in comparative effectiveness research","volume":"51","author":"Hersh","year":"2013","journal-title":"Med Care"},{"key":"2026012716173878500_ocaf181-B3","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1186\/1472-6947-14-51","article-title":"Hidden in plain sight: bias towards sick patients when sampling patients with sufficient electronic health record data for research","volume":"14","author":"Rusanov","year":"2014","journal-title":"BMC Med Inform Decis Mak"},{"key":"2026012716173878500_ocaf181-B4","doi-asserted-by":"publisher","first-page":"971","DOI":"10.1093\/jamia\/ocad013","article-title":"Healthcare utilization is a collider: an introduction to collider bias in EHR data reuse","volume":"30","author":"Weiskopf","year":"2023","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716173878500_ocaf181-B5","doi-asserted-by":"publisher","first-page":"2251","DOI":"10.1093\/jamia\/ocab132","article-title":"Increasing trust in real-world evidence through evaluation of observational data quality","volume":"28","author":"Blacketer","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716173878500_ocaf181-B6","first-page":"186","article-title":"EHR data quality assessment tools and issue reporting workflows for the 'All of Us\u2019 Research Program Clinical Data Research Network","volume":"2022","author":"Engel","year":"2022","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"key":"2026012716173878500_ocaf181-B7","doi-asserted-by":"publisher","first-page":"3","DOI":"10.13063\/2327-9214.1277","article-title":"DQ(e)-v: a database-agnostic framework for exploring variability in electronic health record data across time and site location","volume":"5","author":"Estiri","year":"2017","journal-title":"EGEMS (Wash DC)"},{"key":"2026012716173878500_ocaf181-B8","doi-asserted-by":"publisher","first-page":"1488","DOI":"10.3233\/SHTI190498","article-title":"Extending Achilles heel data quality tool with new rules informed by multi-site data quality comparison","volume":"264","author":"Huser","year":"2019","journal-title":"Stud Health Technol Inform"},{"key":"2026012716173878500_ocaf181-B9","doi-asserted-by":"publisher","first-page":"247","DOI":"10.3233\/SHTI190834","article-title":"Moving towards an EHR Data Quality Framework: the MIRACUM approach","volume":"267","author":"Kapsner","year":"2019","journal-title":"Stud Health Technol Inform"},{"key":"2026012716173878500_ocaf181-B10","first-page":"775","article-title":"Tailoring rule-based data quality assessment to the Patient-Centered Outcomes Research Network (PCORnet) common data model (CDM)","volume":"2022","author":"Mohamed","year":"2022","journal-title":"AMIA Annu Symp Proc"},{"key":"2026012716173878500_ocaf181-B11","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1093\/jamia\/ocab217","article-title":"Synergies between centralized and federated approaches to data quality: a report from the national COVID cohort collaborative","volume":"29","author":"Pfaff","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716173878500_ocaf181-B12","doi-asserted-by":"publisher","first-page":"3","DOI":"10.5334\/egems.199","article-title":"Evaluating foundational data quality in the National Patient-Centered Clinical Research Network (PCORnet(R))","volume":"6","author":"Qualls","year":"2018","journal-title":"eGEMs"},{"key":"2026012716173878500_ocaf181-B13","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1186\/s12874-023-01839-2","article-title":"Data quality considerations for evaluating COVID-19 treatments using real world data: learnings from the National COVID Cohort Collaborative (N3C)","volume":"23","author":"Sidky","year":"2023","journal-title":"BMC Med Res Methodol"},{"key":"2026012716173878500_ocaf181-B14","doi-asserted-by":"publisher","first-page":"1244","DOI":"10.13063\/2327-9214.1244","article-title":"A harmonized data quality assessment terminology and framework for the secondary use of electronic health record data","volume":"4","author":"Kahn","year":"2016","journal-title":"EGEMS (Wash DC)"},{"key":"2026012716173878500_ocaf181-B15","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1093\/jamia\/ocaa196","article-title":"The National COVID Cohort Collaborative (N3C): rationale, design, infrastructure, and deployment","volume":"28","author":"Haendel","year":"2021","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716173878500_ocaf181-B16","doi-asserted-by":"publisher","first-page":"1730","DOI":"10.1093\/jamia\/ocad120","article-title":"Electronic health record data quality assessment and tools: a systematic review","volume":"30","author":"Lewis","year":"2023","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716173878500_ocaf181-B17","doi-asserted-by":"publisher","first-page":"1072","DOI":"10.1093\/jamia\/ocx033","article-title":"A longitudinal analysis of data quality in a large pediatric data research network","volume":"24","author":"Khare","year":"2017","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716173878500_ocaf181-B18","doi-asserted-by":"publisher","first-page":"36","DOI":"10.5334\/egems.294","article-title":"Design and refinement of a data quality assessment workflow for a large pediatric research network","volume":"7","author":"Khare","year":"2019","journal-title":"EGEMS (Wash DC)"},{"key":"2026012716173878500_ocaf181-B19","doi-asserted-by":"publisher","first-page":"602","DOI":"10.1136\/amiajnl-2014-002743","article-title":"PEDSnet: a national pediatric learning health system","volume":"21","author":"Forrest","year":"2014","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716173878500_ocaf181-B20","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.jclinepi.2020.09.036","article-title":"PCORnet(R) 2020: current state, accomplishments, and future directions","volume":"129","author":"Forrest","year":"2021","journal-title":"J Clin Epidemiol"},{"key":"2026012716173878500_ocaf181-B21","author":"National Institutes of Health"},{"key":"2026012716173878500_ocaf181-B22","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1093\/jamia\/ocu023","article-title":"Feasibility and utility of applications of the common data model to multiple, disparate observational health databases","volume":"22","author":"Voss","year":"2015","journal-title":"J Am Med Inform Assoc"},{"key":"2026012716173878500_ocaf181-B23","doi-asserted-by":"publisher","first-page":"e2023-064446","DOI":"10.1542\/peds.2023-064446","article-title":"Vaccine effectiveness against long COVID in children","volume":"153","author":"Razzaghi","year":"2024","journal-title":"Pediatrics"},{"key":"2026012716173878500_ocaf181-B24","author":"Staff PCC"},{"key":"2026012716173878500_ocaf181-B25"},{"key":"2026012716173878500_ocaf181-B26","volume-title":"R: A Language and Environment for Statistical Computing","author":"R Development Core Team","year":"2019"},{"key":"2026012716173878500_ocaf181-B27","doi-asserted-by":"publisher","first-page":"1686","DOI":"10.21105\/joss.01686","article-title":"Welcome to the Tidyverse","volume":"4","author":"Wickham","year":"2019","journal-title":"J Open Source Softw"},{"key":"2026012716173878500_ocaf181-B28","author":"Bailey"},{"key":"2026012716173878500_ocaf181-B29","doi-asserted-by":"crossref","first-page":"155","DOI":"10.32614\/RJ-2021-004","article-title":"Six years of Shiny in Research\u2014collaborative development of web tools in R","volume":"12","author":"Kasprzak","year":"2020","journal-title":"R J"},{"key":"2026012716173878500_ocaf181-B30","author":"Razzaghi"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/2\/371\/64881036\/ocaf181.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/2\/371\/64881036\/ocaf181.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T21:17:48Z","timestamp":1769548668000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/33\/2\/371\/8300124"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,23]]},"references-count":30,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,10,23]]},"published-print":{"date-parts":[[2026,2,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocaf181","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,2]]},"published":{"date-parts":[[2025,10,23]]}}}