{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T21:50:09Z","timestamp":1786485009282,"version":"build-2736575974"},"reference-count":48,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Med Internet Res"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Secondary use of clinical data offers unprecedented opportunities to rapidly conduct large-scale research and improve patient care. However, incomplete understanding of data quality requirements for a study often causes significant delays in executing analyses and validating results. Current practice has largely followed 2 paths. First, multi-institutional networks have developed general data quality programs, but these are typically tied to unique network characteristics and do not address study-specific requirements well. Second, models have been proposed to formalize the requirements for data fitness analyses without extending to the methods needed to meet these requirements. More recently, tools have been developed to conduct cohort-centric screening, focusing on generally applicable structural checks such as missingness or facial implausibility. These provide a first level of information but incompletely capture the fitness requirements of an analysis. In turn, investigators conduct per-study exploratory analyses, but these efforts are typically ad hoc and partially reported, which can hinder reproducible science and delay advances in patient care. Analogously to advances over the past decade in data modeling and reproducible analytics, there is a need for a more systematic, capable approach to study-specific data quality assessment (SSDQA). We discuss such a model, which guides improved SSDQA design and implementation, including metadata for consistent annotation and reporting of data quality assessment results. The model integrates theoretical principles of data quality testing with pragmatic considerations of application to clinical data, providing a consistent approach to specifying data quality assessment checks. Additionally, it proposes to regularize check application through a standard set of options. The SSDQA model builds on current practice, providing a path toward more complete, sound, and reproducible assessments. These characteristics foster multidisciplinary collaboration to identify data quality issues that, in turn, inform decisions about study design and provide important context that has a bearing on adoption of results.<\/jats:p>","DOI":"10.2196\/76398","type":"journal-article","created":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T05:20:07Z","timestamp":1769577607000},"page":"e76398-e76398","source":"Crossref","is-referenced-by-count":2,"title":["Beyond Missingness: Systematizing Methods for Comprehensive Data Fitness Assessment in Clinical Research"],"prefix":"10.2196","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5001-1590","authenticated-orcid":false,"given":"Hanieh","family":"Razzaghi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7477-2601","authenticated-orcid":false,"given":"Kaleigh","family":"Wieand","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9523-056X","authenticated-orcid":false,"given":"Kimberley L","family":"Dickinson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4786-6875","authenticated-orcid":false,"given":"Michael G","family":"Kahn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5178-4210","authenticated-orcid":false,"given":"Jason","family":"Roy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2570-2124","authenticated-orcid":false,"given":"Clair","family":"Blacketer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0726-7253","authenticated-orcid":false,"given":"Dimitri A","family":"Christakis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1252-068X","authenticated-orcid":false,"given":"Christopher B","family":"Forrest","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7819-5360","authenticated-orcid":false,"given":"Jane","family":"Greenberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7698-219X","authenticated-orcid":false,"given":"Harold P","family":"Lehmann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4416-1549","authenticated-orcid":false,"given":"Keith A","family":"Marsolo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9913-1454","authenticated-orcid":false,"given":"Jennifer","family":"Sciolla","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5586-9940","authenticated-orcid":false,"given":"Mark G","family":"Weiner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0365-909X","authenticated-orcid":false,"given":"Nicole G","family":"Weiskopf","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8967-0662","authenticated-orcid":false,"given":"L Charles","family":"Bailey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2026,4,14]]},"reference":[{"issue":"4","key":"R1","doi-asserted-by":"publisher","first-page":"602","DOI":"10.1136\/amiajnl-2014-002743","article-title":"PEDSnet: a national pediatric learning health system","volume":"21","author":"Forrest","journal-title":"J Am Med Inform Assoc"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2020.09.036","article-title":"PCORnet\u00ae 2020: current state, accomplishments, and future directions","volume":"129","author":"Forrest","journal-title":"J Clin Epidemiol"},{"issue":"3","key":"R3","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1093\/jamia\/ocaa196","article-title":"The National COVID Cohort Collaborative (N3C): rationale, design, infrastructure, and deployment","volume":"28","author":"Haendel","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"R4","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1056\/NEJMsr1809937","article-title":"The \u201cAll of Us\u201d research program","volume":"381","author":"All of Us Research Program Investigators","journal-title":"N Engl J Med"},{"issue":"1","key":"R5","doi-asserted-by":"publisher","first-page":"e36","DOI":"10.1055\/s-0041-1731004","article-title":"The Cosmos collaborative: a vendor-facilitated electronic health record data aggregation platform","volume":"5","author":"Tarabichi","journal-title":"ACI Open"},{"issue":"2","key":"R6","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooac035","article-title":"Multi-institutional distributed data networks for real-world evidence about medical devices: building unique device identifiers into longitudinal data (BUILD)","volume":"5","author":"Drozda","journal-title":"JAMIA Open"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.3233\/SHTI220460","article-title":"Building an i2b2-based population repository for COVID-19 research","volume":"294","author":"Pedrera-Jimenez","journal-title":"Stud Health Technol Inform"},{"issue":"4","key":"R8","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1136\/amiajnl-2014-002751","article-title":"pSCANNER: patient-centered Scalable National Network for Effectiveness Research","volume":"21","author":"Ohno-Machado","journal-title":"J Am Med Inform Assoc"},{"issue":"10","key":"R9","doi-asserted-by":"publisher","first-page":"e70028","DOI":"10.1002\/pds.70028","article-title":"The FDA Sentinel Real World Evidence Data Enterprise (RWE-DE)","volume":"33","author":"Desai","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1002\/cpt.2400","article-title":"Longitudinal data discontinuity in electronic health records and consequences for medication effectiveness studies","volume":"111","author":"Joshua Lin","journal-title":"Clin Pharmacol Ther"},{"issue":"5","key":"R11","doi-asserted-by":"publisher","first-page":"2125","DOI":"10.1007\/s11695-021-05226-y","article-title":"Investigating bias from missing data in an electronic health records-based study of weight loss after bariatric surgery","volume":"31","author":"Koffman","journal-title":"Obes Surg"},{"issue":"9","key":"R12","doi-asserted-by":"publisher","first-page":"1561","DOI":"10.1093\/jamia\/ocad115","article-title":"Potential bias and lack of generalizability in electronic health record data: reflections on health equity from the National Institutes of Health Pragmatic Trials Collaboratory","volume":"30","author":"Boyd","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"R13","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1007\/s10742-020-00235-3","article-title":"Characterizing bias due to differential exposure ascertainment in electronic health record data","volume":"21","author":"Hubbard","journal-title":"Health Serv Outcomes Res Methodol"},{"issue":"7","key":"R14","doi-asserted-by":"publisher","first-page":"1191","DOI":"10.1093\/jamia\/ocac050","article-title":"Informative presence bias in analyses of electronic health records-derived data: a cautionary note","volume":"29","author":"Harton","journal-title":"J Am Med Inform Assoc"},{"issue":"2","key":"R15","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2021.0184","article-title":"Assessing missing data assumptions in EHR-based studies: a complex and underappreciated task","volume":"4","author":"Haneuse","journal-title":"JAMA Netw Open"},{"issue":"5","key":"R16","doi-asserted-by":"publisher","first-page":"971","DOI":"10.1093\/jamia\/ocad013","article-title":"Healthcare utilization is a collider: an introduction to collider bias in EHR data reuse","volume":"30","author":"Weiskopf","journal-title":"J Am Med Inform Assoc"},{"issue":"10","key":"R17","doi-asserted-by":"publisher","first-page":"2251","DOI":"10.1093\/jamia\/ocab132","article-title":"Increasing trust in real-world evidence through evaluation of observational data quality","volume":"28","author":"Blacketer","journal-title":"J Am Med Inform Assoc"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.1200\/CCI.23.00046","article-title":"Raising the bar for real-world data in oncology: approaches to quality across multiple dimensions","volume":"8","author":"Castellanos","journal-title":"JCO Clin Cancer Inform"},{"issue":"5","key":"R19","doi-asserted-by":"publisher","first-page":"753","DOI":"10.1177\/0193945916689084","article-title":"Data quality in electronic health records research: quality domains and assessment methods","volume":"40","author":"Feder","journal-title":"West J Nurs Res"},{"key":"R20","doi-asserted-by":"publisher","DOI":"10.3233\/SHTI190498","article-title":"Extending Achilles heel data quality tool with new rules informed by multi-site data quality comparison","volume":"264","author":"Huser","journal-title":"Stud Health Technol Inform"},{"issue":"4","key":"R21","doi-asserted-by":"publisher","first-page":"1012","DOI":"10.4338\/ACI-2017-03-RA-0042","article-title":"Quantifying the effect of data quality on the validity of an eMeasure","volume":"8","author":"Johnson","journal-title":"Appl Clin Inform"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.3233\/SHTI190834","article-title":"Moving towards an EHR data quality framework: the MIRACUM approach","volume":"267","author":"Kapsner","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"R23","doi-asserted-by":"publisher","DOI":"10.5334\/egems.294","article-title":"Design and refinement of a data quality assessment workflow for a large pediatric research network","volume":"7","author":"Khare","journal-title":"EGEMS (Wash DC)"},{"key":"R24","volume":"2017","author":"Lee","journal-title":"AMIA Annu Symp Proc"},{"key":"R25","volume":"2022","author":"Mohamed","journal-title":"AMIA Annu Symp Proc"},{"issue":"4","key":"R26","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1093\/jamia\/ocab217","article-title":"Synergies between centralized and federated approaches to data quality: a report from the national COVID cohort collaborative","volume":"29","author":"Pfaff","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"R27","doi-asserted-by":"publisher","DOI":"10.5334\/egems.199","article-title":"Evaluating foundational data quality in the National Patient-Centered Clinical Research Network (PCORnet\u00ae)","volume":"6","author":"Qualls","journal-title":"EGEMS (Wash DC)"},{"issue":"1","key":"R28","doi-asserted-by":"publisher","DOI":"10.5334\/egems.280","article-title":"Data quality assessment and multi-organizational reporting: tools to enhance network knowledge","volume":"7","author":"Sengupta","journal-title":"EGEMS (Wash DC)"},{"issue":"1","key":"R29","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-023-01839-2","article-title":"Data quality considerations for evaluating COVID-19 treatments using real world data: learnings from the National COVID Cohort Collaborative (N3C)","volume":"23","author":"Sidky","journal-title":"BMC Med Res Methodol"},{"issue":"12","key":"R30","doi-asserted-by":"publisher","first-page":"1094","DOI":"10.1016\/j.ijmedinf.2015.09.008","article-title":"Structured data quality reports to improve EHR data quality","volume":"84","author":"Taggart","journal-title":"Int J Med Inform"},{"issue":"1","key":"R31","doi-asserted-by":"publisher","DOI":"10.5334\/egems.218","article-title":"A data quality assessment guideline for electronic health record data reuse","volume":"5","author":"Weiskopf","journal-title":"EGEMS (Wash DC)"},{"issue":"1","key":"R32","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1136\/amiajnl-2011-000681","article-title":"Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research","volume":"20","author":"Weiskopf","journal-title":"J Am Med Inform Assoc"},{"issue":"10","key":"R33","doi-asserted-by":"publisher","first-page":"1730","DOI":"10.1093\/jamia\/ocad120","article-title":"Electronic health record data quality assessment and tools: a systematic review","volume":"30","author":"Lewis","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"R34","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-022-01892-2","article-title":"Automating electronic health record data quality assessment","volume":"47","author":"Ozonze","journal-title":"J Med Syst"},{"key":"R35","doi-asserted-by":"crossref","unstructured":"Wang TD Henderson DW Weber GM et al. Understanding data differences across the ENACT federated research network. medRxiv. Preprint posted online on Jan 17, 2025. [doi: 10.1101\/2025.01.17.25320686] [Medline: 39867368]","DOI":"10.1101\/2025.01.17.25320686"},{"issue":"1","key":"R36","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1002\/cpt.1480","article-title":"A structured preapproval and postapproval comparative study design framework to generate valid and transparent real-world evidence for regulatory decisions","volume":"106","author":"Gatto","journal-title":"Clin Pharmacol Ther"},{"issue":"6","key":"R37","doi-asserted-by":"publisher","first-page":"1235","DOI":"10.1002\/cpt.2883","article-title":"A structured process to identify fit-for-purpose study design and data to generate valid and transparent real-world evidence for regulatory uses","volume":"113","author":"Gatto","journal-title":"Clin Pharmacol Ther"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.m4856","article-title":"STaRT-RWE: structured template for planning and reporting on the implementation of real world evidence studies","volume":"372","author":"Wang","journal-title":"BMJ"},{"issue":"1","key":"R39","doi-asserted-by":"publisher","DOI":"10.5334\/egems.286","article-title":"DataGauge: a practical process for systematically designing and implementing quality assessments of repurposed clinical data","volume":"7","author":"Diaz-Garelli","journal-title":"EGEMS (Wash DC)"},{"key":"R40","unstructured":"Bergquist T Hassan M . DQe-c-v2. GitHub. URL: https:\/\/github.com\/data2health\/DQe-c-v2\/ [Accessed 03-04-2026]"},{"issue":"4","key":"R41","doi-asserted-by":"publisher","first-page":"826","DOI":"10.1055\/s-0041-1733847","article-title":"Linking a consortium-wide data quality assessment tool with the MIRACUM metadata repository","volume":"12","author":"Kapsner","journal-title":"Appl Clin Inform"},{"issue":"98","key":"R42","doi-asserted-by":"publisher","first-page":"6581","DOI":"10.21105\/joss.06581","article-title":"dataquieR 2: an updated R package for FAIR data quality assessments in observational studies and electronic health record data","volume":"9","author":"Struckmann","journal-title":"J Open Source Softw"},{"issue":"1","key":"R43","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0310634","article-title":"CohortDiagnostics: phenotype evaluation across a network of observational data sources using population-level characterization","volume":"20","author":"Rao","journal-title":"PLoS One"},{"issue":"1","key":"R44","doi-asserted-by":"publisher","DOI":"10.1002\/lrh2.10264","article-title":"Developing a systematic approach to assessing data quality in secondary use of clinical data based on intended use","volume":"6","author":"Razzaghi","journal-title":"Learn Health Syst"},{"issue":"1","key":"R45","doi-asserted-by":"publisher","DOI":"10.13063\/2327-9214.1244","article-title":"A harmonized data quality assessment terminology and framework for the secondary use of electronic health record data","volume":"4","author":"Kahn","journal-title":"EGEMS (Wash DC)"},{"key":"R46","unstructured":"Razzaghi H Wieand K Dickinson K Bailey C . Data quality modules. PEDSpace. URL: https:\/\/pedsnet.org\/metadata\/communities\/57fd85d3-0b50-4239-8f05-8db5e0e65a6a\/browse\/author [Accessed 27-03-2026]"},{"key":"R47","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR guiding principles for scientific data management and stewardship","volume":"3","author":"Wilkinson","journal-title":"Sci Data"},{"key":"R48","doi-asserted-by":"publisher","DOI":"10.3233\/SHTI190490","article-title":"Using FAIR metadata for secondary use of administrative claims data","volume":"264","author":"Haux","journal-title":"Stud Health Technol Inform"}],"container-title":["Journal of Medical Internet Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.jmir.org\/2026\/1\/e76398","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:07:55Z","timestamp":1782842875000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jmir.org\/2026\/1\/e76398"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,14]]},"references-count":48,"URL":"https:\/\/doi.org\/10.2196\/76398","relation":{},"ISSN":["1438-8871"],"issn-type":[{"value":"1438-8871","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,14]]},"article-number":"v28i4e76398"}}