{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T23:23:47Z","timestamp":1787700227125,"version":"build-2784847793"},"reference-count":42,"publisher":"American Society of Clinical Oncology (ASCO)","issue":"8","content-domain":{"domain":["ascopubs.org"],"crossmark-restriction":true},"short-container-title":["JCO Clin Cancer Inform"],"published-print":{"date-parts":[[2024,8]]},"abstract":"<jats:sec><jats:title>PURPOSE<\/jats:title><jats:p> The specific aims of this paper are to (1) develop and operationalize an electronic health record (EHR) data quality framework, (2) apply the dimensions of the framework to the phenotype and treatment pathways of ductal carcinoma in situ (DCIS) using All of Us Research Program data, and (3) propose and apply a checklist to evaluate the application of the framework. <\/jats:p><\/jats:sec><jats:sec><jats:title>METHODS<\/jats:title><jats:p> We developed a framework of five data quality dimensions (DQD; completeness, concordance, conformance, plausibility, and temporality). Participants signed a consent and Health Insurance Portability and Accountability Act authorization to share EHR data and responded to demographic questions in the Basics questionnaire. We evaluated the internal characteristics of the data and compared data with external benchmarks with descriptive and inferential statistics. We developed a DQD checklist to evaluate concept selection, internal verification, and external validity for each DQD. The Observational Medical Outcomes Partnership Common Data Model (OMOP CDM) concept ID codes for DCIS were used to select a cohort of 2,209 females 18 years and older. <\/jats:p><\/jats:sec><jats:sec><jats:title>RESULTS<\/jats:title><jats:p> Using the proposed DQD checklist criteria, (1) concepts were selected and internally verified for conformance; (2) concepts were selected and internally verified for completeness; (3) concepts were selected, internally verified, and externally validated for concordance; (4) concepts were selected, internally verified, and externally validated for plausibility; and (5) concepts were selected, internally verified, and externally validated for temporality. <\/jats:p><\/jats:sec><jats:sec><jats:title>CONCLUSION<\/jats:title><jats:p> This assessment and evaluation provided insights into data quality for the DCIS phenotype using EHR data from the All of Us Research Program. The review demonstrates that salient clinical measures can be selected, applied, and operationalized within a conceptual framework and evaluated for fitness for use by applying a proposed checklist. <\/jats:p><\/jats:sec>","DOI":"10.1200\/cci.24.00052","type":"journal-article","created":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T19:59:41Z","timestamp":1724443181000},"update-policy":"https:\/\/doi.org\/10.1200\/crossmark","source":"Crossref","is-referenced-by-count":5,"title":["Application of a Data Quality Framework to Ductal Carcinoma In Situ Using Electronic Health Record Data From the <i>All of Us<\/i> Research Program"],"prefix":"10.1200","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3025-6990","authenticated-orcid":true,"given":"Lew","family":"Berman","sequence":"first","affiliation":[{"name":"National Institutes of Health, All of Us Research Program, Bethesda, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8054-9727","authenticated-orcid":true,"given":"Yechiam","family":"Ostchega","sequence":"additional","affiliation":[{"name":"National Institutes of Health, All of Us Research Program, Bethesda, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7626-6540","authenticated-orcid":true,"given":"John","family":"Giannini","sequence":"additional","affiliation":[{"name":"National Institutes of Health, All of Us Research Program, Bethesda, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5541-0287","authenticated-orcid":true,"given":"Lakshmi Priya","family":"Anandan","sequence":"additional","affiliation":[{"name":"Leidos, Frederick, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0039-0470","authenticated-orcid":true,"given":"Emily","family":"Clark","sequence":"additional","affiliation":[{"name":"Leidos, Frederick, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2869-0237","authenticated-orcid":true,"given":"Matthew","family":"Spotnitz","sequence":"additional","affiliation":[{"name":"National Institutes of Health, All of Us Research Program, Bethesda, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lina","family":"Sulieman","sequence":"additional","affiliation":[{"name":"Vanderbilt University Medical Center, Nashville, TN"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Volynski","sequence":"additional","affiliation":[{"name":"InfoPro Systems, Rockville, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6460-0182","authenticated-orcid":true,"given":"Andrea","family":"Ramirez","sequence":"additional","affiliation":[{"name":"National Institutes of Health, All of Us Research Program, Bethesda, MD"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"233","reference":[{"key":"b1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2021.7702"},{"key":"b2","first-page":"1884","volume":"381","author":"Denny JC","year":"2019","journal-title":"N Engl J Med"},{"key":"b3","volume-title":"Quality Is Free","author":"Crosby PB","year":"1979"},{"key":"b4","volume-title":"Out of the Crisis","author":"Demming WE","year":"1986"},{"key":"b5","volume-title":"Quality-control Handbook","author":"Juran JM","year":"1951"},{"key":"b6","volume-title":"Quality and Reliability in Engineering. Vol. 2","author":"Chandrupatla TR","year":"2009"},{"key":"b7","doi-asserted-by":"publisher","DOI":"10.1080\/07421222.1996.11518099"},{"key":"b8","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-1075-6"},{"key":"b9","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2012.10.001"},{"key":"b10","first-page":"1937","volume":"2015","author":"Johnson SG","year":"2015","journal-title":"AMIA Annu Symp Proc"},{"key":"b11","first-page":"1244","volume":"4","author":"Kahn MG","year":"2016","journal-title":"EGEMS (Wash DC)."},{"key":"b12","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2016.03.006"},{"key":"b13","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2013.06.010"},{"key":"b14","first-page":"14","volume":"5","author":"Weiskopf NG","year":"2017","journal-title":"EGEMS (Wash DC)"},{"key":"b15","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000681"},{"key":"b16","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1126\/364.6435.twis","volume":"7","author":"Henley-Smith S","year":"2019","journal-title":"EGEMS (Wash DC)."},{"key":"b17","doi-asserted-by":"publisher","DOI":"10.1002\/asi.20652"},{"key":"b18","doi-asserted-by":"publisher","DOI":"10.1177\/1460458204040665"},{"key":"b19","doi-asserted-by":"publisher","DOI":"10.1093\/jamiaopen\/ooad032"},{"key":"b20","doi-asserted-by":"publisher","DOI":"10.1001\/jamaneurol.2024.0551"},{"key":"b21","doi-asserted-by":"publisher","DOI":"10.1016\/j.patter.2022.100570"},{"key":"b22","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0272522"},{"key":"b23","doi-asserted-by":"publisher","DOI":"10.1093\/jnci\/djp485"},{"key":"b24","volume-title":"Observational Health Data Sciences and Informatics Program","author":"OMOP Common Data Model"},{"key":"b25","doi-asserted-by":"publisher","DOI":"10.1186\/bcr623"},{"key":"b26","first-page":"CD000563","volume":"11","author":"Goodwin A","year":"2013","journal-title":"Cochrane Database Syst Rev"},{"key":"b27","first-page":"CD007847","volume":"10","author":"Staley H","year":"2012","journal-title":"Cochrane Database Syst Rev"},{"key":"b30","volume-title":"National Comprehensive Cancer Network","author":"About Clinical Practice Guidelines","year":"2023"},{"key":"b32","volume-title":"DAC Guidelines and Reference Series: Quality Standards for Development Evaluation","author":"Organisation for Economic Co-Operation and Development (OECD) Development Assistance Committee (DAC)","year":"2010"},{"key":"b33","volume-title":"\u201cThe Basics\u201d Survey","author":"All of Us Research Program Participants Provided Information"},{"key":"b34","volume-title":"SEER Cancer Statistics Review, 1975-2017"},{"key":"b35","doi-asserted-by":"publisher","DOI":"10.1093\/jncimonographs\/lgq027"},{"key":"b36","doi-asserted-by":"publisher","DOI":"10.1145\/182.358434"},{"key":"b37","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocad120"},{"key":"b38","volume-title":"National Cancer Institute\/Division of Cancer Control and Population Sciences","author":"Cancer Control Continuum","year":"2020"},{"key":"b39","doi-asserted-by":"publisher","DOI":"10.1002\/pds.5715"},{"key":"b40","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-024-02458-7"},{"key":"b41","doi-asserted-by":"publisher","DOI":"10.3389\/fphar.2018.00435"},{"key":"b42","first-page":"2090","volume":"7","author":"Yang Y","year":"2022","journal-title":"Int J Popul Data Sci"},{"key":"b43","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocv202"},{"key":"b44","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-50680-5"},{"key":"b45","doi-asserted-by":"publisher","DOI":"10.1002\/jso.24579"}],"container-title":["JCO Clinical Cancer Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/ascopubs.org\/doi\/pdfdirect\/10.1200\/CCI.24.00052","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T19:59:50Z","timestamp":1724443190000},"score":1,"resource":{"primary":{"URL":"https:\/\/ascopubs.org\/doi\/10.1200\/CCI.24.00052"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8]]},"references-count":42,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2024,8]]}},"alternative-id":["10.1200\/CCI.24.00052"],"URL":"https:\/\/doi.org\/10.1200\/cci.24.00052","relation":{},"ISSN":["2473-4276"],"issn-type":[{"value":"2473-4276","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8]]},"assertion":[{"value":"2024-03-04","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-27","order":1,"name":"revised","label":"Revised","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-17","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-08-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2400052"}}