{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T11:24:01Z","timestamp":1784114641538,"version":"3.55.0"},"reference-count":23,"publisher":"American Medical Association (AMA)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA Cardiol"],"published-print":{"date-parts":[[2022,12,1]]},"abstract":"<jats:sec><jats:title>Importance<\/jats:title><jats:p>Patient-reported health data can facilitate clinical event capture in pragmatic clinical trials. However, few data are available on the fitness for use of patient-reported data in large-scale health research.<\/jats:p><\/jats:sec><jats:sec><jats:title>Objective<\/jats:title><jats:p>To evaluate the concordance of a set of variables reported by patients and available in the electronic health record as part of a pragmatic clinical trial.<\/jats:p><\/jats:sec><jats:sec><jats:title>Design, Setting, and Participants<\/jats:title><jats:p>Data from ADAPTABLE (Aspirin Dosing: A Patient-Centric Trial Assessing Benefits and Long-term Effectiveness), a pragmatic clinical trial, were used in a concordance substudy of a comparative effectiveness research trial. The trial randomized 15\u202f076 patients with existing atherosclerotic cardiovascular disease in a 1:1 ratio to low- or high-dose aspirin from April 2016 through June 30, 2019.<\/jats:p><\/jats:sec><jats:sec><jats:title>Main Outcomes and Measures<\/jats:title><jats:p>Concordance of data was evaluated from 4 domains (demographic characteristics, encounters, diagnoses, and procedures) present in 2 data sources: patient-reported data captured through an online portal and data from electronic sources (electronic health record data). Overall agreement, sensitivity, specificity, positive predictive value, negative predictive value, and \u03ba statistics with 95% CIs were calculated using patient report as the criterion standard for demographic characteristics and the electronic health record as the criterion standard for clinical outcomes.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Of 15\u202f076 patients with complete information, the median age was 67.6 years (range, 21-99 years), and 68.7% were male. With the use of patient-reported data as the criterion standard, agreement (\u03ba) was high for Black and White race and ethnicity but only moderate for current smoking status. Electronic health record data were highly specific (99.6%) but less sensitive (82.5%) for Hispanic ethnicity. Compared with electronic health record data, patient report of clinical end points had low sensitivity for myocardial infarction (33.0%), stroke (34.2%), and major bleeding (36.6%). Positive predictive value was similarly low for myocardial infarction (40.7%), stroke (38.8%), and major bleeding (21.9%). Coronary revascularization was the most concordant event by data source, with only moderate agreement (\u03ba\u2009=\u20090.54) and positive predictive value. Agreement metrics varied by site for all demographic characteristics and several clinical events.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions and Relevance<\/jats:title><jats:p>In a concordance substudy of a large, pragmatic comparative effectiveness research trial, sensitivity and chance-corrected agreement of patient-reported data captured through an online portal for cardiovascular events were low to moderate. Findings suggest that additional work is needed to optimize integration of patient-reported health data into pragmatic research studies.<\/jats:p><\/jats:sec><jats:sec><jats:title>Trial Registration<\/jats:title><jats:p>ClinicalTrials.gov Identifier: <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/clinicaltrials.gov\/ct2\/show\/NCT02697916\">NCT02697916<\/jats:ext-link><\/jats:p><\/jats:sec>","DOI":"10.1001\/jamacardio.2022.3844","type":"journal-article","created":{"date-parts":[[2022,11,2]],"date-time":"2022-11-02T15:02:10Z","timestamp":1667401330000},"page":"1235","source":"Crossref","is-referenced-by-count":15,"title":["Concordance Between Patient-Reported Health Data and Electronic Health Data in the ADAPTABLE Trial"],"prefix":"10.1001","volume":"7","author":[{"given":"Emily C.","family":"O\u2019Brien","sequence":"first","affiliation":[{"name":"Department of Population Health Sciences, Duke University School of Medicine, Durham, North Carolina"},{"name":"Duke Clinical Research Institute, Duke University School of Medicine, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hillary","family":"Mulder","sequence":"additional","affiliation":[{"name":"Duke Clinical Research Institute, Duke University School of Medicine, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"W. Schuyler","family":"Jones","sequence":"additional","affiliation":[{"name":"Duke Clinical Research Institute, Duke University School of Medicine, Durham, North Carolina"},{"name":"Department of Medicine, Duke University School of Medicine, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bradley G.","family":"Hammill","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, Duke University School of Medicine, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amber","family":"Sharlow","sequence":"additional","affiliation":[{"name":"Medidata Solutions, New York, New York"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adrian F.","family":"Hernandez","sequence":"additional","affiliation":[{"name":"Duke Clinical Research Institute, Duke University School of Medicine, Durham, North Carolina"},{"name":"Department of Medicine, Duke University School of Medicine, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lesley H.","family":"Curtis","sequence":"additional","affiliation":[{"name":"Department of Population Health Sciences, Duke University School of Medicine, Durham, North Carolina"},{"name":"Duke Clinical Research Institute, Duke University School of Medicine, Durham, North Carolina"},{"name":"Department of Medicine, Duke University School of Medicine, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","reference":[{"issue":"9","key":"hoi220065r1","doi-asserted-by":"publisher","first-page":"1120","DOI":"10.1001\/jama.291.9.1120","article-title":"Clinical research in the United States at a crossroads: proposal for a novel public-private partnership to establish a national clinical research enterprise.","volume":"291","author":"Crowley","year":"2004","journal-title":"JAMA"},{"issue":"1","key":"hoi220065r2","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1186\/s12874-017-0420-7","article-title":"Pragmatic clinical trials embedded in healthcare systems: generalizable lessons from the NIH Collaboratory.","volume":"17","author":"Weinfurt","year":"2017","journal-title":"BMC Med Res Methodol"},{"issue":"12","key":"hoi220065r7","doi-asserted-by":"publisher","first-page":"1152","DOI":"10.1093\/aje\/kwh314","article-title":"Comparison of self-report, hospital discharge codes, and adjudication of cardiovascular events in the Women\u2019s Health Initiative.","volume":"160","author":"Heckbert","year":"2004","journal-title":"Am J Epidemiol"},{"issue":"4","key":"hoi220065r8","doi-asserted-by":"publisher","first-page":"470","DOI":"10.1007\/s13142-015-0315-2","article-title":"Self-report measures of medication adherence behavior: recommendations on optimal use.","volume":"5","author":"Stirratt","year":"2015","journal-title":"Transl Behav Med"},{"issue":"9","key":"hoi220065r9","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0137538","article-title":"Accuracy of patient self-report of stroke: a systematic review from the UK Biobank Stroke Outcomes Group.","volume":"10","author":"Woodfield","year":"2015","journal-title":"PLoS One"},{"issue":"1","key":"hoi220065r10","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1111\/jgs.2004.52.issue-1","article-title":"Agreement between self-report of disease diagnoses and medical record validation in disabled older women: factors that modify agreement.","volume":"52","author":"Simpson","year":"2004","journal-title":"J Am Geriatr Soc"},{"issue":"8-9","key":"hoi220065r11","doi-asserted-by":"publisher","first-page":"730","DOI":"10.1093\/jamia\/ocz113","article-title":"Challenges with quality of race and ethnicity data in observational databases.","volume":"26","author":"Polubriaginof","year":"2019","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"hoi220065r12","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1197\/jamia.M1692","article-title":"Detection and prevention of medication errors using real-time bedside nurse charting.","volume":"12","author":"Nelson","year":"2005","journal-title":"J Am Med Inform Assoc"},{"key":"hoi220065r13","first-page":"1392","article-title":"Challenges with collecting smoking status in electronic health records.","volume":"2017","author":"Polubriaginof","year":"2018","journal-title":"AMIA Annu Symp Proc"},{"issue":"8","key":"hoi220065r14","doi-asserted-by":"publisher","first-page":"635","DOI":"10.7326\/M15-1460","article-title":"The ADAPTABLE trial and PCORnet: shining light on a new research paradigm.","volume":"163","author":"Hernandez","year":"2015","journal-title":"Ann Intern Med"},{"issue":"11","key":"hoi220065r16","doi-asserted-by":"publisher","first-page":"1034","DOI":"10.1097\/MLR.0b013e318127148f","article-title":"Attitudes toward health care providers, collecting information about patients\u2019 race, ethnicity, and language.","volume":"45","author":"Baker","year":"2007","journal-title":"Med Care"},{"key":"hoi220065r18","author":"Krishnamoorthy","year":"2016","journal-title":"J Am Heart Assoc"},{"issue":"17","key":"hoi220065r19","doi-asserted-by":"publisher","first-page":"1477","DOI":"10.1161\/CIRCULATIONAHA.114.013829","article-title":"Comparison of self-reported and Medicare claims\u2013identified acute myocardial infarction.","volume":"131","author":"Yasaitis","year":"2015","journal-title":"Circulation"},{"issue":"4","key":"hoi220065r20","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1093\/oxfordjournals.aje.a009653","article-title":"Validation of patient recall of doctor-diagnosed heart attack and stroke: a postal questionnaire and record review comparison.","volume":"148","author":"Walker","year":"1998","journal-title":"Am J Epidemiol"},{"issue":"2","key":"hoi220065r21","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1177\/1077558705285298","article-title":"Self-reported utilization of health care services: improving measurement and accuracy.","volume":"63","author":"Bhandari","year":"2006","journal-title":"Med Care Res Rev"},{"issue":"4","key":"hoi220065r23","doi-asserted-by":"publisher","first-page":"296","DOI":"10.18043\/ncm.70.4.296","article-title":"Concordance between self-reported race\/ethnicity and that recorded in a Veteran Affairs electronic medical record.","volume":"70","author":"Hamilton","year":"2009","journal-title":"N C Med J"},{"key":"hoi220065r3","unstructured":"NIH Pragmatic Trials Collaboratory. Using electronic health record data in pragmatic clinical trials. Accessed March 30, 2022. https:\/\/rethinkingclinicaltrials.org\/chapters\/design\/using-electronic-health-record-data-pragmatic-clinical-trials-top\/specific-uses-ehr-data-pcts\/"},{"key":"hoi220065r4","unstructured":"US Food and Drug Administration. Framework for FDA\u2019s real-world evidence program. US Food and Drug Administration. December 2018. Accessed March 30, 2022. https:\/\/www.fda.gov\/media\/120060\/download"},{"key":"hoi220065r5","unstructured":"US Department of Health and Human Services; Food and Drug Administration; Center for Drug Evaluation and Research (CDER); Center for Biologics Evaluation and Research (CBER); Oncology Center for Excellence (OCE). Real-world data: assessing electronic health records and medical claims data to support regulatory decision-making for drug and biological products: guidance for industry. US Food and Drug Administration. Published September 2021. Accessed March 30, 2022. https:\/\/www.fda.gov\/media\/152503\/download"},{"key":"hoi220065r6","unstructured":"US Department of Health and Human Services; Food and Drug Administration; Center for Drug Evaluation and Research (CDER); Center for Biologics Evaluation and Research (CBER). Considerations for the use of real-world data and real-world evidence to support regulatory decision-making for drug and biological products. US Food and Drug Administration. Published December 2021. Accessed March 30, 2022. https:\/\/www.fda.gov\/media\/154714\/download"},{"key":"hoi220065r15","unstructured":"PCORnet. Data. Accessed September 1, 2018. https:\/\/pcornet.org\/data-driven-common-model"},{"key":"hoi220065r17","unstructured":"US National Library of Medicine. Effect of Evolocumab in Patients at High Cardiovascular Risk Without Prior Myocardial Infarction or Stroke (VESALIUS-CV). Updated December 7, 2021. Accessed January 11, 2022. https:\/\/www.clinicaltrials.gov\/ct2\/show\/NCT03872401"},{"key":"hoi220065r22","unstructured":"US Food and Drug Administration. Patient-focused drug development public workshop on guidance 1. Accessed June 20, 2018. https:\/\/www.fda.gov\/media\/109154\/download"}],"container-title":["JAMA Cardiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jamacardiology\/articlepdf\/2797899\/jamacardiology_obrien_2022_oi_220065_1670961371.68544.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,14]],"date-time":"2022-12-14T16:01:34Z","timestamp":1671033694000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jamacardiology\/fullarticle\/2797899"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,1]]},"references-count":23,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2022,12,1]]}},"URL":"https:\/\/doi.org\/10.1001\/jamacardio.2022.3844","relation":{},"ISSN":["2380-6583"],"issn-type":[{"value":"2380-6583","type":"print"}],"subject":[],"published":{"date-parts":[[2022,12,1]]}}}