{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,30]],"date-time":"2026-10-30T23:57:46Z","timestamp":1793404666670,"version":"4.5.0"},"reference-count":30,"publisher":"American Medical Association (AMA)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JAMA"],"published-print":{"date-parts":[[2023,1,24]]},"abstract":"\n Importance<\/jats:title>\n Stroke is the fifth-highest cause of death in the US and a leading cause of serious long-term disability with particularly high risk in Black individuals. Quality risk prediction algorithms, free of bias, are key for comprehensive prevention strategies.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n To compare the performance of stroke-specific algorithms with pooled cohort equations developed for atherosclerotic cardiovascular disease for the prediction of new-onset stroke across different subgroups (race, sex, and age) and to determine the added value of novel machine learning techniques.<\/jats:p>\n <\/jats:sec>\n \n Design, Setting, and Participants<\/jats:title>\n Retrospective cohort study on combined and harmonized data from Black and White participants of the Framingham Offspring, Atherosclerosis Risk in Communities (ARIC), Multi-Ethnic Study for Atherosclerosis (MESA), and Reasons for Geographical and Racial Differences in Stroke (REGARDS) studies (1983-2019) conducted in the US. The 62\u202f482 participants included at baseline were at least 45 years of age and free of stroke or transient ischemic attack.<\/jats:p>\n <\/jats:sec>\n \n Exposures<\/jats:title>\n Published stroke-specific algorithms from Framingham and REGARDS (based on self-reported risk factors) as well as pooled cohort equations for atherosclerotic cardiovascular disease plus 2 newly developed machine learning algorithms.<\/jats:p>\n <\/jats:sec>\n \n Main Outcomes and Measures<\/jats:title>\n Models were designed to estimate the 10-year risk of new-onset stroke (ischemic or hemorrhagic). Discrimination concordance index (C index) and calibration ratios of expected vs observed event rates were assessed at 10 years. Analyses were conducted by race, sex, and age groups.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n The combined study sample included 62\u202f482 participants (median age, 61 years, 54% women, and 29% Black individuals). Discrimination C indexes were not significantly different for the 2 stroke-specific models (Framingham stroke, 0.72; 95% CI, 0.72-073; REGARDS self-report, 0.73; 95% CI, 0.72-0.74) vs the pooled cohort equations (0.72; 95% CI, 0.71-0.73): differences 0.01 or less (\n P<\/jats:italic>\n values &amp;gt;.05) in the combined sample. Significant differences in discrimination were observed by race: the C indexes were 0.76 for all 3 models in White vs 0.69 in Black women (all\n P<\/jats:italic>\n values &amp;lt;.001) and between 0.71 and 0.72 in White men and between 0.64 and 0.66 in Black men (all\n P<\/jats:italic>\n values \u2264.001). When stratified by age, model discrimination was better for younger (&amp;lt;60 years) vs older (\u226560 years) adults for both Black and White individuals. The ratios of observed to expected 10-year stroke rates were closest to 1 for the REGARDS self-report model (1.05; 95% CI, 1.00-1.09) and indicated risk overestimation for Framingham stroke (0.86; 95% CI, 0.82-0.89) and pooled cohort equations (0.74; 95% CI, 0.71-0.77). Performance did not significantly improve when novel machine learning algorithms were applied.\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions and Relevance<\/jats:title>\n In this analysis of Black and White individuals without stroke or transient ischemic attack among 4 US cohorts, existing stroke\u2013specific risk prediction models and novel machine learning techniques did not significantly improve discriminative accuracy for new-onset stroke compared with the pooled cohort equations, and the REGARDS self-report model had the best calibration. All algorithms exhibited worse discrimination in Black individuals than in White individuals, indicating the need to expand the pool of risk factors and improve modeling techniques to address observed racial disparities and improve model performance.<\/jats:p>\n <\/jats:sec>","DOI":"10.1001\/jama.2022.24683","type":"journal-article","created":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T11:35:05Z","timestamp":1674560105000},"page":"306","source":"Crossref","is-referenced-by-count":105,"title":["Predictive Accuracy of Stroke Risk Prediction Models Across Black and White Race, Sex, and Age Groups"],"prefix":"10.1001","volume":"329","author":[{"given":"Chuan","family":"Hong","sequence":"first","affiliation":[{"name":"Duke AI Health, Durham, North Carolina"},{"name":"Department of Biostatistics & Bioinformatics, Duke University School of Medicine, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael J.","family":"Pencina","sequence":"additional","affiliation":[{"name":"Duke AI Health, Durham, North Carolina"},{"name":"Department of Biostatistics & Bioinformatics, Duke University School of Medicine, Durham, North Carolina"},{"name":"Duke Clinical Research Institute, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel M.","family":"Wojdyla","sequence":"additional","affiliation":[{"name":"Duke Clinical Research Institute, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jennifer L.","family":"Hall","sequence":"additional","affiliation":[{"name":"American Heart Association, Dallas, Texas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suzanne E.","family":"Judd","sequence":"additional","affiliation":[{"name":"School of Public Health, University of Alabama at Birmingham, Birmingham, Alabama"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Cary","sequence":"additional","affiliation":[{"name":"Duke AI Health, Durham, North Carolina"},{"name":"Duke University School of Nursing, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew M.","family":"Engelhard","sequence":"additional","affiliation":[{"name":"Duke AI Health, Durham, North Carolina"},{"name":"Department of Biostatistics & Bioinformatics, Duke University School of Medicine, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samuel","family":"Berchuck","sequence":"additional","affiliation":[{"name":"Department of Statistical Science, Duke University School of Medicine, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ying","family":"Xian","sequence":"additional","affiliation":[{"name":"Department of Neurology, University of Texas Southwestern Medical Center, Dallas"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"suffix":"Sr","given":"Ralph","family":"D\u2019Agostino","sequence":"additional","affiliation":[{"name":"Department of Mathematics & Statistics, Boston University Arts and Sciences, Boston, Massachusetts"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"George","family":"Howard","sequence":"additional","affiliation":[{"name":"School of Public Health, University of Alabama at Birmingham, Birmingham, Alabama"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brett","family":"Kissela","sequence":"additional","affiliation":[{"name":"College of Medicine, University of Cincinnati, Cincinnati, Ohio"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ricardo","family":"Henao","sequence":"additional","affiliation":[{"name":"Duke AI Health, Durham, North Carolina"},{"name":"Department of Biostatistics & Bioinformatics, Duke University School of Medicine, Durham, North Carolina"},{"name":"Department of Electrical and Computer Engineering, Duke University, Durham, North Carolina"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10","reference":[{"issue":"8","key":"joi220151r1","doi-asserted-by":"publisher","first-page":"e254","DOI":"10.1161\/CIR.0000000000000950","article-title":"Heart disease and stroke statistics\u20142021 update: a report from the American Heart Association.","volume":"143","author":"Virani","year":"2021","journal-title":"Circulation"},{"issue":"2","key":"joi220151r3","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1161\/STR.0b013e3181fcb238","article-title":"Guidelines for the primary prevention of stroke: a guideline for healthcare professionals from the American Heart Association\/American Stroke Association.","volume":"42","author":"Goldstein","year":"2011","journal-title":"Stroke"},{"issue":"12","key":"joi220151r4","doi-asserted-by":"publisher","first-page":"3754","DOI":"10.1161\/STR.0000000000000046","article-title":"Guidelines for the primary prevention of stroke: a statement for healthcare professionals from the American Heart Association\/American Stroke Association.","volume":"45","author":"Meschia","year":"2014","journal-title":"Stroke"},{"issue":"3","key":"joi220151r5","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1161\/01.STR.22.3.312","article-title":"Probability of stroke: a risk profile from the Framingham Study.","volume":"22","author":"Wolf","year":"1991","journal-title":"Stroke"},{"issue":"1","key":"joi220151r6","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1161\/01.STR.25.1.40","article-title":"Stroke risk profile: adjustment for antihypertensive medication: the Framingham Study.","volume":"25","author":"D\u2019Agostino","year":"1994","journal-title":"Stroke"},{"issue":"12","key":"joi220151r7","doi-asserted-by":"publisher","first-page":"1145","DOI":"10.1161\/CIRCULATIONAHA.115.021275","article-title":"Revised Framingham stroke risk profile to reflect temporal trends.","volume":"135","author":"Dufouil","year":"2017","journal-title":"Circulation"},{"issue":"7","key":"joi220151r8","doi-asserted-by":"publisher","first-page":"1737","DOI":"10.1161\/STROKEAHA.117.016757","article-title":"Self-reported stroke risk stratification: reasons for geographic and racial differences in stroke study.","volume":"48","author":"Howard","year":"2017","journal-title":"Stroke"},{"key":"joi220151r9","doi-asserted-by":"publisher","first-page":"2886","DOI":"10.1016\/j.jacc.2014.02.606","article-title":"2013 ACC\/AHA guideline on the assessment of cardiovascular risk.","volume":"63","author":"Andrus","year":"2014","journal-title":"J Am Coll Cardiol"},{"issue":"11","key":"joi220151r10","doi-asserted-by":"publisher","first-page":"1093","DOI":"10.1093\/aje\/kwx110","article-title":"An investigation of coronary heart disease in families: the Framingham Offspring Study.","volume":"185","year":"2017","journal-title":"Am J Epidemiol"},{"issue":"4","key":"joi220151r11","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1093\/oxfordjournals.aje.a115184","article-title":"The Atherosclerosis Risk in Communities (ARIC) study: design and objectives. The ARIC investigators.","volume":"129","year":"1989","journal-title":"Am J Epidemiol"},{"issue":"9","key":"joi220151r12","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1093\/aje\/kwf113","article-title":"Multi-Ethnic Study of Atherosclerosis: objectives and design.","volume":"156","author":"Bild","year":"2002","journal-title":"Am J Epidemiol"},{"issue":"3","key":"joi220151r13","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1159\/000086678","article-title":"The reasons for geographic and racial differences in stroke study: objectives and design.","volume":"25","author":"Howard","year":"2005","journal-title":"Neuroepidemiology"},{"issue":"1","key":"joi220151r14","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1186\/s12874-016-0248-6","article-title":"A comparison of time dependent Cox regression, pooled logistic regression and cross sectional pooling with simulations and an application to the Framingham Heart Study.","volume":"16","author":"Ngwa","year":"2016","journal-title":"BMC Med Res Methodol"},{"issue":"5","key":"joi220151r16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v039.i05","article-title":"Regularization paths for Cox\u2019s proportional hazards model via coordinate descent.","volume":"39","author":"Simon","year":"2011","journal-title":"J Stat Softw"},{"issue":"3","key":"joi220151r17","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1214\/08-AOAS169","article-title":"Random survival forests.","volume":"2","author":"Ishwaran","year":"2008","journal-title":"Ann Appl Stat"},{"key":"joi220151r18","doi-asserted-by":"crossref","first-page":"g7594","DOI":"10.1136\/bmj.g7594","article-title":"Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement.","volume":"350","author":"Collins","year":"2015","journal-title":"BMJ"},{"issue":"10","key":"joi220151r19","doi-asserted-by":"crossref","first-page":"1105","DOI":"10.1002\/sim.4154","article-title":"On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data.","volume":"30","author":"Uno","year":"2011","journal-title":"Stat Med"},{"issue":"1","key":"joi220151r20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1175\/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2","article-title":"Verification of forecasts expressed in terms of probability.","volume":"78","author":"Brier","year":"1950","journal-title":"Mon Weather Rev"},{"key":"joi220151r21","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1186\/1472-6947-11-45","article-title":"Decision curve analysis revisited: overall net benefit, relationships to ROC curve analysis, and application to case-control studies.","volume":"11","author":"Rousson","year":"2011","journal-title":"BMC Med Inform Decis Mak"},{"issue":"9","key":"joi220151r22","doi-asserted-by":"crossref","first-page":"2768","DOI":"10.1177\/0962280218785504","article-title":"A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes.","volume":"28","author":"Debray","year":"2019","journal-title":"Stat Methods Med Res"},{"key":"joi220151r23","doi-asserted-by":"crossref","first-page":"i6","DOI":"10.1136\/bmj.i6","article-title":"Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests.","volume":"352","author":"Vickers","year":"2016","journal-title":"BMJ"},{"issue":"3","key":"joi220151r24","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1093\/jamia\/ocaa283","article-title":"Addressing bias in prediction models by improving subpopulation calibration.","volume":"28","author":"Barda","year":"2021","journal-title":"J Am Med Inform Assoc"},{"issue":"6464","key":"joi220151r25","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations.","volume":"366","author":"Obermeyer","year":"2019","journal-title":"Science"},{"issue":"1","key":"joi220151r26","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1186\/s12910-017-0179-8","article-title":"Implicit bias in healthcare professionals: a systematic review.","volume":"18","author":"FitzGerald","year":"2017","journal-title":"BMC Med Ethics"},{"key":"joi220151r27","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.jclinepi.2019.02.004","article-title":"A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models.","volume":"110","author":"Christodoulou","year":"2019","journal-title":"J Clin Epidemiol"},{"key":"joi220151r28","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1038\/s41746-018-0029-1","article-title":"Scalable and accurate deep learning with electronic health records.","volume":"1","author":"Rajkomar","year":"2018","journal-title":"NPJ Digit Med"},{"issue":"1","key":"joi220151r29","doi-asserted-by":"crossref","first-page":"7567","DOI":"10.1038\/s41598-021-87171-5","article-title":"Development of machine learning model for diagnostic disease prediction based on laboratory tests.","volume":"11","author":"Park","year":"2021","journal-title":"Sci Rep"},{"key":"joi220151r30","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-19425-7","volume-title":"Regression Modeling Strategies","author":"Harrell","year":"2015"},{"key":"joi220151r2","unstructured":"Stroke and African Americans. US Dept of Health and Human Services. Accessed April 18, 2022. https:\/\/minorityhealth.hhs.gov\/omh\/browse.aspx?lvl=4&lvlid=28?"},{"key":"joi220151r15","unstructured":"Stroke risk prediction using a harmonized dataset of Framingham, MESA, ARIC, and REGARDS (pilot). American Heart Association. November 30, 2021. Accessed April 18, 2022. https:\/\/sandbox.precision.heart.org\/documentation\/data-resources\/aha-duke-ninds\/index.html"}],"container-title":["JAMA"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/jamanetwork.com\/journals\/jama\/articlepdf\/2800662\/jama_hong_2023_oi_220151_1695399709.75265.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,25]],"date-time":"2023-09-25T11:00:52Z","timestamp":1695639652000},"score":1,"resource":{"primary":{"URL":"https:\/\/jamanetwork.com\/journals\/jama\/fullarticle\/2800662"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,24]]},"references-count":30,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,1,24]]}},"URL":"https:\/\/doi.org\/10.1001\/jama.2022.24683","relation":{},"ISSN":["0098-7484"],"issn-type":[{"value":"0098-7484","type":"print"}],"subject":[],"published":{"date-parts":[[2023,1,24]]}}}