{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T23:24:50Z","timestamp":1776813890858,"version":"3.51.2"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T00:00:00Z","timestamp":1600819200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T00:00:00Z","timestamp":1600819200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000050","name":"U.S. Department of Health & Human Services | NIH | National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["1K01HL144607"],"award-info":[{"award-number":["1K01HL144607"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The pooled cohort equations (PCE) predict atherosclerotic cardiovascular disease (ASCVD) risk in patients with characteristics within prespecified ranges and has uncertain performance among Asians or Hispanics. It is unknown if machine learning (ML) models can improve ASCVD risk prediction across broader diverse, real-world populations. We developed ML models for ASCVD risk prediction for multi-ethnic patients using an electronic health record (EHR) database from Northern California. Our cohort included patients aged 18 years or older with no prior CVD and not on statins at baseline (<jats:italic>n<\/jats:italic>\u2009=\u2009262,923), stratified by PCE-eligible (<jats:italic>n<\/jats:italic>\u2009=\u2009131,721) or PCE-ineligible patients based on missing or out-of-range variables. We trained ML models [logistic regression with L<jats:sub>2<\/jats:sub> penalty and L<jats:sub>1<\/jats:sub> lasso penalty, random forest, gradient boosting machine (GBM), extreme gradient boosting] and determined 5-year ASCVD risk prediction, including with and without incorporation of additional EHR variables, and in Asian and Hispanic subgroups. A total of 4309 patients had ASCVD events, with 2077 in PCE-ineligible patients. GBM performance in the full cohort, including PCE-ineligible patients (area under receiver-operating characteristic curve (AUC) 0.835, 95% confidence interval (CI): 0.825\u20130.846), was significantly better than that of the PCE in the PCE-eligible cohort (AUC 0.775, 95% CI: 0.755\u20130.794). Among patients aged 40\u201379, GBM performed similarly before (AUC 0.784, 95% CI: 0.759\u20130.808) and after (AUC 0.790, 95% CI: 0.765\u20130.814) incorporating additional EHR data. Overall, ML models achieved comparable or improved performance compared to the PCE while allowing risk discrimination in a larger group of patients including PCE-ineligible patients. EHR-trained ML models may help bridge important gaps in ASCVD risk prediction.<\/jats:p>","DOI":"10.1038\/s41746-020-00331-1","type":"journal-article","created":{"date-parts":[[2020,9,23]],"date-time":"2020-09-23T10:03:36Z","timestamp":1600855416000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":88,"title":["Machine learning and atherosclerotic cardiovascular disease risk prediction in a multi-ethnic population"],"prefix":"10.1038","volume":"3","author":[{"given":"Andrew","family":"Ward","sequence":"first","affiliation":[]},{"given":"Ashish","family":"Sarraju","sequence":"additional","affiliation":[]},{"given":"Sukyung","family":"Chung","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4183-1006","authenticated-orcid":false,"given":"Jiang","family":"Li","sequence":"additional","affiliation":[]},{"given":"Robert","family":"Harrington","sequence":"additional","affiliation":[]},{"given":"Paul","family":"Heidenreich","sequence":"additional","affiliation":[]},{"given":"Latha","family":"Palaniappan","sequence":"additional","affiliation":[]},{"given":"David","family":"Scheinker","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5226-0723","authenticated-orcid":false,"given":"Fatima","family":"Rodriguez","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,9,23]]},"reference":[{"key":"331_CR1","doi-asserted-by":"publisher","first-page":"3168","DOI":"10.1016\/j.jacc.2018.11.002","volume":"73","author":"SM Grundy","year":"2019","unstructured":"Grundy, S. M. et al. 2018 AHA\/ACC\/AACVPR\/AAPA\/ABC\/ACPM\/ADA\/AGS\/APhA\/ASPC\/NLA\/PCNA Guideline on the Management of Blood Cholesterol: Executive Summary: A Report of the American College of Cardiology\/American Heart Association Task Force on Clinical Practice Guidelines. J. Am. Coll. Cardiol. 73, 3168\u20133209 (2019).","journal-title":"J. Am. Coll. Cardiol."},{"key":"331_CR2","doi-asserted-by":"publisher","first-page":"20","DOI":"10.7326\/M17-3011","volume":"169","author":"S Yadlowsky","year":"2018","unstructured":"Yadlowsky, S. et al. Clinical implications of revised pooled cohort equations for estimating atherosclerotic cardiovascular disease risk. Ann. Intern. Med. 169, 20\u201329 (2018).","journal-title":"Ann. Intern. Med."},{"key":"331_CR3","doi-asserted-by":"publisher","DOI":"10.1161\/JAHA.118.011874","volume":"8","author":"F Rodriguez","year":"2019","unstructured":"Rodriguez, F. et al. Atherosclerotic cardiovascular disease risk prediction in disaggregated Asian and Hispanic subgroups using electronic health records. J. Am. Heart Assoc. 8, e011874 (2019).","journal-title":"J. Am. Heart Assoc."},{"key":"331_CR4","doi-asserted-by":"publisher","first-page":"2935","DOI":"10.1016\/j.jacc.2013.11.005","volume":"63","author":"DC Goff Jr","year":"2014","unstructured":"Goff, D. C. Jr et al. 2013 ACC\/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology\/American Heart Association Task Force on Practice Guidelines. J. Am. Coll. Cardiol. 63, 2935\u20132959 (2014).","journal-title":"J. Am. Coll. Cardiol."},{"key":"331_CR5","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-018-0644-1","volume":"18","author":"AC Dimopoulos","year":"2018","unstructured":"Dimopoulos, A. C. et al. Machine learning methodologies versus cardiovascular risk scores, in predicting disease risk. BMC Med. Res. Methodol. 18, 179 (2018).","journal-title":"BMC Med. Res. Methodol."},{"key":"331_CR6","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1126\/science.aaa8415","volume":"349","author":"MI Jordan","year":"2015","unstructured":"Jordan, M. I. & Mitchell, T. M. Machine learning: trends, perspectives, and prospects. Science 349, 255\u2013260 (2015).","journal-title":"Science"},{"key":"331_CR7","doi-asserted-by":"publisher","first-page":"1920","DOI":"10.1161\/CIRCULATIONAHA.115.001593","volume":"132","author":"RC Deo","year":"2015","unstructured":"Deo, R. C. Machine learning in medicine. Circulation 132, 1920\u20131930 (2015).","journal-title":"Circulation"},{"key":"331_CR8","doi-asserted-by":"publisher","first-page":"1515","DOI":"10.1016\/j.jvs.2016.04.026","volume":"64","author":"EG Ross","year":"2016","unstructured":"Ross, E. G. et al. The use of machine learning for the identification of peripheral artery disease and future mortality risk. J. Vasc. Surg. 64, 1515\u20131522. e1513 (2016).","journal-title":"J. Vasc. Surg."},{"key":"331_CR9","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1038\/s41591-018-0268-3","volume":"25","author":"AY Hannun","year":"2019","unstructured":"Hannun, A. Y. et al. Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network. Nat. Med. 25, 65\u201369 (2019).","journal-title":"Nat. Med."},{"key":"331_CR10","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1038\/s41746-019-0101-5","volume":"2","author":"JM Banda","year":"2019","unstructured":"Banda, J. M. et al. Finding missed cases of familial hypercholesterolemia in health systems using machine learning. NPJ Digit. Med. 2, 23 (2019).","journal-title":"NPJ Digit. Med."},{"key":"331_CR11","doi-asserted-by":"publisher","first-page":"2118","DOI":"10.1016\/j.jacc.2016.02.055","volume":"67","author":"JS Rana","year":"2016","unstructured":"Rana, J. S. et al. Accuracy of the atherosclerotic cardiovascular risk equation in a large contemporary, multiethnic population. J. Am. Coll. Cardiol. 67, 2118\u20132130 (2016).","journal-title":"J. Am. Coll. Cardiol."},{"key":"331_CR12","doi-asserted-by":"publisher","first-page":"e1162","DOI":"10.1161\/CIR.0000000000000638","volume":"139","author":"DM Lloyd-Jones","year":"2019","unstructured":"Lloyd-Jones, D. M. et al. Use of risk assessment tools to guide decision-making in the primary prevention of atherosclerotic cardiovascular disease: a special report from the American Heart Association and American College of Cardiology. Circulation 139, e1162\u2013e1177 (2019).","journal-title":"Circulation"},{"key":"331_CR13","doi-asserted-by":"publisher","first-page":"1231","DOI":"10.1001\/jamainternmed.2018.2875","volume":"178","author":"S Mora","year":"2018","unstructured":"Mora, S. et al. Evaluation of the pooled cohort risk equations for cardiovascular risk prediction in a multiethnic cohort from the Women\u2019s Health Initiative. JAMA Intern. Med. 178, 1231\u20131240 (2018).","journal-title":"JAMA Intern. Med."},{"key":"331_CR14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0174944","volume":"12","author":"SF Weng","year":"2017","unstructured":"Weng, S. F., Reps, J., Kai, J., Garibaldi, J. M. & Qureshi, N. Can machine-learning improve cardiovascular risk prediction using routine clinical data? PLoS ONE 12, e0174944 (2017).","journal-title":"PLoS ONE"},{"key":"331_CR15","doi-asserted-by":"publisher","first-page":"542","DOI":"10.1161\/CIRCULATIONAHA.119.041149","volume":"140","author":"C Welsh","year":"2019","unstructured":"Welsh, C. et al. Comparison of conventional lipoprotein tests and apolipoproteins in the prediction of cardiovascular disease. Circulation 140, 542\u2013552 (2019).","journal-title":"Circulation"},{"key":"331_CR16","doi-asserted-by":"publisher","DOI":"10.1161\/JAHA.118.009476","volume":"7","author":"IA Kakadiaris","year":"2018","unstructured":"Kakadiaris, I. A. et al. Machine learning outperforms ACC\/AHA CVD risk calculator in MESA. J. Am. Heart Assoc. 7, e009476 (2018).","journal-title":"J. Am. Heart Assoc."},{"key":"331_CR17","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1002546","volume":"15","author":"JW Knowles","year":"2018","unstructured":"Knowles, J. W. & Ashley, E. A. Cardiovascular disease: the rise of the genetic risk score. PLoS Med. 15, e1002546 (2018).","journal-title":"PLoS Med."},{"key":"331_CR18","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0179238","volume":"12","author":"S Reisberg","year":"2017","unstructured":"Reisberg, S., Iljasenko, T., Lall, K., Fischer, K. & Vilo, J. Comparing distributions of polygenic risk scores of type 2 diabetes and coronary heart disease within different populations. PLoS ONE 12, e0179238 (2017).","journal-title":"PLoS ONE"},{"key":"331_CR19","doi-asserted-by":"publisher","unstructured":"Colantonio, L. D. et al. Performance of the atherosclerotic cardiovascular disease pooled cohort risk equations by social deprivation status. J. Am. Heart Assoc. 6, https:\/\/doi.org\/10.1161\/JAHA.117.005676 (2017).","DOI":"10.1161\/JAHA.117.005676"},{"key":"331_CR20","doi-asserted-by":"publisher","first-page":"540","DOI":"10.1097\/MLR.0b013e3181d559e9","volume":"48","author":"EC Wong","year":"2010","unstructured":"Wong, E. C., Palaniappan, L. P. & Lauderdale, D. S. Using name lists to infer Asian racial\/ethnic subgroups in the healthcare setting. Med. Care 48, 540\u2013546 (2010).","journal-title":"Med. Care"},{"key":"331_CR21","unstructured":"HCUP. US Tools & Software Page. http:\/\/www.hcup-us.ahrq.gov\/toolssoftware\/ccs\/ccs.jsp (2019)."},{"key":"331_CR22","doi-asserted-by":"publisher","first-page":"1406","DOI":"10.1001\/jama.2014.2630","volume":"311","author":"P Muntner","year":"2014","unstructured":"Muntner, P. et al. Validation of the atherosclerotic cardiovascular disease Pooled Cohort risk equations. JAMA 311, 1406\u20131415 (2014).","journal-title":"JAMA"},{"key":"331_CR23","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F. et al. Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825\u20132830 (2011).","journal-title":"J. Mach. Learn. Res."},{"key":"331_CR24","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1148\/radiology.143.1.7063747","volume":"143","author":"JA Hanley","year":"1982","unstructured":"Hanley, J. A. & McNeil, B. J. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology 143, 29\u201336 (1982).","journal-title":"Radiology"},{"key":"331_CR25","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1080\/00273171.2015.1036965","volume":"50","author":"DM McNeish","year":"2015","unstructured":"McNeish, D. M. Using Lasso for predictor selection and to assuage overfitting: a method long overlooked in behavioral sciences. Multivar. Behav. Res. 50, 471\u2013484 (2015).","journal-title":"Multivar. Behav. Res."},{"key":"331_CR26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v045.i03","volume":"45","author":"SV Buuren","year":"2011","unstructured":"Buuren, S. V. & Groothuis-Oudshoorn, K. Mice: multivariate imputation by chained equations in R. J. Stat. Softw. 45, 1\u201367 (2011).","journal-title":"J. Stat. Softw."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00331-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00331-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00331-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T02:37:08Z","timestamp":1670380628000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-00331-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,23]]},"references-count":26,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["331"],"URL":"https:\/\/doi.org\/10.1038\/s41746-020-00331-1","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,23]]},"assertion":[{"value":"2 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 September 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 September 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"125"}}