{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T15:53:00Z","timestamp":1794325980480,"version":"4.9.0"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"1161","license":[{"start":{"date-parts":[[2021,3,10]],"date-time":"2021-03-10T00:00:00Z","timestamp":1615334400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Cardiovascular disease (CVD) is one of the leading causes of death across the world. CVD can lead to angina, heart attacks, heart failure, strokes, and eventually, death; among many other serious conditions. The early intervention with those at a higher risk of developing CVD, typically with statin treatment, leads to better health outcomes. For this reason, clinical prediction models (CPMs) have been developed to identify those at a high risk of developing CVD so that treatment can begin at an earlier stage. Currently, CPMs are built around statistical analysis of factors linked to developing CVD, such as body mass index and family history. The emerging field of machine learning (ML) in healthcare, using computer algorithms that learn from a dataset without explicit programming, has the potential to outperform the CPMs available today. ML has already shown exciting progress in the detection of skin malignancies, bone fractures and many other medical conditions. In this review, we will analyse and explain the CPMs currently in use with comparisons to their developing ML counterparts. We have found that although the newest non-ML CPMs are effective, ML-based approaches consistently outperform them. However, improvements to the literature need to be made before ML should be implemented over current CPMs.<\/jats:p>","DOI":"10.1136\/postgradmedj-2020-139352","type":"journal-article","created":{"date-parts":[[2021,3,10]],"date-time":"2021-03-10T18:25:20Z","timestamp":1615400720000},"page":"551-558","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":15,"title":["Reviewing the use and quality of machine learning in developing clinical prediction models for cardiovascular disease"],"prefix":"10.1093","volume":"98","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9578-6469","authenticated-orcid":false,"given":"Simon","family":"Allan","sequence":"first","affiliation":[{"name":"Manchester Medical School, The University of Manchester , Manchester, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raphael","family":"Olaiya","sequence":"additional","affiliation":[{"name":"UCL Centre for Artificial Intelligence, University College London , London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3442-4544","authenticated-orcid":false,"given":"Rasan","family":"Burhan","sequence":"additional","affiliation":[{"name":"St George's Healthcare NHS Trust, St George's Healthcare NHS Trust , London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,3,10]]},"reference":[{"key":"2023041706214646600_","volume-title":"Cardiovascular diseases (CVDs)"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"1945","DOI":"10.1136\/heartjnl-2016-309573","article-title":"Trends in the epidemiology of cardiovascular disease in the UK","volume":"102","author":"Bhatnagar","year":"2016","journal-title":"Heart"},{"key":"2023041706214646600_","volume-title":"Heart and circulatory disease statistics 2019. 2019 STAT Compend","author":"BHF","year":"2019"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"1768","DOI":"10.1161\/CIRCULATIONAHA.109.849166","article-title":"Cardiovascular risk prediction: basic concepts, current status, and future directions","volume":"121","author":"Lloyd-Jones","year":"2010","journal-title":"Circulation"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"3456","DOI":"10.21037\/jtd.2017.09.42","article-title":"Clinical prediction models: a fashion or a necessity in medicine?","volume":"9","author":"Bernard","year":"2017","journal-title":"J Thorac Dis"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"e0213653","DOI":"10.1371\/journal.pone.0213653","article-title":"Cardiovascular disease risk prediction using automated machine learning: a prospective study of 423,604 UK Biobank participants","volume":"14","author":"Alaa","year":"2019","journal-title":"PLoS One"},{"key":"2023041706214646600_","first-page":"417","article-title":"Practical use of the Framingham risk score in primary prevention: Canadian perspective","volume":"57","author":"Bosomworth","year":"2011","journal-title":"Can Fam Physician"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"j2099","DOI":"10.1136\/bmj.j2099","article-title":"Development and validation of QRISK3 risk prediction algorithms to estimate future risk of cardiovascular disease: prospective cohort study","volume":"357","author":"Hippisley-Cox","year":"2017","journal-title":"BMJ"},{"key":"2023041706214646600_","first-page":"1805","article-title":"Moving beyond regression techniques in cardiovascular risk prediction: applying machine learning to address analytic challenges","volume":"38","author":"Goldstein","year":"2017","journal-title":"Eur Heart J"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"1920","DOI":"10.1161\/CIRCULATIONAHA.115.001593","article-title":"Machine learning in medicine","volume":"132","author":"Deo","year":"2015","journal-title":"Circulation"},{"key":"2023041706214646600_","first-page":"2668","volume-title":"Artificial intelligence in cardiology","author":"Johnson","year":"2018"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"e32844","DOI":"10.1371\/journal.pone.0032844","article-title":"Search filters for finding prognostic and diagnostic prediction studies in MEDLINE to enhance systematic reviews","volume":"7","author":"Geersing","year":"2012","journal-title":"PLoS One"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"W1","DOI":"10.7326\/M14-0698","article-title":"Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration","volume":"162","author":"Moons","year":"2015","journal-title":"Ann Intern Med"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1002\/9780470773666","volume-title":"Statistical methods in medical Reasearch","author":"Armitage","year":"2002","edition":"4th edn"},{"key":"2023041706214646600_","volume-title":"Cox Proportional-Hazards Model - Easy Guides - Wiki - STHDA [Internet]"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"e000272","DOI":"10.1136\/lupus-2018-000272","article-title":"QRISK3 improves detection of cardiovascular disease risk in patients with systemic lupus erythematosus","volume":"5","author":"Edwards","year":"2018","journal-title":"Lupus Sci Med"},{"key":"2023041706214646600_","volume-title":"Surveillance report 2018 - Cardiovascular diease: risk assessment and reduction, including lipid modification (2014) NICE guideline CG181","year":"2018"},{"key":"2023041706214646600_","volume-title":"Framingham Heart Study [Internet]"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1161\/CIRCULATIONAHA.107.699579","article-title":"General cardiovascular risk profile for use in primary care: the Framingham heart study","volume":"117","author":"D'Agostino","year":"2008","journal-title":"Circulation"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"b2584","DOI":"10.1136\/bmj.b2584","article-title":"An independent external validation and evaluation of QRISK cardiovascular risk prediction: a prospective open cohort study","volume":"339","author":"Collins","year":"2009","journal-title":"BMJ"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1016\/j.cjca.2015.02.001","article-title":"The new pooled cohort equations risk calculator","volume":"31","author":"Preiss","year":"2015","journal-title":"Can J Cardiol"},{"key":"2023041706214646600_","volume-title":"U.S. census bureau QuickFacts: United States"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"2935","DOI":"10.1016\/j.jacc.2013.11.005","article-title":"2013 ACC\/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology\/American heart association Task force on practice guidelines","volume":"63","author":"Goff","year":"2014","journal-title":"J Am Coll Cardiol"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"e009476","DOI":"10.1161\/JAHA.118.009476","article-title":"Machine learning outperforms ACC \/ AHA CVD risk calculator in MESA","volume":"7","author":"Kakadiaris","year":"2018","journal-title":"J Am Heart Assoc"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"100","DOI":"10.4103\/2229-3485.203040","article-title":"Common pitfalls in statistical analysis: linear regression analysis","volume":"8","author":"Aggarwal","year":"2017","journal-title":"Perspect Clin Res"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1186\/cc2401","article-title":"Statistics review 7: correlation and regression","volume":"7","author":"Bewick","year":"2003","journal-title":"Crit Care"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1016\/j.ejcnurse.2011.06.001","article-title":"Gene-Environment interactions in cardiovascular disease","volume":"11","author":"Flowers","year":"2012","journal-title":"Eur J Cardiovasc Nurs"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1001\/jamacardio.2016.3956","article-title":"Prediction of 30-day all-cause readmissions in patients hospitalized for heart failure: comparison of machine learning and other statistical approaches","volume":"2","author":"Frizzell","year":"2017","journal-title":"JAMA Cardiol"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1145\/212094.212114","article-title":"Overfitting and undercomputing in machine learning","volume":"27","author":"Dietterich","year":"1995","journal-title":"ACM Comput. Surv"},{"key":"2023041706214646600_","volume-title":"The \u201cblack box\u201d metaphor in machine learning - Towards Data Science","author":"Card","year":"2017"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/S0304-3800(02)00064-9","article-title":"Illuminating the \u201cblack box\u201d: a randomization approach for understanding variable contributions in artificial neural networks","volume":"154","author":"Olden","year":"2002","journal-title":"Ecol Modell"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","DOI":"10.1155\/2017\/2780501","article-title":"Neural network-based coronary heart disease risk prediction using feature correlation analysis","author":"Kim","year":"2017","journal-title":"J Healthc Eng"},{"key":"2023041706214646600_","article-title":"An efficient Convolutional neural network for coronary heart disease prediction","author":"Dutta","year":"2020","journal-title":"SSRN Electron J"},{"key":"2023041706214646600_","volume-title":"Random forests","author":"Breiman","year":"2001"},{"key":"2023041706214646600_","first-page":"18","article-title":"Classification and regression by randomForest","volume":"3","author":"Wiener","year":"2003","journal-title":"R News 2"},{"key":"2023041706214646600_","first-page":"294","volume-title":"Random forests for land cover classification","author":"Gislason","year":"2006"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1186\/s12874-018-0644-1","article-title":"Machine learning methodologies versus cardiovascular risk scores, in predicting disease risk","volume":"18","author":"Dimopoulos","year":"2018","journal-title":"BMC Med Res Methodol"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"e0174944","DOI":"10.1371\/journal.pone.0174944","article-title":"Can machine-learning improve cardiovascular risk prediction using routine clinical data?","volume":"12","author":"Weng","year":"2017","journal-title":"PLoS One"},{"key":"2023041706214646600_","first-page":"228","volume-title":"Cardiovascular risk prediction method based on CFS subset evaluation and random forest classification framework. in: 2017 IEEE 2nd International Conference on big data analysis, ICBDA 2017","author":"Xu","year":"2017"},{"key":"2023041706214646600_","first-page":"613","article-title":"Heart disease prediction system using random forest. in: communications in computer and information science","author":"Singh","year":"2017","journal-title":"Springer Verlag"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2016\/3016245","article-title":"Development of health parameter model for risk prediction of CVD using SVM","volume":"2016","author":"Unnikrishnan","year":"2016","journal-title":"Comput Math Methods Med"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: synthetic minority Over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J Artif Intell Res"},{"key":"2023041706214646600_","volume-title":"Prediction of cardiovascular disease using machine learning algorithms. in: proceedings of the 2018 International Conference on current trends towards converging technologies, ICCTCT 2018","author":"Kumar","year":"2018"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/s41512-020-00075-2","article-title":"Logistic regression has similar performance to optimised machine learning algorithms in a clinical setting: application to the discrimination between type 1 and type 2 diabetes in young adults","volume":"4","author":"Lynam","year":"2020","journal-title":"Diagn Progn Res"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1007\/BF00994018","article-title":"Support-vector networks","volume":"20","author":"Cortes","year":"1995","journal-title":"Mach Learn"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3389\/fnbot.2013.00021","article-title":"Gradient boosting machines, a tutorial","volume":"7","author":"Natekin","year":"2013","journal-title":"Front Neurorobot"},{"key":"2023041706214646600_","volume-title":"Naive Bayes Classifier \u2013 Towards Data Science [Internet]. Towards Data Science","author":"Gandhi","year":"2018"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"94","DOI":"10.7861\/futurehosp.6-2-94","article-title":"The potential for artificial intelligence in healthcare","volume":"6","author":"Davenport","year":"2019","journal-title":"Future Healthc J"},{"key":"2023041706214646600_","first-page":"1","article-title":"Comparison of conventional statistical methods with machine learning in medicine: diagnosis, drug development, and treatment","volume":"56","author":"Rajula","year":"2020","journal-title":"Med"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1016\/S0895-4356(96)00002-9","article-title":"Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes","volume":"49","author":"Tu","year":"1996","journal-title":"J Clin Epidemiol"},{"key":"2023041706214646600_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12874-019-0863-0","article-title":"Clinical risk prediction with random forests for survival, longitudinal, and multivariate (RF-SLAM) data analysis","volume":"20","author":"Wongvibulsin","year":"2019","journal-title":"BMC Med Res Methodol"}],"container-title":["Postgraduate Medical Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/pmj\/article-pdf\/98\/1161\/551\/49915520\/postgradmedj-98-551.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/pmj\/article-pdf\/98\/1161\/551\/49915520\/postgradmedj-98-551.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,22]],"date-time":"2023-10-22T21:34:04Z","timestamp":1698010444000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/pmj\/article\/98\/1161\/551\/6958997"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,10]]},"references-count":51,"journal-issue":{"issue":"1161","published-online":{"date-parts":[[2021,3,10]]},"published-print":{"date-parts":[[2022,7,1]]}},"URL":"https:\/\/doi.org\/10.1136\/postgradmedj-2020-139352","relation":{},"ISSN":["0032-5473","1469-0756"],"issn-type":[{"value":"0032-5473","type":"print"},{"value":"1469-0756","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,7]]},"published":{"date-parts":[[2021,3,10]]}}}