{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,2]],"date-time":"2026-11-02T08:41:24Z","timestamp":1793608884100,"version":"4.5.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T00:00:00Z","timestamp":1674518400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T00:00:00Z","timestamp":1674518400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001348","name":"Agency for Science, Technology and Research","doi-asserted-by":"publisher","award":["Grant No. H20c6a0031"],"award-info":[{"award-number":["Grant No. H20c6a0031"]}],"id":[{"id":"10.13039\/501100001348","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Currently in the United Kingdom, cardiovascular disease (CVD) risk assessment is based on the QRISK3 score, in which 10% 10-year CVD risk indicates clinical intervention. However, this benchmark has limited efficacy in clinical practice and the need for a more simple, non-invasive risk stratification tool is necessary. Retinal photography is becoming increasingly acceptable as a non-invasive imaging tool for CVD. Previously, we developed a novel CVD risk stratification system based on retinal photographs predicting future CVD risk. This study aims to further validate our biomarker, Reti-CVD, (1) to detect risk group of \u2265\u200910% in 10-year CVD risk and (2) enhance risk assessment in individuals with QRISK3 of 7.5\u201310% (termed as borderline-QRISK3 group) using the UK Biobank.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Reti-CVD scores were calculated and stratified into three risk groups based on optimized cut-off values from the UK Biobank. We used Cox proportional-hazards models to evaluate the ability of Reti-CVD to predict CVD events in the general population. C-statistics was used to assess the prognostic value of adding Reti-CVD to QRISK3 in borderline-QRISK3 group and three vulnerable subgroups.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Among 48,260 participants with no history of CVD, 6.3% had CVD events during the 11-year follow-up. Reti-CVD was associated with an increased risk of CVD (adjusted hazard ratio [HR] 1.41; 95% confidence interval [CI], 1.30\u20131.52) with a 13.1% (95% CI, 11.7\u201314.6%) 10-year CVD risk in Reti-CVD-high-risk group. The 10-year CVD risk of the borderline-QRISK3 group was greater than 10% in Reti-CVD-high-risk group (11.5% in non-statin cohort [<jats:italic>n<\/jats:italic>\u2009=\u200945,473], 11.5% in stage 1 hypertension cohort [<jats:italic>n<\/jats:italic>\u2009=\u200911,966], and 14.2% in middle-aged cohort [<jats:italic>n<\/jats:italic>\u2009=\u200938,941]). <jats:italic>C<\/jats:italic> statistics increased by 0.014 (0.010\u20130.017) in non-statin cohort, 0.013 (0.007\u20130.019) in stage 1 hypertension cohort, and 0.023 (0.018\u20130.029) in middle-aged cohort for CVD event prediction after adding Reti-CVD to QRISK3.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Reti-CVD has the potential to identify individuals with \u2265\u200910% 10-year CVD risk who are likely to benefit from earlier preventative CVD interventions. For borderline-QRISK3 individuals with 10-year CVD risk between 7.5 and 10%, Reti-CVD could be used as a risk enhancer tool to help improve discernment accuracy, especially in adult groups that may be pre-disposed to CVD.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12916-022-02684-8","type":"journal-article","created":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T03:04:15Z","timestamp":1674529455000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":69,"title":["Validation of a deep-learning-based retinal biomarker (Reti-CVD) in the prediction of cardiovascular disease: data from UK Biobank"],"prefix":"10.1186","volume":"21","author":[{"given":"Rachel Marjorie Wei Wen","family":"Tseng","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6465-2620","authenticated-orcid":false,"given":"Tyler Hyungtaek","family":"Rim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eduard","family":"Shantsila","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph K.","family":"Yi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sungha","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sung Soo","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chan Joo","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sahil","family":"Thakur","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Simon","family":"Nusinovici","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qingsheng","family":"Peng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyeonmin","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geunyoung","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marco","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yih-Chung","family":"Tham","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ameet","family":"Bakhai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Leeson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gregory Y.H.","family":"Lip","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tien Yin","family":"Wong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ching-Yu","family":"Cheng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,1,24]]},"reference":[{"key":"2684_CR1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.104675","volume":"137","author":"M Deshmukh","year":"2021","unstructured":"Deshmukh M, Liu YC, Rim TH, Venkatraman A, Davidson M, Yu M, et al. Automatic segmentation of corneal deposits from corneal stromal dystrophy images via deep learning. Comput Biol Med. 2021;137:104675.","journal-title":"Comput Biol Med"},{"issue":"20","key":"2684_CR2","doi-asserted-by":"publisher","first-page":"2357","DOI":"10.1042\/CS20210207","volume":"135","author":"WY Ng","year":"2021","unstructured":"Ng WY, Zhang S, Wang Z, Ong CJT, Gunasekeran DV, Lim GYS, et al. Updates in deep learning research in ophthalmology. Clin Sci (Lond). 2021;135(20):2357\u201376.","journal-title":"Clin Sci (Lond)"},{"issue":"7611","key":"2684_CR3","doi-asserted-by":"publisher","first-page":"136","DOI":"10.1136\/bmj.39261.471806.55","volume":"335","author":"J Hippisley-Cox","year":"2007","unstructured":"Hippisley-Cox J, Coupland C, Vinogradova Y, Robson J, May M, Brindle P. Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study. BMJ. 2007;335(7611):136.","journal-title":"BMJ."},{"key":"2684_CR4","unstructured":"Cardiovascular disease: risk assessment and reduction, including lipid modification [https:\/\/www.nice.org.uk\/guidance\/cg181\/resources]. 2014."},{"issue":"691","key":"2684_CR5","doi-asserted-by":"publisher","first-page":"90","DOI":"10.3399\/bjgp20X708053","volume":"70","author":"NR Jones","year":"2020","unstructured":"Jones NR, McCormack T, Constanti M, McManus RJ. Diagnosis and management of hypertension in adults: NICE guideline update 2019. Br J Gen Pract. 2020;70(691):90\u20131.","journal-title":"Br J Gen Pract"},{"issue":"700","key":"2684_CR6","doi-asserted-by":"publisher","first-page":"e765","DOI":"10.3399\/bjgp20X713057","volume":"70","author":"A Pate","year":"2020","unstructured":"Pate A, Emsley R, van Staa T. Impact of lowering the risk threshold for statin treatment on statin prescribing: a descriptive study in English primary care. Br J Gen Pract. 2020;70(700):e765\u2013e71.","journal-title":"Br J Gen Pract"},{"issue":"8","key":"2684_CR7","doi-asserted-by":"publisher","DOI":"10.2196\/25165","volume":"9","author":"BK Betzler","year":"2021","unstructured":"Betzler BK, Yang HHS, Thakur S, Yu M, Quek TC, Soh ZD, et al. Gender prediction for a multiethnic population via deep learning across different retinal fundus photograph fields: retrospective cross-sectional study. JMIR Med Inform. 2021;9(8):e25165.","journal-title":"JMIR Med Inform"},{"key":"2684_CR8","first-page":"243","volume-title":"Artificial intelligence using the eye as a biomarker of systemic risk. Artificial Intelligence in Ophthalmology","author":"RMWW Tseng","year":"2021","unstructured":"Tseng RMWW, Rim TH, Cheung CY, Wong TY. Artificial intelligence using the eye as a biomarker of systemic risk. Artificial Intelligence in Ophthalmology: Springer; 2021. p. 243\u201355."},{"issue":"10","key":"2684_CR9","doi-asserted-by":"publisher","first-page":"e526","DOI":"10.1016\/S2589-7500(20)30216-8","volume":"2","author":"TH Rim","year":"2020","unstructured":"Rim TH, Lee G, Kim Y, Tham YC, Lee CJ, Baik SJ, et al. Prediction of systemic biomarkers from retinal photographs: development and validation of deep-learning algorithms. Lancet Digit Health. 2020;2(10):e526\u2013e36.","journal-title":"Lancet Digit Health"},{"issue":"5","key":"2684_CR10","doi-asserted-by":"publisher","first-page":"e306","DOI":"10.1016\/S2589-7500(21)00043-1","volume":"3","author":"TH Rim","year":"2021","unstructured":"Rim TH, Lee CJ, Tham Y-C, Cheung N, Yu M, Lee G, et al. Deep-learning-based cardiovascular risk stratification using coronary artery calcium scores predicted from retinal photographs. Lancet Digital Health. 2021;3(5):e306\u2013e16.","journal-title":"Lancet Digital Health"},{"issue":"3","key":"2684_CR11","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1001779","volume":"12","author":"C Sudlow","year":"2015","unstructured":"Sudlow C, Gallacher J, Allen N, Beral V, Burton P, Danesh J, et al. UK biobank: an open access resource for identifying the causes of a wide range of complex diseases of middle and old age. PLoS Med. 2015;12(3):e1001779.","journal-title":"PLoS Med"},{"issue":"9578","key":"2684_CR12","doi-asserted-by":"publisher","first-page":"1980","DOI":"10.1016\/S0140-6736(07)60924-6","volume":"369","author":"LJ Palmer","year":"2007","unstructured":"Palmer LJ. UK Biobank: bank on it. Lancet. 2007;369(9578):1980\u20132.","journal-title":"Lancet."},{"key":"2684_CR13","volume-title":"Protocol for a large-scale prospective epidemiological resource","author":"UK Biobank","year":"2007","unstructured":"UK Biobank: Protocol for a large-scale prospective epidemiological resource. 2007."},{"issue":"1","key":"2684_CR14","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1186\/s12963-019-0197-5","volume":"17","author":"REK Man","year":"2019","unstructured":"Man REK, Gan AHW, Fenwick EK, Gan ATL, Gupta P, Sabanayagam C, et al. Prevalence, determinants and association of unawareness of diabetes, hypertension and hypercholesterolemia with poor disease control in a multi-ethnic Asian population without cardiovascular disease. Popul Health Metrics. 2019;17(1):17.","journal-title":"Popul Health Metrics"},{"key":"2684_CR15","unstructured":"UK Factsheet [https:\/\/www.bhf.org.uk\/-\/media\/files\/research\/heart-statistics\/bhf-cvd-statistics---ukfactsheet.pdf]. 2022."},{"issue":"2","key":"2684_CR16","doi-asserted-by":"publisher","first-page":"440","DOI":"10.2337\/dc19-1683","volume":"43","author":"C Welsh","year":"2020","unstructured":"Welsh C, Welsh P, Celis-Morales CA, Mark PB, Mackay D, Ghouri N, et al. Glycated hemoglobin, prediabetes, and the links to cardiovascular disease: data from UK Biobank. Diabetes Care. 2020;43(2):440\u20135.","journal-title":"Diabetes Care"},{"key":"2684_CR17","doi-asserted-by":"publisher","first-page":"2139","DOI":"10.12688\/f1000research.21679.3","volume":"8","author":"Y Li","year":"2020","unstructured":"Li Y, Sperrin M, van Staa T. R package \u201cQRISK3\u201d: an unofficial research purposed implementation of ClinRisk\u2019s QRISK3 algorithm into R. F1000Research. 2020;8:2139.","journal-title":"F1000Research."},{"issue":"2","key":"2684_CR18","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1002\/sim.2929","volume":"27","author":"MJ Pencina","year":"2008","unstructured":"Pencina MJ, D'Agostino RB Sr, D'Agostino RB Jr, Vasan RS. Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond. Stat Med. 2008;27(2):157\u201372 discussion 207-12.","journal-title":"Stat Med"},{"issue":"4","key":"2684_CR19","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1093\/eurheartj\/ehab874","volume":"43","author":"PE Vardas","year":"2022","unstructured":"Vardas PE, Asselbergs FW, van Smeden M, Friedman P. The year in cardiovascular medicine 2021: digital health and innovation. Eur Heart J. 2022;43(4):271\u20139.","journal-title":"Eur Heart J"},{"issue":"5","key":"2684_CR20","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0233166","volume":"15","author":"L Zhang","year":"2020","unstructured":"Zhang L, Yuan M, An Z, Zhao X, Wu H, Li H, et al. Prediction of hypertension, hyperglycemia and dyslipidemia from retinal fundus photographs via deep learning: A cross-sectional study of chronic diseases in central China. PLoS One. 2020;15(5):e0233166.","journal-title":"PLoS One"},{"issue":"3","key":"2684_CR21","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1038\/s41551-018-0195-0","volume":"2","author":"R Poplin","year":"2018","unstructured":"Poplin R, Varadarajan AV, Blumer K, Liu Y, McConnell MV, Corrado GS, et al. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat Biomed Eng. 2018;2(3):158\u201364.","journal-title":"Nat Biomed Eng"},{"issue":"1","key":"2684_CR22","doi-asserted-by":"publisher","first-page":"9432","DOI":"10.1038\/s41598-020-65794-4","volume":"10","author":"N Gerrits","year":"2020","unstructured":"Gerrits N, Elen B, Craenendonck TV, Triantafyllidou D, Petropoulos IN, Malik RA, et al. Age and sex affect deep learning prediction of cardiometabolic risk factors from retinal images. Sci Rep. 2020;10(1):9432.","journal-title":"Sci Rep"},{"issue":"11","key":"2684_CR23","doi-asserted-by":"publisher","first-page":"1583","DOI":"10.1136\/hrt.2006.090522","volume":"92","author":"JJ Wang","year":"2006","unstructured":"Wang JJ, Liew G, Wong TY, Smith W, Klein R, Leeder SR, et al. Retinal vascular calibre and the risk of coronary heart disease-related death. Heart. 2006;92(11):1583\u20137.","journal-title":"Heart."},{"issue":"1","key":"2684_CR24","doi-asserted-by":"publisher","first-page":"1389","DOI":"10.1038\/s41598-022-05169-z","volume":"12","author":"S Mueller","year":"2022","unstructured":"Mueller S, Wintergerst MWM, Falahat P, Holz FG, Schaefer C, Schahab N, et al. Multiple instance learning detects peripheral arterial disease from high-resolution color fundus photography. Sci Rep. 2022;12(1):1389.","journal-title":"Sci Rep"},{"key":"2684_CR25","doi-asserted-by":"publisher","unstructured":"Barriada RG, Sim\u00f3-Servat O, Planas A, Hern\u00e1ndez C, Sim\u00f3 R, Masip D. Deep Learning of Retinal Imaging: A Useful Tool for Coronary Artery Calcium Score Prediction in Diabetic Patients. Appl Sci. 2022;12:1401. https:\/\/doi.org\/10.3390\/app12031401.","DOI":"10.3390\/app12031401"},{"issue":"2","key":"2684_CR26","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1167\/tvst.9.2.28","volume":"9","author":"J Son","year":"2020","unstructured":"Son J, Shin JY, Chun EJ, Jung K-H, Park KH, Park SJ. Predicting high coronary artery calcium score from retinal fundus images with deep learning algorithms. Transl Vis Sci Technol. 2020;9(2):28.","journal-title":"Transl Vis Sci Technol"},{"key":"2684_CR27","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.ajo.2020.03.027","volume":"217","author":"J Chang","year":"2020","unstructured":"Chang J, Ko A, Park SM, Choi S, Kim K, Kim SM, et al. Association of cardiovascular mortality and deep learning-funduscopic atherosclerosis score derived from retinal fundus images. Am J Ophthalmol. 2020;217:121\u201330.","journal-title":"Am J Ophthalmol"},{"issue":"13","key":"2684_CR28","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1167\/tvst.10.13.20","volume":"10","author":"L Arnould","year":"2021","unstructured":"Arnould L, Guenancia C, Bourredjem A, Binquet C, Gabrielle PH, Eid P, et al. Prediction of cardiovascular parameters with supervised machine learning from singapore \u201cI\u201d vessel assessment and OCT-angiography: a pilot study. Transl Vision Sci Technol. 2021;10(13):20.","journal-title":"Transl Vision Sci Technol"},{"issue":"672","key":"2684_CR29","doi-asserted-by":"publisher","first-page":"e449","DOI":"10.3399\/bjgp18X697649","volume":"68","author":"A Martin","year":"2018","unstructured":"Martin A, Saunders CL, Harte E, Griffin SJ, MacLure C, Mant J, et al. Delivery and impact of the NHS health check in the first 8 years: a systematic review. Br J Gen Pract. 2018;68(672):e449\u2013e59.","journal-title":"Br J Gen Pract"},{"issue":"5","key":"2684_CR30","doi-asserted-by":"publisher","first-page":"735","DOI":"10.1097\/EDE.0000000000000688","volume":"28","author":"M Kivim\u00e4ki","year":"2017","unstructured":"Kivim\u00e4ki M, Batty GD, Singh-Manoux A, Britton A, Brunner EJ, Shipley MJ. Validity of cardiovascular disease event ascertainment using linkage to UK hospital records. Epidemiology. 2017;28(5):735\u20139.","journal-title":"Epidemiology."},{"key":"2684_CR31","unstructured":"UK Biobank research ethics approval.\u00a02021. [https:\/\/www.ukbiobank.ac.uk\/learn-more-about-ukbiobank\/about-us\/ethics]."}],"container-title":["BMC Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-022-02684-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12916-022-02684-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-022-02684-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,24]],"date-time":"2023-01-24T03:07:10Z","timestamp":1674529630000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedicine.biomedcentral.com\/articles\/10.1186\/s12916-022-02684-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,24]]},"references-count":31,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2684"],"URL":"https:\/\/doi.org\/10.1186\/s12916-022-02684-8","relation":{},"ISSN":["1741-7015"],"issn-type":[{"value":"1741-7015","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,24]]},"assertion":[{"value":"12 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 November 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 January 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The UK Biobank dataset was obtained ethically from UK Biobank (application number 68428). The UK Biobank has also received Research Tissue Bank approval from North West Multi-centre Research Ethics Committee and the Human Tissue Authority license [].","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"T.H.R. was a former scientific adviser and owns stock of Mediwhale Inc. H.K. and G.L. are employees of Mediwhale Inc. T.H.R. and G.L. hold the following patents that might be affected by this study: 10\u20132018\u20130166720(KR), 10\u20132018\u20130166721(KR), 10\u20132018\u20130166722(KR), 62\/694,901(US), 62\/715,729(US), and 62\/776,345 (US). All other authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"28"}}