{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T16:10:21Z","timestamp":1785773421578,"version":"3.56.0"},"reference-count":20,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T00:00:00Z","timestamp":1697500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Korean Health Technology Research and Development"},{"DOI":"10.13039\/501100003710","name":"Korea Health Industry Development Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003710","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008903","name":"Ministry of Health and Welfare","doi-asserted-by":"publisher","award":["HI13C0715"],"award-info":[{"award-number":["HI13C0715"]}],"id":[{"id":"10.13039\/100008903","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100018688","name":"Korea Disease Control and Prevention Agency","doi-asserted-by":"publisher","award":["2021-ER0903-02"],"award-info":[{"award-number":["2021-ER0903-02"]}],"id":[{"id":"10.13039\/100018688","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Main Research Program","award":["E0210601-03"],"award-info":[{"award-number":["E0210601-03"]}]},{"DOI":"10.13039\/501100003712","name":"Korea Food Research Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003712","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Korean Ministry of Science and ICT"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,12,22]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objective<\/jats:title>\n                  <jats:p>The potential of using retinal images as a biomarker of cardiovascular disease (CVD) risk has gained significant attention, but regulatory approval of such artificial intelligence (AI) algorithms is lacking. In this regulated pivotal trial, we validated the efficacy of Reti-CVD, an AI-Software as a Medical Device (AI-SaMD), that utilizes retinal images to stratify CVD risk.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>In this retrospective study, we used data from the Cardiovascular and Metabolic Diseases Etiology Research Center-High Risk (CMERC-HI) Cohort. Cox proportional hazard model was used to estimate hazard ratio (HR) trend across the 3-tier CVD risk groups (low-, moderate-, and high-risk) according to Reti-CVD in prediction of CVD events. The cardiac computed tomography-measured coronary artery calcium (CAC), carotid intima-media thickness (CIMT), and brachial-ankle pulse wave velocity (baPWV) were compared to Reti-CVD.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>A total of 1106 participants were included, with 33 (3.0%) participants experiencing CVD events over 5\u00a0years; the Reti-CVD-defined risk groups (low, moderate, and high) were significantly associated with increased CVD risk (HR trend, 2.02; 95% CI, 1.26-3.24). When all variables of Reti-CVD, CAC, CIMT, baPWV, and other traditional risk factors were incorporated into one Cox model, the Reti-CVD risk groups were only significantly associated with increased CVD risk (HR\u2009=\u20092.40 [0.82-7.03] in moderate risk and HR\u2009=\u20093.56 [1.34-9.51] in high risk using low-risk as a reference).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>This regulated pivotal study validated an AI-SaMD, retinal image-based, personalized CVD risk scoring system (Reti-CVD).<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>These results led the Korean regulatory body to authorize Reti-CVD.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocad199","type":"journal-article","created":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T20:26:54Z","timestamp":1697574414000},"page":"130-138","source":"Crossref","is-referenced-by-count":39,"title":["Pivotal trial of a deep-learning-based retinal biomarker (Reti-CVD) in the prediction of cardiovascular disease: data from CMERC-HI"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8756-409X","authenticated-orcid":false,"given":"Chan Joo","family":"Lee","sequence":"first","affiliation":[{"name":"Division of Cardiology, Severance Cardiovascular Hospital, Yonsei University College of Medicine , Seoul 03722, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6465-2620","authenticated-orcid":false,"given":"Tyler Hyungtaek","family":"Rim","sequence":"additional","affiliation":[{"name":"Ocular Epidemiology Research Group, Singapore Eye Research Institute, Singapore National Eye Centre , Singapore 169856, Singapore"},{"name":"Mediwhale Inc , Seoul 08378, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyun Goo","family":"Kang","sequence":"additional","affiliation":[{"name":"Division of Retina, Severance Eye Hospital, Yonsei University College of Medicine , Seoul 03722, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph Keunhong","family":"Yi","sequence":"additional","affiliation":[{"name":"Department of Ophthalmology and Visual Science, University of Texas Health Science Center at Houston , Houston, TX 77030, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Geunyoung","family":"Lee","sequence":"additional","affiliation":[{"name":"Mediwhale Inc , Seoul 08378, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2825-8914","authenticated-orcid":false,"given":"Marco","family":"Yu","sequence":"additional","affiliation":[{"name":"Ocular Epidemiology Research Group, Singapore Eye Research Institute, Singapore National Eye Centre , Singapore 169856, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soo-Hyun","family":"Park","sequence":"additional","affiliation":[{"name":"Food Functionality Research Division, Korea Food Research Institute , Wanju 55365, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jin-Taek","family":"Hwang","sequence":"additional","affiliation":[{"name":"Food Functionality Research Division, Korea Food Research Institute , Wanju 55365, South Korea"},{"name":"Department of Food Biotechnology, University of Science and Technology , Daejeon 34113, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yih-Chung","family":"Tham","sequence":"additional","affiliation":[{"name":"Ocular Epidemiology Research Group, Singapore Eye Research Institute, Singapore National Eye Centre , Singapore 169856, Singapore"},{"name":"Centre for Innovation and Precision Eye Health, and Department of Ophthalmology, Yong Loo Lin School of Medicine, National University of Singapore , Singapore 117597, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8448-1264","authenticated-orcid":false,"given":"Tien Yin","family":"Wong","sequence":"additional","affiliation":[{"name":"Ocular Epidemiology Research Group, Singapore Eye Research Institute, Singapore National Eye Centre , Singapore 169856, Singapore"},{"name":"Tsinghua Medicine, Tsinghua University , Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0655-885X","authenticated-orcid":false,"given":"Ching-Yu","family":"Cheng","sequence":"additional","affiliation":[{"name":"Ocular Epidemiology Research Group, Singapore Eye Research Institute, Singapore National Eye Centre , Singapore 169856, Singapore"},{"name":"Centre for Innovation and Precision Eye Health, and Department of Ophthalmology, Yong Loo Lin School of Medicine, National University of Singapore , Singapore 117597, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong Wook","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Information and Statistics, Department of Bio & Medical Big Data, Research Institution of National Science (RINS), Gyeongsang National University , Jinju 52828, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sung Soo","family":"Kim","sequence":"additional","affiliation":[{"name":"Division of Retina, Severance Eye Hospital, Yonsei University College of Medicine , Seoul 03722, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5362-478X","authenticated-orcid":false,"given":"Sungha","family":"Park","sequence":"additional","affiliation":[{"name":"Division of Cardiology, Severance Cardiovascular Hospital, Yonsei University College of Medicine , Seoul 03722, South Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,10,17]]},"reference":[{"issue":"9963","key":"2023122220301589500_ocad199-B1","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/S0140-6736(14)61682-2","article-title":"Global, regional, and national age-sex specific all-cause and cause-specific mortality for 240 causes of death, 1990-2013: a systematic analysis for the Global Burden of Disease Study 2013","volume":"385","author":"GBD 2013 Mortality and Causes of Death Collaborators","year":"2015","journal-title":"Lancet"},{"issue":"19","key":"2023122220301589500_ocad199-B2","doi-asserted-by":"crossref","first-page":"2035","DOI":"10.1001\/jama.1979.03290450033020","article-title":"Diabetes and cardiovascular disease: the Framingham study","volume":"241","author":"Kannel","year":"1979","journal-title":"Jama"},{"issue":"5","key":"2023122220301589500_ocad199-B3","doi-asserted-by":"crossref","first-page":"1060","DOI":"10.1093\/ije\/dym169","article-title":"Is weak association between cigarette smoking and cardiovascular disease mortality observed in Japan explained by low total cholesterol? NIPPON DATA80","volume":"36","author":"Hozawa","year":"2007","journal-title":"Int J Epidemiol"},{"issue":"7","key":"2023122220301589500_ocad199-B4","doi-asserted-by":"crossref","first-page":"891","DOI":"10.1001\/jama.290.7.891","article-title":"Major risk factors as antecedents of fatal and nonfatal coronary heart disease events","volume":"290","author":"Greenland","year":"2003","journal-title":"Jama"},{"issue":"7","key":"2023122220301589500_ocad199-B5","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1001\/jama.290.7.898","article-title":"Prevalence of conventional risk factors in patients with coronary heart disease","volume":"290","author":"Khot","year":"2003","journal-title":"Jama"},{"issue":"13","key":"2023122220301589500_ocad199-B6","doi-asserted-by":"crossref","first-page":"1336","DOI":"10.1056\/NEJMoa072100","article-title":"Coronary calcium as a predictor of coronary events in four racial or ethnic groups","volume":"358","author":"Detrano","year":"2008","journal-title":"N Engl J Med"},{"issue":"25","key":"2023122220301589500_ocad199-B7","first-page":"e1046","article-title":"2018 AHA\/ACC\/AACVPR\/AAPA\/ABC\/ACPM\/ADA\/AGS\/APhA\/ASPC\/NLA\/PCNA guideline on the management of blood cholesterol: executive summary: a report of the American College of Cardiology\/American Heart Association Task Force on Clinical Practice Guidelines","volume":"139","author":"Grundy","year":"2019","journal-title":"Circulation"},{"issue":"1","key":"2023122220301589500_ocad199-B8","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1038\/s41572-022-00342-0","article-title":"Hypertensive eye disease","volume":"8","author":"Cheung","year":"2022","journal-title":"Nat Rev Dis Primers"},{"issue":"22","key":"2023122220301589500_ocad199-B9","doi-asserted-by":"crossref","first-page":"2310","DOI":"10.1056\/NEJMra032865","article-title":"Hypertensive retinopathy","volume":"351","author":"Wong","year":"2004","journal-title":"N Engl J Med"},{"issue":"8","key":"2023122220301589500_ocad199-B10","doi-asserted-by":"crossref","first-page":"e25165","DOI":"10.2196\/25165","article-title":"Gender prediction for a multiethnic population via deep learning across different retinal fundus photograph fields: retrospective cross-sectional study","volume":"9","author":"Betzler","year":"2021","journal-title":"JMIR Med Inform"},{"key":"2023122220301589500_ocad199-B11","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1007\/978-3-030-78601-4_22","volume-title":"Artificial Intelligence in Ophthalmology","author":"Tseng","year":"2021"},{"issue":"10","key":"2023122220301589500_ocad199-B12","doi-asserted-by":"crossref","first-page":"e526","DOI":"10.1016\/S2589-7500(20)30216-8","article-title":"Prediction of systemic biomarkers from retinal photographs: development and validation of deep-learning algorithms","volume":"2","author":"Rim","year":"2020","journal-title":"Lancet Digit Health"},{"issue":"5","key":"2023122220301589500_ocad199-B13","doi-asserted-by":"crossref","first-page":"e306","DOI":"10.1016\/S2589-7500(21)00043-1","article-title":"Deep-learning-based cardiovascular risk stratification using coronary artery calcium scores predicted from retinal photographs","volume":"3","author":"Rim","year":"2021","journal-title":"Lancet Digit Health"},{"issue":"3","key":"2023122220301589500_ocad199-B14","first-page":"ztad023","article-title":"Cardiovascular disease risk assessment using a deep-learning-based retinal biomarker: a comparison with existing risk scores","volume":"4","author":"Yi","year":"2023","journal-title":"Eur Heart J Digit Health"},{"issue":"1","key":"2023122220301589500_ocad199-B15","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/s12916-022-02684-8","article-title":"Validation of a deep-learning-based retinal biomarker (Reti-CVD) in the prediction of cardiovascular disease: data from UK Biobank","volume":"21","author":"Tseng","year":"2023","journal-title":"BMC Med"},{"issue":"2","key":"2023122220301589500_ocad199-B16","doi-asserted-by":"crossref","first-page":"355","DOI":"10.3390\/diagnostics12020355","article-title":"Trends in the approval and quality management of artificial intelligence medical devices in the Republic of Korea","volume":"12","author":"Lim","year":"2022","journal-title":"Diagnostics (Basel)"},{"key":"2023122220301589500_ocad199-B17","article-title":".","volume-title":"Guidance on Clinical Trials Design of Artificial Intelligence(AI)-based Medical Devices","author":"Devices","year":"2022"},{"key":"2023122220301589500_ocad199-B18","volume-title":"Software as a Medical Device (SAMD): Clinical Evaluation, Guidance for Industry and Food and Drug Administration Staff","author":"US Food and Drug Administration","year":"2017"},{"key":"2023122220301589500_ocad199-B19","volume-title":"Proposed Regulatory Framework for Modifications to Artificial Intelligence\/Machine Learning (AI\/ML)-Based Software as a Medical Device (SAMD)","author":"US Food and Drug Administration","year":"2019"},{"issue":"1","key":"2023122220301589500_ocad199-B20","doi-asserted-by":"crossref","first-page":"e018342","DOI":"10.1161\/JAHA.120.018342","article-title":"Coronary artery calcium score-directed primary prevention with statins on the basis of the 2018 American College of Cardiology\/American Heart Association\/Multisociety Cholesterol Guidelines","volume":"10","author":"Taron","year":"2021","journal-title":"J Am Heart Assoc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/1\/130\/54762064\/ocad199.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/1\/130\/54762064\/ocad199.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,22]],"date-time":"2023-12-22T20:31:10Z","timestamp":1703277070000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/1\/130\/7320055"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,17]]},"references-count":20,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,10,17]]},"published-print":{"date-parts":[[2023,12,22]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocad199","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,1,1]]},"published":{"date-parts":[[2023,10,17]]}}}