{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T08:59:36Z","timestamp":1778144376637,"version":"3.51.4"},"reference-count":77,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,6,1]],"date-time":"2021-06-01T00:00:00Z","timestamp":1622505600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,1]],"date-time":"2021-06-01T00:00:00Z","timestamp":1622505600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Coronary artery disease (CAD), the most common manifestation of cardiovascular disease, remains the most common cause of mortality in the United States. Risk assessment is key for primary prevention of coronary events and coronary artery calcium (CAC) scoring using computed tomography (CT) is one such non-invasive tool. Despite the proven clinical value of CAC, the current clinical practice implementation for CAC has limitations such as the lack of insurance coverage for the test, need for capital-intensive CT machines, specialized imaging protocols, and accredited 3D imaging labs for analysis (including personnel and software). Perhaps the greatest gap is the millions of patients who undergo routine chest CT exams and demonstrate coronary artery calcification, but their presence is not often reported or quantitation is not feasible. We present two deep learning models that automate CAC scoring demonstrating advantages in automated scoring for both dedicated gated coronary CT exams and routine non-gated chest CTs performed for other reasons to allow opportunistic screening. First, we trained a gated coronary CT model for CAC scoring that showed near perfect agreement (mean difference in scores\u2009=\u2009\u22122.86; Cohen\u2019s Kappa\u2009=\u20090.89, <jats:italic>P<\/jats:italic>\u2009&lt;\u20090.0001) with current conventional manual scoring on a retrospective dataset of 79 patients and was found to perform the task faster (average time for automated CAC scoring using a graphics processing unit (GPU) was 3.5\u2009\u00b1\u20092.1\u2009s vs. 261\u2009s for manual scoring) in a prospective trial of 55 patients with little difference in scores compared to three technologists (mean difference in scores\u2009=\u20093.24, 5.12, and 5.48, respectively). Then using CAC scores from paired gated coronary CT as a reference standard, we trained a deep learning model on our internal data and a cohort from the Multi-Ethnic Study of Atherosclerosis (MESA) study (total training <jats:italic>n<\/jats:italic>\u2009=\u2009341, Stanford test <jats:italic>n<\/jats:italic>\u2009=\u200942, MESA test <jats:italic>n<\/jats:italic>\u2009=\u200946) to perform CAC scoring on routine non-gated chest CT exams with validation on external datasets (total <jats:italic>n<\/jats:italic>\u2009=\u2009303) obtained from four geographically disparate health systems. On identifying patients with any CAC (i.e., CAC\u2009\u2265\u20091), sensitivity and PPV was high across all datasets (ranges: 80\u2013100% and 87\u2013100%, respectively). For CAC\u2009\u2265\u2009100 on routine non-gated chest CTs, which is the latest recommended threshold to initiate statin therapy, our model showed sensitivities of 71\u201394% and positive predictive values in the range of 88\u2013100% across all the sites. Adoption of this model could allow more patients to be screened with CAC scoring, potentially allowing opportunistic early preventive interventions.<\/jats:p>","DOI":"10.1038\/s41746-021-00460-1","type":"journal-article","created":{"date-parts":[[2021,6,1]],"date-time":"2021-06-01T15:20:18Z","timestamp":1622560818000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":157,"title":["Automated coronary calcium scoring using deep learning with multicenter external validation"],"prefix":"10.1038","volume":"4","author":[{"given":"David","family":"Eng","sequence":"first","affiliation":[]},{"given":"Christopher","family":"Chute","sequence":"additional","affiliation":[]},{"given":"Nishith","family":"Khandwala","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8030-3727","authenticated-orcid":false,"given":"Pranav","family":"Rajpurkar","sequence":"additional","affiliation":[]},{"given":"Jin","family":"Long","sequence":"additional","affiliation":[]},{"given":"Sam","family":"Shleifer","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3323-2698","authenticated-orcid":false,"given":"Mohamed H.","family":"Khalaf","sequence":"additional","affiliation":[]},{"given":"Alexander T.","family":"Sandhu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5226-0723","authenticated-orcid":false,"given":"Fatima","family":"Rodriguez","sequence":"additional","affiliation":[]},{"given":"David J.","family":"Maron","sequence":"additional","affiliation":[]},{"given":"Saeed","family":"Seyyedi","sequence":"additional","affiliation":[]},{"given":"Daniele","family":"Marin","sequence":"additional","affiliation":[]},{"given":"Ilana","family":"Golub","sequence":"additional","affiliation":[]},{"given":"Matthew","family":"Budoff","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9992-5630","authenticated-orcid":false,"given":"Felipe","family":"Kitamura","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9489-2844","authenticated-orcid":false,"given":"Marcelo Straus","family":"Takahashi","sequence":"additional","affiliation":[]},{"given":"Ross W.","family":"Filice","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4916-1377","authenticated-orcid":false,"given":"Rajesh","family":"Shah","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2765-7451","authenticated-orcid":false,"given":"John","family":"Mongan","sequence":"additional","affiliation":[]},{"given":"Kimberly","family":"Kallianos","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8972-8051","authenticated-orcid":false,"given":"Curtis P.","family":"Langlotz","sequence":"additional","affiliation":[]},{"given":"Matthew P.","family":"Lungren","sequence":"additional","affiliation":[]},{"given":"Andrew Y.","family":"Ng","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5157-9903","authenticated-orcid":false,"given":"Bhavik N.","family":"Patel","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,6,1]]},"reference":[{"key":"460_CR1","unstructured":"Cardiovascular diseases (CVDs). in World Health Organization, Vol. 2018 (2017)."},{"key":"460_CR2","doi-asserted-by":"publisher","first-page":"e139","DOI":"10.1161\/CIR.0000000000000757","volume":"141","author":"SS Virani","year":"2020","unstructured":"Virani, S. S. et al. Heart disease and stroke statistics-2020 Update: a report from the American Heart Association. Circulation 141, e139\u2013e596 (2020).","journal-title":"Circulation"},{"key":"460_CR3","doi-asserted-by":"publisher","first-page":"e56","DOI":"10.1161\/CIR.0000000000000659","volume":"139","author":"EJ Benjamin","year":"2019","unstructured":"Benjamin, E. J. et al. Heart disease and stroke statistics-2019 Update: a report from the American Heart Association. Circulation 139, e56\u2013e528 (2019).","journal-title":"Circulation"},{"key":"460_CR4","first-page":"e46","volume":"121","author":"Writing Group, M.","year":"2010","unstructured":"Writing Group, M. et al. Heart disease and stroke statistics--2010 update: a report from the American Heart Association. Circulation 121, e46\u2013e215 (2010).","journal-title":"Circulation"},{"key":"460_CR5","doi-asserted-by":"publisher","first-page":"2748","DOI":"10.1161\/CIR.0b013e3182051bab","volume":"122","author":"P Greenland","year":"2010","unstructured":"Greenland, P. et al. 2010 ACCF\/AHA guideline for assessment of cardiovascular risk in asymptomatic adults: executive summary: a report of the American College of Cardiology Foundation\/American Heart Association Task Force on Practice Guidelines. Circulation 122, 2748\u20132764 (2010).","journal-title":"Circulation"},{"key":"460_CR6","doi-asserted-by":"publisher","first-page":"836","DOI":"10.7326\/M16-0577","volume":"164","author":"K Bibbins-Domingo","year":"2016","unstructured":"Bibbins-Domingo, K. U.S. Preventive Services Task Force Aspirin use for the primary prevention of cardiovascular disease and colorectal cancer: U.S. preventive services task force recommendation statement. Ann. Intern. Med. 164, 836\u2013845 (2016).","journal-title":"Ann. Intern. Med."},{"key":"460_CR7","doi-asserted-by":"publisher","first-page":"S49","DOI":"10.1161\/01.cir.0000437741.48606.98","volume":"129","author":"DC Goff Jr.","year":"2014","unstructured":"Goff, D. C. Jr. et al. 2013 ACC\/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology\/American Heart Association Task Force on Practice Guidelines. Circulation 129, S49\u2013S73 (2014).","journal-title":"Circulation"},{"key":"460_CR8","doi-asserted-by":"crossref","unstructured":"Polonsky, T. S. & Greenland, P. Viewing the value of coronary artery calcium testing from different perspectives. JAMA Cardiol. 3, 908\u2013910 (2018).","DOI":"10.1001\/jamacardio.2018.2199"},{"key":"460_CR9","doi-asserted-by":"publisher","first-page":"579 e571","DOI":"10.1016\/j.jash.2018.06.010","volume":"12","author":"PK Whelton","year":"2018","unstructured":"Whelton, P. K. et al. 2017 ACC\/AHA\/AAPA\/ABC\/ACPM\/AGS\/APhA\/ASH\/ASPC\/NMA\/PCNA Guideline for the prevention, detection, evaluation, and management of high blood pressure in adults: executive summary: a report of the American College of Cardiology\/American Heart Association Task Force on Clinical Practice Guidelines. J. Am. Soc. Hypertens. 12, 579 e571\u2013579 e573 (2018).","journal-title":"J. Am. Soc. Hypertens."},{"key":"460_CR10","doi-asserted-by":"publisher","first-page":"2935","DOI":"10.1016\/j.jacc.2013.11.005","volume":"63","author":"DC Goff Jr.","year":"2014","unstructured":"Goff, D. C. Jr. et al. 2013 ACC\/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology\/American Heart Association Task Force on Practice Guidelines. J. Am. Coll. Cardiol. 63, 2935\u20132959 (2014).","journal-title":"J. Am. Coll. Cardiol."},{"key":"460_CR11","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1001\/jama.291.2.210","volume":"291","author":"P Greenland","year":"2004","unstructured":"Greenland, P., LaBree, L., Azen, S. P., Doherty, T. M. & Detrano, R. C. Coronary artery calcium score combined with Framingham score for risk prediction in asymptomatic individuals. JAMA 291, 210\u2013215 (2004).","journal-title":"JAMA"},{"key":"460_CR12","doi-asserted-by":"publisher","first-page":"788","DOI":"10.1001\/jama.2012.9624","volume":"308","author":"J Yeboah","year":"2012","unstructured":"Yeboah, J. et al. Comparison of novel risk markers for improvement in cardiovascular risk assessment in intermediate-risk individuals. JAMA 308, 788\u2013795 (2012).","journal-title":"JAMA"},{"key":"460_CR13","doi-asserted-by":"publisher","first-page":"1336","DOI":"10.1056\/NEJMoa072100","volume":"358","author":"R Detrano","year":"2008","unstructured":"Detrano, R. et al. Coronary calcium as a predictor of coronary events in four racial or ethnic groups. N. Engl. J. Med. 358, 1336\u20131345 (2008).","journal-title":"N. Engl. J. Med."},{"key":"460_CR14","doi-asserted-by":"publisher","first-page":"1657","DOI":"10.1016\/j.jacc.2015.07.066","volume":"66","author":"K Nasir","year":"2015","unstructured":"Nasir, K. et al. Implications of coronary artery calcium testing among statin candidates according to American College of Cardiology\/American Heart Association Cholesterol Management Guidelines: MESA (Multi-Ethnic Study of Atherosclerosis). J. Am. Coll. Cardiol. 66, 1657\u20131668 (2015).","journal-title":"J. Am. Coll. Cardiol."},{"key":"460_CR15","doi-asserted-by":"publisher","first-page":"2401","DOI":"10.1093\/eurheartj\/ehy217","volume":"39","author":"MJ Budoff","year":"2018","unstructured":"Budoff, M. J. et al. Ten-year association of coronary artery calcium with atherosclerotic cardiovascular disease (ASCVD) events: the multi-ethnic study of atherosclerosis (MESA). Eur. Heart J. 39, 2401\u20132408 (2018).","journal-title":"Eur. Heart J."},{"key":"460_CR16","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1148\/rg.2015140181","volume":"35","author":"H Machida","year":"2015","unstructured":"Machida, H. et al. Current and novel imaging techniques in coronary CT. Radiographics 35, 991\u20131010 (2015).","journal-title":"Radiographics"},{"key":"460_CR17","doi-asserted-by":"publisher","first-page":"614","DOI":"10.1148\/radiol.10100140","volume":"257","author":"AA Mahabadi","year":"2010","unstructured":"Mahabadi, A. A. et al. Safety, efficacy, and indications of beta-adrenergic receptor blockade to reduce heart rate prior to coronary CT angiography. Radiology 257, 614\u2013623 (2010).","journal-title":"Radiology"},{"key":"460_CR18","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1148\/radiol.2015150605","volume":"275","author":"A Berrington de Gonzalez","year":"2015","unstructured":"Berrington de Gonzalez, A. & Kleinerman, R. A. CT scanning: is the contrast material enhancing the radiation dose and cancer risk as well as the image? Radiology 275, 627\u2013629 (2015).","journal-title":"Radiology"},{"key":"460_CR19","doi-asserted-by":"publisher","DOI":"10.1038\/srep46479","volume":"7","author":"F Ciompi","year":"2017","unstructured":"Ciompi, F. et al. Towards automatic pulmonary nodule management in lung cancer screening with deep learning. Sci. Rep. 7, 46479 (2017).","journal-title":"Sci. Rep."},{"key":"460_CR20","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"460_CR21","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"460_CR22","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1148\/radiol.2017162326","volume":"284","author":"P Lakhani","year":"2017","unstructured":"Lakhani, P. & Sundaram, B. Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284, 574\u2013582 (2017).","journal-title":"Radiology"},{"key":"460_CR23","doi-asserted-by":"crossref","unstructured":"Ding, X. et al. Automated coronary artery calcium scoring from non-contrast CT using a patient-specific algorithm (SPIE, 2015).","DOI":"10.1117\/12.2081633"},{"key":"460_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.acra.2012.07.018","volume":"20","author":"R Shahzad","year":"2013","unstructured":"Shahzad, R. et al. Vessel specific coronary artery calcium scoring: an automatic system. Acad. Radio. 20, 1\u20139 (2013).","journal-title":"Acad. Radio."},{"key":"460_CR25","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/j.media.2016.04.004","volume":"34","author":"JM Wolterink","year":"2016","unstructured":"Wolterink, J. M. et al. Automatic coronary artery calcium scoring in cardiac CT angiography using paired convolutional neural networks. Med Image Anal. 34, 123\u2013136 (2016).","journal-title":"Med Image Anal."},{"key":"460_CR26","unstructured":"Cano-Espinosa, C., Gonzalez, G., Washko, G. R., Cazorla, M. & Estepar, R. S. J. Automated agatston score computation in non-ECG Gated CT scans using deep learning. Proc. SPIE Int. Soc. Opt. Eng. 10574 (2018)."},{"key":"460_CR27","doi-asserted-by":"publisher","first-page":"2322","DOI":"10.1109\/TMI.2012.2216889","volume":"31","author":"I Isgum","year":"2012","unstructured":"Isgum, I., Prokop, M., Niemeijer, M., Viergever, M. A. & van Ginneken, B. Automatic coronary calcium scoring in low-dose chest computed tomography. IEEE Trans. Med. Imaging 31, 2322\u20132334 (2012).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"460_CR28","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1109\/TMI.2017.2769839","volume":"37","author":"N Lessmann","year":"2018","unstructured":"Lessmann, N. et al. Automatic calcium scoring in low-dose chest CT using deep neural networks with dilated convolutions. IEEE Trans. Med. Imaging 37, 615\u2013625 (2018).","journal-title":"IEEE Trans. Med. Imaging"},{"key":"460_CR29","doi-asserted-by":"crossref","unstructured":"Shadmi, R., Mazo, V., Bregman-Amitai, O. & Elnekave, E. Fully-convolutional deep-learning based system for coronary calcium score prediction from non-contrast chest CT. in 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018) 24\u201328 (2018).","DOI":"10.1109\/ISBI.2018.8363515"},{"key":"460_CR30","doi-asserted-by":"publisher","first-page":"e91239","DOI":"10.1371\/journal.pone.0091239","volume":"9","author":"RA Takx","year":"2014","unstructured":"Takx, R. A. et al. Automated coronary artery calcification scoring in non-gated chest CT: agreement and reliability. PLoS ONE 9, e91239 (2014).","journal-title":"PLoS ONE"},{"key":"460_CR31","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1148\/radiol.2020191621","volume":"295","author":"SGM van Velzen","year":"2020","unstructured":"van Velzen, S. G. M. et al. Deep learning for automatic calcium scoring in CT: validation using multiple cardiac CT and chest CT protocols. Radiology 295, 66\u201379 (2020).","journal-title":"Radiology"},{"key":"460_CR32","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-20966-2","volume":"12","author":"R Zeleznik","year":"2021","unstructured":"Zeleznik, R. et al. Deep convolutional neural networks to predict cardiovascular risk from computed tomography. Nat. Commun. 12, 715 (2021).","journal-title":"Nat. Commun."},{"key":"460_CR33","doi-asserted-by":"publisher","first-page":"871","DOI":"10.1093\/aje\/kwf113","volume":"156","author":"DE Bild","year":"2002","unstructured":"Bild, D. E. et al. Multi-ethnic study of atherosclerosis: objectives and design. Am. J. Epidemiol. 156, 871\u2013881 (2002).","journal-title":"Am. J. Epidemiol."},{"key":"460_CR34","doi-asserted-by":"crossref","unstructured":"Grundy, S. M. et al. 2018 AHA\/ACC\/AACVPR\/AAPA\/ABC\/ACPM\/ADA\/AGS\/APhA\/ASPC\/NLA\/PCNA Guideline on the management of blood cholesterol. Circulation CIR0000000000000625 (2018).","DOI":"10.1016\/j.jacc.2018.11.003"},{"key":"460_CR35","doi-asserted-by":"publisher","first-page":"434","DOI":"10.1016\/j.jacc.2018.05.027","volume":"72","author":"P Greenland","year":"2018","unstructured":"Greenland, P., Blaha, M. J., Budoff, M. J., Erbel, R. & Watson, K. E. Coronary calcium score and cardiovascular risk. J. Am. Coll. Cardiol. 72, 434\u2013447 (2018).","journal-title":"J. Am. Coll. Cardiol."},{"key":"460_CR36","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1001\/jama.2018.8359","volume":"320","author":"USPST Force","year":"2018","unstructured":"Force, U. S. P. S. T. et al. Risk assessment for cardiovascular disease with nontraditional risk factors: US preventive services task force recommendation statement. JAMA 320, 272\u2013280 (2018).","journal-title":"JAMA"},{"key":"460_CR37","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1001\/jama.2018.4242","volume":"320","author":"JS Lin","year":"2018","unstructured":"Lin, J. S. et al. Nontraditional risk factors in cardiovascular disease risk assessment: updated evidence report and systematic review for the US preventive services task force. JAMA 320, 281\u2013297 (2018).","journal-title":"JAMA"},{"key":"460_CR38","doi-asserted-by":"publisher","first-page":"3233","DOI":"10.1016\/j.jacc.2018.09.051","volume":"72","author":"JD Mitchell","year":"2018","unstructured":"Mitchell, J. D. et al. Impact of statins on cardiovascular outcomes following coronary artery calcium scoring. J. Am. Coll. Cardiol. 72, 3233\u20133242 (2018).","journal-title":"J. Am. Coll. Cardiol."},{"key":"460_CR39","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1007\/s10278-011-9370-5","volume":"24","author":"R Mezrich","year":"2011","unstructured":"Mezrich, R., Juluru, K. & Nagy, P. Should post-processing be performed by the radiologist? J. Digit Imaging 24, 378\u2013381 (2011).","journal-title":"J. Digit Imaging"},{"key":"460_CR40","doi-asserted-by":"publisher","first-page":"1799","DOI":"10.1148\/rg.2018180058","volume":"38","author":"TS Cook","year":"2018","unstructured":"Cook, T. S., Steingall, S. J., Steingall, S. R. & Boonn, W. W. Establishing and running a three-dimensional and advanced imaging laboratory. Radiographics 38, 1799\u20131809 (2018).","journal-title":"Radiographics"},{"key":"460_CR41","doi-asserted-by":"crossref","unstructured":"de Vos, B. D. et al. Direct automatic coronary calcium scoring in cardiac and chest CT. IEEE Trans. Med. Imaging 38, 2127\u20132138 (2019).","DOI":"10.1109\/TMI.2019.2899534"},{"key":"460_CR42","doi-asserted-by":"publisher","first-page":"e67","DOI":"10.1161\/CIR.0000000000000558","volume":"137","author":"EJ Benjamin","year":"2018","unstructured":"Benjamin, E. J. et al. Heart disease and stroke statistics-2018 update: a report from the American Heart Association. Circulation 137, e67\u2013e492 (2018).","journal-title":"Circulation"},{"key":"460_CR43","first-page":"e38","volume":"133","author":"Writing Group, M.","year":"2016","unstructured":"Writing Group, M. et al. Heart disease and stroke statistics-2016 update: a report from the American Heart Association. Circulation 133, e38\u2013e360 (2016).","journal-title":"Circulation"},{"key":"460_CR44","doi-asserted-by":"publisher","first-page":"833","DOI":"10.1016\/j.jcmg.2017.01.030","volume":"10","author":"A Gupta","year":"2017","unstructured":"Gupta, A. et al. The identification of calcified coronary plaque is associated with initiation and continuation of pharmacological and lifestyle preventive therapies: a systematic review and meta-analysis. JACC Cardiovasc. Imaging 10, 833\u2013842 (2017).","journal-title":"JACC Cardiovasc. Imaging"},{"key":"460_CR45","doi-asserted-by":"publisher","first-page":"1622","DOI":"10.1016\/j.jacc.2011.01.019","volume":"57","author":"A Rozanski","year":"2011","unstructured":"Rozanski, A. et al. Impact of coronary artery calcium scanning on coronary risk factors and downstream testing the EISNER (early identification of subclinical atherosclerosis by noninvasive imaging research) prospective randomized trial. J. Am. Coll. Cardiol. 57, 1622\u20131632 (2011).","journal-title":"J. Am. Coll. Cardiol."},{"key":"460_CR46","doi-asserted-by":"publisher","first-page":"2437","DOI":"10.1161\/CIRCULATIONAHA.118.036835","volume":"138","author":"MJ Budoff","year":"2018","unstructured":"Budoff, M. J. et al. Coronary artery calcium on noncontrast thoracic computerized tomography scans and all-cause mortality. Circulation 138, 2437\u20132438 (2018).","journal-title":"Circulation"},{"key":"460_CR47","doi-asserted-by":"publisher","first-page":"e7531","DOI":"10.1097\/MD.0000000000007531","volume":"96","author":"F Secchi","year":"2017","unstructured":"Secchi, F. et al. Detection of incidental cardiac findings in noncardiac chest computed tomography. Medicine (Baltim.) 96, e7531 (2017).","journal-title":"Medicine (Baltim.)"},{"key":"460_CR48","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1002\/clc.22685","volume":"40","author":"R Balakrishnan","year":"2017","unstructured":"Balakrishnan, R. et al. Coronary artery calcification is common on nongated chest computed tomography imaging. Clin. Cardiol. 40, 498\u2013502 (2017).","journal-title":"Clin. Cardiol."},{"key":"460_CR49","doi-asserted-by":"crossref","unstructured":"Lessmann, N., et al. Deep convolutional neural networks for automatic coronary calcium scoring in a screening study with low-dose chest CT, (SPIE, 2016).","DOI":"10.1117\/12.2216978"},{"key":"460_CR50","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1161\/CIRCIMAGING.113.000092","volume":"6","author":"X Xie","year":"2013","unstructured":"Xie, X. et al. Validation and prognosis of coronary artery calcium scoring in nontriggered thoracic computed tomography: systematic review and meta-analysis. Circ. Cardiovasc Imaging 6, 514\u2013521 (2013).","journal-title":"Circ. Cardiovasc Imaging"},{"key":"460_CR51","doi-asserted-by":"publisher","first-page":"917","DOI":"10.2214\/AJR.07.2979","volume":"190","author":"SM Kim","year":"2008","unstructured":"Kim, S. M. et al. Coronary calcium screening using low-dose lung cancer screening: effectiveness of MDCT with retrospective reconstruction. AJR Am. J. Roentgenol. 190, 917\u2013922 (2008).","journal-title":"AJR Am. J. Roentgenol."},{"key":"460_CR52","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/j.jcct.2010.11.002","volume":"5","author":"MJ Budoff","year":"2011","unstructured":"Budoff, M. J. et al. Coronary artery and thoracic calcium on noncontrast thoracic CT scans: comparison of ungated and gated examinations in patients from the COPD Gene cohort. J. Cardiovasc. Comput Tomogr. 5, 113\u2013118 (2011).","journal-title":"J. Cardiovasc. Comput Tomogr."},{"key":"460_CR53","doi-asserted-by":"publisher","first-page":"1244","DOI":"10.2214\/AJR.09.3047","volume":"194","author":"PC Jacobs","year":"2010","unstructured":"Jacobs, P. C. et al. Coronary artery calcification scoring in low-dose ungated CT screening for lung cancer: interscan agreement. AJR Am. J. Roentgenol. 194, 1244\u20131249 (2010).","journal-title":"AJR Am. J. Roentgenol."},{"key":"460_CR54","doi-asserted-by":"publisher","first-page":"923","DOI":"10.2214\/AJR.07.2974","volume":"190","author":"MT Wu","year":"2008","unstructured":"Wu, M. T. et al. Coronary arterial calcification on low-dose ungated MDCT for lung cancer screening: concordance study with dedicated cardiac CT. AJR Am. J. Roentgenol. 190, 923\u2013928 (2008).","journal-title":"AJR Am. J. Roentgenol."},{"key":"460_CR55","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1016\/j.atherosclerosis.2009.09.031","volume":"209","author":"PC Jacobs","year":"2010","unstructured":"Jacobs, P. C. et al. Comparing coronary artery calcium and thoracic aorta calcium for prediction of all-cause mortality and cardiovascular events on low-dose non-gated computed tomography in a high-risk population of heavy smokers. Atherosclerosis 209, 455\u2013462 (2010).","journal-title":"Atherosclerosis"},{"key":"460_CR56","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.jacr.2013.09.021","volume":"11","author":"JP Earls","year":"2014","unstructured":"Earls, J. P. et al. ACR appropriateness criteria asymptomatic patient at risk for coronary artery disease. J. Am. Coll. Radio. 11, 12\u201319 (2014).","journal-title":"J. Am. Coll. Radio."},{"key":"460_CR57","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.jcct.2011.02.001","volume":"5","author":"CS White","year":"2011","unstructured":"White, C. S. & Jerome, S. Coronary calcium scoring on nongated chest CT: is it ready for prime time? J. Cardiovasc Comput Tomogr. 5, 119\u2013121 (2011).","journal-title":"J. Cardiovasc Comput Tomogr."},{"key":"460_CR58","doi-asserted-by":"publisher","first-page":"1495","DOI":"10.1148\/rg.275075045","volume":"27","author":"M Mahesh","year":"2007","unstructured":"Mahesh, M. & Cody, D. D. Physics of cardiac imaging with multiple-row detector CT. Radiographics 27, 1495\u20131509 (2007).","journal-title":"Radiographics"},{"key":"460_CR59","doi-asserted-by":"publisher","first-page":"2064","DOI":"10.1148\/rg.2016160079","volume":"36","author":"K Kalisz","year":"2016","unstructured":"Kalisz, K. et al. Artifacts at cardiac CT: physics and solutions. Radiographics 36, 2064\u20132083 (2016).","journal-title":"Radiographics"},{"key":"460_CR60","doi-asserted-by":"publisher","first-page":"810","DOI":"10.1148\/radiol.2363040039","volume":"236","author":"J Shemesh","year":"2005","unstructured":"Shemesh, J. et al. Coronary artery calcium measurement with multi-detector row CT and low radiation dose: comparison between 55 and 165 mAs. Radiology 236, 810\u2013814 (2005).","journal-title":"Radiology"},{"key":"460_CR61","doi-asserted-by":"publisher","first-page":"777","DOI":"10.2214\/AJR.11.7577","volume":"199","author":"PA de Jong","year":"2012","unstructured":"de Jong, P. A., Leiner, T., Lammers, J. W. & Gietema, H. A. Can low-dose unenhanced chest CT be used for follow-up of lung nodules? AJR Am. J. Roentgenol. 199, 777\u2013780 (2012).","journal-title":"AJR Am. J. Roentgenol."},{"key":"460_CR62","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1148\/radiol.2432050808","volume":"243","author":"CH McCollough","year":"2007","unstructured":"McCollough, C. H. et al. Coronary artery calcium: a multi-institutional, multimanufacturer international standard for quantification at cardiac CT. Radiology 243, 527\u2013538 (2007).","journal-title":"Radiology"},{"key":"460_CR63","doi-asserted-by":"publisher","first-page":"1231","DOI":"10.1016\/j.jacc.2012.12.035","volume":"61","author":"MJ Budoff","year":"2013","unstructured":"Budoff, M. J. et al. Progression of coronary calcium and incident coronary heart disease events: MESA (multi-ethnic study of atherosclerosis). J. Am. Coll. Cardiol. 61, 1231\u20131239 (2013).","journal-title":"J. Am. Coll. Cardiol."},{"key":"460_CR64","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1161\/01.HYP.0000164575.16609.02","volume":"46","author":"P Raggi","year":"2005","unstructured":"Raggi, P., Cooil, B., Ratti, C., Callister, T. Q. & Budoff, M. Progression of coronary artery calcium and occurrence of myocardial infarction in patients with and without diabetes mellitus. Hypertension 46, 238\u2013243 (2005).","journal-title":"Hypertension"},{"key":"460_CR65","doi-asserted-by":"publisher","first-page":"923","DOI":"10.1016\/j.jcmg.2017.05.007","volume":"10","author":"MJ Blaha","year":"2017","unstructured":"Blaha, M. J., Mortensen, M. B., Kianoush, S., Tota-Maharaj, R. & Cainzos-Achirica, M. Coronary artery calcium scoring: is it time for a change in methodology? JACC Cardiovasc Imaging 10, 923\u2013937 (2017).","journal-title":"JACC Cardiovasc Imaging"},{"key":"460_CR66","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L. & Sun, G. Squeeze-and-excitation networks. in Proceedings of the IEEE conference on computer vision and pattern recognition 7132\u20137141 (2018).","DOI":"10.1109\/CVPR.2018.00745"},{"key":"460_CR67","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky, O. et al. Imagenet large scale visual recognition challenge. Int. J. computer Vis. 115, 211\u2013252 (2015).","journal-title":"Int. J. computer Vis."},{"key":"460_CR68","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. in International Conference on Medical Image Computing and Computer-Assisted Intervention 234\u2013241 (Springer, 2015).","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"460_CR69","unstructured":"Li, M., Yumer, E. & Ramanan, D. Budgeted training: rethinking deep neural network training under resource constraints. arXiv. arXiv:1905.04753. Preprint at https:\/\/arxiv.org\/abs\/1905.04753 (2019)."},{"key":"460_CR70","unstructured":"Loshchilov, I. & Hutter, F. SGDR: stochastic gradient descent with warm restarts. arXiv. arXiv:1608.03983. Preprint at https:\/\/arxiv.org\/abs\/1608.03983 (2016)."},{"key":"460_CR71","doi-asserted-by":"crossref","unstructured":"Sudre, C. H., Li, W., Vercauteren, T., Ourselin, S. & Cardoso, M. J. Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. in Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, 240\u2013248 (Springer, 2017).","DOI":"10.1007\/978-3-319-67558-9_28"},{"key":"460_CR72","doi-asserted-by":"crossref","unstructured":"Milletari, F., Navab, N. & Ahmadi, S.-A. V-net: Fully convolutional neural networks for volumetric medical image segmentation. in 2016 Fourth International Conference on 3D Vision (3DV) 565-571 (IEEE, 2016).","DOI":"10.1109\/3DV.2016.79"},{"key":"460_CR73","doi-asserted-by":"publisher","first-page":"141","DOI":"10.11613\/BM.2015.015","volume":"25","author":"D Giavarina","year":"2015","unstructured":"Giavarina, D. Understanding Bland Altman analysis. Biochem. Med. (Zagreb) 25, 141\u2013151 (2015).","journal-title":"Biochem. Med. (Zagreb)"},{"key":"460_CR74","doi-asserted-by":"publisher","first-page":"243","DOI":"10.4065\/74.3.243","volume":"74","author":"JA Rumberger","year":"1999","unstructured":"Rumberger, J. A., Brundage, B. H., Rader, D. J. & Kondos, G. Electron beam computed tomographic coronary calcium scanning: a review and guidelines for use in asymptomatic persons. Mayo Clin. Proc. 74, 243\u2013252 (1999).","journal-title":"Mayo Clin. Proc."},{"key":"460_CR75","doi-asserted-by":"publisher","first-page":"1299","DOI":"10.2214\/AJR.09.3734","volume":"195","author":"N van der Bijl","year":"2010","unstructured":"van der Bijl, N. et al. Assessment of Agatston coronary artery calcium score using contrast-enhanced CT coronary angiography. AJR Am. J. Roentgenol. 195, 1299\u20131305 (2010).","journal-title":"AJR Am. J. Roentgenol."},{"key":"460_CR76","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis, J. R. & Koch, G. G. The measurement of observer agreement for categorical data. Biometrics 33, 159\u2013174 (1977).","journal-title":"Biometrics"},{"key":"460_CR77","unstructured":"Chen, L.-C., Papandreou, G., Schroff, F. & Adam, H. Rethinking atrous convolution semantic image segmentation. arXiv. arXiv 1706, 05587. Preprint at https:\/\/arxiv.org\/abs\/1706.05587 (2017)."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00460-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00460-1","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00460-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,4]],"date-time":"2023-02-04T04:55:00Z","timestamp":1675486500000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00460-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,1]]},"references-count":77,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["460"],"URL":"https:\/\/doi.org\/10.1038\/s41746-021-00460-1","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,1]]},"assertion":[{"value":"7 October 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 April 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 June 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors had control of the data and the information submitted for publication. Two of the authors (D.E. and N.K.) are employees of Bunkerhill, which facilitated the external validation at the four sites who were part of the research consortium. Two authors (C.L. and M.L.) are shareholders of Bunkerhill. Otherwise, there are no competing financial and\/or non-financial interests in relation to the work described. No funding for research support was provided for this study. Part of this work is the result of work supported with resources and the use of facilities at the VA Palo Alto Health Care System, Palo Alto, California.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"88"}}