{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,6]],"date-time":"2025-07-06T05:10:09Z","timestamp":1751778609483,"version":"3.41.0"},"reference-count":19,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2018,8,28]],"date-time":"2018-08-28T00:00:00Z","timestamp":1535414400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/academic.oup.com\/journals\/pages\/about_us\/legal\/notices"}],"funder":[{"DOI":"10.13039\/100000050","name":"National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["N01-HC-25195","HHSN268201500001I"],"award-info":[{"award-number":["N01-HC-25195","HHSN268201500001I"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>It is unclear to what extent simulated versions of real data can be used to assess potential value of new biomarkers added to prognostic risk models. Using data on 4522 women and 3969 men who contributed information to the Framingham CVD risk prediction tool, we develop a simulation model that allows assessment of the added contribution of new biomarkers. The simulated model matches closely the one obtained using real data: discrimination area under the curve (AUC) on simulated vs actual data is 0.800 vs 0.799 in women and 0.778 vs 0.776 in men. Positive correlation with standard risk factors decreases the impact of new biomarkers (\u0394AUC 0.002-0.024), but negative correlation leads to stronger effects (\u0394AUC 0.026-0.101) than no correlation (\u0394AUC 0.003-0.051). We suggest that researchers construct simulation models similar to the one proposed here before embarking on larger, expensive biomarker studies based on actual data.<\/jats:p>","DOI":"10.1093\/jamia\/ocy108","type":"journal-article","created":{"date-parts":[[2018,8,1]],"date-time":"2018-08-01T19:13:34Z","timestamp":1533150814000},"page":"1382-1385","source":"Crossref","is-referenced-by-count":2,"title":["Microsimulation model to predict incremental value of biomarkers added to prognostic models"],"prefix":"10.1093","volume":"25","author":[{"given":"Karol M","family":"Pencina","sequence":"first","affiliation":[{"name":"Department of Medicine, Brigham and Women\u2019s Hospital, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ralph B","family":"D\u2019Agostino","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Statistics, Boston University, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ramachandran S","family":"Vasan","sequence":"additional","affiliation":[{"name":"Department of Medicine, Boston University School of Medicine, Boston, Massachusetts, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael J","family":"Pencina","sequence":"additional","affiliation":[{"name":"Duke University School of Medicine, Department of Biostatistics and Bioinformatics, Duke Clinical Research Institute, Durham, North Carolina, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2018,8,28]]},"reference":[{"issue":"17","key":"2020110612235955300_ocy108-B1","doi-asserted-by":"crossref","first-page":"2408","DOI":"10.1161\/CIRCULATIONAHA.109.192278","article-title":"Criteria for evaluation of novel cardiovascular risk: a scientific statement from the American Heart Association","volume":"119","author":"Hlatky","year":"2009","journal-title":"Circulation"},{"issue":"3","key":"2020110612235955300_ocy108-B2","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1111\/j.1751-5823.2011.00153.x","article-title":"Towards unrestricted public use business microdata: the synthetic Longitudinal Business Database","volume":"79","author":"Kinney","year":"2011","journal-title":"Int Stat Rev"},{"issue":"6","key":"2020110612235955300_ocy108-B3","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1161\/CIRCULATIONAHA.107.699579","article-title":"General cardiovascular risk profile for use in primary care","volume":"117","author":"D\u2019Agostino","year":"2008","journal-title":"Circulation"},{"key":"2020110612235955300_ocy108-B4","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1111\/j.2517-6161.1964.tb00553.x","article-title":"An analysis of transformations","volume":"26","author":"Box","year":"1964","journal-title":"J R Stat Soc Ser B"},{"year":"2014","author":"Hershberger","key":"2020110612235955300_ocy108-B5"},{"year":"2014","author":"Kornbrot","key":"2020110612235955300_ocy108-B6"},{"volume-title":"Statistical Power Analysis for the Behavioral Sciences","year":"1988","author":"Cohen","key":"2020110612235955300_ocy108-B7"},{"issue":"4","key":"2020110612235955300_ocy108-B8","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1002\/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4","article-title":"Tutorial in biostatistics: multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors","volume":"15","author":"Harrell","year":"1996","journal-title":"Stat Med"},{"issue":"2","key":"2020110612235955300_ocy108-B9","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1002\/sim.2929","article-title":"Evaluating the added predictive ability of a new marker: from area under the ROC curve to reclassification and beyond","volume":"27","author":"Pencina","year":"2008","journal-title":"Stat Med"},{"issue":"6","key":"2020110612235955300_ocy108-B10","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1093\/aje\/kws207","article-title":"Interpreting incremental value of markers added to risk prediction models","volume":"176","author":"Pencina","year":"2012","journal-title":"Am J Epidemiol"},{"year":"2006","author":"Dwork","key":"2020110612235955300_ocy108-B11"},{"issue":"24","key":"2020110612235955300_ocy108-B12","doi-asserted-by":"crossref","first-page":"4196","DOI":"10.1002\/sim.5824","article-title":"Impact of correlation on predictive ability of biomarkers","volume":"32","author":"Demler","year":"2013","journal-title":"Stat Med"},{"issue":"23","key":"2020110612235955300_ocy108-B13","doi-asserted-by":"crossref","first-page":"2532","DOI":"10.1001\/jama.2016.5951","article-title":"Development and validation of a protein-based risk score for cardiovascular outcomes among patients with stable coronary heart disease","volume":"315","author":"Ganz","year":"2016","journal-title":"JAMA"},{"issue":"2","key":"2020110612235955300_ocy108-B14","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1161\/CIRCOUTCOMES.108.831198","article-title":"C-reactive protein and reclassification of cardiovascular risk in the Framingham Heart Study","volume":"1","author":"Wilson","year":"2008","journal-title":"Circ Cardiovasc Qual Outcomes"},{"issue":"6","key":"2020110612235955300_ocy108-B15","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1001\/jama.297.6.611","article-title":"Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds risk score","volume":"297","author":"Ridker","year":"2007","journal-title":"JAMA"},{"issue":"22","key":"2020110612235955300_ocy108-B16","doi-asserted-by":"crossref","first-page":"2243","DOI":"10.1161\/CIRCULATIONAHA.108.814251","article-title":"The Reynolds risk score for men","volume":"118","author":"Ridker","year":"2008","journal-title":"Circulation"},{"issue":"14","key":"2020110612235955300_ocy108-B17","doi-asserted-by":"crossref","first-page":"1310","DOI":"10.1056\/NEJMoa1107477","article-title":"C-reactive protein, fibrinogen, and cardiovascular disease prediction","volume":"367","author":"The Emerging Risk Factors Collaboration","year":"2012","journal-title":"N Engl J Med"},{"issue":"19","key":"2020110612235955300_ocy108-B18","doi-asserted-by":"crossref","first-page":"2375","DOI":"10.1093\/eurheartj\/ehm316","article-title":"European guidelines on cardiovascular disease prevention in clinical practice: executive summary","volume":"28","author":"Graham","year":"2007","journal-title":"Eur Heart J"},{"issue":"11","key":"2020110612235955300_ocy108-B19","doi-asserted-by":"crossref","first-page":"1877","DOI":"10.1002\/sim.5736","article-title":"When does combining markers improve classification performance and what are implications for practice?","volume":"32","author":"Bansal","year":"2013","journal-title":"Stat Med"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/10\/1382\/34150837\/ocy108.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/25\/10\/1382\/34150837\/ocy108.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,6]],"date-time":"2025-07-06T04:50:21Z","timestamp":1751777421000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/25\/10\/1382\/5085864"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,28]]},"references-count":19,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2018,8,28]]},"published-print":{"date-parts":[[2018,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocy108","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"type":"print","value":"1067-5027"},{"type":"electronic","value":"1527-974X"}],"subject":[],"published-other":{"date-parts":[[2018,10]]},"published":{"date-parts":[[2018,8,28]]}}}