{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,6]],"date-time":"2026-11-06T14:31:29Z","timestamp":1793975489418,"version":"4.8.0"},"reference-count":71,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,1,25]],"date-time":"2023-01-25T00:00:00Z","timestamp":1674604800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,25]],"date-time":"2023-01-25T00:00:00Z","timestamp":1674604800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["HHSN268201800007I"],"award-info":[{"award-number":["HHSN268201800007I"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Multivariate longitudinal data are under-utilized for survival analysis compared to cross-sectional data (CS - data collected once across cohort). Particularly in cardiovascular risk prediction, despite available methods of longitudinal data analysis, the value of longitudinal information has not been established in terms of improved predictive accuracy and clinical applicability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We investigated the value of longitudinal data over and above the use of cross-sectional data via 6 distinct modeling strategies from statistics, machine learning, and deep learning that incorporate repeated measures for survival analysis of the time-to-cardiovascular event in the Coronary Artery Risk Development in Young Adults (CARDIA) cohort. We then examined and compared the use of model-specific interpretability methods (Random Survival Forest Variable Importance) and model-agnostic methods (SHapley Additive exPlanation (SHAP) and Temporal Importance Model Explanation (TIME)) in cardiovascular risk prediction using the top-performing models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>In a cohort of 3539 participants, longitudinal information from 35 variables that were repeatedly collected in 6 exam visits over 15 years improved subsequent long-term (17 years after) risk prediction by up to 8.3% in C-index compared to using baseline data (0.78 vs. 0.72), and up to approximately 4% compared to using the last observed CS data (0.75). Time-varying AUC was also higher in models using longitudinal data (0.86\u20130.87 at 5 years, 0.79\u20130.81 at 10 years) than using baseline or last observed CS data (0.80\u20130.86 at 5 years, 0.73\u20130.77 at 10 years). Comparative model interpretability analysis revealed the impact of longitudinal variables on model prediction on both the individual and global scales among different modeling strategies, as well as identifying the best time windows and best timing within that window for event prediction. The best strategy to incorporate longitudinal data for accuracy was time series massive feature extraction, and the easiest interpretable strategy was trajectory clustering.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Our analysis demonstrates the added value of longitudinal data in predictive accuracy and epidemiological utility in cardiovascular risk survival analysis in young adults via a unified, scalable framework that compares model performance and explainability. The framework can be extended to a larger number of variables and other longitudinal modeling methods.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Trial registration<\/jats:title>\n                    <jats:p>ClinicalTrials.gov Identifier: NCT00005130, Registration Date: 26\/05\/2000.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12874-023-01845-4","type":"journal-article","created":{"date-parts":[[2023,1,25]],"date-time":"2023-01-25T08:03:33Z","timestamp":1674633813000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Multivariate longitudinal data for survival analysis of cardiovascular event prediction in young adults: insights from a comparative explainable study"],"prefix":"10.1186","volume":"23","author":[{"given":"Hieu T.","family":"Nguyen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Henrique D.","family":"Vasconcellos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kimberley","family":"Keck","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jared P.","family":"Reis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cora E.","family":"Lewis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven","family":"Sidney","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Donald M.","family":"Lloyd-Jones","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pamela J.","family":"Schreiner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eliseo","family":"Guallar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Colin O.","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jo\u00e3o A.C.","family":"Lima","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bharath","family":"Ambale-Venkatesh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,1,25]]},"reference":[{"issue":"1","key":"1845_CR1","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1093\/jamia\/ocw042","volume":"24","author":"BA Goldstein","year":"2017","unstructured":"Goldstein BA, Navar AM, Pencina MJ, Ioannidis J. Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J Am Med Inform Assoc. 2017;24(1):198\u2013208.","journal-title":"J Am Med Inform Assoc"},{"issue":"8","key":"1845_CR2","doi-asserted-by":"publisher","first-page":"1299","DOI":"10.1002\/sim.6754","volume":"35","author":"L Yang","year":"2016","unstructured":"Yang L, Yu M, Gao S. Prediction of coronary artery disease risk based on multiple longitudinal biomarkers. Stat Med. 2016;35(8):1299\u2013314.","journal-title":"Stat Med"},{"issue":"7","key":"1845_CR3","doi-asserted-by":"publisher","first-page":"1520","DOI":"10.1093\/aje\/kwx386","volume":"187","author":"RG Miller","year":"2018","unstructured":"Miller RG, Anderson SJ, Costacou T, Sekikawa A, Orchard TJ. Hemoglobin A1c level and cardiovascular disease incidence in persons with type 1 diabetes: an application of joint modeling of longitudinal and time-to-event data in the Pittsburgh Epidemiology of Diabetes Complications Study. Am J Epidemiol. 2018;187(7):1520\u20139.","journal-title":"Am J Epidemiol"},{"issue":"5","key":"1845_CR4","doi-asserted-by":"publisher","first-page":"490","DOI":"10.1001\/jama.2013.285122","volume":"311","author":"NB Allen","year":"2014","unstructured":"Allen NB, Siddique J, Wilkins JT, Shay C, Lewis CE, Goff DC, Jacobs DR, Liu K, Lloyd-Jones D. Blood pressure trajectories in early adulthood and subclinical atherosclerosis in middle age. JAMA. 2014;311(5):490\u20137.","journal-title":"JAMA"},{"issue":"28","key":"1845_CR5","doi-asserted-by":"publisher","first-page":"4514","DOI":"10.1002\/sim.7144","volume":"36","author":"MJ Sweeting","year":"2017","unstructured":"Sweeting MJ, Barrett JK, Thompson SG, Wood AM. The use of repeated blood pressure measures for cardiovascular risk prediction: a comparison of statistical models in the ARIC study. Stat Med. 2017;36(28):4514\u201328.","journal-title":"Stat Med"},{"issue":"12","key":"1845_CR6","doi-asserted-by":"publisher","first-page":"e012129","DOI":"10.1161\/JAHA.119.012129","volume":"8","author":"JR Ayala Solares","year":"2019","unstructured":"Ayala Solares JR, Canoy D, Raimondi FED, Zhu Y, Hassaine A, Salimi-Khorshidi G, Tran J, Copland E, Zottoli M, Pinho\u2010Gomes AC. Long\u2010term exposure to elevated systolic blood pressure in predicting incident cardiovascular disease: evidence from large\u2010scale routine electronic health records. J Am Heart Association. 2019;8(12):e012129.","journal-title":"J Am Heart Association"},{"issue":"8","key":"1845_CR7","doi-asserted-by":"publisher","first-page":"899","DOI":"10.1093\/aje\/kwx149","volume":"186","author":"E Paige","year":"2017","unstructured":"Paige E, Barrett J, Pennells L, Sweeting M, Willeit P, Di Angelantonio E, Gudnason V, Nordestgaard BG, Psaty BM, Goldbourt U. Use of repeated blood pressure and cholesterol measurements to improve cardiovascular disease risk prediction: an individual-participant-data meta-analysis. Am J Epidemiol. 2017;186(8):899\u2013907.","journal-title":"Am J Epidemiol"},{"key":"1845_CR8","first-page":"e596","volume":"140","author":"A American Heart","year":"2019","unstructured":"American Heart A. Guideline on the primary prevention of cardiovascular disease. Circulation. 2019;140:e596\u2013e646.","journal-title":"Circulation"},{"key":"1845_CR9","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1146\/annurev-statistics-030718-105048","volume":"6","author":"G Papageorgiou","year":"2019","unstructured":"Papageorgiou G, Mauff K, Tomer A, Rizopoulos D. An overview of joint modeling of time-to-event and longitudinal outcomes. Annual Rev Stat its application. 2019;6:223\u201340.","journal-title":"Annual Rev Stat its application"},{"issue":"1","key":"1845_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-016-0212-5","volume":"16","author":"GL Hickey","year":"2016","unstructured":"Hickey GL, Philipson P, Jorgensen A, Kolamunnage-Dona R. Joint modelling of time-to-event and multivariate longitudinal outcomes: recent developments and issues. BMC Med Res Methodol. 2016;16(1):1\u201315.","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"1845_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-021-01472-x","volume":"21","author":"D Stevens","year":"2021","unstructured":"Stevens D, Lane DA, Harrison SL, Lip GYH, Kolamunnage-Dona R. Modelling of longitudinal data to predict cardiovascular disease risk: a methodological review. BMC Med Res Methodol. 2021;21(1):1\u201324.","journal-title":"BMC Med Res Methodol"},{"issue":"1","key":"1845_CR12","doi-asserted-by":"publisher","first-page":"e22","DOI":"10.2196\/jmir.9268","volume":"20","author":"C Ye","year":"2018","unstructured":"Ye C, Fu T, Hao S, Zhang Y, Wang O, Jin B, Xia M, Liu M, Zhou X, Wu Q. Prediction of incident hypertension within the next year: prospective study using statewide electronic health records and machine learning. J Med Internet Res. 2018;20(1):e22.","journal-title":"J Med Internet Res"},{"issue":"1","key":"1845_CR13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-37186-2","volume":"9","author":"J Zhao","year":"2019","unstructured":"Zhao J, Feng Q, Wu P, Lupu RA, Wilke RA, Wells QS, Denny JC, Wei W-Q. Learning from longitudinal data in electronic health record and genetic data to improve cardiovascular event prediction. Sci Rep. 2019;9(1):1\u201310.","journal-title":"Sci Rep"},{"issue":"2","key":"1845_CR14","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1016\/j.ijcard.2013.12.031","volume":"171","author":"J Myers","year":"2014","unstructured":"Myers J, De Souza CR, Borghi-Silva A, Guazzi M, Chase P, Bensimhon D, Peberdy MA, Ashley E, West E, Cahalin LP. A neural network approach to predicting outcomes in heart failure using cardiopulmonary exercise testing. Int J Cardiol. 2014;171(2):265\u20139.","journal-title":"Int J Cardiol"},{"issue":"4","key":"1845_CR15","doi-asserted-by":"publisher","first-page":"e0174944","DOI":"10.1371\/journal.pone.0174944","volume":"12","author":"SF Weng","year":"2017","unstructured":"Weng SF, Reps J, Kai J, Garibaldi JM, Qureshi N. Can machine-learning improve cardiovascular risk prediction using routine clinical data? PLoS ONE. 2017;12(4):e0174944.","journal-title":"PLoS ONE"},{"issue":"9","key":"1845_CR16","doi-asserted-by":"publisher","first-page":"1092","DOI":"10.1161\/CIRCRESAHA.117.311312","volume":"121","author":"B Ambale-Venkatesh","year":"2017","unstructured":"Ambale-Venkatesh B, Yang X, Wu CO, Liu K, Hundley WG, McClelland R, Gomes AS, Folsom AR, Shea S, Guallar E. Cardiovascular event prediction by machine learning: the multi-ethnic study of atherosclerosis. Circul Res. 2017;121(9):1092\u2013101.","journal-title":"Circul Res"},{"issue":"6","key":"1845_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3214306","volume":"51","author":"P Wang","year":"2019","unstructured":"Wang P, Li Y, Reddy CK. Machine learning for survival analysis: a survey. ACM Comput Surv (CSUR). 2019;51(6):1\u201336.","journal-title":"ACM Comput Surv (CSUR)"},{"key":"1845_CR18","doi-asserted-by":"crossref","unstructured":"Zheng P, Yuan S, Wu X. Safe: A neural survival analysis model for fraud early detection. In: 2019:1278\u20131285.","DOI":"10.1609\/aaai.v33i01.33011278"},{"issue":"3","key":"1845_CR19","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1214\/08-AOAS169","volume":"2","author":"H Ishwaran","year":"2008","unstructured":"Ishwaran H, Kogalur UB, Blackstone EH, Lauer MS. Random survival forests. The annals of applied statistics. 2008;2(3):841\u201360.","journal-title":"The annals of applied statistics"},{"issue":"1","key":"1845_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-018-0482-1","volume":"18","author":"JL Katzman","year":"2018","unstructured":"Katzman JL, Shaham U, Cloninger A, Bates J, Jiang T, Kluger Y. DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network. BMC Med Res Methodol. 2018;18(1):1\u201312.","journal-title":"BMC Med Res Methodol"},{"key":"1845_CR21","doi-asserted-by":"publisher","first-page":"e6257","DOI":"10.7717\/peerj.6257","volume":"7","author":"MF Gensheimer","year":"2019","unstructured":"Gensheimer MF, Narasimhan B. A scalable discrete-time survival model for neural networks. Peer J. 2019;7:e6257.","journal-title":"Peer J"},{"issue":"1","key":"1845_CR22","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1109\/TBME.2019.2909027","volume":"67","author":"C Lee","year":"2019","unstructured":"Lee C, Yoon J, Van Der Schaar M. Dynamic-deephit: a deep learning approach for dynamic survival analysis with competing risks based on longitudinal data. IEEE Trans Biomed Eng. 2019;67(1):122\u201333.","journal-title":"IEEE Trans Biomed Eng"},{"key":"1845_CR23","doi-asserted-by":"crossref","unstructured":"Jarrett D, Yoon J, van der Schaar M. Dynamic prediction in clinical survival analysis using temporal convolutional networks. IEEE J Biomed Health Inform. 2019;24(2):424\u201336.","DOI":"10.1109\/JBHI.2019.2929264"},{"issue":"1","key":"1845_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41512-020-00078-z","volume":"4","author":"LM Bull","year":"2020","unstructured":"Bull LM, Lunt M, Martin GP, Hyrich K, Sergeant JC. Harnessing repeated measurements of predictor variables for clinical risk prediction: a review of existing methods. Diagn prognostic Res. 2020;4(1):1\u201316.","journal-title":"Diagn prognostic Res"},{"issue":"1","key":"1845_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-019-0847-0","volume":"19","author":"JDJ Plate","year":"2019","unstructured":"Plate JDJ, van de Leur RR, Leenen LPH, Hietbrink F, Peelen LM, Eijkemans MJC. Incorporating repeated measurements into prediction models in the critical care setting: a framework, systematic review and meta-analysis. BMC Med Res Methodol. 2019;19(1):1\u201311.","journal-title":"BMC Med Res Methodol"},{"key":"1845_CR26","first-page":"799","volume":"33","author":"S Tonekaboni","year":"2020","unstructured":"Tonekaboni S, Joshi S, Campbell K, Duvenaud DK, Goldenberg A. What went wrong and when? Instance-wise feature importance for time series black-box models. Adv Neural Inf Process Syst. 2020;33:799\u2013809.","journal-title":"Adv Neural Inf Process Syst"},{"issue":"11","key":"1845_CR27","doi-asserted-by":"publisher","first-page":"1105","DOI":"10.1016\/0895-4356(88)90080-7","volume":"41","author":"GD Friedman","year":"1988","unstructured":"Friedman GD, Cutter GR, Donahue RP, Hughes GH, Hulley SB, Jacobs DR Jr, Liu K, Savage PJ. CARDIA: study design, recruitment, and some characteristics of the examined participants. J Clin Epidemiol. 1988;41(11):1105\u201316.","journal-title":"J Clin Epidemiol"},{"issue":"12","key":"1845_CR28","doi-asserted-by":"publisher","first-page":"1179","DOI":"10.1056\/NEJMoa0807265","volume":"360","author":"K Bibbins-Domingo","year":"2009","unstructured":"Bibbins-Domingo K, Pletcher MJ, Lin F, Vittinghoff E, Gardin JM, Arynchyn A, Lewis CE, Williams OD, Hulley SB. Racial differences in incident heart failure among young adults. N Engl J Med. 2009;360(12):1179\u201390.","journal-title":"N Engl J Med"},{"issue":"2","key":"1845_CR29","doi-asserted-by":"publisher","first-page":"350","DOI":"10.1016\/j.ijcard.2014.01.003","volume":"172","author":"AC Armstrong","year":"2014","unstructured":"Armstrong AC, Jacobs DR Jr, Gidding SS, Colangelo LA, Gjesdal O, Lewis CE, Bibbins-Domingo K, Sidney S, Schreiner PJ, Williams OD. Framingham score and LV mass predict events in young adults: CARDIA study. Int J Cardiol. 2014;172(2):350\u20135.","journal-title":"Int J Cardiol"},{"issue":"83","key":"1845_CR30","doi-asserted-by":"publisher","first-page":"20130048","DOI":"10.1098\/rsif.2013.0048","volume":"10","author":"BD Fulcher","year":"2013","unstructured":"Fulcher BD, Little MA, Jones NS. Highly comparative time series analysis: the empirical structure of time series and their methods. J Royal Soc Interface. 2013;10(83):20130048.","journal-title":"J Royal Soc Interface"},{"key":"1845_CR31","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1016\/j.neucom.2018.03.067","volume":"307","author":"M Christ","year":"2018","unstructured":"Christ M, Braun N, Neuffer J, Kempa-Liehr AW. Time series feature extraction on basis of scalable hypothesis tests (tsfresh\u2013a python package). Neurocomputing. 2018;307:72\u20137.","journal-title":"Neurocomputing"},{"issue":"5","key":"1845_CR32","doi-asserted-by":"publisher","first-page":"1211","DOI":"10.1161\/HYPERTENSIONAHA.121.17555","volume":"78","author":"N Morikawa","year":"2021","unstructured":"Morikawa N, Bancks MP, Yano Y, Kuwabara M, Gaffo AL, Duprez DA, Gross MD, Jacobs DR Jr. Serum urate trajectory in young adulthood and incident cardiovascular disease events by middle age: CARDIA study. Hypertension. 2021;78(5):1211\u20138.","journal-title":"Hypertension"},{"issue":"10","key":"1845_CR33","doi-asserted-by":"publisher","first-page":"e003934","DOI":"10.1161\/JAHA.116.003934","volume":"5","author":"VL Murthy","year":"2016","unstructured":"Murthy VL, Abbasi SA, Siddique J, Colangelo LA, Reis J, Venkatesh BA, Carr JJ, Terry JG, Camhi SM, Jerosch-Herold M. Transitions in metabolic risk and long\u2010term cardiovascular health: coronary artery risk development in young adults (CARDIA) study. J Am Heart Association. 2016;5(10):e003934.","journal-title":"J Am Heart Association"},{"key":"1845_CR34","unstructured":"Sylvestre M-P, Vatnik D, Vatnik MD. Package \u2018traj\u2019. 2014."},{"issue":"10","key":"1845_CR35","doi-asserted-by":"publisher","first-page":"1049","DOI":"10.1016\/j.jclinepi.2004.02.012","volume":"57","author":"K Leffondr\u00e9","year":"2004","unstructured":"Leffondr\u00e9 K, Abrahamowicz M, Regeasse A, Hawker GA, Badley EM, McCusker J, Belzile E. Statistical measures were proposed for identifying longitudinal patterns of change in quantitative health indicators. J Clin Epidemiol. 2004;57(10):1049\u201362.","journal-title":"J Clin Epidemiol"},{"issue":"3","key":"1845_CR36","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1177\/0049124101029003005","volume":"29","author":"BL Jones","year":"2001","unstructured":"Jones BL, Nagin DS, Roeder K. A SAS procedure based on mixture models for estimating developmental trajectories. Sociol methods Res. 2001;29(3):374\u201393.","journal-title":"Sociol methods Res"},{"key":"1845_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v061.i06","volume":"61","author":"M Charrad","year":"2014","unstructured":"Charrad M, Ghazzali N, Boiteau V, Niknafs A. NbClust: an R package for determining the relevant number of clusters in a data set. J Stat Softw. 2014;61:1\u201336.","journal-title":"J Stat Softw"},{"issue":"6","key":"1845_CR38","doi-asserted-by":"publisher","first-page":"1865","DOI":"10.1016\/0016-5085(93)91086-W","volume":"105","author":"E Christensen","year":"1993","unstructured":"Christensen E, Altman DG, Neuberger J, De Stavola BL, Tygstrup N, Williams R, The PBC, Groups PBCT. Updating prognosis in primary biliary cirrhosis using a time-dependent Cox regression model. Gastroenterology. 1993;105(6):1865\u201376.","journal-title":"Gastroenterology"},{"issue":"17","key":"1845_CR39","doi-asserted-by":"publisher","first-page":"2750","DOI":"10.1002\/sim.7308","volume":"36","author":"BA Goldstein","year":"2017","unstructured":"Goldstein BA, Pomann GM, Winkelmayer WC, Pencina MJ. A comparison of risk prediction methods using repeated observations: an application to electronic health records for hemodialysis. Stat Med. 2017;36(17):2750\u201363.","journal-title":"Stat Med"},{"issue":"1","key":"1845_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41512-018-0024-7","volume":"2","author":"M Welten","year":"2018","unstructured":"Welten M, de Kroon MLA, Renders CM, Steyerberg EW, Raat H, Twisk JWR, Heymans MW. Repeatedly measured predictors: a comparison of methods for prediction modeling. Diagn prognostic Res. 2018;2(1):1\u201310.","journal-title":"Diagn prognostic Res"},{"issue":"1","key":"1845_CR41","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1109\/TASSP.1978.1163055","volume":"26","author":"H Sakoe","year":"1978","unstructured":"Sakoe H, Chiba S. Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust Speech Signal Process. 1978;26(1):43\u20139.","journal-title":"IEEE Trans Acoust Speech Signal Process"},{"key":"1845_CR42","unstructured":"Rizopoulos D. The R package JMbayes for fitting joint models for longitudinal and time-to-event data using MCMC.arXiv preprint arXiv:140476252014."},{"issue":"3","key":"1845_CR43","doi-asserted-by":"publisher","first-page":"725","DOI":"10.1111\/biom.12628","volume":"73","author":"CJ Liang","year":"2017","unstructured":"Liang CJ, Heagerty PJ. A risk-based measure of time\u2010varying prognostic discrimination for survival models. Biometrics. 2017;73(3):725\u201334.","journal-title":"Biometrics"},{"issue":"13","key":"1845_CR44","doi-asserted-by":"publisher","first-page":"2173","DOI":"10.1002\/sim.5681","volume":"32","author":"TA Gerds","year":"2013","unstructured":"Gerds TA, Kattan MW, Schumacher M, Yu C. Estimating a time-dependent concordance index for survival prediction models with covariate dependent censoring. Stat Med. 2013;32(13):2173\u201384.","journal-title":"Stat Med"},{"issue":"1","key":"1845_CR45","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1097\/EDE.0b013e3181c30fb2","volume":"21","author":"EW Steyerberg","year":"2010","unstructured":"Steyerberg EW, Vickers AJ, Cook NR, Gerds T, Gonen M, Obuchowski N, Pencina MJ, Kattan MW. Assessing the performance of prediction models: a framework for some traditional and novel measures. Epidemiol (Cambridge Mass). 2010;21(1):128.","journal-title":"Epidemiol (Cambridge Mass)"},{"issue":"4","key":"1845_CR46","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1002\/(SICI)1097-0258(19960229)15:4<361::AID-SIM168>3.0.CO;2-4","volume":"15","author":"FE Harrell Jr","year":"1996","unstructured":"Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361\u201387.","journal-title":"Stat Med"},{"issue":"1","key":"1845_CR47","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1111\/j.0006-341X.2005.030814.x","volume":"61","author":"PJ Heagerty","year":"2005","unstructured":"Heagerty PJ, Zheng Y. Survival model predictive accuracy and ROC curves. Biometrics. 2005;61(1):92\u2013105.","journal-title":"Biometrics"},{"issue":"2","key":"1845_CR48","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1093\/biostatistics\/kxy006","volume":"20","author":"P Blanche","year":"2019","unstructured":"Blanche P, Kattan MW, Gerds TA. The c-index is not proper for the evaluation of-year predicted risks. Biostatistics. 2019;20(2):347\u201357.","journal-title":"Biostatistics"},{"issue":"1","key":"1845_CR49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12864-019-6413-7","volume":"21","author":"D Chicco","year":"2020","unstructured":"Chicco D, Jurman G. The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genomics. 2020;21(1):1\u201313.","journal-title":"BMC Genomics"},{"issue":"30","key":"1845_CR50","doi-asserted-by":"publisher","first-page":"5381","DOI":"10.1002\/sim.5958","volume":"32","author":"P Blanche","year":"2013","unstructured":"Blanche P, Dartigues JF, Jacqmin-Gadda H. Estimating and comparing time\u2010dependent areas under receiver operating characteristic curves for censored event times with competing risks. Stat Med. 2013;32(30):5381\u201397.","journal-title":"Stat Med"},{"issue":"478","key":"1845_CR51","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1198\/016214507000000149","volume":"102","author":"H Uno","year":"2007","unstructured":"Uno H, Cai T, Tian L, Wei L-J. Evaluating prediction rules for t-year survivors with censored regression models. J Am Stat Assoc. 2007;102(478):527\u201337.","journal-title":"J Am Stat Assoc"},{"issue":"4","key":"1845_CR52","doi-asserted-by":"publisher","first-page":"558","DOI":"10.1002\/sim.7803","volume":"38","author":"H Ishwaran","year":"2019","unstructured":"Ishwaran H, Lu M. Standard errors and confidence intervals for variable importance in random forest regression, classification, and survival. Stat Med. 2019;38(4):558\u201382.","journal-title":"Stat Med"},{"key":"1845_CR53","unstructured":"Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Adv Neural Information Process Syst.\u00a02017;30:4768\u201377."},{"key":"1845_CR54","doi-asserted-by":"crossref","unstructured":"Sood A, Craven M. Feature Importance Explanations for Temporal Black-Box Models. arXiv preprint arXiv:210211934 2021.","DOI":"10.1609\/aaai.v36i8.20810"},{"issue":"1","key":"1845_CR55","doi-asserted-by":"publisher","first-page":"101015","DOI":"10.1016\/j.accpm.2021.101015","volume":"41","author":"HB Kim","year":"2022","unstructured":"Kim HB, Nguyen HT, Jin Q, Tamby S, Romer TG, Sung E, Liu R, Greenstein JL, Suarez JI, Storm C. Computational signatures for post-cardiac arrest trajectory prediction: importance of early physiological time series. Anaesth Crit Care Pain Med. 2022;41(1):101015.","journal-title":"Anaesth Crit Care Pain Med"},{"issue":"9","key":"1845_CR56","doi-asserted-by":"publisher","first-page":"e332","DOI":"10.1097\/PCC.0000000000000560","volume":"16","author":"CE Kennedy","year":"2015","unstructured":"Kennedy CE, Aoki N, Mariscalco M, Turley JP. Using time series analysis to predict cardiac arrest in a pediatric intensive care unit. Pediatr Crit care medicine: J Soc Crit Care Med World Federation Pediatr Intensive Crit Care Soc. 2015;16(9):e332.","journal-title":"Pediatr Crit care medicine: J Soc Crit Care Med World Federation Pediatr Intensive Crit Care Soc"},{"issue":"4","key":"1845_CR57","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1007\/s10985-017-9409-0","volume":"24","author":"Y Huang","year":"2018","unstructured":"Huang Y, Lu X, Chen J, Liang J, Zangmeister M. Joint model-based clustering of nonlinear longitudinal trajectories and associated time-to-event data analysis, linked by latent class membership: with application to AIDS clinical studies. Lifetime Data Anal. 2018;24(4):699\u2013718.","journal-title":"Lifetime Data Anal"},{"issue":"6","key":"1845_CR58","doi-asserted-by":"publisher","first-page":"1261","DOI":"10.1002\/bimj.201600238","volume":"59","author":"D Rizopoulos","year":"2017","unstructured":"Rizopoulos D, Molenberghs G, Lesaffre EMEH. Dynamic predictions with time-dependent covariates in survival analysis using joint modeling and landmarking. Biom J. 2017;59(6):1261\u201376.","journal-title":"Biom J"},{"issue":"1","key":"1845_CR59","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1161\/CIRCULATIONAHA.110.002774","volume":"125","author":"N Allen","year":"2012","unstructured":"Allen N, Berry JD, Ning H, Van Horn L, Dyer A, Lloyd-Jones DM. Impact of blood pressure and blood pressure change during middle age on the remaining lifetime risk for cardiovascular disease: the cardiovascular lifetime risk pooling project. Circulation. 2012;125(1):37\u201344.","journal-title":"Circulation"},{"issue":"24","key":"1845_CR60","doi-asserted-by":"publisher","first-page":"e019946","DOI":"10.1161\/JAHA.121.019946","volume":"10","author":"LM Raffield","year":"2021","unstructured":"Raffield LM, Howard AG, Graff M, Lin DY, Cheng S, Demerath E, Ndumele C, Palta P, Rebholz CM, Seidelmann S. Obesity duration, severity, and distribution Trajectories and Cardiovascular Disease Risk in the atherosclerosis risk in Communities Study. J Am Heart Association. 2021;10(24):e019946.","journal-title":"J Am Heart Association"},{"issue":"1","key":"1845_CR61","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-022-01540-w","volume":"22","author":"E Stenwig","year":"2022","unstructured":"Stenwig E, Salvi G, Rossi PS, Skj\u00e6rvold NK. Comparative analysis of explainable machine learning prediction models for hospital mortality. BMC Med Res Methodol. 2022;22(1):1\u201314.","journal-title":"BMC Med Res Methodol"},{"key":"1845_CR62","first-page":"6441","volume":"33","author":"AA Ismail","year":"2020","unstructured":"Ismail AA, Gunady M, Corrada Bravo H, Feizi S. Benchmarking deep learning interpretability in time series predictions. Adv Neural Inf Process Syst. 2020;33:6441\u201352.","journal-title":"Adv Neural Inf Process Syst"},{"key":"1845_CR63","doi-asserted-by":"publisher","first-page":"103876","DOI":"10.1016\/j.jbi.2021.103876","volume":"121","author":"I Gandin","year":"2021","unstructured":"Gandin I, Scagnetto A, Romani S, Barbati G. Interpretability of time series deep learning models: a study in cardiovascular patients admitted to intensive care unit. J Biomed Inform. 2021;121:103876.","journal-title":"J Biomed Inform"},{"key":"1845_CR64","doi-asserted-by":"publisher","first-page":"103672","DOI":"10.1016\/j.jbi.2021.103672","volume":"114","author":"LV Ho","year":"2021","unstructured":"Ho LV, Aczon M, Ledbetter D, Wetzel R. Interpreting a recurrent neural network\u2019s predictions of ICU mortality risk. J Biomed Inform. 2021;114:103672.","journal-title":"J Biomed Inform"},{"key":"1845_CR65","doi-asserted-by":"crossref","unstructured":"Song H, Rajan D, Thiagarajan JJ, Spanias A. Attend and diagnose: Clinical time series analysis using attention models. In: 2018.","DOI":"10.1609\/aaai.v32i1.11635"},{"key":"1845_CR66","unstructured":"Rooke C, Smith J, Leung KK, Volkovs M, Zuberi S. Temporal Dependencies in Feature Importance for Time Series Predictions.arXiv preprint arXiv:2107143172021."},{"issue":"8","key":"1845_CR67","doi-asserted-by":"publisher","first-page":"766","DOI":"10.1080\/10641963.2018.1557677","volume":"41","author":"S Kim","year":"2019","unstructured":"Kim S, Lee SJ, Kim Y-H, Kim J-S, Lim S-Y, Kim SH, Ahn J-C, Song W-H, Jee SH, Park CG. Irreversible effects of long-term chronic smoking on arterial stiffness: an analysis focusing on ex-smokers among otherwise healthy middle-aged men. Clin Exp Hypertens. 2019;41(8):766\u201373.","journal-title":"Clin Exp Hypertens"},{"issue":"1\u20132","key":"1845_CR68","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/j.cca.2005.12.030","volume":"368","author":"J Constans","year":"2006","unstructured":"Constans J, Conri C. Circulating markers of endothelial function in cardiovascular disease. Clin Chim Acta. 2006;368(1\u20132):33\u201347.","journal-title":"Clin Chim Acta"},{"issue":"32","key":"1845_CR69","doi-asserted-by":"publisher","first-page":"2459","DOI":"10.1093\/eurheartj\/ehx144","volume":"38","author":"BA Ference","year":"2017","unstructured":"Ference BA, Ginsberg HN, Graham I, Ray KK, Packard CJ, Bruckert E, Hegele RA, Krauss RM, Raal FJ, Schunkert H. Low-density lipoproteins cause atherosclerotic cardiovascular disease. 1. Evidence from genetic, epidemiologic, and clinical studies. A consensus statement from the european atherosclerosis Society Consensus Panel. Eur Heart J. 2017;38(32):2459\u201372.","journal-title":"Eur Heart J"},{"issue":"1","key":"1845_CR70","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1177\/0962280212445839","volume":"23","author":"C Proust-Lima","year":"2014","unstructured":"Proust-Lima C, S\u00e9ne M, Taylor JMG, Jacqmin-Gadda H. Joint latent class models for longitudinal and time-to-event data: a review. Stat Methods Med Res. 2014;23(1):74\u201390.","journal-title":"Stat Methods Med Res"},{"issue":"1","key":"1845_CR71","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-018-0502-1","volume":"18","author":"GL Hickey","year":"2018","unstructured":"Hickey GL, Philipson P, Jorgensen A, Kolamunnage-Dona R. joineRML: a joint model and software package for time-to-event and multivariate longitudinal outcomes. BMC Med Res Methodol. 2018;18(1):1\u201314.","journal-title":"BMC Med Res Methodol"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-023-01845-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-023-01845-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-023-01845-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,25]],"date-time":"2023-01-25T09:03:30Z","timestamp":1674637410000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-023-01845-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,25]]},"references-count":71,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["1845"],"URL":"https:\/\/doi.org\/10.1186\/s12874-023-01845-4","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2082433\/v1","asserted-by":"object"}]},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,25]]},"assertion":[{"value":"19 September 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 January 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 January 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Institutional Review Board approval was obtained for the overall CARDIA study at all sites (Northwestern University, University of Alabama Birmingham, University of Minnesota, and Kaiser Foundation Research Institute). Written informed consent was obtained from all subjects and\/or their legal guardian(s). All methods were performed in accordance with the relevant guidelines and regulations.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"23"}}