{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:25:40Z","timestamp":1772166340919,"version":"3.50.1"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T00:00:00Z","timestamp":1747094400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T00:00:00Z","timestamp":1747094400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BioData Mining"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Over the past decade an increase in usage of electronic health data (EHR) by office-based physicians and hospitals has been reported. However, these data types come with challenge regarding completeness and data quality and it is, especially for more complex models, unclear how these characteristics influence the performance.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>In this paper, we focus on joint models which combines longitudinal modelling with survival modelling to incorporate all available information. The aim of this paper is to establish simulation-based guidelines for the necessary quality of longitudinal EHR data so that joint models perform better than cox models. We conducted an extensive simulation study by systematically and transparently varying different characteristics of data quality, e.g., measurement frequency, noise, and heterogeneity between patients. We apply the joint models and evaluate their performance relative to traditional Cox survival modelling techniques.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Key findings suggest that biomarker changes before disease onset must be consistent within similar patient groups. With increasing noise and a higher measurement density, the joint model surpasses the traditional Cox regression model in terms of model performance. We illustrate the usefulness and limitations of the guidelines with two real-world examples, namely the influence of serum bilirubin on primary biliary liver cirrhosis and the influence of the estimated glomerular filtration rate on chronic kidney disease.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s13040-025-00450-z","type":"journal-article","created":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T02:32:57Z","timestamp":1747103577000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Joint models in big data: simulation-based guidelines for required data quality in longitudinal electronic health records"],"prefix":"10.1186","volume":"18","author":[{"given":"Berit","family":"Hunsdieck","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian","family":"Bender","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katja","family":"Ickstadt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johanna","family":"Mielke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,5,13]]},"reference":[{"issue":"3","key":"450_CR1","doi-asserted-by":"publisher","first-page":"819","DOI":"10.1111\/j.1541-0420.2010.01546.x","volume":"67","author":"D Rizopoulos","year":"2011","unstructured":"Rizopoulos D. Dynamic Predictions and Prospective Accuracy in Joint Models for Longitudinal and Time-to-Event Data. Biometrics. 2011;67(3):819\u201329. https:\/\/doi.org\/10.1111\/j.1541-0420.2010.01546.x.","journal-title":"Biometrics."},{"issue":"5","key":"450_CR2","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1093\/fampra\/cmx055","volume":"34","author":"JF Scherrer","year":"2017","unstructured":"Scherrer JF, Pace WD. Will electronic health record data become the standard resource for clinical research? Fam Pract. 2017;34(5):505\u20137. https:\/\/doi.org\/10.1093\/fampra\/cmx055.","journal-title":"Fam Pract."},{"issue":"3","key":"450_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0033182","volume":"7","author":"D Zhang","year":"2012","unstructured":"Zhang D, Shen D, Initiative ADN. Predicting Future Clinical Changes of MCI Patients Using Longitudinal and Multimodal Biomarkers. PLOS ONE. 2012;7(3):1\u201315. https:\/\/doi.org\/10.1371\/journal.pone.0033182.","journal-title":"PLOS ONE."},{"key":"450_CR4","unstructured":"Tsiatis AA, Davidian M. Joint modeling of longitudinal and time-to-event data: an overview. Stat Sin. 2004;14(3):809\u201334."},{"key":"450_CR5","doi-asserted-by":"publisher","first-page":"2796","DOI":"10.1200\/JCO.2009.25.0654","volume":"3","author":"JG Ibrahim","year":"2010","unstructured":"Ibrahim JG, Chu H, Chen LM. Basic Concepts and Methods for Joint Models of Longitudinal and Survival Data. J Clin Oncol. 2010;3:2796\u2013801.","journal-title":"J Clin Oncol."},{"issue":"5","key":"450_CR6","doi-asserted-by":"publisher","first-page":"473","DOI":"10.1370\/afm.1441","volume":"10","author":"J Meiman","year":"2012","unstructured":"Meiman J, Freund JE. Large data sets in primary care research. Ann Fam Med. 2012;10(5):473\u20134. https:\/\/doi.org\/10.1370\/afm.1441.","journal-title":"Ann Fam Med."},{"key":"450_CR7","first-page":"1","volume":"2010","author":"T Botsis","year":"2010","unstructured":"Botsis T, Hartvigsen G, Chen F, Weng C. Secondary Use of EHR: Data Quality Issues and Informatics Opportunities. Summit Transl Bioinforma. 2010;2010:1\u20135.","journal-title":"Summit Transl Bioinforma."},{"key":"450_CR8","doi-asserted-by":"crossref","unstructured":"Therneau TM, Grambsch PM, Therneau TM, Grambsch PM. The cox model.\u00a0New York: Springer; 2000.","DOI":"10.1007\/978-1-4757-3294-8_3"},{"issue":"2","key":"450_CR9","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1002\/sim.4405","volume":"31","author":"PS Albert","year":"2012","unstructured":"Albert PS. A linear mixed model for predicting a binary event from longitudinal data under random effects misspecification. Stat Med. 2012;31(2):143\u201354.","journal-title":"Stat Med."},{"issue":"3","key":"450_CR10","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1111\/j.1365-3016.2012.01261.x","volume":"26","author":"J Zhang","year":"2012","unstructured":"Zhang J, Kim S, Grewal J, Albert PS. Predicting large fetuses at birth: do multiple ultrasound examinations and longitudinal statistical modelling improve prediction? Paediatr Perinatal Epidemiol. 2012;26(3):199\u2013207.","journal-title":"Paediatr Perinatal Epidemiol."},{"key":"450_CR11","unstructured":"Pinheiro J, Bates D, R Core Team. nlme: Linear and Nonlinear Mixed Effects Models. 2022. R package version 3.1-157. https:\/\/CRAN.R-project.org\/package=nlme. Accessed\u00a0 2 Dec 2024."},{"key":"450_CR12","unstructured":"Therneau TM. A Package for Survival Analysis in R. 2022. R package version 3.3-1. https:\/\/CRAN.R-project.org\/package=survival.\u00a0Accessed\u00a0 2 Dec 2024."},{"key":"450_CR13","doi-asserted-by":"publisher","unstructured":"Rizopoulos D. The R Package JMbayes for Fitting Joint Models for Longitudinal and Time-to-Event Data Using MCMC. J Stat Softw. 2016;72(7). https:\/\/doi.org\/10.18637\/jss.v072.i07.","DOI":"10.18637\/jss.v072.i07"},{"issue":"2","key":"450_CR14","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1093\/biostatistics\/kxad019","volume":"25","author":"D Rustand","year":"2024","unstructured":"Rustand D, Van Niekerk J, Krainski ET, Rue H, Proust-Lima C. Fast and flexible inference for joint models of multivariate longitudinal and survival data using integrated nested Laplace approximations. Biostatistics. 2024;25(2):429\u201348.","journal-title":"Biostatistics."},{"key":"450_CR15","unstructured":"Rizopoulos D, Papageorgiou G, Miranda Afonso P. JMbayes2: Extended Joint Models for Longitudinal and Time-to-Event Data. 2024. https:\/\/github.com\/drizopoulos\/JMbayes2.\u00a0Accessed\u00a0 2 Dec 2024."},{"issue":"10","key":"450_CR16","doi-asserted-by":"publisher","first-page":"1697","DOI":"10.3348\/kjr.2021.0223","volume":"22","author":"SY Park","year":"2021","unstructured":"Park SY, Park JE, Kim H, Park SH. Review of statistical methods for evaluating the performance of survival or other time-to-event prediction models (from conventional to deep learning approaches). Korean J Radiol. 2021;22(10):1697.","journal-title":"Korean J Radiol."},{"issue":"8","key":"450_CR17","doi-asserted-by":"publisher","first-page":"2359","DOI":"10.1177\/0962280216680245","volume":"27","author":"AR Brentnall","year":"2018","unstructured":"Brentnall AR, Cuzick J. Use of the concordance index for predictors of censored survival data. Stat Methods Med Res. 2018;27(8):2359\u201373.","journal-title":"Stat Methods Med Res."},{"key":"450_CR18","unstructured":"R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria. 2022. https:\/\/www.R-project.org\/.\u00a0Accessed\u00a0 2 Dec 2024."},{"key":"450_CR19","unstructured":"Wickham H, Fran\u00e7ois R, Henry L, M\u00fcller K, Vaughan D. dplyr: A Grammar of Data Manipulation. 2023. R package version 1.1.4. https:\/\/CRAN.R-project.org\/package=dplyr.\u00a0Accessed\u00a0 2 Dec 2024."},{"key":"450_CR20","unstructured":"Wickham H. ggplot2: Elegant Graphics for Data Analysis. Springer; 2016. https:\/\/ggplot2.tidyverse.org.\u00a0Accessed\u00a0 2 Dec 2024."},{"key":"450_CR21","unstructured":"Pedersen TL. patchwork: The Composer of Plots. 2024. R package version 1.2.0. https:\/\/CRAN.R-project.org\/package=patchwork.\u00a0Accessed\u00a0 2 Dec 2024."},{"key":"450_CR22","unstructured":"Wickham H, Henry L. purrr: Functional Programming Tools. 2023. R package version 1.0.2. https:\/\/CRAN.R-project.org\/package=purrr.\u00a0Accessed\u00a0 2 Dec 2024."},{"key":"450_CR23","unstructured":"Wickham H, Vaughan D, Girlich M. tidyr: Tidy Messy Data. 2024. R package version 1.3.1. https:\/\/CRAN.R-project.org\/package=tidyr.\u00a0Accessed\u00a0 2 Dec 2024."},{"issue":"8","key":"450_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v042.i08","volume":"42","author":"DE Ho","year":"2011","unstructured":"Ho DE, Imai K, King G, Stuart EA. MatchIt: Nonparametric Preprocessing for Parametric Causal Inference. J Stat Softw. 2011;42(8):1\u20138. https:\/\/doi.org\/10.18637\/jss.v042.i08.","journal-title":"J Stat Softw."},{"issue":"2","key":"450_CR25","doi-asserted-by":"publisher","first-page":"e0149283","DOI":"10.1371\/journal.pone.0149283","volume":"11","author":"Y Xie","year":"2016","unstructured":"Xie Y, Bowe B, Xian H, Balasubramanian S, Al-Aly Z. Renal function trajectories in patients with prior improved eGFR slopes and risk of death. PloS ONE. 2016;11(2):e0149283.","journal-title":"PloS ONE."},{"key":"450_CR26","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3294-8","volume-title":"Modeling Survival Data: Extending the Cox Model","author":"TM Therneau","year":"2000","unstructured":"Therneau TM, Grambsch PM. Modeling Survival Data: Extending the Cox Model. New York: Springer; 2000."},{"issue":"1","key":"450_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/hep.1840100102","volume":"10","author":"ER Dickson","year":"1989","unstructured":"Dickson ER, Grambsch PM, Fleming TR, Fisher LD, Langworthy A. Prognosis in primary biliary cirrhosis: model for decision making. Hepatology. 1989;10(1):1\u20137.","journal-title":"Hepatology."},{"issue":"26","key":"450_CR28","doi-asserted-by":"publisher","first-page":"1709","DOI":"10.1056\/NEJM198906293202602","volume":"320","author":"BH Markus","year":"1989","unstructured":"Markus BH, Dickson ER, Grambsch PM, Fleming TR, Mazzaferro V, Klintmalm GBG, et al. Efficacy of liver transplantation in patients with primary biliary cirrhosis. N Engl J Med. 1989;320(26):1709\u201313.","journal-title":"N Engl J Med."},{"issue":"4","key":"450_CR29","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1053\/j.ajkd.2016.07.030","volume":"69","author":"N Tangri","year":"2017","unstructured":"Tangri N, Inker LA, Hiebert B, Wong J, Naimark D, Kent D, et al. A Dynamic Predictive Model for Progression of CKD. Am J Kidney Dis. 2017;69(4):514\u201320. https:\/\/doi.org\/10.1053\/j.ajkd.2016.07.030.","journal-title":"Am J Kidney Dis."},{"issue":"11","key":"450_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pmed.1001344","volume":"9","author":"JB Echouffo-Tcheugui","year":"2012","unstructured":"Echouffo-Tcheugui JB, Kengne AP. Risk Models to Predict Chronic Kidney Disease and Its Progression: A Systematic Review. PLOS Med. 2012;9(11):1\u201318. https:\/\/doi.org\/10.1371\/journal.pmed.1001344.","journal-title":"PLOS Med."},{"issue":"12","key":"450_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0275816","volume":"17","author":"O Stroganov","year":"2022","unstructured":"Stroganov O, Fedarovich A, Wong E, Skovpen Y, Pakhomova E, Grishagin I, et al. Mapping of UK Biobank clinical codes: Challenges and possible solutions. PLoS ONE. 2022;17(12):1\u201315. https:\/\/doi.org\/10.1371\/journal.pone.0275816.","journal-title":"PLoS ONE."},{"key":"450_CR32","unstructured":"Office\u00a0of\u00a0the\u00a0National\u00a0Coordinator\u00a0for\u00a0Health\u00a0Information\u00a0Technology. National trends in hospital and physician adoption of electronic health records.\u00a0HealthIT. gov. 2022.\u00a0"},{"issue":"14","key":"450_CR33","doi-asserted-by":"publisher","first-page":"2181","DOI":"10.1002\/sim.6141","volume":"34","author":"A Lawrence\u00a0Gould","year":"2015","unstructured":"Lawrence\u00a0Gould A, Boye ME, Crowther MJ, Ibrahim JG, Quartey G, Micallef S, et al. Joint modeling of survival and longitudinal non-survival data: current methods and issues. Report of the DIA Bayesian joint modeling working group. Stat Med. 2015;34(14):2181\u201395. https:\/\/doi.org\/10.1002\/sim.6141.","journal-title":"Stat Med."},{"issue":"3","key":"450_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pmed.1001779","volume":"12","author":"C Sudlow","year":"2015","unstructured":"Sudlow C, Gallacher J, Allen N, Beral V, Burton P, Danesh J, et al. UK Biobank: An Open Access Resource for Identifying the Causes of a Wide Range of Complex Diseases of Middle and Old Age. PLOS Med. 2015;12(3):1\u201310. https:\/\/doi.org\/10.1371\/journal.pmed.1001779.","journal-title":"PLOS Med."},{"key":"450_CR35","unstructured":"Center VUM. BioVU: The Vanderbilt University Medical Center Biobank. victr.vumc.org\/biovu-description\/. Accessed 19 Nov 2024."},{"key":"450_CR36","unstructured":"Singapore PHR. PRECISE. https:\/\/www.npm.sg\/. Accessed 19 Nov 2024."},{"issue":"1","key":"450_CR37","doi-asserted-by":"publisher","first-page":"2534","DOI":"10.1038\/s41467-025-56625-z","volume":"16","author":"J Qiu","year":"2025","unstructured":"Qiu J, Hu Y, Li L, Erzurumluoglu AM, Braenne I, Whitehurst C, et al. Deep representation learning for clustering longitudinal survival data from electronic health records. Nat Commun. 2025;16(1):2534.","journal-title":"Nat Commun."},{"key":"450_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v065.i04","volume":"65","author":"C Genolini","year":"2015","unstructured":"Genolini C, Alacoque X, Sentenac M, Arnaud C. kml and kml3d: R packages to cluster longitudinal data. J Stat Softw. 2015;65:1\u201334.","journal-title":"J Stat Softw."},{"issue":"8","key":"450_CR39","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1513\/pats.200809-100TH","volume":"5","author":"T Walser","year":"2008","unstructured":"Walser T, Cui X, Yanagawa J, Lee J, Heinrich E, Lee G, et al. Smoking and lung cancer: the role of inflammation. Proc Am Thorac Soc. 2008;5(8):811\u20135. https:\/\/doi.org\/10.1513\/pats.200809-100TH.","journal-title":"Proc Am Thorac Soc"},{"issue":"1","key":"450_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i01","volume":"67","author":"D Bates","year":"2015","unstructured":"Bates D, M\u00e4chler M, Bolker B, Walker S. Fitting Linear Mixed-Effects Models Using lme4. J Stat Softw. 2015;67(1):1\u201348. https:\/\/doi.org\/10.18637\/jss.v067.i01.","journal-title":"J Stat Softw."},{"issue":"9","key":"450_CR41","doi-asserted-by":"publisher","first-page":"604","DOI":"10.7326\/0003-4819-150-9-200905050-00006","volume":"150","author":"AS Levey","year":"2009","unstructured":"Levey AS, Stevens LA, Schmid CH, Zhang Y, Castro AF III, Feldman HI, et al. A new equation to estimate glomerular filtration rate. Ann Intern Med. 2009;150(9):604\u201312.","journal-title":"Ann Intern Med."},{"key":"450_CR42","doi-asserted-by":"crossref","unstructured":"Vafaei N, Ribeiro RA, Camarinha-Matos LM. Comparison of Normalization Techniques on Data Sets With Outliers. Int J Decis Support Syst Technol (IJDSST). 2022;14(1):1\u201317.","DOI":"10.4018\/IJDSST.286184"}],"container-title":["BioData Mining"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13040-025-00450-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13040-025-00450-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13040-025-00450-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T02:33:12Z","timestamp":1747103592000},"score":1,"resource":{"primary":{"URL":"https:\/\/biodatamining.biomedcentral.com\/articles\/10.1186\/s13040-025-00450-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,13]]},"references-count":42,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["450"],"URL":"https:\/\/doi.org\/10.1186\/s13040-025-00450-z","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-6031358\/v1","asserted-by":"object"}]},"ISSN":["1756-0381"],"issn-type":[{"value":"1756-0381","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,13]]},"assertion":[{"value":"14 February 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 May 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 May 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Data obtained from the UK Biobank received ethical approval from the North West Multi-Centre Research Ethics Committee (MREC). All participants provided informed consent to participate in the study and for their data to be used for research purposes.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Berit Hunsdieck, Christian Bender, and Johanna Mielke are employees of Bayer AG.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"35"}}