{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,1]],"date-time":"2026-09-01T14:37:49Z","timestamp":1788273469223,"version":"build-2803163510"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T00:00:00Z","timestamp":1658448000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T00:00:00Z","timestamp":1658448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>In recent years there is increasing interest in modeling the effect of early longitudinal biomarker data on future time-to-event or other outcomes. Sometimes investigators are also interested in knowing whether the variability of biomarkers is independently predictive of clinical outcomes. This question in most applications is addressed via a two-stage approach where summary statistics such as variance are calculated in the first stage and then used in models as covariates to predict clinical outcome in the second stage. The objective of this study is to compare the relative performance of various methods in estimating the effect of biomarker variability.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A joint model and 4 different two-stage approaches (na\u00efve, landmark analysis, time-dependent Cox model, and regression calibration) were illustrated using data from a large multi-center randomized phase III trial, the Ocular Hypertension Treatment Study (OHTS), regarding the association between the variability of intraocular pressure (IOP) and the development of primary open-angle glaucoma (POAG). The model performance was also evaluated in terms of bias using simulated data from the joint model of longitudinal IOP and time to POAG. The parameters for simulation were chosen after OHTS data, and the association between longitudinal and survival data was introduced via underlying, unobserved, and error-free parameters including subject-specific variance.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>In the OHTS data, joint modeling and two-stage methods reached consistent conclusion that IOP variability showed no significant association with the risk of POAG. In the simulated data with no association between IOP variability and time-to-POAG, all the two-stage methods (except the na\u00efve approach) provided a reliable estimation. When a moderate effect of IOP variability on POAG was imposed, all the two-stage methods underestimated the true association as compared with the joint modeling while the model-based two-stage method (regression calibration) resulted in the least bias.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Regression calibration and joint modelling are the preferred methods in assessing the effect of biomarker variability. Two-stage methods with sample-based measures should be used with caution unless there exists a relatively long series of longitudinal measurements and\/or strong effect size (NCT00000125).<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12874-022-01686-7","type":"journal-article","created":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T15:02:55Z","timestamp":1658502175000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Comparing statistical methods in assessing the prognostic effect of biomarker variability on time-to-event clinical outcomes"],"prefix":"10.1186","volume":"22","author":[{"given":"Feng","family":"Gao","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingqin","family":"Luo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingxia","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fei","family":"Wan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guoqiao","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mae","family":"Gordon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengjie","family":"Xiong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,7,22]]},"reference":[{"issue":"5","key":"1686_CR1","doi-asserted-by":"publisher","first-page":"1327","DOI":"10.1093\/ije\/dyt157","volume":"42","author":"YK Tu","year":"2013","unstructured":"Tu YK, Tilling K, Sterne JA, Gilthorpe MS. A critical evaluation of statistical approaches to examining the role of growth trajectories in the developmental origins of health and disease. Int J Epidemiol. 2013;42(5):1327\u201339.","journal-title":"Int J Epidemiol"},{"issue":"1","key":"1686_CR2","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1177\/0962280214548822","volume":"26","author":"A Sayers","year":"2017","unstructured":"Sayers A, Heron J, Smith A, Macdonald-Wallis C, Gilthorpe MS, Steele F, Tilling K. Joint modelling compared with two stage methods for analyzing longitudinal data and prospective outcomes: a simulation study of childhood growth and BP. Stat Methods Med Res. 2017;26(1):437\u201352.","journal-title":"Stat Methods Med Res"},{"key":"1686_CR3","doi-asserted-by":"publisher","first-page":"4514","DOI":"10.1002\/sim.7144","volume":"36","author":"MJ Sweeting","year":"2017","unstructured":"Sweeting MJ, Barrett JK, Thompson SG, Wood AM. The use of repeated blood pressure measures for cardiovascular risk prediction: a comparison of statistical models in the ARIC study. Statist Med. 2017;36:4514\u201328.","journal-title":"Statist Med"},{"issue":"1","key":"1686_CR4","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1080\/03014460.2019.1574896","volume":"46","author":"SR Crozier","year":"2019","unstructured":"Crozier SR, Johnson W, Cole TJ, Macdonald-Wallis C, Muniz-Terrera G, Inskip HM, Tilling K. A discussion of statistical methods to characterise early growth and its impact on bone mineral content later in childhood. Ann Hum Biol. 2019;46(1):17\u201326. https:\/\/doi.org\/10.1080\/03014460.2019.1574896.","journal-title":"Ann Hum Biol"},{"key":"1686_CR5","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1016\/j.ophtha.2007.10.031","volume":"115","author":"J Caprioli","year":"2008","unstructured":"Caprioli J, Coleman AL. Intraocular pressure fluctuation: a risk factor for visual field progression at low intraocular pressures in the Advanced Glaucoma Intervention Study. Ophthalmology. 2008;115:1123\u20139.","journal-title":"Ophthalmology"},{"issue":"1","key":"1686_CR6","first-page":"68","volume":"6","author":"MW Segar","year":"2021","unstructured":"Segar MW, Patel RB, Patel KV, Fudim M, DeVore AD, Martens P, Hedayati SS, Grodin JL, Tang WHW, Pandey A. Association of Visit-to-Visit Variability in Kidney Function and Serum Electrolyte Indexes With Risk of Adverse Clinical Outcomes Among Patients With Heart Failure With Preserved Ejection Fraction. JAMA Cardiol. 2021;6(1):68\u201377.","journal-title":"JAMA Cardiol"},{"key":"1686_CR7","doi-asserted-by":"publisher","first-page":"471","DOI":"10.2215\/CJN.04660415","volume":"11","author":"J Whittle","year":"2016","unstructured":"Whittle J, Lynch AI, Tanner RM, Simpson LM, Davis BR, Rahman M, Whelton PK, Oparil S, Muntner P. Visit-to-Visit Variability of BP and CKD Outcomes: Results from the ALLHAT. Clin J Am Soc Nephrol. 2016;11:471\u201380. https:\/\/doi.org\/10.2215\/CJN.04660415.","journal-title":"Clin J Am Soc Nephrol"},{"issue":"5","key":"1686_CR8","doi-asserted-by":"publisher","first-page":"329","DOI":"10.7326\/M14-2803","volume":"163","author":"P Muntner","year":"2015","unstructured":"Muntner P, Whittle J, Lynch AI, Colantonio LD, Simpson LM, Einhorn PT, Levitan EB, Whelton PK, Cushman WC, Louis GT, Davis BR, Oparil S. Visit-to-visit variability of blood pressure and coronary heart disease, stroke, heart failure and mortality: A cohort study. Ann Intern Med. 2015;163(5):329\u201338. https:\/\/doi.org\/10.7326\/M14-2803.","journal-title":"Ann Intern Med"},{"issue":"1","key":"1686_CR9","doi-asserted-by":"publisher","first-page":"79","DOI":"10.3233\/JAD-170498","volume":"61","author":"CE Gleason","year":"2018","unstructured":"Gleason CE, Norton D, Anderson ED, et al. Cognitive Variability Predicts Incident Alzheimer\u2019s Disease and Mild Cognitive Impairment Comparable to a Cerebrospinal Fluid Biomarker. J Alzheimers Dis. 2018;61(1):79\u201389. https:\/\/doi.org\/10.3233\/JAD-170498.","journal-title":"J Alzheimers Dis"},{"issue":"1","key":"1686_CR10","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1007\/s10260-010-0150-z","volume":"20","author":"F Gao","year":"2011","unstructured":"Gao F, Miller JP, Xiong C, Huecker J, Gordon MO. A joint-modeling approach to assess the impact of biomarker variability on the risk of developing clinical outcome. Stat Methods Appl. 2011;20(1):83\u2013100.","journal-title":"Stat Methods Appl"},{"key":"1686_CR11","doi-asserted-by":"publisher","unstructured":"Martins R.\u00a0 A Bayesian Joint Dispersion Model with Flexible Links. In: Argiento R, Lanzarone E, Antoniano Villalobos I, Mattei A, editors. Bayesian Statistics in Action. New York: Springer; 2017. https:\/\/doi.org\/10.1007\/978-3-319-54084-9_5.","DOI":"10.1007\/978-3-319-54084-9_5"},{"key":"1686_CR12","doi-asserted-by":"publisher","first-page":"2030","DOI":"10.1016\/j.ophtha.2008.06.036","volume":"115","author":"MO Gordon","year":"2008","unstructured":"Gordon MO, Kass MA, Torri V, Miglior S, Beiser JA, Floriani I, Miller JP, Gao F, Adamsons I, Poli D. The Accuracy and Clinical Application of Predictive Models for Primary Open-Angle Glaucoma in Ocular Hypertensive Individuals. Ophthalmology. 2008;115:2030\u20136.","journal-title":"Ophthalmology"},{"issue":"7","key":"1686_CR13","doi-asserted-by":"publisher","first-page":"780","DOI":"10.1001\/jamaophthalmol.2020.1902","volume":"138","author":"MO Gordon","year":"2020","unstructured":"Gordon MO, Gao F, Huecker JB, Miller JP, Margolis M, Kass MA, Migliore S, Torri V. Evaluation of a Primary Open-Angle Glaucoma Prediction Model Using Long-term Intraocular Pressure Variability Data. A Secondary Analysis of 2 Randomized Clinical Trials. JAMA Ophthalmol. 2020;138(7):780\u20138.","journal-title":"JAMA Ophthalmol"},{"key":"1686_CR14","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.1002\/(SICI)1097-0258(19990515)18:9<1069::AID-SIM97>3.0.CO;2-7","volume":"18","author":"RH Lyles","year":"1999","unstructured":"Lyles RH, Mun\u00f5z A, Xu J, Taylor JMG, Chmiel JS. Adjusting for measurement error to assess health effects of variability in biomarkers. Stat Med. 1999;18:1069\u201386.","journal-title":"Stat Med"},{"key":"1686_CR15","doi-asserted-by":"publisher","first-page":"963","DOI":"10.2307\/2529876","volume":"38","author":"NM Laird","year":"1982","unstructured":"Laird NM, Ware JH. Random-effects models for longitudinal data. Biometrics. 1982;38:963\u201374.","journal-title":"Biometrics"},{"key":"1686_CR16","doi-asserted-by":"publisher","first-page":"307","DOI":"10.3102\/1076998614546494","volume":"39","author":"G Leckie","year":"2014","unstructured":"Leckie G, French R, Charlton C, Browne W. Modeling Heterogeneous Variance-Covariance Components in Two-Level Models. J Educ Behav Stat. 2014;39:307\u201332.","journal-title":"J Educ Behav Stat"},{"key":"1686_CR17","doi-asserted-by":"crossref","unstructured":"Gelman A, Carlin JB, Stern HS, Rubin DB. Bayesian Data Analysis. New York: Chapman and Hall\/CRC; 2003.","DOI":"10.1201\/9780429258480"},{"issue":"1","key":"1686_CR18","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1111\/j.1467-9469.2006.00529.x","volume":"34","author":"HC Van Houwelingen","year":"2007","unstructured":"Van Houwelingen HC. Dynamic Prediction by Landmarking in Event History Analysis. Scand J Stat. 2007;34(1):70\u201385.","journal-title":"Scand J Stat"},{"key":"1686_CR19","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3294-8","volume-title":"Modeling Survival Data: Extending the Cox Model","author":"TM Therneau","year":"2000","unstructured":"Therneau TM, Grambsch PM. Modeling Survival Data: Extending the Cox Model. New York: Springer-Verlag; 2000."},{"key":"1686_CR20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v012.i03","volume":"12","author":"S Sturtz","year":"2005","unstructured":"Sturtz S, Ligges U, Gelman A. R2WinBUGS: A Package for Running WinBUGS from R. J Stat Softw. 2005;12:1\u201316.","journal-title":"J Stat Softw"},{"issue":"11","key":"1686_CR21","doi-asserted-by":"publisher","first-page":"3478","DOI":"10.1177\/0962280217706728","volume":"27","author":"H Goldstein","year":"2018","unstructured":"Goldstein H, Leckie G, Charlton C, Tilling K, Browne WJ. Multilevel growth curve models that incorporate a random coefficient model for the level 1 variance function. Stat Methods Med Res. 2018;27(11):3478\u201391.","journal-title":"Stat Methods Med Res"},{"key":"1686_CR22","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1007\/s12561-016-9157-9","volume":"9","author":"H Putter","year":"2017","unstructured":"Putter H, Van Houwelingen HC. Understanding landmarking and its relation with time-dependent Cox regression. Stat Biosci. 2017;9:489\u2013503.","journal-title":"Stat Biosci"},{"key":"1686_CR23","volume-title":"Hierarchical linear models: Applications and data analysis methods","author":"SW Raudenbush","year":"2002","unstructured":"Raudenbush SW, Bryk AS. Hierarchical linear models: Applications and data analysis methods. 2nd ed. Thousand Oaks: Sage; 2002.","edition":"2"},{"issue":"47","key":"1686_CR24","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1080\/00273171.2012.658328","volume":"2012","author":"P Rast","year":"2012","unstructured":"Rast P, Hofer SM, Sparks C. Modeling individual differences in within person variation of negative and positive affect in a mixed effects location scale model using BUGS\/JAGS. Multivar Behav Res. 2012;2012(47):177\u2013200.","journal-title":"Multivar Behav Res"},{"key":"1686_CR25","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1093\/biomet\/69.2.331","volume":"69","author":"RL Prentice","year":"1982","unstructured":"Prentice RL. Covariate measurement errors and parameter estimation in failure time regression model. Biometrika. 1982;69:331\u201342.","journal-title":"Biometrika"},{"key":"1686_CR26","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1093\/biostatistics\/1.4.465","volume":"4","author":"R Henderson","year":"2000","unstructured":"Henderson R, Diggle P, Dobson A. Joint modeling of longitudinal measurements and event time data. Biostatistics. 2000;4:465\u201380.","journal-title":"Biostatistics"},{"issue":"2","key":"1686_CR27","doi-asserted-by":"publisher","first-page":"487","DOI":"10.1111\/biom.12284","volume":"71","author":"B Jiang","year":"2015","unstructured":"Jiang B, Elliott MR, Sammel MD, Wang N. Joint modeling of cross-sectional health-outcome and longitudinal predictors via mixture of means and variance. Biometrics. 2015;71(2):487\u201397.","journal-title":"Biometrics"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-022-01686-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12874-022-01686-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-022-01686-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T15:09:15Z","timestamp":1658502555000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-022-01686-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,22]]},"references-count":27,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1686"],"URL":"https:\/\/doi.org\/10.1186\/s12874-022-01686-7","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,22]]},"assertion":[{"value":"21 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 July 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The study has been performed in accordance with the\u00a0Declaration of Helsinki. The OHTS protocol has been approved by Washington University Institutional Review Board as well as the institutional review boards of each participating clinic and resource center. Each participant provided written informed consent. All data were de-identified for the data analysis.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"201"}}