{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T01:18:58Z","timestamp":1780449538387,"version":"3.54.1"},"reference-count":64,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,9,4]],"date-time":"2023-09-04T00:00:00Z","timestamp":1693785600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,4]],"date-time":"2023-09-04T00:00:00Z","timestamp":1693785600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Over the past several decades, metrics have been defined to assess the quality of various types of models and to compare their performance depending on their capacity to explain the variance found in real-life data. However, available validation methods are mostly designed for statistical regressions rather than for mechanistic models. To our knowledge, in the latter case, there are no consensus standards, for instance for the validation of predictions against real-world data given the variability and uncertainty of the data. In this work, we focus on the prediction of time-to-event curves using as an application example a mechanistic model of non-small cell lung cancer. We designed four empirical methods to assess both model performance and reliability of predictions: two methods based on bootstrapped versions of parametric statistical tests: log-rank and combined weighted log-ranks (MaxCombo); and two methods based on bootstrapped prediction intervals, referred to here as raw coverage and the juncture metric. We also introduced the notion of observation time uncertainty to take into consideration the real life delay between the moment when an event happens, and the moment when it is observed and reported.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We highlight the advantages and disadvantages of these methods according to their application context. We have shown that the context of use of the model has an impact on the model validation process. Thanks to the use of several validation metrics we have highlighted the limit of the model to predict the evolution of the disease in the whole population of mutations at the same time, and that it was more efficient with specific predictions in the target mutation populations. The choice and use of a single metric could have led to an erroneous validation of the model and its context of use.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>With this work, we stress the importance of making judicious choices for a metric, and how using a combination of metrics could be more relevant, with the objective of validating a given model and its predictions within a specific context of use. We also show how the reliability of the results depends both on the metric and on the statistical comparisons, and that the conditions of application and the type of available information need to be taken into account to choose the best validation strategy.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12859-023-05430-w","type":"journal-article","created":{"date-parts":[[2023,9,4]],"date-time":"2023-09-04T11:02:19Z","timestamp":1693825339000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Empirical methods for the validation of time-to-event mathematical models taking into account uncertainty and variability: application to EGFR\u2009+\u2009lung adenocarcinoma"],"prefix":"10.1186","volume":"24","author":[{"given":"Evgueni","family":"Jacob","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ang\u00e9lique","family":"Perrillat-Mercerot","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jean-Louis","family":"Palgen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ad\u00e8le","family":"L\u2019Hostis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicoletta","family":"Ceres","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jean-Pierre","family":"Boissel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jim","family":"Bosley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claudio","family":"Monteiro","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Riad","family":"Kahoul","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,9,4]]},"reference":[{"issue":"49","key":"5430_CR1","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1146\/annurev.pharmtox.011008.145613","volume":"10","author":"JV Gobburu","year":"2009","unstructured":"Gobburu JV, Lesko LJ. Quantitative disease, drug, and trial models. Annu Rev Pharmacol Toxicol. 2009;10(49):291\u2013301.","journal-title":"Annu Rev Pharmacol Toxicol"},{"issue":"5","key":"5430_CR2","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1038\/nrg2098","volume":"8","author":"CJ Tomlin","year":"2007","unstructured":"Tomlin CJ, Axelrod JD. Biology by numbers: mathematical modelling in developmental biology. Nat Rev Genet. 2007;8(5):331\u201340.","journal-title":"Nat Rev Genet"},{"issue":"6","key":"5430_CR3","doi-asserted-by":"crossref","first-page":"502","DOI":"10.1038\/clpt.2013.54","volume":"93","author":"PA Milligan","year":"2013","unstructured":"Milligan PA, Brown MJ, Marchant B, Martin SW, Van Der Graaf PH, Benson N, Nucci G, Nichols DJ, Boyd RA, Mandema JW, Krishnaswami S. Model-based drug development: a rational approach to efficiently accelerate drug development. Clin Pharmacol Ther. 2013;93(6):502\u201314.","journal-title":"Clin Pharmacol Ther"},{"key":"5430_CR4","doi-asserted-by":"crossref","unstructured":"Courcelles E, Boissel JP, Massol J, Klingmann I, Kahoul R, Hommel M, Pham E, Kulesza A. Solving the evidence interpretability crisis in health technology assessment: a role for mechanistic models? Front Med Technol. 2022;4.","DOI":"10.3389\/fmedt.2022.810315"},{"issue":"4","key":"5430_CR5","doi-asserted-by":"crossref","first-page":"899","DOI":"10.1002\/cpt.1363","volume":"105","author":"Y Wang","year":"2019","unstructured":"Wang Y, Zhu H, Madabushi R, Liu Q, Huang SM, Zineh I. Model-informed drug development: current US regulatory practice and future considerations. Clin Pharmacol Ther. 2019;105(4):899\u2013911.","journal-title":"Clin Pharmacol Ther"},{"issue":"1","key":"5430_CR6","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.pbiomolbio.2007.10.001","volume":"97","author":"MA Dronne","year":"2008","unstructured":"Dronne MA, Grenier E, Chapuisat G, Hommel M, Boissel JP. A modelling approach to explore some hypotheses of the failure of neuroprotective trials in ischemic stroke patients. Prog Biophys Mol Biol. 2008;97(1):60\u201378.","journal-title":"Prog Biophys Mol Biol"},{"issue":"6","key":"5430_CR7","first-page":"1203","volume":"19","author":"J Gal","year":"2018","unstructured":"Gal J, Milano G, Ferrero JM, Sa\u00e2da-Bouzid E, Viotti J, Chabaud S, Gougis P, Le Tourneau C, Schiappa R, Paquet A, Chamorey E. Optimizing drug development in oncology by clinical trial simulation: Why and how? Brief Bioinform. 2018;19(6):1203\u201317.","journal-title":"Brief Bioinform"},{"issue":"4","key":"5430_CR8","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1002\/psp4.12504","volume":"9","author":"FT Musuamba","year":"2020","unstructured":"Musuamba FT, Bursi R, Manolis E, Karlsson K, Kulesza A, Courcelles E, Boissel JP, Lesage R, Crozatier C, Voisin EM, Rousseau CF. Verifying and validating quantitative systems pharmacology and in silico models in drug development: current needs, gaps, and challenges. CPT Pharmacomet Syst Pharmacol. 2020;9(4):195.","journal-title":"CPT Pharmacomet Syst Pharmacol."},{"issue":"8","key":"5430_CR9","doi-asserted-by":"crossref","first-page":"804","DOI":"10.1002\/psp4.12669","volume":"10","author":"FT Musuamba","year":"2021","unstructured":"Musuamba FT, Skottheim Rusten I, Lesage R, Russo G, Bursi R, Emili L, Wangorsch G, Manolis E, Karlsson KE, Kulesza A, Courcelles E. Scientific and regulatory evaluation of mechanistic in silico drug and disease models in drug development: Building model credibility. CPT Pharmacomet Syst Pharmacol. 2021;10(8):804\u201325.","journal-title":"CPT Pharmacomet Syst Pharmacol"},{"issue":"1","key":"5430_CR10","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/JBHI.2019.2949888","volume":"24","author":"M Viceconti","year":"2019","unstructured":"Viceconti M, Ju\u00e1rez MA, Curreli C, Pennisi M, Russo G, Pappalardo F. Credibility of in silico trial technologies\u2014a theoretical framing. IEEE J Biomed Health Inform. 2019;24(1):4\u201313.","journal-title":"IEEE J Biomed Health Inform"},{"issue":"1","key":"5430_CR11","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1002\/psp4.12479","volume":"9","author":"C Kuemmel","year":"2020","unstructured":"Kuemmel C, Yang Y, Zhang X, Florian J, Zhu H, Tegenge M, et al. Consideration of a credibility assessment framework in model-informed drug development: potential application to physiologically-based pharmacokinetic modeling and simulation. CPT Pharmacomet Syst Pharmacol. 2020;9(1):21\u20138.","journal-title":"CPT Pharmacomet Syst Pharmacol"},{"issue":"1","key":"5430_CR12","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1002\/psp4.12479","volume":"9","author":"C Kuemmel","year":"2020","unstructured":"Kuemmel C, Yang Y, Zhang X, Florian J, Zhu H, Tegenge M, Huang SM, Wang Y, Morrison T, Zineh I. Consideration of a credibility assessment framework in model-informed drug development: potential application to physiologically-based pharmacokinetic modeling and simulation. CPT Pharmacomet Syst Pharmacol. 2020;9(1):21\u20138.","journal-title":"CPT Pharmacomet Syst Pharmacol"},{"issue":"3","key":"5430_CR13","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1002\/psp4.26","volume":"4","author":"JP Boissel","year":"2015","unstructured":"Boissel JP, Auffray C, Noble D, Hood L, Boissel FH. Bridging systems medicine and patient needs. CPT Pharmacomet Syst Pharmacol. 2015;4(3):135\u201345.","journal-title":"CPT Pharmacomet Syst Pharmacol."},{"issue":"2","key":"5430_CR14","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1634\/theoncologist.2015-0322","volume":"21","author":"N Buil-Bruna","year":"2016","unstructured":"Buil-Bruna N, L\u00f3pez-Picazo JM, Mart\u00edn-Algarra S, Troc\u00f3niz IF. Bringing model-based prediction to oncology clinical practice: a review of pharmacometrics principles and applications. Oncologist. 2016;21(2):220\u201332.","journal-title":"Oncologist"},{"issue":"5","key":"5430_CR15","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1002\/psp4.12071","volume":"5","author":"K Gadkar","year":"2016","unstructured":"Gadkar K, Kirouac DC, Mager DE, van der Graaf PH, Ramanujan S. A six-stage workflow for robust application of systems pharmacology. CPT Pharmacomet Syst Pharmacol. 2016;5(5):235\u201349.","journal-title":"CPT Pharmacomet Syst Pharmacol."},{"key":"5430_CR16","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511760396","volume-title":"Verification and validation in scientific computing","author":"WL Oberkampf","year":"2010","unstructured":"Oberkampf WL, Roy CJ. Verification and validation in scientific computing. Cambridge: Cambridge University Press; 2010."},{"key":"5430_CR17","unstructured":"Dahabreh IJ, Chan JA, Earley A, Moorthy D, Avendano EE, Trikalinos TA, Balk EM, Wong JB. A review of validation and calibration methods for health care modeling and simulation. Modeling and Simulation in the Context of Health Technology Assessment: Review of Existing Guidance, Future Research Needs, and Validity Assessment [Internet]. 2017."},{"key":"5430_CR18","unstructured":"European Medicines Agency. Guideline on the reporting of physiologically based pharmacokinetic (PBPK) modeling and simulation, Appendix 2 p.15\/16. 2018. https:\/\/www.ema.europa.eu\/en\/documents\/scientific-guideline\/guideline-reporting-physiologically-based-pharmacokinetic-pbpk-modelling-simulation_en.pdf. Accessed 25 Feb 2022."},{"issue":"185","key":"5430_CR19","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.ymeth.2020.01.011","volume":"1","author":"M Viceconti","year":"2021","unstructured":"Viceconti M, Pappalardo F, Rodriguez B, Horner M, Bischoff J, Tshinanu FM. In silico trials: verification, validation and uncertainty quantification of predictive models used in the regulatory evaluation of biomedical products. Methods. 2021;1(185):120\u20137.","journal-title":"Methods"},{"issue":"6","key":"5430_CR20","doi-asserted-by":"crossref","first-page":"961","DOI":"10.3390\/pr9060961","volume":"9","author":"V Rajamanickam","year":"2021","unstructured":"Rajamanickam V, Babel H, Montano-Herrera L, Ehsani A, Stiefel F, Haider S, Presser B, Knapp B. About model validation in bioprocessing. Processes. 2021;9(6):961.","journal-title":"Processes"},{"issue":"9","key":"5430_CR21","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1002\/psp4.12310","volume":"7","author":"DC Kirouac","year":"2018","unstructured":"Kirouac DC. How do we \u201cvalidate\u201d a QSP model? CPT Pharmacomet Syst Pharmacol. 2018;7(9):547.","journal-title":"CPT Pharmacomet Syst Pharmacol."},{"issue":"1","key":"5430_CR22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12918-015-0180-0","volume":"9","author":"D Hasdemir","year":"2015","unstructured":"Hasdemir D, Hoefsloot HC, Smilde AK. Validation and selection of ODE based systems biology models: how to arrive at more reliable decisions. BMC Syst Biol. 2015;9(1):1\u20139.","journal-title":"BMC Syst Biol"},{"key":"5430_CR23","doi-asserted-by":"crossref","unstructured":"Altman N, Krzywinski M. Points of significance: sources of variation. Nat Methods. 2015;12(1).","DOI":"10.1038\/nmeth.3224"},{"issue":"9","key":"5430_CR24","doi-asserted-by":"crossref","first-page":"879","DOI":"10.1038\/nmeth.3091","volume":"11","author":"P Blainey","year":"2014","unstructured":"Blainey P, Krzywinski M, Altman N. Points of significance: replication. Nat Methods. 2014;11(9):879.","journal-title":"Nat Methods"},{"issue":"6","key":"5430_CR25","doi-asserted-by":"crossref","first-page":"663","DOI":"10.18609\/cgti.2016.073","volume":"2","author":"S Lin-Gibson","year":"2016","unstructured":"Lin-Gibson S, Sarkar S, Elliott J, Plant A. Understanding and managing sources of variability in cell measurements. Cell Gene Ther Insights. 2016;2(6):663\u201373.","journal-title":"Cell Gene Ther Insights"},{"key":"5430_CR26","first-page":"368","volume":"20","author":"JP McCormack","year":"2020","unstructured":"McCormack JP, Holmes DT. Your results may vary: the imprecision of medical measurements. BMJ. 2020;20:368.","journal-title":"BMJ"},{"issue":"9","key":"5430_CR27","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1038\/nmeth.3968","volume":"13","author":"J Lever","year":"2016","unstructured":"Lever J, Krzywinski M, Altman N. Points of significance: model selection and overfitting. Nat Methods. 2016;13(9):703\u20135.","journal-title":"Nat Methods"},{"key":"5430_CR28","unstructured":"ASME V&V 40, 2018 Edition, November 19, 2018\u2014Assessing Credibility of Computational Modeling Through Verification and Validation: Application to Medical Devices"},{"issue":"5","key":"5430_CR29","doi-asserted-by":"crossref","first-page":"986","DOI":"10.1080\/10543406.2013.813524","volume":"23","author":"X Sun","year":"2013","unstructured":"Sun X, Li X, Chen C, Song Y. A review of statistical issues with progression-free survival as an interval-censored time-to-event endpoint. J Biopharm Stat. 2013;23(5):986\u20131003.","journal-title":"J Biopharm Stat"},{"issue":"10","key":"5430_CR30","doi-asserted-by":"crossref","first-page":"2629","DOI":"10.1158\/1078-0432.CCR-12-2935","volume":"19","author":"LC Villaruz","year":"2013","unstructured":"Villaruz LC, Socinski MA. The clinical viewpoint: definitions, limitations of RECIST, practical considerations of measurement. Clin Cancer Res. 2013;19(10):2629\u201336.","journal-title":"Clin Cancer Res"},{"issue":"3","key":"5430_CR31","first-page":"1","volume":"3","author":"J Houser","year":"2007","unstructured":"Houser J. How many are enough? Statistical power analysis and sample size estimation in clinical research. J Clin Res Best Pract. 2007;3(3):1\u20135.","journal-title":"J Clin Res Best Pract"},{"issue":"3","key":"5430_CR32","doi-asserted-by":"crossref","first-page":"279","DOI":"10.4300\/JGME-D-12-00156.1","volume":"4","author":"GM Sullivan","year":"2012","unstructured":"Sullivan GM, Feinn R. Using effect size\u2014or why the P value is not enough. J Grad Med Educ. 2012;4(3):279\u201382.","journal-title":"J Grad Med Educ"},{"issue":"1","key":"5430_CR33","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1080\/02701367.1997.10608865","volume":"68","author":"W Zhu","year":"1997","unstructured":"Zhu W. Making bootstrap statistical inferences: a tutorial. Res Q Exerc Sport. 1997;68(1):44\u201355.","journal-title":"Res Q Exerc Sport"},{"key":"5430_CR34","first-page":"3159","volume-title":"Handbook of econometrics","author":"JL Horowitz","year":"2001","unstructured":"Horowitz JL. The bootstrap. In: Handbook of econometrics, vol. 5. Amsterdam: Elsevier; 2001. p. 3159\u2013228."},{"issue":"4","key":"5430_CR35","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1257\/jep.15.4.129","volume":"15","author":"D Brownstone","year":"2001","unstructured":"Brownstone D, Valletta R. The bootstrap and multiple imputations: harnessing increased computing power for improved statistical tests. J Econ Perspect. 2001;15(4):129\u201341.","journal-title":"J Econ Perspect"},{"issue":"5","key":"5430_CR36","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1093\/bjaed\/mkv034","volume":"16","author":"MO Columb","year":"2016","unstructured":"Columb MO, Atkinson MS. Statistical analysis: sample size and power estimations. BJA Educ. 2016;16(5):159\u201361.","journal-title":"BJA Educ"},{"issue":"2","key":"5430_CR37","doi-asserted-by":"crossref","first-page":"144","DOI":"10.4097\/kjae.2017.70.2.144","volume":"70","author":"SG Kwak","year":"2017","unstructured":"Kwak SG, Kim JH. Central limit theorem: the cornerstone of modern statistics. Korean J Anesthesiol. 2017;70(2):144\u201356.","journal-title":"Korean J Anesthesiol"},{"key":"5430_CR38","doi-asserted-by":"crossref","unstructured":"Kleinman K, Huang SS. Calculating power by bootstrap, with an application to cluster-randomized trials. EGEMs. 2016;4(1).","DOI":"10.13063\/2327-9214.1202"},{"issue":"7","key":"5430_CR39","doi-asserted-by":"crossref","first-page":"1075","DOI":"10.1002\/sim.1984","volume":"24","author":"SJ Walters","year":"2005","unstructured":"Walters SJ, Campbell MJ. The use of bootstrap methods for estimating sample size and analysing health-related quality of life outcomes. Stat Med. 2005;24(7):1075\u2013102.","journal-title":"Stat Med"},{"issue":"2","key":"5430_CR40","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1177\/2168479018778280","volume":"53","author":"Z Wang","year":"2019","unstructured":"Wang Z. Comparison of sample size by bootstrap and by formulas based on normal distribution assumption. Therap Innov Regul Sci. 2019;53(2):170\u20135.","journal-title":"Therap Innov Regul Sci"},{"issue":"7447","key":"5430_CR41","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1136\/bmj.328.7447.1073","volume":"328","author":"JM Bland","year":"2004","unstructured":"Bland JM, Altman DG. The logrank test. BMJ. 2004;328(7447):1073.","journal-title":"BMJ"},{"key":"5430_CR42","unstructured":"Peng X, Peng G, Gonzales C. Power analysis and sample size estimation using bootstrap. Phoenix: Paper presented at PharmaSUG. 2005."},{"issue":"102","key":"5430_CR43","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/j.jclinepi.2018.06.014","volume":"1","author":"HJ Lamberink","year":"2018","unstructured":"Lamberink HJ, Otte WM, Sinke MR, Lakens D, Glasziou PP, Tijdink JK, Vinkers CH. Statistical power of clinical trials increased while effect size remained stable: an empirical analysis of 136,212 clinical trials between 1975 and 2014. J Clin Epidemiol. 2018;1(102):123\u20138.","journal-title":"J Clin Epidemiol"},{"key":"5430_CR44","first-page":"163","volume":"50","author":"N Mentel","year":"1966","unstructured":"Mentel N. Evaluation of survival data and two new rank order statistics arising in its consideration. Cancer Chemother Rep. 1966;50:163\u201370.","journal-title":"Cancer Chemother Rep"},{"issue":"1","key":"5430_CR45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13063-020-4153-2","volume":"21","author":"PB Royston","year":"2020","unstructured":"Royston PB, Parmar MK. A simulation study comparing the power of nine tests of the treatment effect in randomized controlled trials with a time-to-event outcome. Trials. 2020;21(1):1\u20137.","journal-title":"Trials"},{"issue":"1","key":"5430_CR46","volume":"10","author":"H Li","year":"2015","unstructured":"Li H, Han D, Hou Y, Chen H, Chen Z. Statistical inference methods for two crossing survival curves: a comparison of methods. PLoS ONE. 2015;10(1): e0116774.","journal-title":"PLoS ONE"},{"issue":"3","key":"5430_CR47","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1093\/biomet\/81.3.515","volume":"81","author":"PM Grambsch","year":"1994","unstructured":"Grambsch PM, Therneau TM. Proportional hazards tests and diagnostics based on weighted residuals. Biometrika. 1994;81(3):515\u201326.","journal-title":"Biometrika"},{"issue":"2","key":"5430_CR48","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1093\/pan\/mpp044","volume":"18","author":"L Keele","year":"2010","unstructured":"Keele L. Proportionally difficult: testing for nonproportional hazards in Cox models. Polit Anal. 2010;18(2):189\u2013205.","journal-title":"Polit Anal"},{"issue":"3","key":"5430_CR49","first-page":"678","volume":"16","author":"TG Karrison","year":"2016","unstructured":"Karrison TG. Versatile tests for comparing survival curves based on weighted log-rank statistics. Stand Genomic Sci. 2016;16(3):678\u201390.","journal-title":"Stand Genomic Sci"},{"issue":"1","key":"5430_CR50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12874-016-0110-x","volume":"16","author":"P Royston","year":"2016","unstructured":"Royston P, Parmar MK. Augmenting the logrank test in the design of clinical trials in which non-proportional hazards of the treatment effect may be anticipated. BMC Med Res Methodol. 2016;16(1):1\u20133.","journal-title":"BMC Med Res Methodol"},{"issue":"12","key":"5430_CR51","doi-asserted-by":"crossref","first-page":"3525","DOI":"10.1177\/0962280220931560","volume":"29","author":"TJ Prior","year":"2020","unstructured":"Prior TJ. Group sequential monitoring based on the maximum of weighted log-rank statistics with the Fleming-Harrington class of weights in oncology clinical trials. Stat Methods Med Res. 2020;29(12):3525\u201332.","journal-title":"Stat Methods Med Res"},{"issue":"2","key":"5430_CR52","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1080\/19466315.2019.1697738","volume":"12","author":"RS Lin","year":"2020","unstructured":"Lin RS, Lin J, Roychoudhury S, Anderson KM, Hu T, Huang B, Leon LF, Liao JJ, Liu R, Luo X, Mukhopadhyay P. Alternative analysis methods for time to event endpoints under nonproportional hazards: a comparative analysis. Stat Biopharm Res. 2020;12(2):187\u201398.","journal-title":"Stat Biopharm Res"},{"issue":"1","key":"5430_CR53","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1038\/s41540-023-00292-7","volume":"9","author":"A L\u2019Hostis","year":"2023","unstructured":"L\u2019Hostis A, Palgen J-L, Perrillat-Mercerot A, Peyronnet E, Jacob E, Bosley J, Duruisseaux M, Toueg R, Lef\u00e8vre L, Kahoul R, Ceres N, Monteiro C (2023) Knowledge-based mechanistic modeling accurately predicts disease progression with gefitinib in EGFR-mutant lung adenocarcinoma. npj Syst Biol Appl 9(1):37. https:\/\/doi.org\/10.1038\/s41540-023-00292-7","journal-title":"npj Syst Biol Appl"},{"issue":"8","key":"5430_CR54","doi-asserted-by":"crossref","first-page":"998","DOI":"10.1038\/sj.bjc.6603393","volume":"95","author":"H Asahina","year":"2006","unstructured":"Asahina H, Yamazaki K, Kinoshita I, Sukoh N, Harada M, Yokouchi H, Ishida T, Ogura S, Kojima T, Okamoto Y, Fujita Y. A phase II trial of gefitinib as first-line therapy for advanced non-small cell lung cancer with epidermal growth factor receptor mutations. Br J Cancer. 2006;95(8):998\u20131004.","journal-title":"Br J Cancer"},{"issue":"16","key":"5430_CR55","doi-asserted-by":"crossref","first-page":"2745","DOI":"10.1200\/JCO.2007.15.6695","volume":"26","author":"CH Yang","year":"2008","unstructured":"Yang CH, Yu CJ, Shih JY, Chang YC, Hu FC, Tsai MC, Chen KY, Lin ZZ, Huang CJ, Shun CT, Huang CL. Specific EGFR mutations predict treatment outcome of stage IIIB\/IV patients with chemotherapy-naive non\u2013small-cell lung cancer receiving first-line gefitinib monotherapy. J Clin Oncol. 2008;26(16):2745\u201353.","journal-title":"J Clin Oncol"},{"issue":"15","key":"5430_CR56","doi-asserted-by":"crossref","first-page":"4877","DOI":"10.1158\/1078-0432.CCR-07-5123","volume":"14","author":"JY Wu","year":"2008","unstructured":"Wu JY, Wu SG, Yang CH, Gow CH, Chang YL, Yu CJ, Shih JY, Yang PC. Lung cancer with epidermal growth factor receptor exon 20 mutations is associated with poor gefitinib treatment response. Clin Cancer Res. 2008;14(15):4877\u201382.","journal-title":"Clin Cancer Res"},{"issue":"3","key":"5430_CR57","volume":"1","author":"PE Vasconcelos","year":"2020","unstructured":"Vasconcelos PE, Gergis C, Viray H, Varkaris A, Fujii M, Rangachari D, VanderLaan PA, Kobayashi IS, Kobayashi SS, Costa DB. EGFR-A763_Y764insFQEA is a unique exon 20 insertion mutation that displays sensitivity to approved and in-development lung cancer EGFR tyrosine kinase inhibitors. JTO Clin Res Rep. 2020;1(3): 100051.","journal-title":"JTO Clin Res Rep"},{"issue":"216","key":"5430_CR58","doi-asserted-by":"crossref","first-page":"216ra177","DOI":"10.1126\/scitranslmed.3007205","volume":"5","author":"H Yasuda","year":"2013","unstructured":"Yasuda H, Park E, Yun CH, Sng NJ, Lucena-Araujo AR, Yeo WL, Huberman MS, Cohen DW, Nakayama S, Ishioka K, Yamaguchi N. Structural, biochemical, and clinical characterization of epidermal growth factor receptor (EGFR) exon 20 insertion mutations in lung cancer. Sci Transl Med. 2013;5(216):216ra177.","journal-title":"Sci Transl Med"},{"issue":"3","key":"5430_CR59","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1016\/j.lungcan.2008.09.010","volume":"64","author":"K Sugio","year":"2009","unstructured":"Sugio K, Uramoto H, Onitsuka T, Mizukami M, Ichiki Y, Sugaya M, Yasuda M, Takenoyama M, Oyama T, Hanagiri T, Yasumoto K. Prospective phase II study of gefitinib in non-small cell lung cancer with epidermal growth factor receptor gene mutations. Lung Cancer. 2009;64(3):314\u20138.","journal-title":"Lung Cancer"},{"issue":"3","key":"5430_CR60","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10441-022-09445-3","volume":"70","author":"JL Palgen","year":"2022","unstructured":"Palgen JL, Perrillat-Mercerot A, Ceres N, Peyronnet E, Coudron M, Tixier E, Illigens BM, Bosley J, L\u2019Hostis A, Monteiro C. Integration of heterogeneous biological data in multiscale mechanistic model calibration: application to lung adenocarcinoma. Acta Biotheor. 2022;70(3):1\u201324.","journal-title":"Acta Biotheor"},{"issue":"25","key":"5430_CR61","doi-asserted-by":"crossref","first-page":"2380","DOI":"10.1056\/NEJMoa0909530","volume":"362","author":"M Maemondo","year":"2010","unstructured":"Maemondo M, Inoue A, Kobayashi K, Sugawara S, Oizumi S, Isobe H, Gemma A, Harada M, Yoshizawa H, Kinoshita I, Fujita Y. Gefitinib or chemotherapy for non\u2013small-cell lung cancer with mutated EGFR. N Engl J Med. 2010;362(25):2380\u20138.","journal-title":"N Engl J Med"},{"issue":"1","key":"5430_CR62","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s00228-015-1966-0","volume":"72","author":"M Sheng","year":"2016","unstructured":"Sheng M, Wang F, Zhao Y, Li S, Wang X, Shou T, Luo Y, Tang W. Comparison of clinical outcomes of patients with non-small-cell lung cancer harbouring epidermal growth factor receptor exon 19 or exon 21 mutations after tyrosine kinase inhibitors treatment: a meta-analysis. Eur J Clin Pharmacol. 2016;72(1):1\u20131.","journal-title":"Eur J Clin Pharmacol"},{"issue":"6","key":"5430_CR63","doi-asserted-by":"crossref","first-page":"101042831770621","DOI":"10.1177\/1010428317706211","volume":"39","author":"Z Zheng","year":"2017","unstructured":"Zheng Z, Xie D, Su H, Lin B, Zhao L, Deng X, Chen H, Fei S, Jin X, Xie C. Treatment outcome comparisons between exons 19 and 21 EGFR mutations for non-small-cell lung cancer patients with malignant pleural effusion after first-line and second-line tyrosine kinase inhibitors. Tumor Biol. 2017;39(6):1010428317706211.","journal-title":"Tumor Biol"},{"issue":"17","key":"5430_CR64","doi-asserted-by":"crossref","first-page":"1958","DOI":"10.1200\/JCO.2014.58.1736","volume":"33","author":"CK Lee","year":"2015","unstructured":"Lee CK, Wu YL, Ding PN, Lord SJ, Inoue A, Zhou C, Mitsudomi T, Rosell R, Pavlakis N, Links M, Gebski V. Impact of specific epidermal growth factor receptor (EGFR) mutations and clinical characteristics on outcomes after treatment with EGFR tyrosine kinase inhibitors versus chemotherapy in EGFR-mutant lung cancer: a meta-analysis. J Clin Oncol. 2015;33(17):1958\u201365.","journal-title":"J Clin Oncol"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-023-05430-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-023-05430-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-023-05430-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,18]],"date-time":"2023-11-18T07:06:48Z","timestamp":1700291208000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-023-05430-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,4]]},"references-count":64,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["5430"],"URL":"https:\/\/doi.org\/10.1186\/s12859-023-05430-w","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.09.08.507079","asserted-by":"object"}]},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,4]]},"assertion":[{"value":"15 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 July 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"All the authors of this article are employees of Novadiscovery who have been working on a project funded by Jansen-Cilag. Janssen-Cilag coworkers have not been involved in the establishment of the statistical methods described in this article nor in the writing of the manuscript and therefore are not included as co-authors.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"331"}}