{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T03:01:29Z","timestamp":1787022089455,"version":"build-2736575974"},"reference-count":43,"publisher":"Public Library of Science (PLoS)","issue":"11","license":[{"start":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T00:00:00Z","timestamp":1636934400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002957","name":"TU Dresden","doi-asserted-by":"crossref","award":["MeDDrive grant no. 60470"],"award-info":[{"award-number":["MeDDrive grant no. 60470"]}],"id":[{"id":"10.13039\/501100002957","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Federal Ministry of Education and Research of Germany","award":["e:Bio Module III - Junior Research Group \"MessAge\" (Grant no. 031A315)"],"award-info":[{"award-number":["e:Bio Module III - Junior Research Group \"MessAge\" (Grant no. 031A315)"]}]},{"name":"AICURA medical GmbH"}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Risk stratification and treatment decisions for leukemia patients are regularly based on clinical markers determined at diagnosis, while measurements on system dynamics are often neglected. However, there is increasing evidence that linking quantitative time-course information to disease outcomes can improve the predictions for patient-specific treatment responses. We designed a synthetic experiment simulating response kinetics of 5,000 patients to compare different computational methods with respect to their ability to accurately predict relapse for chronic and acute myeloid leukemia treatment. Technically, we used clinical reference data to first fit a model and then generate de novo model simulations of individual patients\u2019 time courses for which we can systematically tune data quality (i.e. measurement error) and quantity (i.e. number of measurements). Based hereon, we compared the prediction accuracy of three different computational methods, namely mechanistic models, generalized linear models, and deep neural networks that have been fitted to the reference data. Reaching prediction accuracies between 60 and close to 100%, our results indicate that data quality has a higher impact on prediction accuracy than the specific choice of the particular method. We further show that adapted treatment and measurement schemes can considerably improve the prediction accuracy by 10 to 20%. Our proof-of-principle study highlights how computational methods and optimized data acquisition strategies can improve risk assessment and treatment of leukemia patients.<\/jats:p>","DOI":"10.1371\/journal.pone.0256585","type":"journal-article","created":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T13:25:57Z","timestamp":1636982757000},"page":"e0256585","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":4,"title":["How to predict relapse in leukemia using time series data: A comparative in silico study"],"prefix":"10.1371","volume":"16","author":[{"given":"Helene","family":"Hoffmann","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4366-1453","authenticated-orcid":true,"given":"Christoph","family":"Baldow","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2125-9084","authenticated-orcid":true,"given":"Thomas","family":"Zerjatke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrea","family":"Gottschalk","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6468-4833","authenticated-orcid":true,"given":"Sebastian","family":"Wagner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elena","family":"Karg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastian","family":"Niehaus","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ingo","family":"Roeder","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ingmar","family":"Glauche","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4003-9121","authenticated-orcid":true,"given":"Nico","family":"Scherf","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2021,11,15]]},"reference":[{"key":"pone.0256585.ref001","first-page":"1646","article-title":"Chronic myeloid leukemia from basics to bedside","volume":"13","author":"S Thijsen","year":"1999","journal-title":"Leukemia. Springer Nature"},{"key":"pone.0256585.ref002","first-page":"441","article-title":"Chronic myeloid leukaemia as a model of disease evolution in human cancer","volume":"7","author":"JV Melo","year":"2007","journal-title":"Nat Rev Cancer. Springer Science and Business Media LLC"},{"issue":"Suppl 2","key":"pone.0256585.ref003","first-page":"S107","article-title":"Natural course and biology of CML","volume":"94","author":"B Chereda","year":"2015","journal-title":"Ann Hematol. Springer Science and Business Media LLC"},{"key":"pone.0256585.ref004","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1007\/s13238-015-0143-7","article-title":"Leukemia stem cells: the root of chronic myeloid leukemia","volume":"6","author":"H Zhou","year":"2015","journal-title":"Protein Cell"},{"key":"pone.0256585.ref005","doi-asserted-by":"crossref","first-page":"917","DOI":"10.1056\/NEJMoa1609324","article-title":"Long-Term Outcomes of Imatinib Treatment for Chronic Myeloid Leukemia","volume":"376","author":"A Hochhaus","year":"2017","journal-title":"N Engl J Med"},{"key":"pone.0256585.ref006","doi-asserted-by":"crossref","first-page":"1245","DOI":"10.1186\/s12885-018-5167-y","article-title":"Discontinuation of tyrosine kinase inhibitors in CML patients in real-world clinical practice at a single institution","volume":"18","author":"N Cerveira","year":"2018","journal-title":"BMC Cancer"},{"key":"pone.0256585.ref007","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1016\/S1470-2045(10)70233-3","article-title":"Discontinuation of imatinib in patients with chronic myeloid leukaemia who have maintained complete molecular remission for at least 2 years: the prospective, multicentre Stop Imatinib (STIM) trial","volume":"11","author":"F-X Mahon","year":"2010","journal-title":"Lancet Oncol"},{"key":"pone.0256585.ref008","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1007\/s12185-019-02736-5","article-title":"Cessation of nilotinib in patients with chronic myelogenous leukemia who have maintained deep molecular responses for 2 years: a multicenter phase 2 trial, stop nilotinib (NILSt)","volume":"110","author":"K Nagafuji","year":"2019","journal-title":"Int J Hematol"},{"key":"pone.0256585.ref009","doi-asserted-by":"crossref","first-page":"2059","DOI":"10.1056\/NEJMoa1301689","article-title":"Genomic and epigenomic landscapes of adult de novo acute myeloid leukemia","volume":"368","author":"Cancer Genome Atlas Research Network","year":"2013","journal-title":"N Engl J Med"},{"key":"pone.0256585.ref010","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1182\/blood-2017-09-801498","article-title":"Minimal\/measurable residual disease in AML: a consensus document from the European LeukemiaNet MRD Working Party","volume":"131","author":"GJ Schuurhuis","year":"2018","journal-title":"Blood"},{"key":"pone.0256585.ref011","first-page":"83","article-title":"The level of residual disease based on mutant NPM1 is an independent prognostic factor for relapse and survival in AML","volume":"122","author":"N Shayegi","year":"2013","journal-title":"Blood. American Society of Hematology"},{"key":"pone.0256585.ref012","first-page":"5188","article-title":"The Real-World Incidence of Relapse in Acute Myeloid Leukemia (AML): A Systematic Literature Review (SLR)","volume":"132","author":"EN Oliva","year":"2018","journal-title":"Blood. American Society of Hematology"},{"key":"pone.0256585.ref013","doi-asserted-by":"crossref","first-page":"1136","DOI":"10.1056\/NEJMra1406184","article-title":"Acute myeloid leukemia","volume":"373","author":"H D\u00f6hner","year":"2015","journal-title":"N Engl J Med. New England Journal of Medicine (NEJM\/MMS)"},{"key":"pone.0256585.ref014","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1182\/blood-2016-08-733196","article-title":"Diagnosis and management of AML in adults: 2017 ELN recommendations from an international expert panel","volume":"129","author":"H D\u00f6hner","year":"2017","journal-title":"Blood"},{"key":"pone.0256585.ref015","doi-asserted-by":"crossref","first-page":"2080","DOI":"10.1038\/leu.2016.120","article-title":"Effect of measurable (\u2019minimal\u2019) residual disease (MRD) information on prediction of relapse and survival in adult acute myeloid leukemia","volume":"30","author":"M Othus","year":"2016","journal-title":"Leukemia"},{"key":"pone.0256585.ref016","article-title":"Overlooking the obvious? On the potential of treatment alterations to predict patient-specific therapy response","author":"I Roeder","year":"2020","journal-title":"Exp Hematol"},{"key":"pone.0256585.ref017","first-page":"511","article-title":"Prognosis for patients with CML and >10% BCR-ABL1 after 3 months of imatinib depends on the rate of BCR-ABL1 decline","volume":"124","author":"S Branford","year":"2014","journal-title":"Blood. American Society of Hematology"},{"key":"pone.0256585.ref018","article-title":"Molecular dynamics during reduction of TKI dose reliably identify molecular recurrence after treatment cessation in CML","author":"A Gottschalk","year":"2020","journal-title":"Blood"},{"key":"pone.0256585.ref019","doi-asserted-by":"crossref","first-page":"1531","DOI":"10.1038\/s41375-018-0371-y","article-title":"The prognostic potential of monitoring disease dynamics in NPM1-positive acute myeloid leukemia","volume":"33","author":"H Hoffmann","year":"2019","journal-title":"Leukemia"},{"key":"pone.0256585.ref020","doi-asserted-by":"crossref","first-page":"20200091","DOI":"10.1098\/rsif.2020.0091","article-title":"Differential response to cytotoxic therapy explains treatment dynamics of acute myeloid leukaemia patients: insights from a mathematical modelling approach","volume":"17","author":"H Hoffmann","year":"2020","journal-title":"J R Soc Interface"},{"key":"pone.0256585.ref021","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1016\/S1470-2045(18)30192-X","article-title":"Discontinuation of tyrosine kinase inhibitor therapy in chronic myeloid leukaemia (EURO-SKI): a prespecified interim analysis of a prospective, multicentre, non-randomised, trial","volume":"19","author":"S Saussele","year":"2018","journal-title":"Lancet Oncol"},{"key":"pone.0256585.ref022","article-title":"Early BCR-ABL1 kinetics are predictive of subsequent achievement of treatment-free remission in chronic myeloid leukemia","author":"N Shanmuganathan","year":"2020","journal-title":"Blood"},{"key":"pone.0256585.ref023","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1080\/10556789408805584","article-title":"Time series analysis and prediction by neural networks","volume":"4","author":"X Zhang","year":"1994","journal-title":"Optim Methods Softw. Taylor & Francis"},{"key":"pone.0256585.ref024","unstructured":"Goodfellow I, Bengio Y, Courville A. Deep Learning. The MIT Press; 2016."},{"key":"pone.0256585.ref025","unstructured":"Fawaz HI, Forestier G, Weber J, Idoumghar L, Muller P-A. Deep learning for time series classification: a review [Internet]. arXiv [cs.LG]. 2018. http:\/\/arxiv.org\/abs\/1809.04356"},{"key":"pone.0256585.ref026","volume-title":"Generalized Linear Models (Chapman & Hall\/CRC Monographs on Statistics and Applied Probability)","author":"P McCullagh","year":"1989","edition":"2"},{"key":"pone.0256585.ref027","first-page":"4765","volume-title":"Advances in Neural Information Processing Systems 30","author":"SM Lundberg","year":"2017"},{"key":"pone.0256585.ref028","doi-asserted-by":"crossref","first-page":"2394","DOI":"10.1158\/0008-5472.CAN-19-2175","article-title":"Model-Based Inference and Classification of Immunologic Control Mechanisms from TKI Cessation and Dose Reduction in Patients with CML","author":"T H\u00e4hnel","year":"2020","journal-title":"Cancer Res"},{"key":"pone.0256585.ref029","unstructured":"Chollet F. keras [Internet]. Github; [cited 2020 Nov 10]. https:\/\/github.com\/keras-team\/keras"},{"key":"pone.0256585.ref030","first-page":"273","article-title":"Bayesian Experimental Design: A Review","volume":"10","author":"K Chaloner","year":"1995","journal-title":"Stat Sci. Institute of Mathematical Statistics"},{"key":"pone.0256585.ref031","unstructured":"Goodwin. Dynamic System Identification: Experiment Design and Data Analysis. Academic Press; 1977."},{"key":"pone.0256585.ref032","first-page":"759","article-title":"Bayesian Inference and Optimal Design for the Sparse Linear Model","volume":"9","author":"MW Seeger","year":"2008","journal-title":"J Mach Learn Res"},{"key":"pone.0256585.ref033","volume-title":"Identification of Parametric Models: from Experimental Data","author":"E Walter","year":"2010"},{"key":"pone.0256585.ref034","doi-asserted-by":"crossref","first-page":"e375","DOI":"10.1016\/S2352-3026(19)30094-8","article-title":"De-escalation of tyrosine kinase inhibitor therapy before complete treatment discontinuation in patients with chronic myeloid leukaemia (DESTINY): a non-randomised, phase 2 trial","volume":"6","author":"RE Clark","year":"2019","journal-title":"Lancet Haematol"},{"key":"pone.0256585.ref035","unstructured":"Chen RTQ, Rubanova Y, Bettencourt J, Duvenaud D. Neural Ordinary Differential Equations [Internet]. arXiv [cs.LG]. 2018. http:\/\/arxiv.org\/abs\/1806.07366"},{"key":"pone.0256585.ref036","unstructured":"De Brouwer E, Simm J, Arany A, Moreau Y. GRU-ODE-Bayes: Continuous modeling of sporadically-observed time series. arXiv [csLG] [Internet]. 2019; https:\/\/arxiv.org\/abs\/1905.12374"},{"key":"pone.0256585.ref037","doi-asserted-by":"crossref","unstructured":"Arras L, Montavon G, M\u00fcller K-R, Samek W. Explaining Recurrent Neural Network Predictions in Sentiment Analysis [Internet]. arXiv [cs.CL]. 2017. http:\/\/arxiv.org\/abs\/1706.07206","DOI":"10.18653\/v1\/W17-5221"},{"key":"pone.0256585.ref038","unstructured":"Shrikumar A, Greenside P, Kundaje A. Learning Important Features Through Propagating Activation Differences [Internet]. arXiv [cs.CV]. 2017. http:\/\/arxiv.org\/abs\/1704.02685"},{"key":"pone.0256585.ref039","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","article-title":"A guide to deep learning in healthcare","volume":"25","author":"A Esteva","year":"2019","journal-title":"Nat Med"},{"key":"pone.0256585.ref040","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1038\/s42256-019-0048-x","article-title":"Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead","volume":"1","author":"C Rudin","year":"2019","journal-title":"Nature Machine Intelligence"},{"key":"pone.0256585.ref041","unstructured":"Tjoa E, Guan C. A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI [Internet]. arXiv [cs.LG]. 2019. http:\/\/arxiv.org\/abs\/1907.07374"},{"key":"pone.0256585.ref042","unstructured":"Pearl J, Mackenzie D. The book of why: the new science of cause and effect. Basic books; 2018."},{"key":"pone.0256585.ref043","unstructured":"Sch\u00f6lkopf B, Locatello F, Bauer S, Ke NR, Kalchbrenner N, Goyal A, et al. Towards Causal Representation Learning [Internet]. arXiv [cs.LG]. 2021. http:\/\/arxiv.org\/abs\/2102.11107"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0256585","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,15]],"date-time":"2023-01-15T01:27:13Z","timestamp":1673746033000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0256585"}},"subtitle":[],"editor":[{"given":"Mohamed A","family":"Yassin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,11,15]]},"references-count":43,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,11,15]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0256585","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.12.04.20243907","asserted-by":"object"}]},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,11,15]]}}}