{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T11:19:56Z","timestamp":1767179996857,"version":"build-2238731810"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1010734","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T00:00:00Z","timestamp":1670457600000}}],"reference-count":60,"publisher":"Public Library of Science (PLoS)","issue":"11","license":[{"start":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T00:00:00Z","timestamp":1669593600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["DP200100177"],"award-info":[{"award-number":["DP200100177"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["FT210100260"],"award-info":[{"award-number":["FT210100260"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Heterogeneity is a dominant factor in the behaviour of many biological processes. Despite this, it is common for mathematical and statistical analyses to ignore biological heterogeneity as a source of variability in experimental data. Therefore, methods for exploring the identifiability of models that explicitly incorporate heterogeneity through variability in model parameters are relatively underdeveloped. We develop a new likelihood-based framework, based on moment matching, for inference and identifiability analysis of differential equation models that capture biological heterogeneity through parameters that vary according to probability distributions. As our novel method is based on an approximate likelihood function, it is highly flexible; we demonstrate identifiability analysis using both a frequentist approach based on profile likelihood, and a Bayesian approach based on Markov-chain Monte Carlo. Through three case studies, we demonstrate our method by providing a didactic guide to inference and identifiability analysis of hyperparameters that relate to the statistical moments of model parameters from independent observed data. Our approach has a computational cost comparable to analysis of models that neglect heterogeneity, a significant improvement over many existing alternatives. We demonstrate how analysis of random parameter models can aid better understanding of the sources of heterogeneity from biological data.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1010734","type":"journal-article","created":{"date-parts":[[2022,11,28]],"date-time":"2022-11-28T14:07:03Z","timestamp":1669644423000},"page":"e1010734","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":13,"title":["Efficient inference and identifiability analysis for differential equation models with random parameters"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8753-1538","authenticated-orcid":true,"given":"Alexander P.","family":"Browning","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9222-8763","authenticated-orcid":true,"given":"Christopher","family":"Drovandi","sequence":"additional","affiliation":[]},{"given":"Ian W.","family":"Turner","sequence":"additional","affiliation":[]},{"given":"Adrianne L.","family":"Jenner","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6254-313X","authenticated-orcid":true,"given":"Matthew J.","family":"Simpson","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,11,28]]},"reference":[{"issue":"16","key":"pcbi.1010734.ref001","doi-asserted-by":"crossref","first-page":"5126","DOI":"10.1073\/pnas.81.16.5126","article-title":"Outline of a theory of cellular heterogeneity","volume":"81","author":"WM Elsasser","year":"1984","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"2","key":"pcbi.1010734.ref002","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1038\/nrg2509","article-title":"Stochastic modelling for quantitative description of heterogeneous biological systems","volume":"10","author":"DJ Wilkinson","year":"2009","journal-title":"Nature Reviews Genetics"},{"issue":"3","key":"pcbi.1010734.ref003","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1177\/2472555216682725","article-title":"Biologically relevant heterogeneity: metrics and practical insights","volume":"22","author":"A Gough","year":"2016","journal-title":"SLAS Discovery"},{"issue":"2","key":"pcbi.1010734.ref004","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.tree.2003.10.013","article-title":"Model selection in ecology and evolution","volume":"19","author":"JB Johnson","year":"2004","journal-title":"Trends in Ecology & Evolution"},{"issue":"484","key":"pcbi.1010734.ref005","doi-asserted-by":"crossref","first-page":"1570","DOI":"10.1198\/016214508000000797","article-title":"Parameter estimation for differential equation models using a framework of measurement error in regression models","volume":"103","author":"H Liang","year":"2008","journal-title":"Journal of the American Statistical Association"},{"issue":"1984","key":"pcbi.1010734.ref006","doi-asserted-by":"crossref","first-page":"20110544","DOI":"10.1098\/rsta.2011.0544","article-title":"Joining forces of Bayesian and frequentist methodology: a study for inference in the presence of non-identifiability","volume":"371","author":"A Raue","year":"2013","journal-title":"Philosophical Transactions of the Royal Society A"},{"issue":"3","key":"pcbi.1010734.ref007","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1085\/jgp.201311116","article-title":"Determination of parameter identifiability in nonlinear biophysical models: A Bayesian approach","volume":"143","author":"KE Hines","year":"2014","journal-title":"The Journal of General Physiology"},{"issue":"164","key":"pcbi.1010734.ref008","doi-asserted-by":"crossref","first-page":"20200055","DOI":"10.1098\/rsif.2020.0055","article-title":"Practical parameter identifiability for spatio-temporal models of cell invasion","volume":"17","author":"MJ Simpson","year":"2020","journal-title":"Journal of The Royal Society Interface"},{"issue":"15","key":"pcbi.1010734.ref009","doi-asserted-by":"crossref","first-page":"1923","DOI":"10.1093\/bioinformatics\/btp358","article-title":"Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood","volume":"25","author":"A Raue","year":"2009","journal-title":"Bioinformatics"},{"issue":"11","key":"pcbi.1010734.ref010","doi-asserted-by":"crossref","first-page":"e27755","DOI":"10.1371\/journal.pone.0027755","article-title":"Structural identifiability of systems biology models: a critical comparison of methods","volume":"6","author":"OT Chis","year":"2011","journal-title":"PLOS One"},{"issue":"11","key":"pcbi.1010734.ref011","doi-asserted-by":"crossref","first-page":"2275","DOI":"10.1016\/j.bpj.2012.10.024","article-title":"MCMC can detect nonidentifiable models","volume":"103","author":"I Siekmann","year":"2012","journal-title":"Biophysical Journal"},{"key":"pcbi.1010734.ref012","doi-asserted-by":"crossref","first-page":"20200652","DOI":"10.1098\/rsif.2020.0652","article-title":"Identifiability analysis for stochastic differential equation models in systems biology","volume":"17","author":"AP Browning","year":"2020","journal-title":"Journal of The Royal Society Interface"},{"key":"pcbi.1010734.ref013","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.mbs.2014.08.008","article-title":"Determining identifiable parameter combinations using subset profiling","volume":"256","author":"MC Eisenberg","year":"2014","journal-title":"Mathematical Biosciences"},{"issue":"1","key":"pcbi.1010734.ref014","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1038\/msb.2009.75","article-title":"Listening to the noise: random fluctuations reveal gene network parameters","volume":"5","author":"B Munsky","year":"2009","journal-title":"Molecular Systems Biology"},{"issue":"21","key":"pcbi.1010734.ref015","doi-asserted-by":"crossref","first-page":"8645","DOI":"10.1073\/pnas.1015814108","article-title":"Sensitivity, robustness, and identifiability in stochastic chemical kinetics models","volume":"108","author":"M Komorowski","year":"2011","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"pcbi.1010734.ref016","doi-asserted-by":"crossref","first-page":"e1006365","DOI":"10.1371\/journal.pcbi.1006365","article-title":"The finite state projection based Fisher information matrix approach to estimate information and optimize single-cell experiments","volume":"15","author":"ZR Fox","year":"2019","journal-title":"PLOS Computational Biology"},{"issue":"1-2","key":"pcbi.1010734.ref017","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/s00285-021-01711-1","article-title":"Structural identifiability analysis of age-structured PDE epidemic models","volume":"84","author":"M Renardy","year":"2022","journal-title":"Journal of Mathematical Biology"},{"issue":"5584","key":"pcbi.1010734.ref018","doi-asserted-by":"crossref","first-page":"1183","DOI":"10.1126\/science.1070919","article-title":"Stochastic gene expression in a single cell","volume":"297","author":"MB Elowitz","year":"2002","journal-title":"Science"},{"issue":"6508","key":"pcbi.1010734.ref019","doi-asserted-by":"crossref","first-page":"eabc8511","DOI":"10.1126\/science.abc8511","article-title":"Deep immune profiling of COVID-19 patients reveals distinct immunotypes with therapeutic implications","volume":"369","author":"D Mathew","year":"2020","journal-title":"Science"},{"key":"pcbi.1010734.ref020","doi-asserted-by":"crossref","first-page":"e73020","DOI":"10.7554\/eLife.73020","article-title":"Quantitative analysis of tumour spheroid structure","volume":"10","author":"AP Browning","year":"2021","journal-title":"eLife"},{"key":"pcbi.1010734.ref021","doi-asserted-by":"crossref","DOI":"10.1007\/b98868","volume-title":"Mathematical Biology","author":"JD Murray","year":"2002","edition":"3"},{"key":"pcbi.1010734.ref022","doi-asserted-by":"crossref","first-page":"110998","DOI":"10.1016\/j.jtbi.2021.110998","article-title":"Parameter identifiability and model selection for sigmoid population growth models","volume":"535","author":"MJ Simpson","year":"2022","journal-title":"Journal of Theoretical Biology"},{"issue":"5","key":"pcbi.1010734.ref023","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1016\/j.cels.2018.04.008","article-title":"A hierarchical, data-driven approach to modeling single-cell populations predicts latent causes of cell-to-cell variability","volume":"6","author":"C Loos","year":"2018","journal-title":"Cell Systems"},{"key":"pcbi.1010734.ref024","doi-asserted-by":"crossref","first-page":"110541","DOI":"10.1016\/j.jtbi.2020.110541","article-title":"A Monte Carlo method to estimate cell population heterogeneity from cell snapshot data","volume":"511","author":"B Lambert","year":"2021","journal-title":"Journal of Theoretical Biology"},{"key":"pcbi.1010734.ref025","volume-title":"vol. 103 of Mathematics in Science and Engineering","author":"T Soong","year":"1973"},{"issue":"1","key":"pcbi.1010734.ref026","doi-asserted-by":"crossref","first-page":"e1701676","DOI":"10.1126\/sciadv.1701676","article-title":"Unlocking data sets by calibrating populations of models to data density: A study in atrial electrophysiology","volume":"4","author":"BAJ Lawson","year":"2018","journal-title":"Science Advances"},{"issue":"2","key":"pcbi.1010734.ref027","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1111\/j.1541-0420.2005.00447.x","article-title":"Hierarchical Bayesian methods for estimation of parameters in a longitudinal HIV dynamic system","volume":"62","author":"Y Huang","year":"2006","journal-title":"Biometrics"},{"issue":"7","key":"pcbi.1010734.ref028","doi-asserted-by":"crossref","first-page":"e1003686","DOI":"10.1371\/journal.pcbi.1003686","article-title":"ODE constrained mixture modelling: a method for unraveling subpopulation structures and dynamics","volume":"10","author":"J Hasenauer","year":"2014","journal-title":"PLOS Computational Biology"},{"issue":"2","key":"pcbi.1010734.ref029","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1038\/nmeth.2794","article-title":"Scalable inference of heterogeneous reaction kinetics from pooled single-cell recordings","volume":"11","author":"C Zechner","year":"2014","journal-title":"Nature Methods"},{"issue":"1","key":"pcbi.1010734.ref030","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/j.cels.2018.12.007","article-title":"A simple and flexible computational framework for inferring sources of heterogeneity from single-cell dynamics","volume":"8","author":"L Dharmarajan","year":"2019","journal-title":"Cell Systems"},{"issue":"1","key":"pcbi.1010734.ref031","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1007\/s11222-012-9357-1","article-title":"Estimating mixed-effects differential equation models","volume":"24","author":"L Wang","year":"2014","journal-title":"Statistics and Computing"},{"issue":"190","key":"pcbi.1010734.ref032","doi-asserted-by":"crossref","first-page":"20220019","DOI":"10.1098\/rsif.2022.0019","article-title":"Identifying cell-to-cell variability in internalization using flow cytometry","volume":"19","author":"AP Browning","year":"2022","journal-title":"Journal of the Royal Society Interface"},{"key":"pcbi.1010734.ref033","unstructured":"Drovandi C, Lawson B, Jenner AL, Browning AP. Population calibration using likelihood-free Bayesian inference. arXiv. 2022;"},{"issue":"1","key":"pcbi.1010734.ref034","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1186\/1471-2105-12-125","article-title":"Identification of models of heterogeneous cell populations from population snapshot data","volume":"12","author":"J Hasenauer","year":"2011","journal-title":"BMC Bioinformatics"},{"issue":"4","key":"pcbi.1010734.ref035","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1016\/S0167-9473(97)00012-1","article-title":"Two Taylor-series approximation methods for nonlinear mixed models","volume":"25","author":"RD Wolfinger","year":"1997","journal-title":"Computational Statistics & Data Analysis"},{"issue":"11","key":"pcbi.1010734.ref036","doi-asserted-by":"crossref","first-page":"2475","DOI":"10.1101\/gr.1196503","article-title":"Fast evaluation of fluctuations in biochemical networks with the linear noise approximation","volume":"13","author":"J Elf","year":"2003","journal-title":"Genome Research"},{"key":"pcbi.1010734.ref037","volume-title":"Stochastic processes in physics and chemistry","author":"NG van Kampen","year":"2007","edition":"3"},{"issue":"3","key":"pcbi.1010734.ref038","doi-asserted-by":"crossref","first-page":"035101","DOI":"10.1063\/1.3454685","article-title":"An effective rate equation approach to reaction kinetics in small volumes: Theory and application to biochemical reactions in nonequilibrium steady-state conditions","volume":"133","author":"R Grima","year":"2010","journal-title":"The Journal of Chemical Physics"},{"issue":"7","key":"pcbi.1010734.ref039","doi-asserted-by":"crossref","first-page":"e1005030","DOI":"10.1371\/journal.pcbi.1005030","article-title":"Inference for stochastic chemical kinetics using moment equations and system size expansion","volume":"12","author":"F Fr\u00f6hlich","year":"2016","journal-title":"PLOS Computational Biology"},{"issue":"3","key":"pcbi.1010734.ref040","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1158\/0008-5472.CAN-12-3783","article-title":"Sequential application of a cytotoxic nanoparticle and a PI3K inhibitor enhances antitumor efficacy","volume":"74","author":"A Pandey","year":"2014","journal-title":"Cancer Research"},{"key":"pcbi.1010734.ref041","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.jtbi.2018.05.030","article-title":"Modelling heterogeneity in viral-tumour dynamics: The effects of gene-attenuation on viral characteristics","volume":"454","author":"A Jenner","year":"2018","journal-title":"Journal of Theoretical Biology"},{"issue":"9","key":"pcbi.1010734.ref042","doi-asserted-by":"crossref","first-page":"4699","DOI":"10.3390\/ijms22094699","article-title":"Procaspase-activating compound-1 synergizes with TRAIL to induce apoptosis in established granulosa cell tumor cell line (KGN) and explanted patient granulosa cell tumor cells in vitro","volume":"22","author":"P Crosley","year":"2021","journal-title":"International Journal of Molecular Sciences"},{"issue":"3","key":"pcbi.1010734.ref043","doi-asserted-by":"crossref","first-page":"577","DOI":"10.2307\/1913267","article-title":"Identification in parametric models","volume":"39","author":"TJ Rothenberg","year":"1971","journal-title":"Econometrica"},{"key":"pcbi.1010734.ref044","volume-title":"Springer series in statistics","author":"RB Nelsen","year":"2006","edition":"2"},{"issue":"6","key":"pcbi.1010734.ref045","doi-asserted-by":"crossref","first-page":"109507","DOI":"10.1016\/j.celrep.2021.109507","article-title":"Cell-to-cell variability in JAK2\/STAT5 pathway components and cytoplasmic volumes defines survival threshold in erythroid progenitor cells","volume":"36","author":"L Adlung","year":"2021","journal-title":"Cell Reports"},{"key":"pcbi.1010734.ref046","volume-title":"Bayesian Data Analysis","author":"A Gelman","year":"2014","edition":"3"},{"key":"pcbi.1010734.ref047","unstructured":"Johnson SG. The NLopt module for Julia; 2021. Available from: https:\/\/github.com\/JuliaOpt\/NLopt.jl."},{"key":"pcbi.1010734.ref048","volume-title":"In all likelihood: statistical modelling and inference using likelihood","author":"Y Pawitan","year":"2013"},{"key":"pcbi.1010734.ref049","first-page":"1","article-title":"Ergonomic and reliable Bayesian inference with adaptive Markov chain Monte Carlo","author":"M Vihola","year":"2020","journal-title":"Wiley StatsRef: Statistics Reference Online"},{"key":"pcbi.1010734.ref050","doi-asserted-by":"crossref","first-page":"105999","DOI":"10.1016\/j.aml.2019.105999","article-title":"Parameter estimation using aggregate data","volume":"100","author":"HT Banks","year":"2020","journal-title":"Applied Mathematics Letters"},{"issue":"6","key":"pcbi.1010734.ref051","doi-asserted-by":"crossref","first-page":"982","DOI":"10.1172\/JCI106079","article-title":"Distribution and turnover of cholesterol in humans","volume":"48","author":"PJ Nestel","year":"1969","journal-title":"Journal of Clinical Investigation"},{"issue":"1","key":"pcbi.1010734.ref052","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1152\/ajpregu.1980.239.1.R7","article-title":"Parameter and structural identifiability concepts and ambiguities: a critical review and analysis","volume":"239","author":"C Cobelli","year":"1980","journal-title":"American Journal of Physiology-Regulatory, Integrative and Comparative Physiology"},{"issue":"1","key":"pcbi.1010734.ref053","doi-asserted-by":"crossref","DOI":"10.5334\/jors.151","article-title":"DifferentialEquations.jl\u2014A performant and feature-rich ecosystem for solving differential equations in Julia","volume":"5","author":"C Rackauckas","year":"2016","journal-title":"Journal of Open Research Software"},{"key":"pcbi.1010734.ref054","unstructured":"Revels J, Lubin M, Papamarkou T. Forward-mode automatic differentiation in Julia. arXiv. 2016;."},{"issue":"9","key":"pcbi.1010734.ref055","doi-asserted-by":"crossref","first-page":"2314","DOI":"10.1016\/j.biomaterials.2010.10.031","article-title":"Active targeting and safety profile of PEG-modified adenovirus conjugated with herceptin","volume":"32","author":"PH Kim","year":"2011","journal-title":"Biomaterials"},{"issue":"7821","key":"pcbi.1010734.ref056","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1038\/s41586-020-2588-y","article-title":"Longitudinal analyses reveal immunological misfiring in severe COVID-19","volume":"584","author":"C Lucas","year":"2020","journal-title":"Nature"},{"issue":"1","key":"pcbi.1010734.ref057","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1016\/j.tcs.2008.07.005","article-title":"Bayesian inference for differential equations","volume":"408","author":"M Girolami","year":"2008","journal-title":"Theoretical Computer Science"},{"issue":"2262","key":"pcbi.1010734.ref058","doi-asserted-by":"crossref","first-page":"20220013","DOI":"10.1098\/rspa.2022.0013","article-title":"Interpreting how nonlinear diffusion affects the fate of bistable populations using a discrete modelling framework","volume":"478","author":"Y Li","year":"2022","journal-title":"Proceedings of the Royal Society A"},{"issue":"2","key":"pcbi.1010734.ref059","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/0040-5809(77)90040-5","article-title":"Random environments and stochastic calculus","volume":"12","author":"M Turelli","year":"1977","journal-title":"Theoretical Population Biology"},{"issue":"2","key":"pcbi.1010734.ref060","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1080\/10618600.2021.2000419","article-title":"Rapid Bayesian inference for expensive stochastic models","volume":"31","author":"DJ Warne","year":"2021","journal-title":"Journal of Computational and Graphical Statistics"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1010734","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T00:00:00Z","timestamp":1670457600000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010734","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T13:44:47Z","timestamp":1670507087000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010734"}},"subtitle":[],"editor":[{"given":"Ricardo","family":"Martinez-Garcia","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,11,28]]},"references-count":60,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,11,28]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010734","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,28]]}}}