{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T22:47:16Z","timestamp":1775861236372,"version":"3.50.1"},"reference-count":28,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2016,10,2]],"date-time":"2016-10-02T00:00:00Z","timestamp":1475366400000},"content-version":"vor","delay-in-days":2756,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/2.0\/uk\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,5,15]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Motivation: Although widely accepted that high-throughput biological data are typically highly noisy, the effects that this uncertainty has upon the conclusions we draw from these data are often overlooked. However, in order to assign any degree of confidence to our conclusions, we must quantify these effects. Bootstrap resampling is one method by which this may be achieved. Here, we present a parametric bootstrapping approach for time-course data, in which Gaussian process regression (GPR) is used to fit a probabilistic model from which replicates may then be drawn. This approach implicitly allows the time dependence of the data to be taken into account, and is applicable to a wide range of problems.<\/jats:p><jats:p>Results: We apply GPR bootstrapping to two datasets from the literature. In the first example, we show how the approach may be used to investigate the effects of data uncertainty upon the estimation of parameters in an ordinary differential equations (ODE) model of a cell signalling pathway. Although we find that the parameter estimates inferred from the original dataset are relatively robust to data uncertainty, we also identify a distinct second set of estimates. In the second example, we use our method to show that the topology of networks constructed from time-course gene expression data appears to be sensitive to data uncertainty, although there may be individual edges in the network that are robust in light of present data.<\/jats:p><jats:p>Availability: Matlab code for performing GPR bootstrapping is available from our web site: http:\/\/www3.imperial.ac.uk\/theoreticalsystemsbiology\/data-software\/<\/jats:p><jats:p>Contact: \u00a0paul.kirk@imperial.ac.uk, m.stumpf@imperial.ac.uk<\/jats:p><jats:p>Supplementary information: \u00a0Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btp139","type":"journal-article","created":{"date-parts":[[2009,3,17]],"date-time":"2009-03-17T00:34:13Z","timestamp":1237250053000},"page":"1300-1306","source":"Crossref","is-referenced-by-count":70,"title":["Gaussian process regression bootstrapping: exploring the effects of uncertainty in time course data"],"prefix":"10.1093","volume":"25","author":[{"given":"Paul D. W.","family":"Kirk","sequence":"first","affiliation":[{"name":"Centre for Bioinformatics, Division of Molecular Biosciences, Imperial College London, London SW7 2AZ, UK"}]},{"given":"Michael P. H.","family":"Stumpf","sequence":"additional","affiliation":[{"name":"Centre for Bioinformatics, Division of Molecular Biosciences, Imperial College London, London SW7 2AZ, UK"}]}],"member":"286","published-online":{"date-parts":[[2009,3,17]]},"reference":[{"key":"2023013110284968300_B1","doi-asserted-by":"crossref","first-page":"1653","DOI":"10.1126\/science.1071545","article-title":"A road map for those who don't know JAK-STAT","volume":"296","author":"Aaronson","year":"2002","journal-title":"Science"},{"key":"2023013110284968300_B2","doi-asserted-by":"crossref","first-page":"1152","DOI":"10.1214\/aos\/1176342871","article-title":"Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems","volume":"2","author":"Antoniak","year":"1974","journal-title":"Ann. Stat."},{"key":"2023013110284968300_B3","doi-asserted-by":"crossref","first-page":"R25","DOI":"10.1186\/gb-2006-7-3-r25","article-title":"Ranked prediction of p53 targets using hidden variable dynamic modeling","volume":"7","author":"Barenco","year":"2006","journal-title":"Genome Biol"},{"key":"2023013110284968300_B4","doi-asserted-by":"crossref","first-page":"12182","DOI":"10.1073\/pnas.220392197","article-title":"Discovering functional relationships between RNA expression and chemotherapeutic susceptibility using relevance networks","volume":"97","author":"Butte","year":"2000","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013110284968300_B5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1214\/aos\/1176344552","article-title":"Bootstrap methods: Another look at the jackknife","volume":"7","author":"Efron","year":"1979","journal-title":"Ann. Stat."},{"key":"2023013110284968300_B6","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-4541-9","volume-title":"An Introduction to the Bootstrap.","author":"Efron","year":"1993"},{"key":"2023013110284968300_B7","doi-asserted-by":"crossref","first-page":"783","DOI":"10.2307\/2408678","article-title":"Confidence limits on phylogenies: an approach using the bootstrap","volume":"39","author":"Felsenstein","year":"1985","journal-title":"Evolution"},{"key":"2023013110284968300_B8","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1214\/aos\/1176342360","article-title":"A Bayesian analysis of some nonparametric problems","volume":"1","author":"Ferguson","year":"1973","journal-title":"Ann. Stat."},{"key":"2023013110284968300_B9","doi-asserted-by":"crossref","first-page":"i70","DOI":"10.1093\/bioinformatics\/btn278","article-title":"Gaussian process modelling of latent chemical species: applications to inferring transcription factor activities","volume":"24","author":"Gao","year":"2008","journal-title":"Bioinformatics"},{"key":"2023013110284968300_B10","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1016\/S0968-0004(00)01624-8","article-title":"STAT proteins and transcriptional responses to extracellular signals","volume":"25","author":"Horvath","year":"2000","journal-title":"Trends Biochem. Sci."},{"key":"2023013110284968300_B11","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/978-3-540-25974-9_12","article-title":"Residual bootstrapping and median filtering for robust estimation of gene networks from microarray data","volume-title":"Computational Methods in Systems Biology.","author":"Imoto","year":"2005"},{"key":"2023013110284968300_B12","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1093\/bioinformatics\/bti753","article-title":"libsres: a c library for stochastic ranking evolution strategy for parameter estimation","volume":"22","author":"Ji","year":"2006","journal-title":"Bioinformatics"},{"key":"2023013110284968300_B13","doi-asserted-by":"crossref","first-page":"8961","DOI":"10.1073\/pnas.161273698","article-title":"Bootstrapping cluster analysis: assessing the reliability of conclusions from microarray experiments","volume":"98","author":"Kerr","year":"2001","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013110284968300_B14","doi-asserted-by":"crossref","first-page":"785","DOI":"10.7551\/mitpress\/7503.003.0103","article-title":"Modelling transcriptional regulation using Gaussian processes","volume-title":"Advances in Neural Information Processing Systems 19.","author":"Lawrence","year":"2007"},{"key":"2023013110284968300_B15","first-page":"1","article-title":"Inferring dynamic genetic networks with low order independencies","author":"L\u00e8bre","year":"2007","journal-title":"arXiv.org"},{"key":"2023013110284968300_B16","first-page":"133","article-title":"Introduction to Gaussian processes","volume-title":"Neural Networks and Machine Learning.","author":"MacKay","year":"1998"},{"key":"2023013110284968300_B17","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1214\/088342304000000017","article-title":"Nonparametric Bayesian data analysis","volume":"19","author":"M\u00fcller","year":"2004","journal-title":"Stat. Sci."},{"key":"2023013110284968300_B18","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1186\/1752-0509-1-37","article-title":"From correlation to causation networks: a simple approximate learning algorithm and its application to high-dimensional plant gene expression data","volume":"1","author":"Opgen-Rhein","year":"2007","journal-title":"BMC Syst. Biol."},{"key":"2023013110284968300_B19","volume-title":"Numerical Recipes: The Art of Scientific Computing.","author":"Press","year":"2007"},{"key":"2023013110284968300_B20","article-title":"Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning)","author":"Rasmussen","year":"2006"},{"key":"2023013110284968300_B21","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1109\/4235.873238","article-title":"Stochastic ranking for constrained evolutionary optimization","volume":"4","author":"Runarsson","year":"2000","journal-title":"IEEE Trans. Evol. Comput."},{"key":"2023013110284968300_B22","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1093\/bioinformatics\/bti062","article-title":"An empirical Bayes approach to inferring large-scale gene association networks","volume":"21","author":"Sch\u00e4fer","year":"2005","journal-title":"Bioinformatics"},{"key":"2023013110284968300_B23","first-page":"50","article-title":"Reverse engineering genetic networks using the GeneNet package","volume":"6","author":"Sch\u00e4fer","year":"2006","journal-title":"R News"},{"key":"2023013110284968300_B24","doi-asserted-by":"crossref","first-page":"2687","DOI":"10.1104\/pp.104.044347","article-title":"Diurnal changes in the transcriptome encoding enzymes of starch metabolism provide evidence for both transcriptional and posttranscriptional regulation of starch metabolism in Arabidopsis leaves","volume":"136","author":"Smith","year":"2004","journal-title":"Plant Physiol."},{"key":"2023013110284968300_B25","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-1494-6","volume-title":"Interpolation of Spatial Data : Some Theory for Kriging (Springer Series in Statistics).","author":"Stein","year":"1999"},{"key":"2023013110284968300_B26","doi-asserted-by":"crossref","first-page":"1028","DOI":"10.1073\/pnas.0237333100","article-title":"Identification of nucleocytoplasmic cycling as a remote sensor in cellular signaling by databased modeling","volume":"100","author":"Swameye","year":"2003","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013110284968300_B27","volume-title":"Mathematical Theory of Probability and Statistics.","author":"von Mises","year":"1964"},{"key":"2023013110284968300_B28","doi-asserted-by":"crossref","first-page":"1754","DOI":"10.1016\/j.csda.2005.11.017","article-title":"Flexible temporal expression profile modelling using the Gaussian process","volume":"51","author":"Yuan","year":"2006","journal-title":"Comput. Stat. Data Anal."}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/25\/10\/1300\/48990193\/bioinformatics_25_10_1300.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/25\/10\/1300\/48990193\/bioinformatics_25_10_1300.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,11]],"date-time":"2024-03-11T19:22:38Z","timestamp":1710184958000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/25\/10\/1300\/269780"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,3,17]]},"references-count":28,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2009,5,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btp139","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2009,5,15]]},"published":{"date-parts":[[2009,3,17]]}}}