{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T18:26:26Z","timestamp":1772907986541,"version":"3.50.1"},"reference-count":41,"publisher":"Oxford University Press (OUP)","issue":"24","license":[{"start":{"date-parts":[[2019,5,29]],"date-time":"2019-05-29T00:00:00Z","timestamp":1559088000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"Center for Interdisciplinary Mathematics"},{"DOI":"10.13039\/100016408","name":"G\u00f6ran Gustafsson foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100016408","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000070","name":"National Institute of Biomedical Imaging And Bioengineering","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000070","name":"NIBIB","doi-asserted-by":"publisher","award":["2R01EB014877-04A1"],"award-info":[{"award-number":["2R01EB014877-04A1"]}],"id":[{"id":"10.13039\/100000070","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2019,12,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>Discrete stochastic models of gene regulatory network models are indispensable tools for biological inquiry since they allow the modeler to predict how molecular interactions give rise to nonlinear system output. Model exploration with the objective of generating qualitative hypotheses about the workings of a pathway is usually the first step in the modeling process. It involves simulating the gene network model under a very large range of conditions, due to the large uncertainty in interactions and kinetic parameters. This makes model exploration highly computational demanding. Furthermore, with no prior information about the model behavior, labor-intensive manual inspection of very large amounts of simulation results becomes necessary. This limits systematic computational exploration to simplistic models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We have developed an interactive, smart workflow for model exploration based on semi-supervised learning and human-in-the-loop labeling of data. The workflow lets a modeler rapidly discover ranges of interesting behaviors predicted by the model. Utilizing that similar simulation output is in proximity of each other in a feature space, the modeler can focus on informing the system about what behaviors are more interesting than others by labeling, rather than analyzing simulation results with custom scripts and workflows. This results in a large reduction in time-consuming manual work by the modeler early in a modeling project, which can substantially reduce the time needed to go from an initial model to testable predictions and downstream analysis.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability and implementation<\/jats:title>\n                    <jats:p>A python-package is available at https:\/\/github.com\/Wrede\/mio.git.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Supplementary information<\/jats:title>\n                    <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btz420","type":"journal-article","created":{"date-parts":[[2019,5,27]],"date-time":"2019-05-27T07:10:07Z","timestamp":1558941007000},"page":"5199-5206","source":"Crossref","is-referenced-by-count":12,"title":["Smart computational exploration of stochastic gene regulatory network models using human-in-the-loop semi-supervised learning"],"prefix":"10.1093","volume":"35","author":[{"given":"Fredrik","family":"Wrede","sequence":"first","affiliation":[{"name":"Department of Information Technology, Uppsala University , Uppsala SE-75105, Sweden"}]},{"given":"Andreas","family":"Hellander","sequence":"additional","affiliation":[{"name":"Department of Information Technology, Uppsala University , Uppsala SE-75105, Sweden"}]}],"member":"286","published-online":{"date-parts":[[2019,5,29]]},"reference":[{"key":"2023013108384190900_btz420-B1","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1109\/LLS.2017.2652448","article-title":"GillesPy: a python package for stochastic model building and simulation","volume":"2","author":"Abel","year":"2017","journal-title":"IEEE Life Sci. Lett"},{"key":"2023013108384190900_btz420-B2","doi-asserted-by":"crossref","first-page":"3366","DOI":"10.1093\/bioinformatics\/btw469","article-title":"BioNetGen 2.2: advances in rule-based modeling","volume":"32","author":"Arora","year":"2016","journal-title":"Bioinformatics"},{"key":"2023013108384190900_btz420-B3","first-page":"396","volume-title":"Tools and Algorithms for the Construction and Analysis of Systems, Lecture Notes in Computer Science","author":"Bortolussi","year":"2018"},{"key":"2023013108384190900_btz420-B4","volume-title":"arXiv preprint","author":"Budnik","year":"2018"},{"key":"2023013108384190900_btz420-B5","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/FormaliSE.2015.12","article-title":"Infer gene regulatory networks from time series data with probabilistic model checking","author":"Ceccarelli","year":"2015","journal-title":"2015 IEEE\/ACM 3rd FME Workshop on Formal Methods in Software Engineering"},{"key":"2023013108384190900_btz420-B12","author":"\u010ce\u0161ka","year":"2017"},{"key":"2023013108384190900_btz420-B6","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.neucom.2018.03.067","article-title":"Time series featuRe extraction on basis of scalable hypothesis tests (tsfresh - A Python package)","volume":"307","author":"Christ","year":"2018","journal-title":"Neurocomputing"},{"key":"2023013108384190900_btz420-B7","doi-asserted-by":"crossref","first-page":"1018","DOI":"10.1016\/j.cub.2006.03.092","article-title":"Transcriptional pulsing of a developmental gene","volume":"16","author":"Chubb","year":"2006","journal-title":"Curr. Biol"},{"key":"2023013108384190900_btz420-B8","first-page":"231","volume-title":"Computational Methods in Systems Biology, Lecture Notes in Computer Science","author":"Clarke","year":"2008"},{"key":"2023013108384190900_btz420-B34","year":"2016"},{"key":"2023013108384190900_btz420-B10","doi-asserted-by":"crossref","first-page":"C179","DOI":"10.1137\/15M1014784","article-title":"MOLNs: a cloud platform for interactive, reproducible, and scalable spatial stochastic computational experiments in systems biology using pyURDME","volume":"38","author":"Drawert","year":"2016","journal-title":"SIAM J. Sci. Comput"},{"key":"2023013108384190900_btz420-B11","doi-asserted-by":"crossref","first-page":"e1005220.","DOI":"10.1371\/journal.pcbi.1005220","article-title":"Stochastic simulation service: bridging the gap between the computational expert and the biologist","volume":"12","author":"Drawert","year":"2016","journal-title":"PLoS Comput. Biol"},{"key":"2023013108384190900_btz420-B13","doi-asserted-by":"crossref","first-page":"1183","DOI":"10.1126\/science.1070919","article-title":"Stochastic gene expression in a single cell","volume":"297","author":"Elowitz","year":"2002","journal-title":"Science"},{"key":"2023013108384190900_btz420-B9","doi-asserted-by":"crossref","first-page":"e80.","DOI":"10.1371\/journal.pcbi.0020080","article-title":"Noise induced Min phenotypes in E. coli","volume":"2","author":"Fange","year":"2006","journal-title":"PLoS Comput. Biol"},{"key":"2023013108384190900_btz420-B14","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1016\/0021-9991(76)90041-3","article-title":"A general method for numerically simulating the stochastic time evolution of coupled chemical reactions","volume":"22","author":"Gillespie","year":"1976","journal-title":"J. Comput. Phys"},{"key":"2023013108384190900_btz420-B15","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1016\/0378-4371(92)90283-V","article-title":"A rigorous derivation of the chemical master equation","volume":"188","author":"Gillespie","year":"1992","journal-title":"Phys. A Stat. Mech. Appl"},{"key":"2023013108384190900_btz420-B16","doi-asserted-by":"crossref","first-page":"170901.","DOI":"10.1063\/1.4801941","article-title":"Perspective: stochastic algorithms for chemical kinetics","volume":"138","author":"Gillespie","year":"2013","journal-title":"J. Chem. Phys"},{"key":"2023013108384190900_btz420-B17","doi-asserted-by":"crossref","first-page":"75.","DOI":"10.1186\/s13073-017-0467-4","article-title":"A practical guide to single-cell RNA-sequencing for biomedical research and clinical applications","volume":"9","author":"Haque","year":"2017","journal-title":"Genome Med"},{"key":"2023013108384190900_btz420-B18","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1007\/978-3-642-03845-7_15","volume-title":"Computational Methods in Systems Biology","author":"Jha","year":"2009"},{"key":"2023013108384190900_btz420-B19","doi-asserted-by":"crossref","first-page":"e1003139.","DOI":"10.1371\/journal.pcbi.1003139","article-title":"Spatial stochastic dynamics enable robust cell polarization","volume":"9","author":"Lawson","year":"2013","journal-title":"PLoS Comput. Biol"},{"key":"2023013108384190900_btz420-B20","doi-asserted-by":"crossref","first-page":"3067","DOI":"10.1093\/bioinformatics\/btl485","article-title":"COPASI\u2014a COmplex PAthway SImulator","volume":"22","author":"Lee","year":"2006","journal-title":"Bioinformatics"},{"key":"2023013108384190900_btz420-B21","doi-asserted-by":"crossref","DOI":"10.1038\/msb.2013.1","article-title":"Programming biological models in python using PySB","volume":"9","author":"Lopez","year":"2013","journal-title":"Mol. Syst. Biol"},{"key":"2023013108384190900_btz420-B22","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"Maaten","year":"2008","journal-title":"J. Mach. Learn. Res"},{"key":"2023013108384190900_btz420-B23","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/S0168-9525(98)01659-X","article-title":"It\u2019s a noisy business! Genetic regulation at the nanomolar scale","volume":"15","author":"McAdams","year":"1999","journal-title":"Trends Genet"},{"key":"2023013108384190900_btz420-B24","volume-title":"arXiv preprint","author":"McInnes","year":"2018"},{"key":"2023013108384190900_btz420-B25","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1080\/14786440109462720","article-title":"LIII. on lines and planes of closest fit to systems of points in space","volume":"2","author":"Pearson","year":"1901","journal-title":"Lond. Edinburgh Dublin Philos. Mag. J. Sci"},{"key":"2023013108384190900_btz420-B26","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1038\/547125a","article-title":"Single-cell sequencing made simple","volume":"547","author":"Perkel","year":"2017","journal-title":"Nature"},{"key":"2023013108384190900_btz420-B27","author":"Ragan-Kelley","year":"2014"},{"key":"2023013108384190900_btz420-B28","doi-asserted-by":"crossref","first-page":"e309.","DOI":"10.1371\/journal.pbio.0040309","article-title":"Stochastic mRNA synthesis in mammalian cells","volume":"4","author":"Raj","year":"2006","journal-title":"PLoS Biol"},{"key":"2023013108384190900_btz420-B29","doi-asserted-by":"crossref","first-page":"2457","DOI":"10.1093\/bioinformatics\/btr401","article-title":"StochKit2: software for discrete stochastic simulation of biochemical systems with events","volume":"27","author":"Sanft","year":"2011","journal-title":"Bioinformatics"},{"key":"2023013108384190900_btz420-B30","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1162\/089976698300017467","article-title":"Nonlinear component analysis as a kernel eigenvalue problem","volume":"10","author":"Sch\u00f6lkopf","year":"1998","journal-title":"Neural Comput"},{"key":"2023013108384190900_btz420-B31","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1007\/s11538-013-9842-5","article-title":"The role of dimerisation and nuclear transport in the hes1 gene regulatory network","volume":"76","author":"Sturrock","year":"2014","journal-title":"Bull. Math. Biol"},{"key":"2023013108384190900_btz420-B32","doi-asserted-by":"crossref","first-page":"20120988.","DOI":"10.1098\/rsif.2012.0988","article-title":"Spatial stochastic modelling of the hes1 gene regulatory network: intrinsic noise can explain heterogeneity in embryonic stem cell differentiation","volume":"10","author":"Sturrock","year":"2013","journal-title":"J. R. Soc. Interface"},{"key":"2023013108384190900_btz420-B33","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1126\/science.1188308","article-title":"Quantifying E. coli proteome and transcriptome with single-molecule sensitivity in single cells","volume":"329","author":"Taniguchi","year":"2010","journal-title":"Science"},{"key":"2023013108384190900_btz420-B35","volume-title":"Stochastic Processes in Physics and Chemistry","author":"Van Kampen","year":"1992"},{"key":"2023013108384190900_btz420-B36","doi-asserted-by":"crossref","first-page":"5988","DOI":"10.1073\/pnas.092133899","article-title":"Mechanisms of noise-resistance in genetic oscillators","volume":"99","author":"Vilar","year":"2002","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"2023013108384190900_btz420-B37","volume-title":"J. Phys. Chem. A.","author":"Wales","year":"1997"},{"key":"2023013108384190900_btz420-B38","doi-asserted-by":"crossref","first-page":"142.","DOI":"10.1186\/1752-0509-5-142","article-title":"Efficient characterization of high-dimensional parameter spaces for systems biology","volume":"5","author":"Zamora-Sillero","year":"2011","journal-title":"BMC Syst. Biol"},{"key":"2023013108384190900_btz420-B39","first-page":"321","volume-title":"Advances in Neural Information Processing Systems","author":"Zhou","year":"2004"},{"key":"2023013108384190900_btz420-B40","first-page":"58","article-title":"Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions","author":"Zhu","year":"2003","journal-title":"ICML 2003 Workshop on The Continuum from Labeled to Unlabeled Data in Machine Learning and Data Mining"},{"key":"2023013108384190900_btz420-B41","first-page":"912","volume-title":"Proceedings of the Twentieth International Conference on International Conference on Machine Learning, ICML\u201903","author":"Zhu","year":"2003"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btz420\/28856207\/btz420.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/35\/24\/5199\/48978360\/bioinformatics_35_24_5199.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/35\/24\/5199\/48978360\/bioinformatics_35_24_5199.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,31]],"date-time":"2023-01-31T12:57:01Z","timestamp":1675169821000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/35\/24\/5199\/5505421"}},"subtitle":[],"editor":[{"given":"Jonathan","family":"Wren","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2019,5,29]]},"references-count":41,"journal-issue":{"issue":"24","published-print":{"date-parts":[[2019,12,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btz420","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/490623","asserted-by":"object"}]},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,12,15]]},"published":{"date-parts":[[2019,5,29]]}}}