{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,4]],"date-time":"2025-10-04T14:38:46Z","timestamp":1759588726958,"version":"3.37.3"},"reference-count":50,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2020,5,12]],"date-time":"2020-05-12T00:00:00Z","timestamp":1589241600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"Ministry of Science and Technology ROC"},{"DOI":"10.13039\/100007225","name":"MOST","doi-asserted-by":"publisher","award":["108-2221-E-009-127","108-3011-F-075-001","107-2218-E-009-005","108-2218-E-029-004","108-2319-B-400-001"],"award-info":[{"award-number":["108-2221-E-009-127","108-3011-F-075-001","107-2218-E-009-005","108-2218-E-029-004","108-2319-B-400-001"]}],"id":[{"id":"10.13039\/100007225","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Center for Intelligent Drug Systems and Smart Bio-devices"},{"name":"Featured Areas Research Center"},{"name":"Higher Education Sprout Project by the Ministry of Education"},{"DOI":"10.13039\/100009122","name":"MOE","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100009122","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Non-linear ordinary differential equation (ODE) models that contain numerous parameters are suitable for inferring an emulated gene regulatory network (eGRN). However, the number of experimental measurements is usually far smaller than the number of parameters of the eGRN model that leads to an underdetermined problem. There is no unique solution to the inference problem for an eGRN using insufficient measurements.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>This work proposes an evolutionary modelling algorithm (EMA) that is based on evolutionary intelligence to cope with the underdetermined problem. EMA uses an intelligent genetic algorithm to solve the large-scale parameter optimization problem. An EMA-based method, GREMA, infers a novel type of gene regulatory network with confidence levels for every inferred regulation. The higher the confidence level is, the more accurate the inferred regulation is. GREMA gradually determines the regulations of an eGRN with confidence levels in descending order using either an S-system or a Hill function-based ODE model. The experimental results showed that the regulations with high-confidence levels are more accurate and robust than regulations with low-confidence levels. Evolutionary intelligence enhanced the mean accuracy of GREMA by 19.2% when using the S-system model with benchmark datasets. An increase in the number of experimental measurements may increase the mean confidence level of the inferred regulations. GREMA performed well compared with existing methods that have been previously applied to the same S-system, DREAM4 challenge and SOS DNA repair benchmark datasets.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>All of the datasets that were used and the GREMA-based tool are freely available at https:\/\/nctuiclab.github.io\/GREMA.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Supplementary information<\/jats:title>\n                  <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btaa267","type":"journal-article","created":{"date-parts":[[2020,5,9]],"date-time":"2020-05-09T19:08:31Z","timestamp":1589051311000},"page":"3833-3840","source":"Crossref","is-referenced-by-count":18,"title":["GREMA: modelling of emulated gene regulatory networks with confidence levels based on evolutionary intelligence to cope with the underdetermined problem"],"prefix":"10.1093","volume":"36","author":[{"given":"Ming-Ju","family":"Tsai","sequence":"first","affiliation":[{"name":"Institute of Bioinformatics and Systems Biology , National Chiao Tung University, Hsinchu 300, Taiwan"}]},{"given":"Jyun-Rong","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Bioinformatics and Systems Biology , National Chiao Tung University, Hsinchu 300, Taiwan"}]},{"given":"Shinn-Jang","family":"Ho","sequence":"additional","affiliation":[{"name":"Department of Automation Engineering , National Formosa University, Yunlin 632, Taiwan"}]},{"given":"Li-Sun","family":"Shu","sequence":"additional","affiliation":[{"name":"Department of Information Management , Overseas Chinese University, Taichung 407, Taiwan"}]},{"given":"Wen-Lin","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering and Management , Minghsin University of Science and Technology, Xinfeng 304, Taiwan"}]},{"given":"Shinn-Ying","family":"Ho","sequence":"additional","affiliation":[{"name":"Institute of Bioinformatics and Systems Biology , National Chiao Tung University, Hsinchu 300, Taiwan"},{"name":"Department of Biological Science and Technology"},{"name":"Center For Intelligent Drug Systems and Smart Bio-devices (IDS2B) , National Chiao Tung University, Hsinchu 300, Taiwan"}]}],"member":"286","published-online":{"date-parts":[[2020,5,12]]},"reference":[{"key":"2023063011302255600_btaa267-B1","doi-asserted-by":"crossref","first-page":"2937","DOI":"10.1093\/bioinformatics\/btp511","article-title":"Learning gene regulatory networks from gene expression measurements using non-parametric molecular kinetics","volume":"25","author":"Aijo","year":"2009","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B2","doi-asserted-by":"crossref","DOI":"10.1201\/9781420011432","volume-title":"An Introduction to Systems Biology: Design Principles of Biological Circuits","author":"Alon","year":"2006"},{"key":"2023063011302255600_btaa267-B3","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1509\/jppm.25.1.127","article-title":"The wisdom of crowds: why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations","volume":"25","author":"Andreasen","year":"2006","journal-title":"J. Public Policy Mark"},{"key":"2023063011302255600_btaa267-B4","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1093\/bioinformatics\/btl003","article-title":"Inference of gene regulatory networks and compound mode of action from time course gene expression profiles","volume":"22","author":"Bansal","year":"2006","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B5","doi-asserted-by":"crossref","first-page":"552","DOI":"10.1038\/nrg3244","article-title":"Studying and modelling dynamic biological processes using time-series gene expression data","volume":"13","author":"Bar-Joseph","year":"2012","journal-title":"Nat. Rev. Genet"},{"key":"2023063011302255600_btaa267-B6","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1038\/nrg1272","article-title":"Network biology: understanding the cell\u2019s functional organization","volume":"5","author":"Barab\u00e1si","year":"2004","journal-title":"Nat. Rev. Genet"},{"key":"2023063011302255600_btaa267-B7","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1093\/bioinformatics\/bti014","article-title":"A Bayesian approach to reconstructing genetic regulatory networks with hidden factors","volume":"21","author":"Beal","year":"2005","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B8","doi-asserted-by":"crossref","first-page":"R36","DOI":"10.1186\/gb-2006-7-5-r36","article-title":"The Inferelator: an algorithm for learning parsimonious regulatory networks from systems-biology data sets de novo","volume":"7","author":"Bonneau","year":"2006","journal-title":"Genome Biol"},{"key":"2023063011302255600_btaa267-B9","doi-asserted-by":"crossref","first-page":"1055","DOI":"10.1093\/genetics\/153.2.1055","article-title":"Evolution of genetic variability and the advantage of sex and recombination in changing environments","volume":"153","author":"Burger","year":"1999","journal-title":"Genetics"},{"key":"2023063011302255600_btaa267-B10","doi-asserted-by":"crossref","first-page":"2151","DOI":"10.1093\/bioinformatics\/btv075","article-title":"GeNOSA: inferring and experimentally supporting quantitative gene regulatory networks in prokaryotes","volume":"31","author":"Chen","year":"2015","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B11","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1186\/1471-2105-14-196","article-title":"Incorporating time-delays in S-System model for reverse engineering genetic networks","volume":"14","author":"Chowdhury","year":"2013","journal-title":"BMC Bioinformatics"},{"key":"2023063011302255600_btaa267-B12","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1038\/nrmicro2419","article-title":"Advantages and limitations of current network inference methods","volume":"8","author":"De Smet","year":"2010","journal-title":"Nat. Rev. Microbiol"},{"key":"2023063011302255600_btaa267-B13","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.tig.2005.12.005","article-title":"Reliability and reproducibility issues in DNA microarray measurements","volume":"22","author":"Draghici","year":"2006","journal-title":"Trends Genet"},{"key":"2023063011302255600_btaa267-B14","doi-asserted-by":"crossref","first-page":"e8","DOI":"10.1371\/journal.pbio.0050008","article-title":"Large-scale mapping and validation of Escherichia coli transcriptional regulation from a compendium of expression profiles","volume":"5","author":"Faith","year":"2007","journal-title":"PLoS Biol"},{"key":"2023063011302255600_btaa267-B15","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1126\/science.1081900","article-title":"Inferring genetic networks and identifying compound mode of action via expression profiling","volume":"301","author":"Gardner","year":"2003","journal-title":"Science"},{"key":"2023063011302255600_btaa267-B16","doi-asserted-by":"crossref","first-page":"e68358","DOI":"10.1371\/journal.pone.0068358","article-title":"Improved inference of gene regulatory networks through integrated Bayesian clustering and dynamic modeling of time-course expression data","volume":"8","author":"Godsey","year":"2013","journal-title":"PLoS One"},{"key":"2023063011302255600_btaa267-B17","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1109\/tcbb.2007.1051","article-title":"An intelligent two-stage evolutionary algorithm for dynamic pathway identification from gene expression profiles","volume":"4","author":"Ho","year":"2007","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform"},{"key":"2023063011302255600_btaa267-B18","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1109\/TEVC.2004.835176","article-title":"Intelligent evolutionary algorithms for large parameter optimization problems","volume":"8","author":"Ho","year":"2004","journal-title":"IEEE Trans. Evol. Comput"},{"key":"2023063011302255600_btaa267-B19","doi-asserted-by":"crossref","first-page":"3384","DOI":"10.1038\/s41598-018-21715-0","article-title":"dynGENIE3: dynamical GENIE3 for the inference of gene networks from time series expression data","volume":"8","author":"Huynh-Thu","year":"2018","journal-title":"Sci. Rep"},{"key":"2023063011302255600_btaa267-B20","doi-asserted-by":"crossref","first-page":"e12776","DOI":"10.1371\/journal.pone.0012776","article-title":"Inferring regulatory networks from expression data using tree-based methods","volume":"5","author":"Huynh-Thu","year":"2010","journal-title":"PLoS One"},{"key":"2023063011302255600_btaa267-B21","doi-asserted-by":"crossref","first-page":"1614","DOI":"10.1093\/bioinformatics\/btu863","article-title":"Combining tree-based and dynamical systems for the inference of gene regulatory networks","volume":"31","author":"Huynh-Thu","year":"2015","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B22","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1101\/gr.7080508","article-title":"Systematic evaluation of variability in ChIP-chip experiments using predefined DNA targets","volume":"18","author":"Johnson","year":"2008","journal-title":"Genome Res"},{"key":"2023063011302255600_btaa267-B23","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.1093\/bioinformatics\/bti071","article-title":"Inference of S-system models of genetic networks using a cooperative coevolutionary algorithm","volume":"21","author":"Kimura","year":"2005","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B24","doi-asserted-by":"crossref","first-page":"918","DOI":"10.1093\/bioinformatics\/btp072","article-title":"Genetic network inference as a series of discrimination tasks","volume":"25","author":"Kimura","year":"2009","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B25","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1186\/1471-2105-9-23","article-title":"Function approximation approach to the inference of reduced NGnet models of genetic networks","volume":"9","author":"Kimura","year":"2008","journal-title":"BMC Bioinformatics"},{"key":"2023063011302255600_btaa267-B26","doi-asserted-by":"crossref","first-page":"2160","DOI":"10.1093\/bioinformatics\/btq342","article-title":"TRANSWESD: inferring cellular networks with transitive reduction","volume":"26","author":"Klamt","year":"2010","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B27","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1038\/nrg3885","article-title":"Quantitative and logic modelling of molecular and gene networks","volume":"16","author":"Le Novere","year":"2015","journal-title":"Nat. Rev. Genet"},{"key":"2023063011302255600_btaa267-B28","doi-asserted-by":"crossref","first-page":"15522","DOI":"10.1073\/pnas.2136632100","article-title":"Network component analysis: reconstruction of regulatory signals in biological systems","volume":"100","author":"Liao","year":"2003","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"2023063011302255600_btaa267-B29","doi-asserted-by":"crossref","first-page":"1416","DOI":"10.1093\/bioinformatics\/btt167","article-title":"OKVAR-Boost: a novel boosting algorithm to infer nonlinear dynamics and interactions in gene regulatory networks","volume":"29","author":"Lim","year":"2013","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B30","doi-asserted-by":"crossref","first-page":"303","DOI":"10.3389\/fgene.2013.00303","article-title":"Experimental assessment of static and dynamic algorithms for gene regulation inference from time series expression data","volume":"4","author":"Lopes","year":"2013","journal-title":"Front. Genet"},{"key":"2023063011302255600_btaa267-B31","doi-asserted-by":"crossref","first-page":"9","DOI":"10.2202\/1544-6115.1294","article-title":"Inferring dynamic genetic networks with low order independencies","volume":"8","author":"L\u00e8bre","year":"2009","journal-title":"Stat. Appl. Genet. Mol. Biol"},{"key":"2023063011302255600_btaa267-B32","doi-asserted-by":"crossref","first-page":"796","DOI":"10.1038\/nmeth.2016","article-title":"Wisdom of crowds for robust gene network inference","volume":"9","author":"Marbach","year":"2012","journal-title":"Nat. Methods"},{"key":"2023063011302255600_btaa267-B33","doi-asserted-by":"crossref","first-page":"6286","DOI":"10.1073\/pnas.0913357107","article-title":"Revealing strengths and weaknesses of methods for gene network inference","volume":"107","author":"Marbach","year":"2010","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"2023063011302255600_btaa267-B34","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1089\/cmb.2008.09TT","article-title":"Generating realistic in silico gene networks for performance assessment of reverse engineering methods","volume":"16","author":"Marbach","year":"2009","journal-title":"J. Comput. Biol"},{"key":"2023063011302255600_btaa267-B35","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1126\/science.306.5696.630","article-title":"Getting the noise out of gene arrays","volume":"306","author":"Marshall","year":"2004","journal-title":"Science"},{"first-page":"615","year":"2003","author":"Morishita","key":"2023063011302255600_btaa267-B36"},{"key":"2023063011302255600_btaa267-B37","doi-asserted-by":"crossref","first-page":"Ii138","DOI":"10.1093\/bioinformatics\/btg1071","article-title":"Gene networks inference using dynamic Bayesian networks","volume":"19","author":"Perrin","year":"2003","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B38","doi-asserted-by":"crossref","first-page":"10555","DOI":"10.1073\/pnas.152046799","article-title":"Assigning numbers to the arrows: parameterizing a gene regulation network by using accurate expression kinetics","volume":"99","author":"Ronen","year":"2002","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"2023063011302255600_btaa267-B39","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1038\/ng881","article-title":"Network motifs in the transcriptional regulation network of Escherichia coli","volume":"31","author":"Shen-Orr","year":"2002","journal-title":"Nat. Genet"},{"key":"2023063011302255600_btaa267-B40","doi-asserted-by":"crossref","first-page":"e90481","DOI":"10.1371\/journal.pone.0090481","article-title":"Assessment of network inference methods: how to cope with an underdetermined problem","volume":"9","author":"Siegenthaler","year":"2014","journal-title":"PLoS One"},{"key":"2023063011302255600_btaa267-B41","doi-asserted-by":"crossref","first-page":"3221","DOI":"10.1093\/bioinformatics\/bth389","article-title":"A model-based optimization framework for the inference on gene regulatory networks from DNA array data","volume":"20","author":"Thomas","year":"2004","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B42","doi-asserted-by":"crossref","first-page":"951","DOI":"10.1038\/s41598-017-18648-5","article-title":"PredCRP: predicting and analysing the regulatory roles of CRP from its binding sites in Escherichia coli","volume":"8","author":"Tsai","year":"2018","journal-title":"Sci. Rep"},{"key":"2023063011302255600_btaa267-B43","doi-asserted-by":"crossref","first-page":"e103812","DOI":"10.1371\/journal.pone.0103812","article-title":"Ensemble inference and inferability of gene regulatory networks","volume":"9","author":"Ud-Dean","year":"2014","journal-title":"PLoS One"},{"key":"2023063011302255600_btaa267-B44","doi-asserted-by":"crossref","first-page":"875","DOI":"10.1093\/bioinformatics\/btv672","article-title":"Optimal design of gene knockout experiments for gene regulatory network inference","volume":"32","author":"Ud-Dean","year":"2016","journal-title":"Bioinformatics"},{"key":"2023063011302255600_btaa267-B45","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1186\/s12859-016-1137-z","article-title":"TRaCE+: ensemble inference of gene regulatory networks from transcriptional expression profiles of gene knock-out experiments","volume":"17","author":"Ud-Dean","year":"2016","journal-title":"BMC Bioinformatics"},{"key":"2023063011302255600_btaa267-B46","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1186\/1471-2105-7-43","article-title":"SynTReN: a generator of synthetic gene expression data for design and analysis of structure learning algorithms","volume":"7","author":"Van den Bulcke","year":"2006","journal-title":"BMC Bioinformatics"},{"key":"2023063011302255600_btaa267-B47","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1186\/1752-0509-2-35","article-title":"Parameter optimization in S-system models","volume":"2","author":"Vilela","year":"2008","journal-title":"BMC Syst. Biol"},{"key":"2023063011302255600_btaa267-B48","doi-asserted-by":"crossref","first-page":"2765","DOI":"10.1093\/bioinformatics\/btr457","article-title":"GlobalMIT: learning globally optimal dynamic Bayesian network with the mutual information test criterion","volume":"27","author":"Vinh","year":"2011","journal-title":"Bioinformatics"},{"year":"2000","author":"Voit","key":"2023063011302255600_btaa267-B49"},{"key":"2023063011302255600_btaa267-B50","doi-asserted-by":"crossref","first-page":"6163","DOI":"10.1073\/pnas.092576199","article-title":"Reverse engineering gene networks using singular value decomposition and robust regression","volume":"99","author":"Yeung","year":"2002","journal-title":"Proc. Natl. Acad. Sci. USA"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btaa267\/33320731\/btaa267.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/36\/12\/3833\/50751251\/bioinformatics_36_12_3833.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/36\/12\/3833\/50751251\/bioinformatics_36_12_3833.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,30]],"date-time":"2023-06-30T11:31:46Z","timestamp":1688124706000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/36\/12\/3833\/5836502"}},"subtitle":[],"editor":[{"given":"Lenore","family":"Cowen","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2020,5,12]]},"references-count":50,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2020,6,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btaa267","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"type":"print","value":"1367-4803"},{"type":"electronic","value":"1367-4811"}],"subject":[],"published-other":{"date-parts":[[2020,6,15]]},"published":{"date-parts":[[2020,5,12]]}}}