{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,8,5]],"date-time":"2024-08-05T15:19:14Z","timestamp":1722871154765},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2016,2,9]],"date-time":"2016-02-09T00:00:00Z","timestamp":1454976000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2016,2,9]],"date-time":"2016-02-09T00:00:00Z","timestamp":1454976000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Many algorithms have been developed to infer the topology of gene regulatory networks from gene expression data. These methods typically produce a ranking of links between genes with associated confidence scores, after which a certain threshold is chosen to produce the inferred topology. However, the structural properties of the predicted network do not resemble those typical for a gene regulatory network, as most algorithms only take into account connections found in the data and do not include known graph properties in their inference process. This lowers the prediction accuracy of these methods, limiting their usability in practice.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We propose a post-processing algorithm which is applicable to any confidence ranking of regulatory interactions obtained from a network inference method which can use, <jats:italic>inter alia<\/jats:italic>, graphlets and several graph-invariant properties to re-rank the links into a more accurate prediction. To demonstrate the potential of our approach, we re-rank predictions of six different state-of-the-art algorithms using three simple network properties as optimization criteria and show that Netter can improve the predictions made on both artificially generated data as well as the DREAM4 and DREAM5 benchmarks. Additionally, the DREAM5 <jats:italic>E.coli.<\/jats:italic> community prediction inferred from real expression data is further improved. Furthermore, Netter compares favorably to other post-processing algorithms and is not restricted to correlation-like predictions. Lastly, we demonstrate that the performance increase is robust for a wide range of parameter settings. Netter is available at <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"http:\/\/bioinformatics.intec.ugent.be\">http:\/\/bioinformatics.intec.ugent.be<\/jats:ext-link>.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Network inference from high-throughput data is a long-standing challenge. In this work, we present Netter, which can further refine network predictions based on a set of user-defined graph properties. Netter is a flexible system which can be applied in unison with any method producing a ranking from omics data. It can be tailored to specific prior knowledge by expert users but can also be applied in general uses cases. Concluding, we believe that Netter is an interesting second step in the network inference process to further increase the quality of prediction.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12859-016-0913-0","type":"journal-article","created":{"date-parts":[[2016,2,9]],"date-time":"2016-02-09T04:48:50Z","timestamp":1454993330000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Netter: re-ranking gene network inference predictions using structural network properties"],"prefix":"10.1186","volume":"17","author":[{"given":"Joeri","family":"Ruyssinck","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Piet","family":"Demeester","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tom","family":"Dhaene","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yvan","family":"Saeys","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2016,2,9]]},"reference":[{"issue":"1","key":"913_CR1","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/j.ygeno.2010.10.003","volume":"97","author":"V Narendra","year":"2011","unstructured":"Narendra V, Lytkin NI, Aliferis CF, Statnikov A. A comprehensive assessment of methods for de-novo reverse-engineering of genome-scale regulatory networks. Genomics. 2011; 97(1):7\u201318.","journal-title":"Genomics"},{"issue":"13","key":"913_CR2","doi-asserted-by":"publisher","first-page":"1640","DOI":"10.1093\/bioinformatics\/btm163","volume":"23","author":"N Soranzo","year":"2007","unstructured":"Soranzo N, Bianconi G, Altafini C. Comparing association network algorithms for reverse engineering of large-scale gene regulatory networks: synthetic versus real data. Bioinformatics. 2007; 23(13):1640\u20131647.","journal-title":"Bioinformatics"},{"key":"913_CR3","first-page":"8","volume":"2009","author":"H Hache","year":"2009","unstructured":"Hache H, Lehrach H, Herwig R. Reverse engineering of gene regulatory networks: a comparative study. EURASIP J Bioinformatics Syst Biol. 2009; 2009:8\u20131812.","journal-title":"EURASIP J Bioinformatics Syst Biol"},{"issue":"10","key":"913_CR4","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1038\/nrmicro2419","volume":"8","author":"R De Smet","year":"2010","unstructured":"De Smet R, Marchal K. Advantages and limitations of current network inference methods. Nat Rev Micro. 2010; 8(10):717\u201329.","journal-title":"Nat Rev Micro"},{"issue":"1","key":"913_CR5","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1186\/1752-0509-3-49","volume":"3","author":"T Michoel","year":"2009","unstructured":"Michoel T, De Smet R, Joshi A, Van de Peer Y, Marchal K. Comparative analysis of module-based versus direct methods for reverse-engineering transcriptional regulatory networks. BMC Systems Biology. 2009; 3(1):49.","journal-title":"BMC Systems Biology"},{"issue":"8","key":"913_CR6","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1038\/nmeth.2016","volume":"9","author":"D Marbach","year":"2012","unstructured":"Marbach D, Costello J, Kuffner R, Vega N, Prill R, Camacho D, et al.Wisdom of crowds for robust gene network inference. Nat Meth. 2012; 9(8):796\u2013804.","journal-title":"Nat Meth"},{"issue":"5","key":"913_CR7","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1038\/ng0506-500","volume":"38","author":"M Reich","year":"2006","unstructured":"Reich M, Liefeld T, Gould J, Lerner J, Tamayo P, Mesirov JP. GenePattern 2.0. Nat. Genet. 2006; 38(5):500\u20131.","journal-title":"Nat. Genet"},{"issue":"10","key":"913_CR8","doi-asserted-by":"publisher","first-page":"1376","DOI":"10.1093\/bioinformatics\/bts143","volume":"28","author":"R K\u00fcffner","year":"2012","unstructured":"K\u00fcffner R, Petri T, Tavakkolkhah P, Windhager L, Zimmer R. Inferring gene regulatory networks by ANOVA. Bioinforma. 2012; 28(10):1376\u20131382.","journal-title":"Bioinforma"},{"issue":"1","key":"913_CR9","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1371\/journal.pbio.0050008","volume":"5","author":"JJ Faith","year":"2007","unstructured":"Faith JJ, Hayete B, Thaden JT, Mogno I, Wierzbowski J, Cottarel G, et al.Large-Scale Mapping and Validation of Escherichia coli Transcriptional Regulation from a Compendium of Expression Profiles. PLoS Biol. 2007; 5(1):8.","journal-title":"PLoS Biol"},{"issue":"9","key":"913_CR10","doi-asserted-by":"publisher","first-page":"12776","DOI":"10.1371\/journal.pone.0012776","volume":"5","author":"VA Huynh-Thu","year":"2010","unstructured":"Huynh-Thu VA, Irrthum A, Wehenkel L, Geurts P. Inferring Regulatory Networks from Expression Data Using Tree-Based Methods. PLoS ONE. 2010; 5(9):12776.","journal-title":"PLoS ONE"},{"issue":"5","key":"913_CR11","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1186\/gb-2006-7-5-r36","volume":"7","author":"R Bonneau","year":"2006","unstructured":"Bonneau R, Reiss DJ, Shannon P, Facciotti M, Hood L, Baliga NS, et al.The Inferelator: an algorithm for learning parsimonious regulatory networks from systems-biology data sets de novo. Genome Biology. 2006; 7(5):36.","journal-title":"Genome Biology"},{"issue":"1","key":"913_CR12","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1186\/1752-0509-6-145","volume":"6","author":"AC Haury","year":"2012","unstructured":"Haury AC, Mordelet F, Vera-Licona P, Vert JP. TIGRESS: Trustful Inference of Gene REgulation using Stability Selection. BMC Syst Biol. 2012; 6(1):145.","journal-title":"BMC Syst Biol"},{"key":"913_CR13","first-page":"415","volume":"5","author":"AJ Butte","year":"2000","unstructured":"Butte AJ, Kohane IS. Mutual information relevance networks: functional genomic clustering using pairwise entropy measurements. Pac Symp Biocomput. 2000; 5:415\u201326.","journal-title":"Pac Symp Biocomput"},{"issue":"Suppl 1","key":"913_CR14","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1186\/1471-2105-7-S1-S7","volume":"7","author":"AA Margolin","year":"2006","unstructured":"Margolin AA, Nemenman I, Basso K, Wiggins C, Stolovitzky G, Favera RD, et al.ARACNE: An Algorithm for the Reconstruction of Gene Regulatory Networks in a Mammalian Cellular Context. BMC Bioinforma. 2006; 7(Suppl 1):7\u20137.","journal-title":"BMC Bioinforma"},{"key":"913_CR15","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1186\/1471-2105-9-559","volume":"9","author":"P Langfelder","year":"2008","unstructured":"Langfelder P, Horvath S. WGCNA: an R package for weighted correlation network analysis. BMC Bioinforma. 2008; 9:559.","journal-title":"BMC Bioinforma"},{"issue":"8","key":"913_CR16","doi-asserted-by":"publisher","first-page":"726","DOI":"10.1038\/nbt.2635","volume":"31","author":"S Feizi","year":"2013","unstructured":"Feizi S, Marbach D, M\u00e9dard M, Kellis M. Network deconvolution as a general method to distinguish direct dependencies in networks. Nat Biotechnol. 2013; 31(8):726\u201333.","journal-title":"Nat Biotechnol"},{"issue":"8","key":"913_CR17","doi-asserted-by":"publisher","first-page":"720","DOI":"10.1038\/nbt.2601","volume":"31","author":"B Barzel","year":"2013","unstructured":"Barzel B, Barab\u00e1si AL. Network link prediction by global silencing of indirect correlations. Nat Biotechnol. 2013; 31(8):720\u20135.","journal-title":"Nat Biotechnol"},{"issue":"2","key":"913_CR18","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1038\/nrg1272","volume":"5","author":"AL Barab\u00e1si","year":"2004","unstructured":"Barab\u00e1si AL, Oltvai ZN. Network biology: understanding the cell\u2019s functional organization. Nat Rev Genet. 2004; 5(2):101\u201313.","journal-title":"Nat Rev Genet"},{"issue":"5","key":"913_CR19","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1016\/S1359-6446(05)03369-6","volume":"10","author":"MG Grigorov","year":"2005","unstructured":"Grigorov MG. Global properties of biological networks. Drug Discovery Today. 2005; 10(5):365\u201372.","journal-title":"Drug Discovery Today"},{"issue":"7006","key":"913_CR20","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1038\/nature02782","volume":"431","author":"NM Luscombe","year":"2004","unstructured":"Luscombe NM, Babu MM, Yu H, Snyder M, Teichmann SA, Gerstein M. Genomic analysis of regulatory network dynamics reveals large topological changes. Nature. 2004; 431(7006):308\u201312.","journal-title":"Nature"},{"key":"913_CR21","doi-asserted-by":"publisher","first-page":"4947","DOI":"10.1242\/jcs.02714","volume":"118","author":"R Albert","year":"2005","unstructured":"Albert R. Scale-free networks in cell biology. J Cell Science. 2005; 118:4947\u2013957.","journal-title":"J Cell Science"},{"issue":"Suppl 6","key":"913_CR22","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1186\/1471-2105-8-S6-S9","volume":"8","author":"T Schlitt","year":"2007","unstructured":"Schlitt T, Brazma A. Current approaches to gene regulatory network modelling. BMC Bioinforma. 2007; 8(Suppl 6):9.","journal-title":"BMC Bioinforma"},{"issue":"6","key":"913_CR23","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1038\/nrg2102","volume":"8","author":"U Alon","year":"2007","unstructured":"Alon U. Network motifs: theory and experimental approaches. Nat Rev Genet. 2007; 8(6):450\u201361.","journal-title":"Nat Rev Genet"},{"issue":"4598","key":"913_CR24","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1126\/science.220.4598.671","volume":"220","author":"S Kirkpatrick","year":"1983","unstructured":"Kirkpatrick S, Gelatt CD, Vecchi MP. Optimization by Simulated Annealing. Science. 1983; 220(4598):671\u201380.","journal-title":"Science"},{"issue":"18","key":"913_CR25","doi-asserted-by":"publisher","first-page":"3508","DOI":"10.1093\/bioinformatics\/bth436","volume":"20","author":"N Pr\u017eulj","year":"2004","unstructured":"Pr\u017eulj N, Corneil DG, Jurisica I. Modeling interactome: scale-free or geometric?Bioinforma. 2004; 20(18):3508\u2013515.","journal-title":"Bioinforma"},{"issue":"2","key":"913_CR26","doi-asserted-by":"publisher","first-page":"177","DOI":"10.1093\/bioinformatics\/btl301","volume":"23","author":"N Pr\u017eulj","year":"2007","unstructured":"Pr\u017eulj N. Biological network comparison using graphlet degree distribution. Bioinforma. 2007; 23(2):177\u201383.","journal-title":"Bioinforma"},{"issue":"14","key":"913_CR27","doi-asserted-by":"publisher","first-page":"6286","DOI":"10.1073\/pnas.0913357107","volume":"107","author":"D Marbach","year":"2010","unstructured":"Marbach D, Prill RJ, Schaffter T, Mattiussi C, Floreano D, Stolovitzky G. Revealing strengths and weaknesses of methods for gene network inference. Proc Natl Acad Sci. 2010; 107(14):6286\u2013291.","journal-title":"Proc Natl Acad Sci"},{"issue":"3","key":"913_CR28","doi-asserted-by":"publisher","first-page":"33624","DOI":"10.1371\/journal.pone.0033624","volume":"7","author":"R de Matos Simoes","year":"2012","unstructured":"de Matos Simoes R, Emmert-Streib F. Bagging statistical network inference from large-scale gene expression data. PLoS ONE. 2012; 7(3):33624.","journal-title":"PLoS ONE"},{"issue":"3","key":"913_CR29","doi-asserted-by":"publisher","first-page":"92709","DOI":"10.1371\/journal.pone.0092709","volume":"9","author":"J Ruyssinck","year":"2014","unstructured":"Ruyssinck J, Huynh-Thu VA, Geurts P, Dhaene T, Demeester P, Saeys Y. Nimefi: Gene regulatory network inference using multiple ensemble feature importance algorithms. PLoS ONE. 2014; 9(3):92709.","journal-title":"PLoS ONE"},{"issue":"2","key":"913_CR30","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1089\/cmb.2008.09TT","volume":"16","author":"D Marbach","year":"2009","unstructured":"Marbach D, Schaffter T, Mattiussi C, Floreano D. Generating Realistic In Silico Gene Networks for Performance Assessment of Reverse Engineering Methods. J Comput Biol. 2009; 16(2):229\u201339.","journal-title":"J Comput Biol"},{"issue":"2","key":"913_CR31","doi-asserted-by":"publisher","first-page":"9202","DOI":"10.1371\/journal.pone.0009202","volume":"5","author":"RJ Prill","year":"2010","unstructured":"Prill RJ, Marbach D, Saez-Rodriguez J, Sorger PK, Alexopoulos LG, Xue X, et al.Towards a Rigorous Assessment of Systems Biology Models: The DREAM3 Challenges. PLoS ONE. 2010; 5(2):9202.","journal-title":"PLoS ONE"},{"issue":"1","key":"913_CR32","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1186\/1471-2105-7-43","volume":"7","author":"T Van den Bulcke","year":"2006","unstructured":"Van den Bulcke T, Van Leemput K, Naudts B, van Remortel P, Ma H, Verschoren A, et al.SynTReN: a generator of synthetic gene expression data for design and analysis of structure learning algorithms. BMC Bioinforma. 2006; 7(1):43.","journal-title":"BMC Bioinforma"},{"issue":"16","key":"913_CR33","doi-asserted-by":"publisher","first-page":"2263","DOI":"10.1093\/bioinformatics\/btr373","volume":"27","author":"T Schaffter","year":"2011","unstructured":"Schaffter T, Marbach D, Floreano D. GeneNetWeaver: In silico benchmark generation and performance profiling of network inference methods. Bioinforma. 2011; 27(16):2263\u2013270.","journal-title":"Bioinforma"},{"issue":"4","key":"913_CR34","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1038\/nbt.3185","volume":"33","author":"P Bastiaens","year":"2015","unstructured":"Bastiaens P, Birtwistle MR, Bluthgen N, Bruggeman FJ, Cho KH, Cosentino C, et al.Silence on the relevant literature and errors in implementation. Nat Biotech. 2015; 33(4):336\u20139.","journal-title":"Nat Biotech"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-016-0913-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-016-0913-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-016-0913-0","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-016-0913-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,1]],"date-time":"2024-02-01T18:24:01Z","timestamp":1706811841000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-016-0913-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,2,9]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2016,12]]}},"alternative-id":["913"],"URL":"https:\/\/doi.org\/10.1186\/s12859-016-0913-0","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,2,9]]},"assertion":[{"value":"14 July 2015","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 January 2016","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 February 2016","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"76"}}