{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:03:29Z","timestamp":1760241809201,"version":"build-2065373602"},"reference-count":65,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2018,8,22]],"date-time":"2018-08-22T00:00:00Z","timestamp":1534896000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Austrian Science Funds","award":["P30031"],"award-info":[{"award-number":["P30031"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>Causal networks, e.g., gene regulatory networks (GRNs) inferred from gene expression data, contain a wealth of information but are defying simple, straightforward and low-budget experimental validations. In this paper, we elaborate on this problem and discuss distinctions between biological and clinical validations. As a result, validation differences for GRNs reflect known differences between basic biological and clinical research questions making the validations context specific. Hence, the meaning of biologically and clinically meaningful GRNs can be very different. For a concerted approach to a problem of this size, we suggest the establishment of the HUMAN GENE REGULATORY NETWORK PROJECT which provides the information required for biological and clinical validations alike.<\/jats:p>","DOI":"10.3390\/make1010008","type":"journal-article","created":{"date-parts":[[2018,8,23]],"date-time":"2018-08-23T03:00:46Z","timestamp":1534993246000},"page":"138-148","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Inference of Genome-Scale Gene Regulatory Networks: Are There Differences in Biological and Clinical Validations?"],"prefix":"10.3390","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0745-5641","authenticated-orcid":false,"given":"Frank","family":"Emmert-Streib","sequence":"first","affiliation":[{"name":"Predictive Medicine and Data Analytics Lab, Department of Signal Processing, Tampere University of Technology, 33720 Tampere, Finland"},{"name":"Institute of Biosciences and Medical Technology, 33520 Tampere, Finland"}]},{"given":"Matthias","family":"Dehmer","sequence":"additional","affiliation":[{"name":"Department of Mechatronics and Biomedical Computer Science, University for Health Sciences, Medical Informatics and Technology (UMIT), 6060 Hall in Tyrol, Austria"},{"name":"College of Computer and Control Engineering, Nankai University, Tianjin 300071, China"},{"name":"Institute for Intelligent Production, Faculty for Management, University of Applied Sciences Upper Austria, Steyr Campus, 4400 Steyr, Austria"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"452","DOI":"10.1038\/nature14541","article-title":"Probabilistic machine learning and artificial intelligence","volume":"521","author":"Ghahramani","year":"2015","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1198\/jcgs.2011.11051a","article-title":"New Insights and Faster Computations for the Graphical Lasso","volume":"20","author":"Witten","year":"2011","journal-title":"J. Comput. Graph. Stat."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"De Matos Simoes, R., and Emmert-Streib, F. (2012). Bagging statistical network inference from large-scale gene expression data. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0033624"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Opgen-Rhein, R., and Strimmer, K. (2007). Learning causal networks from systems biology time course data: An effective model selection procedure for the vector autoregressive process. BMC Bioinform., 8.","DOI":"10.1186\/1471-2105-8-S2-S3"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1093\/nar\/30.1.207","article-title":"Gene Expression Omnibus: NCBI gene expression and hybridization array data repository","volume":"30","author":"Edgar","year":"2002","journal-title":"Nucleic Acids Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1146\/annurev.genom.9.081307.164359","article-title":"Next-Generation DNA Sequencing Methods","volume":"9","author":"Mardis","year":"2008","journal-title":"Annu. Rev. Genom. Hum. Genet."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1586\/erm.09.41","article-title":"Integrating genomics, proteomics and bioinformatics in translational studies of molecular medicine","volume":"9","author":"Ostrowski","year":"2009","journal-title":"Expert Rev. Mol. Diagn."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1038\/nrg1272","article-title":"Network Biology: Understanding the Cell\u2019s Functional Organization","volume":"5","author":"Oltvai","year":"2004","journal-title":"Nat. Rev."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1038\/msb4100180","article-title":"Network-based classification of breast cancer metastasis","volume":"3","author":"Chuang","year":"2007","journal-title":"Mol. Syst. Biol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Holzinger, A., Dehmer, M., and Jurisica, I. (2014). Knowledge discovery and interactive data mining in bioinformatics-state-of-the-art, future challenges and research directions. BMC Bioinform., 15.","DOI":"10.1186\/1471-2105-15-S6-I1"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Aguilar-Hidalgo, D., Dom\u00ednguez-Cejudo, M.A., Amore, G., Brockmann, A., Lemos, M.C., C\u00f3rdoba, A., and Casares, F. (2012). A Hh-driven gene network controls specification, pattern and size of the Drosophila simple eyes. Development, 082172.","DOI":"10.1242\/dev.082172"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1250156","DOI":"10.1142\/S0218127412501568","article-title":"Complex networks evolutionary dynamics using genetic algorithms","volume":"22","author":"Zurita","year":"2012","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"99","DOI":"10.3390\/computation3010099","article-title":"Evolutionary dynamics in gene networks and inference algorithms","volume":"3","author":"Lemos","year":"2015","journal-title":"Computation"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1038\/msb.2011.99","article-title":"Differential network biology","volume":"8","author":"Ideker","year":"2012","journal-title":"Mol. Syst. Biol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1038\/ng881","article-title":"Network motifs in the transcriptional regulatory network of Escherichia coli","volume":"31","author":"Milo","year":"2002","journal-title":"Nat. Genet."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1002\/wsbm.1254","article-title":"Genome network medicine: Innovation to overcome huge challenges in cancer therapy","volume":"6","author":"Roukos","year":"2014","journal-title":"Wiley Interdiscip. Rev. Syst. Biol. Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"e7952","DOI":"10.15252\/msb.20177952","article-title":"Modeling signaling-dependent pluripotency with Boolean logic to predict cell fate transitions","volume":"14","author":"Onishi","year":"2018","journal-title":"Mol. Syst. Biol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"351","DOI":"10.2174\/138920207783406505","article-title":"Validation of inference procedures for gene regulatory networks","volume":"8","author":"Dougherty","year":"2007","journal-title":"Curr. Genom."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1093\/bib\/bbq078","article-title":"Validation of gene regulatory networks: Scientific and inferential","volume":"12","author":"Dougherty","year":"2011","journal-title":"Brief. Bioinform."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1186\/gb-2011-12-4-109","article-title":"What does biologically meaningful mean? A perspective on gene regulatory network validation","volume":"12","author":"Walhout","year":"2011","journal-title":"Genome Biol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2263","DOI":"10.1093\/bioinformatics\/btr373","article-title":"GeneNetWeaver: In silico benchmark generation and performance profiling of network inference methods","volume":"27","author":"Schaffter","year":"2011","journal-title":"Bioinformatics"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Van den Bulcke, T., Van Leemput, K., Naudts, B., van Remortel, P., Ma, H., Verschoren, A., De Moor, B., and Marchal, K. (2006). SynTReN: A generator of synthetic gene expression data for design and analysis of structure learning algorithms. BMC Bioinform., 7.","DOI":"10.1186\/1471-2105-7-43"},{"key":"ref_24","first-page":"8","article-title":"Statistical inference and reverse engineering of gene regulatory networks from observational expression data","volume":"3","author":"Glazko","year":"2012","journal-title":"Front. Genet."},{"key":"ref_25","unstructured":"Pearl, J. (2000). Causality: Models, Reasoning, and Inference, Cambridge University Press."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Spirtes, P., Glymour, C., and Scheines, R. (1993). Causation, Prediction, and Search, Springer.","DOI":"10.1007\/978-1-4612-2748-9"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1089\/cmb.2007.0041","article-title":"The Chronic Fatigue Syndrome: A Comparative Pathway Analysis","volume":"14","year":"2007","journal-title":"J. Comput. Biol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"De Matos Simoes, R., Dehmer, M., and Emmert-Streib, F. (2013). Interfacing cellular networks of S. cerevisiae and E. coli: Connecting dynamic and genetic information. BMC Genom., 14.","DOI":"10.1186\/1471-2164-14-324"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1038\/ng1532","article-title":"Reverse Engineering of Regulatory Networks in Human B Cells","volume":"37","author":"Basso","year":"2005","journal-title":"Nat. Genet."},{"key":"ref_30","first-page":"281","article-title":"B-cell lymphoma gene regulatory networks: Biological consistency among inference methods","volume":"4","author":"Dehmer","year":"2013","journal-title":"Front. Genet."},{"key":"ref_31","first-page":"15","article-title":"The gene regulatory network for breast cancer: Integrated regulatory landscape of cancer hallmarks","volume":"5","author":"Mullan","year":"2014","journal-title":"Front. Genet."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Emmert-Streib, F., de Matos Simoes, R., Glazko, G., McDade, S., Haibe-Kains, B., Holzinger, A., Dehmer, M., and Campbell, F. (2014). Functional and genetic analysis of the colon cancer network. BMC Bioinform., 15.","DOI":"10.1186\/1471-2105-15-S6-S6"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Godfrey-Smith, P. (2003). Theory and Reality: An Introduction to the Philosophy of Science, University of Chicago Press.","DOI":"10.7208\/chicago\/9780226300610.001.0001"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1002\/bies.10385","article-title":"Here is the evidence, now what is the hypothesis? The complementary roles of inductive and hypothesis-driven science in the post-genomic era","volume":"26","author":"Kell","year":"2004","journal-title":"BioEssays"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1007\/978-1-59745-493-3_17","article-title":"Chemical Cross-Linking for Protein? Protein Interaction Studies","volume":"Volume 492","author":"Lipton","year":"2009","journal-title":"Mass Spectrometry of Proteins and Peptides"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, Q., Dinu, I., Adewale, A., Potter, J., and Yasui, Y. (2007). Comparative evaluation of gene-set analysis methods. BMC Bioinform., 8.","DOI":"10.1186\/1471-2105-8-431"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Edmondson, D.G., and Roth, S.Y. (2001). Current Protocols in Molecular Biology, John Wiley & Sons, Inc.. Chapter Identification of Protein Interactions by Far Western Analysis.","DOI":"10.1002\/0471142727.mb2006s55"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1278","DOI":"10.1038\/nprot.2006.201","article-title":"Design and implementation of bimolecular fluorescence complementation (BiFC) assays for the visualization of protein interactions in living cells","volume":"1","author":"Kerppola","year":"2006","journal-title":"Nat. Protoc."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"D525","DOI":"10.1093\/nar\/gkp878","article-title":"The IntAct molecular interaction database in 2010","volume":"38","author":"Aranda","year":"2009","journal-title":"Nucleic Acids Res."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/j.ygeno.2003.11.004","article-title":"ChIP-chip: Considerations for the design, analysis, and application of genome-wide chromatin immunoprecipitation experiments","volume":"83","author":"Buck","year":"2004","journal-title":"Genomics"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"918","DOI":"10.1038\/ni.2117","article-title":"ChIP-Seq: Technical considerations for obtaining high-quality data","volume":"12","author":"Kidder","year":"2011","journal-title":"Nat. Immunol."},{"key":"ref_42","first-page":"18","article-title":"Identification of associated proteins by coimmunoprecipitation","volume":"Volume 3","author":"Sambrook","year":"2002","journal-title":"Molecular Cloning\u2014A Laboratory Manual"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"7382","DOI":"10.1073\/pnas.110149297","article-title":"A bacterial two-hybrid selection system for studying protein\u2013DNA and protein\u2013protein interactions","volume":"97","author":"Joung","year":"2000","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_44","first-page":"2638","article-title":"iCLIP\u2013transcriptome-wide mapping of protein-RNA interactions with individual nucleotide resolution","volume":"50","author":"Konig","year":"2011","journal-title":"J. Vis. Exp."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1002\/(SICI)1098-1004(200001)15:1<57::AID-HUMU12>3.0.CO;2-G","article-title":"Online Mendelian inheritance in man (OMIM)","volume":"15","author":"Hamosh","year":"2000","journal-title":"Hum. Mutat."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1038\/35021093","article-title":"Molecular portraits of human breast tumours","volume":"406","author":"Perou","year":"2000","journal-title":"Nature"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1038\/nature10983","article-title":"The genomic and transcriptomic architecture of 2000 breast tumours reveals novel subgroups","volume":"486","author":"Curtis","year":"2012","journal-title":"Nature"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"R68","DOI":"10.1186\/bcr2635","article-title":"Phenotypic and molecular characterization of the claudin-low intrinsic subtype of breast cancer","volume":"12","author":"Prat","year":"2010","journal-title":"Breast Cancer Res."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"The Cancer Genome Atlas Research Network (2008). Comprehensive genomic characterization defines human glioblastoma genes and core pathways. Nature, 455, 1061\u20131068.","DOI":"10.1038\/nature07385"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1093\/jnci\/djr545","article-title":"A Three-Gene Model to Robustly Identify Breast Cancer Molecular Subtypes","volume":"104","author":"Desmedt","year":"2012","journal-title":"J. Natl. Cancer Inst."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1038\/35057062","article-title":"Initial sequencing and analysis of the human genome","volume":"409","author":"Lander","year":"2001","journal-title":"Nature"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/j.ygeno.2014.03.004","article-title":"Inference and validation of predictive gene networks from biomedical literature and gene expression data","volume":"103","author":"Olsen","year":"2014","journal-title":"Genomics"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"D362","DOI":"10.1093\/nar\/gkw937","article-title":"The STRING database in 2017: Quality-controlled protein\u2013protein association networks, made broadly accessible","volume":"45","author":"Szklarczyk","year":"2016","journal-title":"Nucleic Acids Res."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"D380","DOI":"10.1093\/nar\/gkx1013","article-title":"TRRUST v2: An expanded reference database of human and mouse transcriptional regulatory interactions","volume":"46","author":"Han","year":"2017","journal-title":"Nucleic Acids Res."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1186\/gm293","article-title":"Gene expression and network-based analysis reveals a novel role for hsa-miR-9 and drug control over the p38 network in glioblastoma multiforme progression","volume":"3","author":"Efroni","year":"2011","journal-title":"Genome Med."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Dehmer, M., Mueller, L., and Emmert-Streib, F. (2013). Quantitative Network Measures as Biomarkers for Classifying Prostate Cancer Disease States: A Systems Approach to Diagnostic Biomarkers. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0077602"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Cun, Y., and Frohlich, H. (2013). Network and Data Integration for Biomarker Signature Discovery via Network Smoothed T-Statistics. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0073074"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1002\/bimj.201300035","article-title":"Including network knowledge into Cox regression models for biomarker signature discovery","volume":"56","author":"Frohlich","year":"2014","journal-title":"Biom. J."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1093\/bioinformatics\/btt620","article-title":"Prediction and early diagnosis of complex diseases by edge-network","volume":"30","author":"Yu","year":"2014","journal-title":"Bioinformatics"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1007\/s11427-014-4757-4","article-title":"Edge biomarkers for classification and prediction of phenotypes","volume":"57","author":"Zeng","year":"2014","journal-title":"Sci. China Life Sci."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"5682","DOI":"10.1111\/febs.12536","article-title":"Network biomarkers reveal dysfunctional gene regulations during disease progression","volume":"280","author":"Zeng","year":"2013","journal-title":"FEBS J."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1038\/gim.2014.133","article-title":"An overview of recommendations and translational milestones for genomic tests in cancer","volume":"17","author":"Chang","year":"2014","journal-title":"Genet. Med."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"1999","DOI":"10.1056\/NEJMoa021967","article-title":"A gene-expression signature as a predictor of survival in breast cancer","volume":"347","author":"He","year":"2002","journal-title":"N. Engl. J. Med."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1186\/s12967-018-1535-2","article-title":"In silico identification of drug target pathways in breast cancer subtypes using pathway cross-talk inhibition","volume":"16","author":"Cava","year":"2018","journal-title":"J. Transl. Med."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Jaeger, S., Igea, A., Arroyo, R., Alcalde, V., Canovas, B., Orozco, M., Nebreda, A.R., and Aloy, P. (2016). Quantification of pathway cross-talk reveals novel synergistic drug combinations for breast cancer. Cancer Res.","DOI":"10.1158\/0008-5472.CAN-16-0097"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/1\/1\/8\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:20:20Z","timestamp":1760196020000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/1\/1\/8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,22]]},"references-count":65,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,3]]}},"alternative-id":["make1010008"],"URL":"https:\/\/doi.org\/10.3390\/make1010008","relation":{},"ISSN":["2504-4990"],"issn-type":[{"type":"electronic","value":"2504-4990"}],"subject":[],"published":{"date-parts":[[2018,8,22]]}}}