{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T00:33:36Z","timestamp":1785198816971,"version":"3.55.0"},"reference-count":65,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,5,19]],"date-time":"2021-05-19T00:00:00Z","timestamp":1621382400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Genet."],"abstract":"<jats:p>Genes often work together to perform complex biological processes, and \u201cnetworks\u201d provide a versatile framework for representing the interactions between multiple genes. Differential network analysis (DiNA) quantifies how this network structure differs between two or more groups\/phenotypes (e.g., disease subjects and healthy controls), with the goal of determining whether differences in network structure can help explain differences between phenotypes. In this paper, we focus on gene co-expression networks, although in principle, the methods studied can be used for DiNA for other types of features (e.g., metabolome, epigenome, microbiome, proteome, etc.). Three common applications of DiNA involve (1) testing whether the connections to a single gene differ between groups, (2) testing whether the connection between a <jats:italic>pair<\/jats:italic> of genes differs between groups, or (3) testing whether the connections within a \u201cmodule\u201d (a subset of 3 or more genes) differs between groups. This article focuses on the latter, as there is a lack of studies comparing statistical methods for identifying differentially co-expressed modules (DCMs). Through extensive simulations, we compare several previously proposed test statistics and a new p-norm difference test (PND). We demonstrate that the true positive rate of the proposed PND test is competitive with and often higher than the other methods, while controlling the false positive rate. The R package discoMod (differentially co-expressed modules) implements the proposed method and provides a full pipeline for identifying DCMs: clustering tools to derive gene modules, tests to identify DCMs, and methods for visualizing the results.<\/jats:p>","DOI":"10.3389\/fgene.2021.630215","type":"journal-article","created":{"date-parts":[[2021,5,19]],"date-time":"2021-05-19T05:21:50Z","timestamp":1621401710000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Comparing Statistical Tests for Differential Network Analysis of Gene Modules"],"prefix":"10.3389","volume":"12","author":[{"given":"Jaron","family":"Arbet","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yaxu","family":"Zhuang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elizabeth","family":"Litkowski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laura","family":"Saba","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katerina","family":"Kechris","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2021,5,19]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1093\/bib\/bbn058","article-title":"A roadmap of clustering algorithms: finding a match for a biomedical application.","volume":"10","author":"Andreopoulos","year":"2009","journal-title":"Brief. Bioinform."},{"key":"B2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/75556","article-title":"Gene ontology: tool for the unification of biology.","volume":"25","author":"Ashburner","year":"2000","journal-title":"Nat. Genet."},{"key":"B3","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1038\/nrg2918","article-title":"Network medicine: a network-based approach to human disease.","volume":"12","author":"Barab\u00e1si","year":"2011","journal-title":"Nat. Rev. Genet."},{"key":"B4","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1038\/nrg1272","article-title":"Network biology: understanding the cell\u2019s functional organization.","volume":"5","author":"Barabasi","year":"2004","journal-title":"Nat. Rev. Genet."},{"key":"B5","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing.","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc. Series B Stat. Methodol."},{"key":"B6","doi-asserted-by":"crossref","first-page":"989","DOI":"10.3150\/bj\/1106314847","article-title":"Some theory for Fisher\u2019s linear discriminant function, naive Bayes\u2019, and some alternatives when there are many more variables than observations.","volume":"10","author":"Bickel","year":"2004","journal-title":"Bernoulli"},{"key":"B7","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1080\/01621459.2012.758041","article-title":"Two-sample covariance matrix testing and support recovery in high-dimensional and sparse settings.","volume":"108","author":"Cai","year":"2013","journal-title":"J. Am. Stat. Assoc."},{"key":"B8","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1111\/biom.12552","article-title":"Comparing large covariance matrices under weak conditions on the dependence structure and its application to gene clustering.","volume":"73","author":"Chang","year":"2017","journal-title":"Biometrics"},{"key":"B9","doi-asserted-by":"publisher","first-page":"2780","DOI":"10.1093\/bioinformatics\/btp502","article-title":"Statistical methods for gene set co-expression analysis.","volume":"25","author":"Choi","year":"2009","journal-title":"Bioinformatics"},{"key":"B10","doi-asserted-by":"publisher","first-page":"721","DOI":"10.1146\/annurev-cellbio-100109-104122","article-title":"A decade of systems biology.","volume":"26","author":"Chuang","year":"2010","journal-title":"Annu. Rev. Cell Dev. Biol."},{"key":"B11","doi-asserted-by":"publisher","first-page":"1243","DOI":"10.1093\/bioinformatics\/btx750","article-title":"iDINGO\u2014integrative differential network analysis in genomics with Shiny application.","volume":"34","author":"Class","year":"2018","journal-title":"Bioinformatics"},{"key":"B12","doi-asserted-by":"publisher","first-page":"1939","DOI":"10.1093\/bioinformatics\/bts268","article-title":"R\/EBcoexpress: an empirical Bayesian framework for discovering differential co-expression.","volume":"28","author":"Dawson","year":"2012","journal-title":"Bioinformatics"},{"key":"B13","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1016\/j.tig.2010.05.001","article-title":"From \u2018differential expression\u2019to \u2018differential networking\u2019\u2013identification of dysfunctional regulatory networks in diseases.","volume":"26","author":"de la Fuente","year":"2010","journal-title":"Trends Genet."},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1038\/nrg.2016.29","article-title":"The statistical properties of gene-set analysis.","volume":"17","author":"De Leeuw","year":"2016","journal-title":"Nat. Rev. Genet."},{"key":"B15","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1198\/016214502753479248","article-title":"Comparison of discrimination methods for the classification of tumors using gene expression data.","volume":"97","author":"Dudoit","year":"2002","journal-title":"J. Am. Stat. Assoc."},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1002053","article-title":"Pathway analysis of expression data: deciphering functional building blocks of complex diseases.","volume":"7","author":"Emmert-Streib","year":"2011","journal-title":"PLoS Comput. Biol."},{"key":"B17","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/978-1-4939-8882-2_13","article-title":"Learning differential module networks across multiple experimental conditions.","volume":"1883","author":"Erola","year":"2019","journal-title":"Methods Mol. Biol."},{"key":"B18","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1093\/biostatistics\/kxm045","article-title":"Sparse inverse covariance estimation with the graphical lasso.","volume":"9","author":"Friedman","year":"2008","journal-title":"Biostatistics"},{"key":"B19","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1016\/j.gene.2012.11.028","article-title":"DiffCorr: an R package to analyze and visualize differential correlations in biological networks.","volume":"518","author":"Fukushima","year":"2013","journal-title":"Gene"},{"key":"B20","doi-asserted-by":"publisher","first-page":"498","DOI":"10.5606\/archrheumatol.2018.6595","article-title":"Cathepsin G and its role in inflammation and autoimmune diseases.","volume":"33","author":"Gao","year":"2018","journal-title":"Arch. Rheumatol."},{"key":"B21","doi-asserted-by":"crossref","first-page":"950","DOI":"10.1198\/106186002394","article-title":"Package \u2018mvtnorm\u2019.","volume":"11","author":"Genz","year":"2020","journal-title":"J. Comput. Graphic. Stat."},{"key":"B22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v057.i13","article-title":"Linear quantile mixed models: the lqmm package for Laplace quantile regression.","volume":"57","author":"Geraci","year":"2014","journal-title":"J. Stat. Softw."},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-11-95","article-title":"A statistical framework for differential network analysis from microarray data.","volume":"11","author":"Gill","year":"2010","journal-title":"BMC Bioinform."},{"key":"B24","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1126\/science.286.5439.531","article-title":"Molecular classification of cancer: class discovery and class prediction by gene expression monitoring.","volume":"286","author":"Golub","year":"1999","journal-title":"Science"},{"key":"B25","doi-asserted-by":"publisher","first-page":"3413","DOI":"10.1093\/bioinformatics\/btv406","article-title":"DINGO: differential network analysis in genomics.","volume":"31","author":"Ha","year":"2015","journal-title":"Bioinformatics"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/nar\/gkn923","article-title":"Bioinformatics enrichment tools: paths toward the comprehensive functional analysis of large gene lists.","volume":"37","author":"Huang","year":"2009","journal-title":"Nucleic Acids Res."},{"key":"B27","article-title":"Differential expression analysis for RNA-Seq: an overview of statistical methods and computational software: supplementary issue: sequencing platform modeling and analysis.","volume":"14","author":"Huang","year":"2015","journal-title":"Cancer Inform."},{"key":"B28","doi-asserted-by":"crossref","DOI":"10.3389\/fgene.2019.00594","article-title":"BioNetStat: a tool for biological networks differential analysis.","volume":"10","author":"Jardim","year":"2019","journal-title":"Front. Genet."},{"key":"B29","doi-asserted-by":"publisher","first-page":"1978","DOI":"10.1038\/onc.2012.204","article-title":"AML1-ETO targets and suppresses cathepsin G, a serine protease, which is able to degrade AML1-ETO in t(8;21) acute myeloid leukemia.","volume":"32","author":"Jin","year":"2013","journal-title":"Oncogene"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2019.103380","article-title":"Comparison of methods for differential co-expression analysis for disease biomarker prediction.","volume":"113","author":"Kakati","year":"2019","journal-title":"Comp. Biol. Med."},{"key":"B31","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1093\/nar\/28.1.27","article-title":"KEGG: kyoto encyclopedia of genes and genomes.","volume":"28","author":"Kanehisa","year":"2000","journal-title":"Nucleic Acids Res."},{"key":"B32","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1109\/tcbb.2013.2297921","article-title":"Detecting differentially coexpressed genes from labeled expression data: a brief review.","volume":"11","author":"Kayano","year":"2014","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"B33","article-title":"Cathepsin G is expressed by acute lymphoblastic leukemia and is a potential immunotherapeutic target.","volume":"8","author":"Khan","year":"2017","journal-title":"Front. Immunol."},{"key":"B34","doi-asserted-by":"crossref","first-page":"W90","DOI":"10.1093\/nar\/gkw377","article-title":"Enrichr: a comprehensive gene set enrichment analysis web server 2016 update.","volume":"44","author":"Kuleshov","year":"2016","journal-title":"Nucleic Acids Res."},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0050411","article-title":"Evaluation of gene association methods for coexpression network construction and biological knowledge discovery.","volume":"7","author":"Kumari","year":"2012","journal-title":"PLoS One"},{"key":"B36","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2105-9-559","article-title":"WGCNA: an R package for weighted correlation network analysis.","volume":"9","author":"Langfelder","year":"2008","journal-title":"BMC Bioinform."},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1001057","article-title":"Is my network module preserved and reproducible?","volume":"7","author":"Langfelder","year":"2011","journal-title":"PLoS Comput. Biol."},{"key":"B38","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1093\/bioinformatics\/btm563","article-title":"Defining clusters from a hierarchical cluster tree: the dynamic tree cut package for R.","volume":"24","author":"Langfelder","year":"2008","journal-title":"Bioinformatics"},{"key":"B39","first-page":"837","article-title":"Comparative assessment of differential network analysis methods.","volume":"18","author":"Lichtblau","year":"2017","journal-title":"Brief. Bioinform."},{"key":"B40","doi-asserted-by":"publisher","first-page":"2637","DOI":"10.1093\/bioinformatics\/btq471","article-title":"DCGL: an R package for identifying differentially coexpressed genes and links from gene expression microarray data.","volume":"26","author":"Liu","year":"2010","journal-title":"Bioinformatics"},{"key":"B41","doi-asserted-by":"crossref","DOI":"10.1186\/s12918-016-0349-1","article-title":"DGCA: a comprehensive R package for differential gene correlation analysis.","volume":"10","author":"McKenzie","year":"2016","journal-title":"BMC Syst. Biol."},{"key":"B42","doi-asserted-by":"crossref","DOI":"10.1186\/s12918-016-0298-8","article-title":"petal: co-expression network modelling in R.","volume":"10","author":"Petereit","year":"2016","journal-title":"BMC Syst. Biol."},{"key":"B43","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1007\/0-387-29362-0_15","article-title":"Multiple testing procedures: the multtest package and applications to genomics","author":"Pollard","year":"2005","journal-title":"Bioinformatics and Computational Biology Solutions Using R and Bioconductor"},{"key":"B44","article-title":"R: A Language and Environment for Statistical Computing.","year":"2018","journal-title":"R Foundation for Statistical Computing"},{"key":"B45","doi-asserted-by":"publisher","first-page":"360","DOI":"10.1093\/bioinformatics\/btt687","article-title":"Gene Sets Net Correlations Analysis (GSNCA): a multivariate differential coexpression test for gene sets.","volume":"30","author":"Rahmatallah","year":"2014","journal-title":"Bioinformatics"},{"key":"B46","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1016\/j.tig.2012.03.004","article-title":"Pathway analysis of genomic data: concepts, methods, and prospects for future development.","volume":"28","author":"Ramanan","year":"2012","journal-title":"Trends Genet."},{"key":"B47","doi-asserted-by":"publisher","first-page":"1551","DOI":"10.1126\/science.1073374","article-title":"Hierarchical organization of modularity in metabolic networks.","volume":"297","author":"Ravasz","year":"2002","journal-title":"Science"},{"key":"B48","doi-asserted-by":"crossref","DOI":"10.1186\/s12859-015-0735-5","article-title":"Differential analysis of biological networks.","volume":"16","author":"Ruan","year":"2015","journal-title":"BMC Bioinform."},{"key":"B49","doi-asserted-by":"publisher","first-page":"6535","DOI":"10.1016\/j.csda.2007.03.004","article-title":"A test for the equality of covariance matrices when the dimension is large relative to the sample sizes.","volume":"51","author":"Schott","year":"2007","journal-title":"Comput. Stat. Data Anal."},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.32614\/rj-2016-021","article-title":"mclust 5: clustering, classification and density estimation using Gaussian finite mixture models.","volume":"8","author":"Scrucca","year":"2016","journal-title":"R J."},{"key":"B51","doi-asserted-by":"publisher","first-page":"2498","DOI":"10.1101\/gr.1239303","article-title":"Cytoscape: a software environment for integrated models of biomolecular interaction networks.","volume":"13","author":"Shannon","year":"2003","journal-title":"Genome Res."},{"key":"B52","doi-asserted-by":"publisher","first-page":"4336","DOI":"10.1093\/bioinformatics\/btz226","article-title":"Unsupervised discovery of phenotype-specific multi-omics networks.","volume":"35","author":"Shi","year":"2019","journal-title":"Bioinformatics"},{"key":"B53","article-title":"Differential network analysis: a statistical perspective.","volume":"13","author":"Shojaie","year":"2020","journal-title":"Wiley Interdiscip. Rev. Comput. Stat."},{"key":"B54","doi-asserted-by":"publisher","first-page":"1013","DOI":"10.1007\/s00018-017-2679-6","article-title":"Differential gene regulatory networks in development and disease.","volume":"75","author":"Singh","year":"2018","journal-title":"Cell. Mol. Life Sci."},{"key":"B55","doi-asserted-by":"publisher","first-page":"690","DOI":"10.1093\/bioinformatics\/btv633","article-title":"The discordant method: a novel approach for differential correlation.","volume":"32","author":"Siska","year":"2016","journal-title":"Bioinformatics"},{"key":"B56","doi-asserted-by":"crossref","DOI":"10.1186\/s13104-016-2331-9","article-title":"Differential correlation for sequencing data.","volume":"10","author":"Siska","year":"2017","journal-title":"BMC Res. Notes"},{"key":"B57","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2105-14-91","article-title":"A comparison of methods for differential expression analysis of RNA-seq data.","volume":"14","author":"Soneson","year":"2013","journal-title":"BMC Bioinform."},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-11-497","article-title":"DiffCoEx: a simple and sensitive method to find differentially coexpressed gene modules.","volume":"11","author":"Tesson","year":"2010","journal-title":"BMC Bioinform."},{"key":"B59","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1214\/ss\/1056397488","article-title":"Class prediction by nearest shrunken centroids, with applications to DNA microarrays.","volume":"18","author":"Tibshirani","year":"2003","journal-title":"Stat. Sci."},{"key":"B60","first-page":"575","article-title":"Gene co-expression analysis for functional classification and gene\u2013disease predictions.","volume":"19","author":"van Dam","year":"2018","journal-title":"Brief. Bioinform."},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004755","article-title":"FastGGM: an efficient algorithm for the inference of gaussian graphical model in biological networks.","volume":"12","author":"Wang","year":"2016","journal-title":"PLoS Comput. Biol."},{"key":"B62","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2105-7-509","article-title":"CoXpress: differential co-expression in gene expression data.","volume":"7","author":"Watson","year":"2006","journal-title":"BMC Bioinform."},{"key":"B63","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1109\/rbme.2010.2083647","article-title":"Clustering algorithms in biomedical research: a review.","volume":"3","author":"Xu","year":"2010","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"B64","doi-asserted-by":"crossref","DOI":"10.2202\/1544-6115.1128","article-title":"A general framework for weighted gene co-expression network analysis.","volume":"4","author":"Zhang","year":"2005","journal-title":"Stat. Appl. Genet. Mol. Biol."},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1006369","article-title":"SILGGM: an extensive R package for efficient statistical inference in large-scale gene networks.","volume":"14","author":"Zhang","year":"2018","journal-title":"PLoS Comput. Biol."}],"container-title":["Frontiers in Genetics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fgene.2021.630215\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,5,19]],"date-time":"2021-05-19T05:22:04Z","timestamp":1621401724000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fgene.2021.630215\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,19]]},"references-count":65,"alternative-id":["10.3389\/fgene.2021.630215"],"URL":"https:\/\/doi.org\/10.3389\/fgene.2021.630215","relation":{},"ISSN":["1664-8021"],"issn-type":[{"value":"1664-8021","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,19]]},"article-number":"630215"}}