{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,5]],"date-time":"2026-09-05T13:39:24Z","timestamp":1788615564641,"version":"build-2803163510"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1009459","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000}}],"reference-count":27,"publisher":"Public Library of Science (PLoS)","issue":"10","license":[{"start":{"date-parts":[[2021,10,6]],"date-time":"2021-10-06T00:00:00Z","timestamp":1633478400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["U19AI118626"],"award-info":[{"award-number":["U19AI118626"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["U01AI150753"],"award-info":[{"award-number":["U01AI150753"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Recent technological advances have made the gathering of comprehensive gene expression datasets a commodity. This has shifted the limiting step of transcriptomic studies from the accumulation of data to their analyses and interpretation. The main problem in analyzing transcriptomics data is that the number of independent samples is typically much lower (&lt;100) than the number of genes whose expression is quantified (typically &gt;14,000). To address this, it would be desirable to reduce the gathered data\u2019s dimensionality without losing information. Clustering genes into discrete modules is one of the most commonly used tools to accomplish this task. While there are multiple clustering approaches, there is a lack of informative metrics available to evaluate the resultant clusters\u2019 biological quality. Here we present a metric that incorporates known ground truth gene sets to quantify gene clusters\u2019 biological quality derived from standard clustering techniques. The GECO (<jats:bold>G<\/jats:bold>round truth <jats:bold>E<\/jats:bold>valuation of <jats:bold>C<\/jats:bold>lustering <jats:bold>O<\/jats:bold>utcomes) metric demonstrates that quantitative and repeatable scoring of gene clusters is not only possible but computationally lightweight and robust. Unlike current methods, it allows direct comparison between gene clusters generated by different clustering techniques. It also reveals that current cluster analysis techniques often underestimate the number of clusters that should be formed from a dataset, which leads to fewer clusters of lower quality. As a test case, we applied GECO combined with k-means clustering to derive an optimal set of co-expressed gene modules derived from PBMC, which we show to be superior to previously generated modules generated on whole-blood. Overall, GECO provides a rational metric to test and compare different clustering approaches to analyze high-dimensional transcriptomic data.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1009459","type":"journal-article","created":{"date-parts":[[2021,10,7]],"date-time":"2021-10-07T10:58:58Z","timestamp":1633604338000},"page":"e1009459","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":5,"title":["A metric for evaluating biological information in gene sets and its application to identify co-expressed gene clusters in PBMC"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5879-2037","authenticated-orcid":true,"given":"Jason","family":"Bennett","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mikhail","family":"Pomaznoy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6941-3618","authenticated-orcid":true,"given":"Akul","family":"Singhania","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bjoern","family":"Peters","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2021,10,6]]},"reference":[{"key":"pcbi.1009459.ref001","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1038\/s41592-018-0019-x","article-title":"The curse(s) of dimensionality","volume":"15","author":"N Altman","year":"2018","journal-title":"Nat Methods"},{"key":"pcbi.1009459.ref002","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1186\/1471-2105-9-559","article-title":"WGCNA: an R package for weighted correlation network analysis","volume":"9","author":"P Langfelder","year":"2008","journal-title":"BMC Bioinformatics"},{"key":"pcbi.1009459.ref003","doi-asserted-by":"crossref","first-page":"655","DOI":"10.4049\/jimmunol.1600397","article-title":"Transcriptional Profiling of Th2 Cells Identifies Pathogenic Features Associated with Asthma","volume":"197","author":"G Seumois","year":"2016","journal-title":"J Immunol"},{"key":"pcbi.1009459.ref004","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/75556","article-title":"Gene Ontology: tool for the unification of biology","volume":"25","author":"M Ashburner","year":"2000","journal-title":"Nat Genet"},{"key":"pcbi.1009459.ref005","doi-asserted-by":"crossref","first-page":"D330","DOI":"10.1093\/nar\/gky1055","article-title":"The Gene Ontology Resource: 20 years and still GOing strong","volume":"47","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"pcbi.1009459.ref006","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1093\/nar\/28.1.27","article-title":"KEGG: kyoto encyclopedia of genes and genomes","volume":"28","author":"M Kanehisa","year":"2000","journal-title":"Nucleic Acids Res"},{"key":"pcbi.1009459.ref007","doi-asserted-by":"crossref","first-page":"D590","DOI":"10.1093\/nar\/gky962","article-title":"New approach for understanding genome variations in KEGG","volume":"47","author":"M Kanehisa","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"pcbi.1009459.ref008","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1093\/bioinformatics\/18.1.39","article-title":"Tumor classification by partial least squares using microarray gene expression data","volume":"18","author":"DV Nguyen","year":"2002","journal-title":"Bioinformatics"},{"key":"pcbi.1009459.ref009","first-page":"189","volume-title":"The Gene Ontology Handbook","author":"Springer","year":"2017"},{"key":"pcbi.1009459.ref010","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.immuni.2008.05.012","article-title":"A Modular Analysis Framework for Blood Genomics Studies: Application to Systemic Lupus Erythematosus","volume":"29","author":"D Chaussabel","year":"2008","journal-title":"Immunity"},{"key":"pcbi.1009459.ref011","first-page":"525709","article-title":"A Novel Repertoire of Blood Transcriptome Modules Based on Co-expression Patterns Across Sixteen Disease and Physiological States","author":"MC Altman","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1009459.ref012","first-page":"9","article-title":"Longitudinal peripheral blood transcriptional analysis of a patient with severe Ebola virus disease","author":"JC Kash","year":"2017","journal-title":"Sci Transl Med"},{"key":"pcbi.1009459.ref013","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1038\/ni.2789","article-title":"Molecular signatures of antibody responses derived from a systems biological study of 5 human vaccines","volume":"15","author":"S Li","year":"2014","journal-title":"Nat Immunol"},{"key":"pcbi.1009459.ref014","volume-title":"Some methods for classification and analysis of multivariate observations","author":"J MacQueen","year":"1967"},{"key":"pcbi.1009459.ref015","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1007\/BF02289263","article-title":"Who belongs in the family?","volume":"18","author":"RL Thorndike","year":"1953","journal-title":"Psychometrika"},{"key":"pcbi.1009459.ref016","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","article-title":"Silhouettes: A graphical aid to the interpretation and validation of cluster analysis","volume":"20","author":"PJ Rousseeuw","year":"1987","journal-title":"J Comput Appl Math"},{"key":"pcbi.1009459.ref017","doi-asserted-by":"crossref","first-page":"1701","DOI":"10.1016\/j.cell.2018.10.022","article-title":"Impact of Genetic Polymorphisms on Human Immune Cell Gene Expression","volume":"175","author":"BJ Schmiedel","year":"2018","journal-title":"Cell"},{"key":"pcbi.1009459.ref018","article-title":"Transcriptomic Analysis of CD4+ T Cells Reveals Novel Immune Signatures of Latent Tuberculosis","author":"JG Burel","year":"2018","journal-title":"J Immunol"},{"key":"pcbi.1009459.ref019","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/0092-8674(91)90193-3","article-title":"The candidate gene for the X-linked Kallmann syndrome encodes a protein related to adhesion molecules","volume":"67","author":"R Legouis","year":"1991","journal-title":"Cell"},{"key":"pcbi.1009459.ref020","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.cels.2015.12.004","article-title":"The Molecular Signatures Database (MSigDB) hallmark gene set collection","volume":"1","author":"A Liberzon","year":"2015","journal-title":"Cell Syst"},{"key":"pcbi.1009459.ref021","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1038\/nature09247","article-title":"An Interferon-Inducible Neutrophil-Driven Blood Transcriptional Signature in Human Tuberculosis","volume":"466","author":"MPR Berry","year":"2010","journal-title":"Nature"},{"key":"pcbi.1009459.ref022","doi-asserted-by":"crossref","first-page":"e002387","DOI":"10.1161\/CIRCGEN.118.002387","article-title":"Whole Blood Transcriptome Profiling Identifies Women with Myocardial Infarction with Non-Obstructive Coronary Artery Disease (MINOCA): Findings from the American Heart Association Go Red for Women Strategically Focused Research Network","volume":"11","author":"TJ Barrett","year":"2018","journal-title":"Circ Genomic Precis Med"},{"key":"pcbi.1009459.ref023","first-page":"10","article-title":"Baseline and Disease-Induced Transcriptional Profiles in Children with Sickle Cell Disease","author":"S Creary","year":"2020","journal-title":"Sci Rep"},{"key":"pcbi.1009459.ref024","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.jcf.2019.08.021","article-title":"Whole-blood transcriptomic responses to lumacaftor\/ivacaftor therapy in cystic fibrosis","volume":"19","author":"BT Kopp","year":"2020","journal-title":"J Cyst Fibros Off J Eur Cyst Fibros Soc"},{"key":"pcbi.1009459.ref025","doi-asserted-by":"crossref","first-page":"D786","DOI":"10.1093\/nar\/gky930","article-title":"Genenames.org: the HGNC and VGNC resources in 2019","volume":"47","author":"B Braschi","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"pcbi.1009459.ref026","first-page":"684159","article-title":"Uncovering the cell type specificity of blood sample derived gene signatures using RNA expression data","author":"M Pomaznoy","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1009459.ref027","first-page":"12","article-title":"A Quantitative Analysis of Complexity of Human Pathogen-Specific CD4 T Cell Responses in Healthy M. tuberculosis Infected South Africans","author":"CS Lindestam Arlehamn","year":"2016","journal-title":"PLoS Pathog"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1009459","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,10,18]],"date-time":"2021-10-18T00:00:00Z","timestamp":1634515200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009459","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,19]],"date-time":"2021-10-19T01:30:53Z","timestamp":1634607053000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1009459"}},"subtitle":[],"editor":[{"given":"Tamas","family":"Korcsmaros","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,10,6]]},"references-count":27,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,10,6]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1009459","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1009459","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,6]]}}}