{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T19:21:49Z","timestamp":1777490509633,"version":"3.51.4"},"reference-count":50,"publisher":"Oxford University Press (OUP)","issue":"13","license":[{"start":{"date-parts":[[2018,6,27]],"date-time":"2018-06-27T00:00:00Z","timestamp":1530057600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100005508","name":"Boettcher Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005508","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Front Range Cancer Challenge"},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["T32GM007635"],"award-info":[{"award-number":["T32GM007635"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["T15LM009451"],"award-info":[{"award-number":["T15LM009451"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>Gene Set Enrichment Analysis (GSEA) is routinely used to analyze and interpret coordinate pathway-level changes in transcriptomics experiments. For an experiment where less than seven samples per condition are compared, GSEA employs a competitive null hypothesis to test significance. A gene set enrichment score is tested against a null distribution of enrichment scores generated from permuted gene sets, where genes are randomly selected from the input experiment. Looking across a variety of biological conditions, however, genes are not randomly distributed with many showing consistent patterns of up- or down-regulation. As a result, common patterns of positively and negatively enriched gene sets are observed across experiments. Placing a single experiment into the context of a relevant set of background experiments allows us to identify both the common and experiment-specific patterns of gene set enrichment.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We compiled a compendium of 442 small molecule transcriptomic experiments and used GSEA to characterize common patterns of positively and negatively enriched gene sets. To identify experiment-specific gene set enrichment, we developed the GSEA-InContext method that accounts for gene expression patterns within a background set of experiments to identify statistically significantly enriched gene sets. We evaluated GSEA-InContext on experiments using small molecules with known targets to show that it successfully prioritizes gene sets that are specific to each experiment, thus providing valuable insights that complement standard GSEA analysis.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability and implementation<\/jats:title>\n                    <jats:p>GSEA-InContext implemented in Python, Supplementary results and the background expression compendium are available at: https:\/\/github.com\/CostelloLab\/GSEA-InContext.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/bty271","type":"journal-article","created":{"date-parts":[[2018,4,14]],"date-time":"2018-04-14T05:35:35Z","timestamp":1523684135000},"page":"i555-i564","source":"Crossref","is-referenced-by-count":203,"title":["GSEA-InContext: identifying novel and common patterns in expression experiments"],"prefix":"10.1093","volume":"34","author":[{"given":"Rani K","family":"Powers","sequence":"first","affiliation":[{"name":"Computational Bioscience Program, University of Colorado Anschutz Medical Campus, Aurora, CO, USA"},{"name":"Department of Pharmacology, University of Colorado Anschutz Medical Campus, Aurora, CO, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew","family":"Goodspeed","sequence":"additional","affiliation":[{"name":"Department of Pharmacology, University of Colorado Anschutz Medical Campus, Aurora, CO, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Harrison","family":"Pielke-Lombardo","sequence":"additional","affiliation":[{"name":"Computational Bioscience Program, University of Colorado Anschutz Medical Campus, Aurora, CO, USA"},{"name":"Department of Pharmacology, University of Colorado Anschutz Medical Campus, Aurora, CO, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aik-Choon","family":"Tan","sequence":"additional","affiliation":[{"name":"Department of Medical Oncology, University of Colorado Anschutz Medical Campus, Aurora, CO, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James C","family":"Costello","sequence":"additional","affiliation":[{"name":"Computational Bioscience Program, University of Colorado Anschutz Medical Campus, Aurora, CO, USA"},{"name":"Department of Pharmacology, University of Colorado Anschutz Medical Campus, Aurora, CO, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2018,6,27]]},"reference":[{"key":"2023051605131736400_bty271-B1","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1016\/j.fob.2012.04.003","article-title":"GeneSetDB: a comprehensive meta-database, statistical and visualisation framework for gene set analysis","volume":"2","author":"Araki","year":"2012","journal-title":"FEBS Open Bio"},{"key":"2023051605131736400_bty271-B2","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1016\/j.cell.2013.11.012","article-title":"Glucocorticoid receptor confers resistance to antiandrogens by bypassing androgen receptor blockade","volume":"155","author":"Arora","year":"2013","journal-title":"Cell"},{"key":"2023051605131736400_bty271-B3","doi-asserted-by":"crossref","first-page":"282","DOI":"10.1038\/487282a","article-title":"Gene data to hit milestone","volume":"487","author":"Baker","year":"2012","journal-title":"Nature"},{"key":"2023051605131736400_bty271-B4","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1038\/nature08460","article-title":"Systematic RNA interference reveals that oncogenic KRAS-driven cancers require TBK1","volume":"462","author":"Barbie","year":"2009","journal-title":"Nature"},{"key":"2023051605131736400_bty271-B5","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1038\/nature11003","article-title":"The Cancer Cell Line Encyclopedia enables predictive modelling of anticancer drug sensitivity","volume":"483","author":"Barretina","year":"2012","journal-title":"Nature"},{"key":"2023051605131736400_bty271-B6","doi-asserted-by":"crossref","first-page":"1943","DOI":"10.1093\/bioinformatics\/bti260","article-title":"Significance analysis of functional categories in gene expression studies: a structured permutation approach","volume":"21","author":"Barry","year":"2005","journal-title":"Bioinformatics"},{"key":"2023051605131736400_bty271-B7","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1093\/bioinformatics\/19.2.185","article-title":"A comparison of normalization methods for high density oligonucleotide array data based on variance and bias","volume":"19","author":"Bolstad","year":"2003","journal-title":"Bioinformatics"},{"key":"2023051605131736400_bty271-B8","author":"Carlson","year":"2016"},{"key":"2023051605131736400_bty271-B9","doi-asserted-by":"crossref","first-page":"25130","DOI":"10.1074\/jbc.M001914200","article-title":"Reactive oxygen species generated at mitochondrial complex III stabilize hypoxia-inducible factor-1alpha during hypoxia: a mechanism of O2 sensing","volume":"275","author":"Chandel","year":"2000","journal-title":"J. Biol. Chem"},{"key":"2023051605131736400_bty271-B10","doi-asserted-by":"crossref","first-page":"1727","DOI":"10.1016\/j.yexcr.2006.02.013","article-title":"Temporal transcriptome of mouse ATDC5 chondroprogenitors differentiating under hypoxic conditions","volume":"312","author":"Chen","year":"2006","journal-title":"Exp. Cell Res"},{"key":"2023051605131736400_bty271-B11","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1038\/nm.4306","article-title":"The Drug Repurposing Hub: a next-generation drug library and information resource","volume":"23","author":"Corsello","year":"2017","journal-title":"Nat. Med"},{"key":"2023051605131736400_bty271-B12","doi-asserted-by":"crossref","first-page":"D1060","DOI":"10.1093\/nar\/gkr901","article-title":"GeneSigDB: a manually curated database and resource for analysis of gene expression signatures","volume":"40","author":"Culhane","year":"2012","journal-title":"Nucleic Acids Res"},{"key":"2023051605131736400_bty271-B13","doi-asserted-by":"crossref","first-page":"1846","DOI":"10.1093\/bioinformatics\/btm254","article-title":"GEOquery: a bridge between the gene expression omnibus (geo) and bioconductor","volume":"23","author":"Davis","year":"2007","journal-title":"Bioinformatics"},{"key":"2023051605131736400_bty271-B14","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1038\/nrg.2016.29","article-title":"The statistical properties of gene-set analysis","volume":"17","author":"de Leeuw","year":"2016","journal-title":"Nat. Rev. Genet"},{"key":"2023051605131736400_bty271-B15","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1093\/nar\/30.1.207","article-title":"Gene expression omnibus: ncbi gene expression and hybridization array data repository","volume":"30","author":"Edgar","year":"2002","journal-title":"Nucleic Acids Res"},{"key":"2023051605131736400_bty271-B16","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1214\/07-AOAS101","article-title":"On testing the significance of sets of genes","volume":"1","author":"Efron","year":"2007","journal-title":"Ann. Appl. Stat"},{"key":"2023051605131736400_bty271-B17","doi-asserted-by":"crossref","first-page":"R26.","DOI":"10.1186\/gb-2008-9-2-r26","article-title":"Correction of technical bias in clinical microarray data improves concordance with known biological information","volume":"9","author":"Eklund","year":"2008","journal-title":"Genome Biol"},{"key":"2023051605131736400_bty271-B18","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1038\/nature11005","article-title":"Systematic identification of genomic markers of drug sensitivity in cancer cells","volume":"483","author":"Garnett","year":"2012","journal-title":"Nature"},{"key":"2023051605131736400_bty271-B19","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1093\/bioinformatics\/btg405","article-title":"affy \u2013 analysis of affymetrix genechip data at the probe level","volume":"20","author":"Gautier","year":"2004","journal-title":"Bioinformatics"},{"key":"2023051605131736400_bty271-B20","doi-asserted-by":"crossref","first-page":"980","DOI":"10.1093\/bioinformatics\/btm051","article-title":"Analyzing gene expression data in terms of gene sets: methodological issues","volume":"23","author":"Goeman","year":"2007","journal-title":"Bioinformatics"},{"key":"2023051605131736400_bty271-B21","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1158\/1541-7786.MCR-15-0189","article-title":"Tumor-derived cell lines as molecular models of cancer pharmacogenomics","volume":"14","author":"Goodspeed","year":"2016","journal-title":"Mol. Cancer Res"},{"key":"2023051605131736400_bty271-B22","author":"GSEA User Guide","year":"2018"},{"key":"2023051605131736400_bty271-B23","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1128\/MCB.19.1.612","article-title":"Cyclin E2, a novel G1 cyclin that binds Cdk2 and is aberrantly expressed in human cancers","volume":"19","author":"Gudas","year":"1999","journal-title":"Mol. Cell. Biol"},{"key":"2023051605131736400_bty271-B24","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1016\/j.devcel.2005.09.010","article-title":"Hypoxia requires notch signaling to maintain the undifferentiated cell state","volume":"9","author":"Gustafsson","year":"2005","journal-title":"Dev. Cell"},{"key":"2023051605131736400_bty271-B25","doi-asserted-by":"crossref","first-page":"7.","DOI":"10.1186\/1471-2105-14-7","article-title":"GSVA: gene set variation analysis for microarray and rna-seq data","volume":"14","author":"H\u00e4nzelmann","year":"2013","journal-title":"BMC Bioinformatics"},{"key":"2023051605131736400_bty271-B26","doi-asserted-by":"crossref","first-page":"S2.","DOI":"10.1186\/1471-2105-13-S15-S2","article-title":"PAGED: a pathway and gene-set enrichment database to enable molecular phenotype discoveries","volume":"13","author":"Huang","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2023051605131736400_bty271-B27","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1093\/bioinformatics\/btl599","article-title":"Extensions to gene set enrichment","volume":"23","author":"Jiang","year":"2007","journal-title":"Bioinformatics"},{"key":"2023051605131736400_bty271-B28","doi-asserted-by":"crossref","first-page":"8044","DOI":"10.1128\/MCB.25.18.8044-8051.2005","article-title":"Genetic evidence that small maf proteins are essential for the activation of antioxidant response element-dependent genes","volume":"25","author":"Katsuoka","year":"2005","journal-title":"Mol. Cell. Biol"},{"key":"2023051605131736400_bty271-B29","doi-asserted-by":"crossref","first-page":"e1002375.","DOI":"10.1371\/journal.pcbi.1002375","article-title":"Ten years of pathway analysis: current approaches and outstanding challenges","volume":"8","author":"Khatri","year":"2012","journal-title":"PLOS Comput. Biol"},{"key":"2023051605131736400_bty271-B30","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1042\/bj2800117","article-title":"Modulation of complement gene expression by glucocorticoids","volume":"280","author":"Lappin","year":"1991","journal-title":"Biochem. J"},{"key":"2023051605131736400_bty271-B31","doi-asserted-by":"crossref","first-page":"5496","DOI":"10.1021\/pr500473n","article-title":"PSEA-Quant: a protein set enrichment analysis on label-free and label-based protein quantification data","volume":"13","author":"Lavall\u00e9e-Adam","year":"2014","journal-title":"J. Proteome Res"},{"key":"2023051605131736400_bty271-B32","doi-asserted-by":"crossref","first-page":"e1000217","DOI":"10.1371\/journal.pcbi.1000217","article-title":"Inferring pathway activity toward precise disease classification","volume":"4","author":"Lee","year":"2008","journal-title":"PLOS Comput. Biol"},{"key":"2023051605131736400_bty271-B33","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.cels.2015.12.004","article-title":"The Molecular Signatures Database (MSigDB) hallmark gene set collection","volume":"1","author":"Liberzon","year":"2015","journal-title":"Cell Syst"},{"key":"2023051605131736400_bty271-B34","doi-asserted-by":"crossref","first-page":"23111","DOI":"10.1074\/jbc.M202487200","article-title":"Hypoxia-inducible factor 1 activation by aerobic glycolysis implicates the Warburg effect in carcinogenesis","volume":"277","author":"Lu","year":"2002","journal-title":"J. Biol. Chem"},{"key":"2023051605131736400_bty271-B35","doi-asserted-by":"crossref","first-page":"182","DOI":"10.1038\/nature08543","article-title":"Direct inhibition of the NOTCH transcription factor complex","volume":"462","author":"Moellering","year":"2009","journal-title":"Nature"},{"key":"2023051605131736400_bty271-B36","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1038\/ng1180","article-title":"Pgc-1alpha-responsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes","volume":"34","author":"Mootha","year":"2003","journal-title":"Nat. Genet"},{"key":"2023051605131736400_bty271-B37","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1023\/A:1020546615229","article-title":"TNF-induced signaling in apoptosis","volume":"19","author":"Rath","year":"1999","journal-title":"J. Clin. Immunol"},{"key":"2023051605131736400_bty271-B38","doi-asserted-by":"crossref","first-page":"e47.","DOI":"10.1093\/nar\/gkv007","article-title":"limma powers differential expression analyses for RNA-sequencing and microarray studies","volume":"43","author":"Ritchie","year":"2015","journal-title":"Nucleic Acids Res"},{"key":"2023051605131736400_bty271-B39","doi-asserted-by":"crossref","first-page":"6392","DOI":"10.1073\/pnas.0802047105","article-title":"Notch signaling mediates hypoxia-induced tumor cell migration and invasion","volume":"105","author":"Sahlgren","year":"2008","journal-title":"PNAS"},{"key":"2023051605131736400_bty271-B40","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1038\/nrc1951","article-title":"The NCI60 human tumour cell line anticancer drug screen","volume":"6","author":"Shoemaker","year":"2006","journal-title":"Nat. Rev. Cancer"},{"key":"2023051605131736400_bty271-B41","doi-asserted-by":"crossref","first-page":"15545","DOI":"10.1073\/pnas.0506580102","article-title":"Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles","volume":"102","author":"Subramanian","year":"2005","journal-title":"PNAS"},{"key":"2023051605131736400_bty271-B42","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1016\/j.cell.2017.10.049","article-title":"A Next Generation Connectivity Map: l 1000 Platform and the First 1,000,000 Profiles","volume":"171","author":"Subramanian","year":"2017","journal-title":"Cell"},{"key":"2023051605131736400_bty271-B43","doi-asserted-by":"crossref","first-page":"13544","DOI":"10.1073\/pnas.0506577102","article-title":"Discovering statistically significant pathways in expression profiling studies","volume":"102","author":"Tian","year":"2005","journal-title":"PNAS"},{"key":"2023051605131736400_bty271-B44","doi-asserted-by":"crossref","first-page":"225.","DOI":"10.1186\/1471-2105-6-225","article-title":"Pathway level analysis of gene expression using singular value decomposition","volume":"6","author":"Tomfohr","year":"2005","journal-title":"BMC Bioinformatics"},{"key":"2023051605131736400_bty271-B45","doi-asserted-by":"crossref","first-page":"12846.","DOI":"10.1038\/ncomms12846","article-title":"Extraction and analysis of signatures from the Gene Expression Omnibus by the crowd","volume":"7","author":"Wang","year":"2016","journal-title":"Nat. Commun"},{"key":"2023051605131736400_bty271-B46","doi-asserted-by":"crossref","first-page":"707","DOI":"10.1158\/1541-7786.MCR-15-0433","article-title":"GR and ER coactivation alters the expression of differentiation genes and associates with improved ER+ breast cancer outcome","volume":"14","author":"West","year":"2016","journal-title":"Mol. Cancer Res"},{"key":"2023051605131736400_bty271-B47","doi-asserted-by":"crossref","first-page":"W71","DOI":"10.1093\/nar\/gkq329","article-title":"MSEA: a web-based tool to identify biologically meaningful patterns in quantitative metabolomic data","volume":"38","author":"Xia","year":"2010","journal-title":"Nucleic Acids Res"},{"key":"2023051605131736400_bty271-B48","doi-asserted-by":"crossref","first-page":"3003","DOI":"10.1158\/1078-0432.CCR-05-2085","article-title":"Glucocorticoids suppress tumor angiogenesis and in vivo growth of prostate cancer cells","volume":"12","author":"Yano","year":"2006","journal-title":"Clin. Cancer Res"},{"key":"2023051605131736400_bty271-B49","doi-asserted-by":"crossref","first-page":"3069","DOI":"10.1093\/bioinformatics\/btv313","article-title":"DSigDB: drug signatures database for gene set analysis","volume":"31","author":"Yoo","year":"2015","journal-title":"Bioinformatics"},{"key":"2023051605131736400_bty271-B50","doi-asserted-by":"crossref","first-page":"W90","DOI":"10.1093\/nar\/gkq324","article-title":"i-GSEA4gwas: a web server for identification of pathways\/gene sets associated with traits by applying an improved gene set enrichment analysis to genome-wide association study","volume":"38","author":"Zhang","year":"2010","journal-title":"Nucleic Acids Res"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/13\/i555\/50315899\/bioinformatics_34_13_i555.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/13\/i555\/50315899\/bioinformatics_34_13_i555.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,16]],"date-time":"2023-05-16T01:14:43Z","timestamp":1684199683000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/34\/13\/i555\/5045793"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,27]]},"references-count":50,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2018,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/bty271","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/259440","asserted-by":"object"}]},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,7,1]]},"published":{"date-parts":[[2018,6,27]]}}}