{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T10:25:55Z","timestamp":1777976755265,"version":"3.51.4"},"reference-count":26,"publisher":"Oxford University Press (OUP)","issue":"4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2008,2,15]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Motivation: Current methods for multiplicity adjustment do not make use of the graph structure of Gene Ontology (GO) when testing for association of expression profiles of GO terms with a response variable.<\/jats:p><jats:p>Results: We propose a multiple testing method, called the focus level procedure, that preserves the graph structure of Gene Ontology (GO). The procedure is constructed as a combination of a Closed Testing procedure with Holm's method. It requires a user to choose a \u2018focus level\u2019 in the GO graph, which reflects the level of specificity of terms in which the user is most interested. This choice also determines the level in the GO graph at which the procedure has most power. We prove that the procedure strongly controls the family-wise error rate without any additional assumptions on the joint distribution of the test statistics used. We also present an algorithm to calculate multiplicity-adjusted P-values. Because the focus level procedure preserves the structure of the GO graph, it does not generally preserve the ordering of the raw P-values in the adjusted P-values.<\/jats:p><jats:p>Availability: The focus level procedure has been implemented in the globaltest and GlobalAncova packages, both of which are available on www.bioconductor.org.<\/jats:p><jats:p>Contact: \u00a0j.j.goeman@lumc.nl<\/jats:p><jats:p>Supplementary information: Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btm628","type":"journal-article","created":{"date-parts":[[2008,1,19]],"date-time":"2008-01-19T01:34:46Z","timestamp":1200706486000},"page":"537-544","source":"Crossref","is-referenced-by-count":70,"title":["Multiple testing on the directed acyclic graph of gene ontology"],"prefix":"10.1093","volume":"24","author":[{"given":"Jelle J.","family":"Goeman","sequence":"first","affiliation":[{"name":"1 Department of Medical Statistics, Postzone S5-P, P.O. Box 9600, 2300 RC Leiden, The Netherlands and 2IBE, Medical School, University of Munich and Department of Statistics, University of Munich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ulrich","family":"Mansmann","sequence":"additional","affiliation":[{"name":"1 Department of Medical Statistics, Postzone S5-P, P.O. Box 9600, 2300 RC Leiden, The Netherlands and 2IBE, Medical School, University of Munich and Department of Statistics, University of Munich, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2008,1,18]]},"reference":[{"key":"2023020209505431800_B1","doi-asserted-by":"crossref","first-page":"1600","DOI":"10.1093\/bioinformatics\/btl140","article-title":"Improved scoring of functional groups from gene expression data by decorrelating GO graph structure","volume":"22","author":"Alexa","year":"2006","journal-title":"Bioinformatics"},{"key":"2023020209505431800_B2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/75556","article-title":"Gene Ontology: tool for the unification of biology","volume":"25","author":"Ashburner","year":"2000","journal-title":"Nat. Genet"},{"key":"2023020209505431800_B3","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. Roy. Stat. Soc. B Met"},{"key":"2023020209505431800_B4","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1186\/1471-2105-8-242","article-title":"Improving gene set analysis of microarray data by SAM-GS","volume":"8","author":"Dinu","year":"2007","journal-title":"BMC Bioinformatics"},{"key":"2023020209505431800_B5","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1214\/ss\/1056397487","article-title":"Multiple hypothesis testing in microarray experiments","volume":"18","author":"Dudoit","year":"2003","journal-title":"Stat. Sci"},{"key":"2023020209505431800_B6","author":"Gentry","year":"2005","journal-title":"Rgraphviz: Provides Plotting Capabilities for R Graph Objects"},{"key":"2023020209505431800_B7","doi-asserted-by":"crossref","first-page":"980","DOI":"10.1093\/bioinformatics\/btm051","article-title":"Analyzing gene expression data in terms of gene sets: methodological issues","volume":"23","author":"Goeman","year":"2007","journal-title":"Bioinformatics"},{"key":"2023020209505431800_B8","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1093\/bioinformatics\/btg382","article-title":"A global test for groups of genes: testing association with a clinical outcome","volume":"20","author":"Goeman","year":"2004","journal-title":"Bioinformatics"},{"key":"2023020209505431800_B9","doi-asserted-by":"crossref","first-page":"1950","DOI":"10.1093\/bioinformatics\/bti267","article-title":"Testing association of a pathway with survival using gene expression data","volume":"21","author":"Goeman","year":"2005","journal-title":"Bioinformatics"},{"key":"2023020209505431800_B10","article-title":"An improved statistic for detecting over-representated Gene Ontology annotations in gene sets","author":"Grossmann","year":"2006"},{"key":"2023020209505431800_B11","first-page":"65","article-title":"A simple sequentially rejective multiple test procedure","volume":"6","author":"Holm","year":"1979","journal-title":"Scandinavian J. Stat"},{"key":"2023020209505431800_B12","article-title":"GlobalANCOVA: exploration and assessment of gene group effects","author":"Hummel","year":"2007","journal-title":"Bioinformatics"},{"key":"2023020209505431800_B13","doi-asserted-by":"crossref","first-page":"3587","DOI":"10.1093\/bioinformatics\/bti565","article-title":"Ontological analysis of gene expression data: current tools, limitations, and open problems","volume":"21","author":"Khatri","year":"2005","journal-title":"Bioinformatics"},{"issue":"3","key":"2023020209505431800_B14","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1055\/s-0038-1633992","article-title":"Testing differential gene expression in functional groups: Goeman's global test versus an ANCOVA approach","volume":"44","author":"Mansmann","year":"2005","journal-title":"Method. Inform. in Med"},{"key":"2023020209505431800_B15","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1093\/biomet\/63.3.655","article-title":"On closed testing procedures with special reference to ordered analysis of variance","volume":"63","author":"Marcus","year":"1976","journal-title":"Biometrika"},{"key":"2023020209505431800_B16","article-title":"Hierarchical testing of variable importance","author":"Meinshausen","year":"2007"},{"key":"2023020209505431800_B17","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1038\/ng1180","article-title":"PGC-1 alpha-responsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes","volume":"34","author":"Mootha","year":"2003","journal-title":"Nat. Genet"},{"key":"2023020209505431800_B18","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1093\/nar\/27.1.29","article-title":"KEGG: Kyoto Encyclopedia of Genes and Genomes","volume":"27","author":"Ogata","year":"1999","journal-title":"Nucleic Acids Res"},{"key":"2023020209505431800_B19","doi-asserted-by":"crossref","first-page":"3733","DOI":"10.1182\/blood-2005-06-2248","article-title":"Nucleophosmin gene mutations are predictors of favorable prognosis in acute myelogenous leukemia with a normal karyotype","volume":"106","author":"Schnittger","year":"2005","journal-title":"Blood"},{"key":"2023020209505431800_B20","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1080\/01621459.1986.10478341","article-title":"Modified sequentially rejective multiple test procedures","volume":"81","author":"Shaffer","year":"1986","journal-title":"J. Am. Stat. Assoc"},{"key":"2023020209505431800_B21","doi-asserted-by":"crossref","first-page":"13544","DOI":"10.1073\/pnas.0506577102","article-title":"Discovering statistically significant pathways in expression profiling studies","volume":"102","author":"Tian","year":"2005","journal-title":"Proc. Natl Acad. of Sci. USA"},{"key":"2023020209505431800_B22","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1186\/1471-2105-6-225","article-title":"Pathway level analysis of gene expression using singular value decomposition","volume":"6","author":"Tomfohr","year":"2005","journal-title":"BMC Bioinformatics"},{"key":"2023020209505431800_B23","doi-asserted-by":"crossref","first-page":"1999","DOI":"10.1056\/NEJMoa021967","article-title":"A gene-expression signature as a predictor of survival in breast cancer","volume":"347","author":"Van de Vijver","year":"2002","journal-title":"New Engl. J. Med"},{"key":"2023020209505431800_B24","volume-title":"Resampling-Based Multiple Testing: Examples and Methods for p-value Adjustment.","author":"Westfall","year":"1993"},{"key":"2023020209505431800_B25","unstructured":"Yekutieli D 2007 Unpublished preprint available at www.math.tau.ac.il\/~yekutiel"},{"key":"2023020209505431800_B26","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1093\/bioinformatics\/19.1.155","article-title":"An extensible application for assembling annotation for genomic data","volume":"19","author":"Zhang","year":"2003","journal-title":"Bioinformatics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/24\/4\/537\/49045054\/bioinformatics_24_4_537.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/24\/4\/537\/49045054\/bioinformatics_24_4_537.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,25]],"date-time":"2025-01-25T21:45:29Z","timestamp":1737841529000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/24\/4\/537\/207121"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,1,18]]},"references-count":26,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2008,2,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btm628","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2008,2,15]]},"published":{"date-parts":[[2008,1,18]]}}}