{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T05:42:59Z","timestamp":1761975779497,"version":"build-2065373602"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2013,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Reliability and Reproducibility of differentially expressed genes (DEGs) are essential for the biological interpretation of microarray data. The microarray quality control (MAQC) project launched by US Food and Drug Administration (FDA) elucidated that the lists of DEGs generated by intra- and inter-platform comparisons can reach a high level of concordance, which mainly depended on the statistical criteria used for ranking and selecting DEGs. Generally, it will produce reproducible lists of DEGs when combining fold change ranking with a non-stringent p-value cutoff. For further interpretation of the gene expression data, statistical methods of gene enrichment analysis provide powerful tools for associating the DEGs with prior biological knowledge, e.g. Gene Ontology (GO) terms and pathways, and are widely used in genome-wide research. Although the DEG lists generated from the same compared conditions proved to be reliable, the reproducible enrichment results are still crucial to the discovery of the underlying molecular mechanism differentiating the two conditions. Therefore, it is important to know whether the enrichment results are still reproducible, when using the lists of DEGs generated by different statistic criteria from inter-laboratory and cross-platform comparisons. In our study, we used the MAQC data sets for systematically accessing the intra- and inter-platform concordance of GO terms enriched by Gene Set Enrichment Analysis (GSEA) and LRpath.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>In intra-platform comparisons, the overlapped percentage of enriched GO terms was as high as ~80% when the inputted lists of DEGs were generated by fold change ranking and Significance Analysis of Microarrays (SAM), whereas the percentages decreased about 20% when generating the lists of DEGs by using fold change ranking and <jats:italic>t<\/jats:italic>-test, or by using SAM and <jats:italic>t<\/jats:italic>-test. Similar results were found in inter-platform comparisons.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions<\/jats:title>\n            <jats:p>Our results demonstrated that the lists of DEGs in a high level of concordance can ensure the high concordance of enrichment results. Importantly, based on the lists of DEGs generated by a straightforward method of combining fold change ranking with a non-stringent p-value cutoff, enrichment analysis will produce reproducible enriched GO terms for the biological interpretation.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1471-2105-14-143","type":"journal-article","created":{"date-parts":[[2013,4,29]],"date-time":"2013-04-29T12:14:24Z","timestamp":1367237664000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Investigating the concordance of Gene Ontology terms reveals the intra- and inter-platform reproducibility of enrichment analysis"],"prefix":"10.1186","volume":"14","author":[{"given":"Lifang","family":"Zhang","sequence":"first","affiliation":[]},{"given":"Juan","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Gang","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Di","family":"Wu","sequence":"additional","affiliation":[]},{"given":"Lina","family":"Jiang","sequence":"additional","affiliation":[]},{"given":"Zhining","family":"Wen","sequence":"additional","affiliation":[]},{"given":"Menglong","family":"Li","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2013,4,29]]},"reference":[{"issue":"5439","key":"5844_CR1","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1126\/science.286.5439.531","volume":"286","author":"TR Golub","year":"1999","unstructured":"Golub TR, Slonim DK, Tamayo P, Huard C, Gaasenbeek M, Mesirov JP, Coller H, Loh ML, Downing JR, Caligiuri MA: Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science. 1999, 286 (5439): 531-537. 10.1126\/science.286.5439.531.","journal-title":"Science"},{"issue":"16","key":"5844_CR2","first-page":"5974","volume":"61","author":"JB Welsh","year":"2001","unstructured":"Welsh JB, Sapinoso LM, Su AI, Kern SG, Wang-Rodriguez J, Moskaluk CA, Frierson HF, Hampton GM: Analysis of gene expression identifies candidate markers and pharmacological targets in prostate cancer. Cancer Res. 2001, 61 (16): 5974-5978.","journal-title":"Cancer Res"},{"issue":"9","key":"5844_CR3","doi-asserted-by":"publisher","first-page":"1151","DOI":"10.1038\/nbt1239","volume":"24","author":"L Shi","year":"2006","unstructured":"Shi L, Reid LH, Jones WD, Shippy R, Warrington JA, Baker SC, Collins PJ, de Longueville F, Kawasaki ES, Lee KY: The MicroArray Quality Control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol. 2006, 24 (9): 1151-1161. 10.1038\/nbt1239.","journal-title":"Nat Biotechnol"},{"key":"5844_CR4","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/978-3-642-16345-6_9","volume-title":"Handbook of statistical bioinformatics. Chapter 9","author":"ZSZ Wen","year":"2011","unstructured":"Wen ZSZ, Liu J, Ning B, Guo L, Tong W, Shi L: The Microarray quality control (MAQC) project and cross-platform analysis of microarray data. Handbook of statistical bioinformatics. Chapter 9. Edited by: Lu HH, Scholkopf B, Zhao H. 2011, Berlin: Springer, 171-192."},{"issue":"1","key":"5844_CR5","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1038\/75556","volume":"25","author":"M Ashburner","year":"2000","unstructured":"Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT: Gene Ontology: tool for the unification of biology. Nat Genet. 2000, 25 (1): 25-29. 10.1038\/75556.","journal-title":"Nat Genet"},{"key":"5844_CR6","doi-asserted-by":"publisher","first-page":"D258","DOI":"10.1093\/nar\/gkh066","volume":"32","author":"MA Harris","year":"2004","unstructured":"Harris MA, Clark J, Ireland A, Lomax J, Ashburner M, Foulger R, Eilbeck K, Lewis S, Marshall B, Mungall C: The Gene Ontology (GO) database and informatics resource. Nucleic Acids Res. 2004, 32: D258-D261. 10.1093\/nar\/gkh036.","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"5844_CR7","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1093\/nar\/27.1.29","volume":"27","author":"H Ogata","year":"1999","unstructured":"Ogata H, Goto S, Sato K, Fujibuchi W, Bono H, Kanehisa M: KEGG: Kyoto Encyclopedia of Genes and Genomes. Nucleic Acids Res. 1999, 27 (1): 29-34. 10.1093\/nar\/27.1.29.","journal-title":"Nucleic Acids Res"},{"key":"5844_CR8","doi-asserted-by":"publisher","first-page":"D354","DOI":"10.1093\/nar\/gkj102","volume":"34","author":"M Kanehisa","year":"2006","unstructured":"Kanehisa M, Goto S, Hattori M, Aoki-Kinoshita KF, Itoh M, Kawashima S, Katayama T, Araki M, Hirakawa M: From genomics to chemical genomics: new developments in KEGG. Nucleic Acids Res. 2006, 34: D354-D357. 10.1093\/nar\/gkj102.","journal-title":"Nucleic Acids Res"},{"issue":"3","key":"5844_CR9","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1038\/ng1180","volume":"34","author":"VK Mootha","year":"2003","unstructured":"Mootha VK, Lindgren CM, Eriksson KF, Subramanian A, Sihag S, Lehar J, Puigserver P, Carlsson E, Ridderstrale M, Laurila E: PGC-1 alpha-responsive genes involved in oxidative phosphorylation are coordinately downregulated in human diabetes. Nat Genet. 2003, 34 (3): 267-273. 10.1038\/ng1180.","journal-title":"Nat Genet"},{"issue":"43","key":"5844_CR10","doi-asserted-by":"publisher","first-page":"15545","DOI":"10.1073\/pnas.0506580102","volume":"102","author":"A Subramanian","year":"2005","unstructured":"Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, Paulovich A, Pomeroy SL, Golub TR, Lander ES: Gene set enrichment analysis: A knowledge-based approach for interpreting genome-wide expression profiles. PNAS. 2005, 102 (43): 15545-15550. 10.1073\/pnas.0506580102.","journal-title":"PNAS"},{"key":"5844_CR11","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1186\/1471-2105-6-144","volume":"6","author":"SY Kim","year":"2005","unstructured":"Kim SY, Volsky DJ: PAGE: Parametric analysis of gene set enrichment. BMC Bioinformatics. 2005, 6: 144-155. 10.1186\/1471-2105-6-144.","journal-title":"BMC Bioinformatics"},{"issue":"22","key":"5844_CR12","doi-asserted-by":"publisher","first-page":"2586","DOI":"10.1093\/bioinformatics\/btn465","volume":"24","author":"AP Oron","year":"2008","unstructured":"Oron AP, Jiang Z, Gentleman R: Gene set enrichment analysis using linear models and diagnostics. Bioinformatics. 2008, 24 (22): 2586-2591. 10.1093\/bioinformatics\/btn465.","journal-title":"Bioinformatics"},{"key":"5844_CR13","doi-asserted-by":"crossref","first-page":"37","DOI":"10.2147\/AABC.S15840","volume":"4","author":"R-R Ji","year":"2011","unstructured":"Ji R-R, Ott K-H, Yordanova R, Bruccoleri RE: FDR-FET: an optimizing gene set enrichment analysis method. AABC. 2011, 4: 37-42.","journal-title":"AABC"},{"issue":"13","key":"5844_CR14","doi-asserted-by":"publisher","first-page":"1697","DOI":"10.1093\/bioinformatics\/btm144","volume":"23","author":"S-B Kim","year":"2007","unstructured":"Kim S-B, Yang S, Kim S-K, Kim SC, Woo HG, Volsky DJ, Kim S-Y, Chu I-S: GAzer: gene set analyzer. Bioinformatics. 2007, 23 (13): 1697-1699. 10.1093\/bioinformatics\/btm144.","journal-title":"Bioinformatics"},{"issue":"9","key":"5844_CR15","doi-asserted-by":"publisher","first-page":"1943","DOI":"10.1093\/bioinformatics\/bti260","volume":"21","author":"WT Barry","year":"2005","unstructured":"Barry WT, Nobel AB, Wright FA: Significance analysis of functional categories in gene expression studies: a structured permutation approach. Bioinformatics. 2005, 21 (9): 1943-1949. 10.1093\/bioinformatics\/bti260.","journal-title":"Bioinformatics"},{"key":"5844_CR16","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1186\/1471-2105-7-86","volume":"7","author":"RZN Vencio","year":"2006","unstructured":"Vencio RZN, Koide T, Gomes SL, Pereira CAD: BayGO: Bayesian analysis of ontology term enrichment in microarray data. BMC Bioinformatics. 2006, 7: 86-96. 10.1186\/1471-2105-7-86.","journal-title":"BMC Bioinformatics"},{"key":"5844_CR17","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1186\/1471-2105-8-383","volume":"8","author":"RZN Vencio","year":"2007","unstructured":"Vencio RZN, Shmulevich I: ProbCD: enrichment analysis accounting for categorization uncertainty. BMC Bioinformatics. 2007, 8: 383-389. 10.1186\/1471-2105-8-383.","journal-title":"BMC Bioinformatics"},{"key":"5844_CR18","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1186\/1471-2164-8-246","volume":"8","author":"X Zhou","year":"2007","unstructured":"Zhou X, Su Z: EasyGO: Gene Ontology-based annotation and functional enrichment analysis tool for agronomical species. BMC Genomics. 2007, 8: 246-249. 10.1186\/1471-2164-8-246.","journal-title":"BMC Genomics"},{"key":"5844_CR19","doi-asserted-by":"publisher","first-page":"W347","DOI":"10.1093\/nar\/gkn239","volume":"36","author":"AV Antonov","year":"2008","unstructured":"Antonov AV, Schmidt T, Wang Y, Mewes HW: ProfCom: a web tool for profiling the complex functionality of gene groups identified from high-throughput data. Nucleic Acids Res. 2008, 36: W347-W351. 10.1093\/nar\/gkn239.","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"5844_CR20","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1093\/bioinformatics\/btm531","volume":"24","author":"M Hummel","year":"2008","unstructured":"Hummel M, Meister R, Mansmann U: GlobalANCOVA: exploration and assessment of gene group effects. Bioinformatics. 2008, 24 (1): 78-85. 10.1093\/bioinformatics\/btm531.","journal-title":"Bioinformatics"},{"key":"5844_CR21","doi-asserted-by":"publisher","first-page":"W358","DOI":"10.1093\/nar\/gkn276","volume":"36","author":"Q Zheng","year":"2008","unstructured":"Zheng Q, Wang X-J: GOEAST: a web-based software toolkit for Gene Ontology enrichment analysis. Nucleic Acids Res. 2008, 36: W358-W363. 10.1093\/nar\/gkn276.","journal-title":"Nucleic Acids Res"},{"issue":"2","key":"5844_CR22","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1093\/bioinformatics\/btn592","volume":"25","author":"MA Sartor","year":"2009","unstructured":"Sartor MA, Leikauf GD, Medvedovic M: LRpath: a logistic regression approach for identifying enriched biological groups in gene expression data. Bioinformatics. 2009, 25 (2): 211-217. 10.1093\/bioinformatics\/btn592.","journal-title":"Bioinformatics"},{"issue":"45","key":"5844_CR23","doi-asserted-by":"publisher","first-page":"17771","DOI":"10.1073\/pnas.0708476104","volume":"104","author":"Q Xu","year":"2007","unstructured":"Xu Q, Majumder PK, Ross K, Shim Y, Golub TR, Loda M, Sellers WR: Identification of prostate cancer modifier pathways using parental strain expression mapping. PNAS. 2007, 104 (45): 17771-17776. 10.1073\/pnas.0708476104.","journal-title":"PNAS"},{"issue":"9","key":"5844_CR24","doi-asserted-by":"publisher","first-page":"665","DOI":"10.1089\/dna.2006.0570","volume":"26","author":"A De Windt","year":"2007","unstructured":"De Windt A, Rai M, Kytomaki L, Thelen KM, Luetjohann D, Bernier L, Davignon J, Soini J, Pandolfo M, Laaksonen R: Gene set enrichment analyses revealed several affected pathways in Niemann-Pick disease type C fibroblasts. Dna Cell Biol. 2007, 26 (9): 665-671. 10.1089\/dna.2006.0570.","journal-title":"Dna Cell Biol"},{"issue":"1","key":"5844_CR25","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1038\/sj.bjc.6605468","volume":"102","author":"M Murohashi","year":"2010","unstructured":"Murohashi M, Hinohara K, Kuroda M, Isagawa T, Tsuji S, Kobayashi S, Umezawa K, Tojo A, Aburatani H, Gotoh N: Gene set enrichment analysis provides insight into novel signalling pathways in breast cancer stem cells. Brit J Cancer. 2010, 102 (1): 206-212. 10.1038\/sj.bjc.6605468.","journal-title":"Brit J Cancer"},{"issue":"9","key":"5844_CR26","doi-asserted-by":"publisher","first-page":"1162","DOI":"10.1038\/nbt1238","volume":"24","author":"L Guo","year":"2006","unstructured":"Guo L, Lobenhofer EK, Wang C, Shippy R, Harris SC, Zhang L, Mei N, Chen T, Herman D, Goodsaid FM: Rat toxicogenomic study reveals analytical consistency across microarray platforms. Nat Biotechnol. 2006, 24 (9): 1162-1169. 10.1038\/nbt1238.","journal-title":"Nat Biotechnol"},{"issue":"20","key":"5844_CR27","doi-asserted-by":"publisher","first-page":"2500","DOI":"10.1093\/bioinformatics\/btl424","volume":"22","author":"T Manoli","year":"2006","unstructured":"Manoli T, Gretz N, Grone H-J, Kenzelmann M, Eils R, Brors B: Group testing for pathway analysis improves comparability of different microarray datasets. Bioinformatics. 2006, 22 (20): 2500-2506. 10.1093\/bioinformatics\/btl424.","journal-title":"Bioinformatics"},{"issue":"18","key":"5844_CR28","doi-asserted-by":"publisher","first-page":"10515","DOI":"10.1073\/pnas.98.18.10515-c","volume":"98","author":"VG Tusher","year":"2001","unstructured":"Tusher VG, Tibshirani R, Chu G: Significance analysis of microarrays applied to the ionizing radiation response. PNSA. 2001, 98 (18): 10515-","journal-title":"PNSA"},{"issue":"7","key":"5844_CR29","doi-asserted-by":"publisher","first-page":"e1000443","DOI":"10.1371\/journal.pcbi.1000443","volume":"5","author":"C Pesquita","year":"2009","unstructured":"Pesquita C, Faria D, Falcao AO, Lord P, Couto FM: Semantic Similarity in Biomedical Ontologies. PLoS Comput Biol. 2009, 5 (7): e1000443-10.1371\/journal.pcbi.1000443.","journal-title":"PLoS Comput Biol"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-14-143.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T23:20:33Z","timestamp":1630538433000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-14-143"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,4,29]]},"references-count":29,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,12]]}},"alternative-id":["5844"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-14-143","relation":{},"ISSN":["1471-2105"],"issn-type":[{"type":"electronic","value":"1471-2105"}],"subject":[],"published":{"date-parts":[[2013,4,29]]},"assertion":[{"value":"12 February 2013","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 April 2013","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 April 2013","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"143"}}