{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T03:53:31Z","timestamp":1779249211904,"version":"3.51.4"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2013,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>As high-throughput genomic technologies become accurate and affordable, an increasing number of data sets have been accumulated in the public domain and genomic information integration and meta-analysis have become routine in biomedical research. In this paper, we focus on microarray meta-analysis, where multiple microarray studies with relevant biological hypotheses are combined in order to improve candidate marker detection. Many methods have been developed and applied in the literature, but their performance and properties have only been minimally investigated. There is currently no clear conclusion or guideline as to the proper choice of a meta-analysis method given an application; the decision essentially requires both statistical and biological considerations.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We performed 12 microarray meta-analysis methods for combining multiple simulated expression profiles, and such methods can be categorized for different hypothesis setting purposes: (1)<jats:italic>HS<\/jats:italic><jats:sub><jats:italic>A<\/jats:italic><\/jats:sub>: DE genes with non-zero effect sizes in all studies, (2)<jats:italic>HS<\/jats:italic><jats:sub><jats:italic>B<\/jats:italic><\/jats:sub>: DE genes with non-zero effect sizes in one or more studies and (3)<jats:italic>HS<\/jats:italic><jats:sub><jats:italic>r<\/jats:italic><\/jats:sub>: DE gene with non-zero effect in \"majority\" of studies. We then performed a comprehensive comparative analysis through six large-scale real applications using four quantitative statistical evaluation criteria: detection capability, biological association, stability and robustness. We elucidated hypothesis settings behind the methods and further apply multi-dimensional scaling (MDS) and an entropy measure to characterize the meta-analysis methods and data structure, respectively.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The aggregated results from the simulation study categorized the 12 methods into three hypothesis settings (<jats:italic>HS<\/jats:italic><jats:sub><jats:italic>A<\/jats:italic><\/jats:sub>,<jats:italic>HS<\/jats:italic><jats:sub><jats:italic>B<\/jats:italic><\/jats:sub>, and<jats:italic>HS<\/jats:italic><jats:sub><jats:italic>r<\/jats:italic><\/jats:sub>). Evaluation in real data and results from MDS and entropy analyses provided an insightful and practical guideline to the choice of the most suitable method in a given application. All source files for simulation and real data are available on the author\u2019s publication website.<\/jats:p><\/jats:sec>","DOI":"10.1186\/1471-2105-14-368","type":"journal-article","created":{"date-parts":[[2013,12,21]],"date-time":"2013-12-21T02:02:56Z","timestamp":1387591376000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":115,"title":["Meta-analysis methods for combining multiple expression profiles: comparisons, statistical characterization and an application guideline"],"prefix":"10.1186","volume":"14","author":[{"given":"Lun-Ching","family":"Chang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui-Min","family":"Lin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Etienne","family":"Sibille","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"George C","family":"Tseng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2013,12,21]]},"reference":[{"issue":"9","key":"6864_CR1","doi-asserted-by":"publisher","first-page":"e184","DOI":"10.1371\/journal.pmed.0050184","volume":"5","author":"A Ramasamy","year":"2008","unstructured":"Ramasamy A, Mondry A, Holmes CC, Altman DG: Key issues in conducting a meta-analysis of gene expression microarray datasets. PLoS Med. 2008, 5 (9): e184-10.1371\/journal.pmed.0050184.","journal-title":"PLoS Med"},{"issue":"2","key":"6864_CR2","doi-asserted-by":"publisher","first-page":"e15","DOI":"10.1093\/nar\/gkr1071","volume":"40","author":"DD Kang","year":"2012","unstructured":"Kang DD, Sibille E, Kaminski N, Tseng GC: MetaQC: objective quality control and inclusion\/exclusion criteria for genomic meta-analysis. Nucleic Acids Res. 2012, 40 (2): e15-10.1093\/nar\/gkr1071.","journal-title":"Nucleic Acids Res"},{"issue":"9","key":"6864_CR3","doi-asserted-by":"publisher","first-page":"3785","DOI":"10.1093\/nar\/gkr1265","volume":"40","author":"GC Tseng","year":"2012","unstructured":"Tseng GC, Ghosh D, Feingold E: Comprehensive literature review and statistical considerations for microarray meta-analysis. Nucleic Acids Res. 2012, 40 (9): 3785-3799. 10.1093\/nar\/gkr1265.","journal-title":"Nucleic Acids Res"},{"issue":"3","key":"6864_CR4","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1093\/bioinformatics\/btm620","volume":"24","author":"F Hong","year":"2008","unstructured":"Hong F, Breitling R: A comparison of meta-analysis methods for detecting differentially expressed genes in microarray experiments. Bioinformatics. 2008, 24 (3): 374-382. 10.1093\/bioinformatics\/btm620.","journal-title":"Bioinformatics"},{"key":"6864_CR5","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1186\/1471-2105-11-408","volume":"11","author":"A Campain","year":"2010","unstructured":"Campain A, Yang YH: Comparison study of microarray meta-analysis methods. BMC Bioinforma. 2010, 11: 408-10.1186\/1471-2105-11-408.","journal-title":"BMC Bioinforma"},{"key":"6864_CR6","first-page":"559","volume":"49","author":"A Birnbaum","year":"1954","unstructured":"Birnbaum A: Combining independent tests of significance. J Am Stat Assoc. 1954, 49: 559-574.","journal-title":"J Am Stat Assoc"},{"key":"6864_CR7","doi-asserted-by":"publisher","first-page":"994","DOI":"10.1214\/10-AOAS393","volume":"5","author":"J Li","year":"2011","unstructured":"Li J, Tseng GC: An adaptively weighted statistic for detecting differential gene expression when combining multiple transcriptomic studies. Ann Appl Stat. 2011, 5: 994-1019. 10.1214\/10-AOAS393.","journal-title":"Ann Appl Stat"},{"issue":"9","key":"6864_CR8","doi-asserted-by":"publisher","first-page":"5116","DOI":"10.1073\/pnas.091062498","volume":"98","author":"VG Tusher","year":"2001","unstructured":"Tusher VG, Tibshirani R, Chu G: Significance analysis of microarrays applied to the ionizing radiation response. Proc Natl Acad Sci USA. 2001, 98 (9): 5116-5121. 10.1073\/pnas.091062498.","journal-title":"Proc Natl Acad Sci USA"},{"key":"6864_CR9","doi-asserted-by":"publisher","DOI":"10.1002\/9780470689516","volume-title":"Permutation tests for complex data: theory, applications and software","author":"F Pesarin","year":"2010","unstructured":"Pesarin F, Salmaso L: Permutation tests for complex data: theory, applications and software. 2010, Ames, IA 50010: Wiley.com"},{"issue":"2","key":"6864_CR10","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.2517-6161.1972.tb00899.x","volume":"34","author":"DR Cox","year":"1972","unstructured":"Cox DR: Regression models and life-tables. J R Stat Soc Ser B. 1972, 34 (2): 187-220.","journal-title":"J R Stat Soc Ser B"},{"issue":"1","key":"6864_CR11","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini Y, Hochberg Y: Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 1995, 57 (1): 289-300.","journal-title":"J R Stat Soc Ser B"},{"issue":"19","key":"6864_CR12","doi-asserted-by":"publisher","first-page":"2534","DOI":"10.1093\/bioinformatics\/bts485","volume":"28","author":"X Wang","year":"2012","unstructured":"Wang X, Kang DD, Shen K, Song C, Lu S, Chang LC, Liao SG, Huo Z, Tang S, Ding Y, et al: An R package suite for microarray meta-analysis in quality control, differentially expressed gene analysis and pathway enrichment detection. Bioinformatics. 2012, 28 (19): 2534-2536. 10.1093\/bioinformatics\/bts485.","journal-title":"Bioinformatics"},{"key":"6864_CR13","volume-title":"Statistical methods for research workers","author":"RA Fisher","year":"1925","unstructured":"Fisher RA: Statistical methods for research workers. 1925, Edinburgh: Genesis Publishing, Oliver and Boyd"},{"issue":"5","key":"6864_CR14","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1038\/scientificamerican0549-11","volume":"180","author":"SA Stouffer","year":"1949","unstructured":"Stouffer SA: A study of attitudes. Sci Am. 1949, 180 (5): 11-15. 10.1038\/scientificamerican0549-11.","journal-title":"Sci Am"},{"key":"6864_CR15","volume-title":"The Methods of Statistics An Introduction mainly for Workers in the Biological Sciences","author":"LHC Tippett","year":"1931","unstructured":"Tippett LHC: The Methods of Statistics. An introduction mainly for workers in the biological sciences. The Methods of Statistics An Introduction mainly for Workers in the Biological Sciences. 1931, London: Williams &Norgate Ltd"},{"issue":"3","key":"6864_CR16","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1037\/h0059111","volume":"48","author":"B Wilkinson","year":"1951","unstructured":"Wilkinson B: A statistical consideration in psychological research. Psychol Bull. 1951, 48 (3): 156-158.","journal-title":"Psychol Bull"},{"key":"6864_CR17","volume-title":"Ann Appl Stat","author":"C Song","year":"2012","unstructured":"Song C, Tseng GC: Order statistics for robust genomic meta-analysis. Ann Appl Stat. 2012, Accepted"},{"issue":"Suppl 1","key":"6864_CR18","doi-asserted-by":"publisher","first-page":"i84","DOI":"10.1093\/bioinformatics\/btg1010","volume":"19","author":"JK Choi","year":"2003","unstructured":"Choi JK, Yu U, Kim S, Yoo OJ: Combining multiple microarray studies and modeling interstudy variation. Bioinformatics. 2003, 19 (Suppl 1): i84-i90. 10.1093\/bioinformatics\/btg1010.","journal-title":"Bioinformatics"},{"issue":"22","key":"6864_CR19","doi-asserted-by":"publisher","first-page":"2825","DOI":"10.1093\/bioinformatics\/btl476","volume":"22","author":"F Hong","year":"2006","unstructured":"Hong F, Breitling R, McEntee CW, Wittner BS, Nemhauser JL, Chory J: RankProd: a bioconductor package for detecting differentially expressed genes in meta-analysis. Bioinformatics. 2006, 22 (22): 2825-2827. 10.1093\/bioinformatics\/btl476.","journal-title":"Bioinformatics"},{"key":"6864_CR20","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1186\/1476-4598-8-71","volume":"8","author":"JM Dreyfuss","year":"2009","unstructured":"Dreyfuss JM, Johnson MD, Park PJ: Meta-analysis of glioblastoma multiforme versus anaplastic astrocytoma identifies robust gene markers. Mol Cancer. 2009, 8: 71-10.1186\/1476-4598-8-71.","journal-title":"Mol Cancer"},{"key":"6864_CR21","volume-title":"Modern multidimensional scaling: theory and applications","author":"I Borg","year":"2005","unstructured":"Borg I: Modern multidimensional scaling: theory and applications. 2005, New York, NY 10013: Springer"},{"key":"6864_CR22","volume-title":"Mathematical theory of entropy, vol. 12","author":"NF Martin","year":"2011","unstructured":"Martin NF, England JW: Mathematical theory of entropy, vol. 12. 2011, Cambridge\u00a0CB2 8BS\u00a0United Kingdom: Cambridge University Press"},{"key":"6864_CR23","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1186\/1471-2105-6-309","volume":"6","author":"W Wu","year":"2005","unstructured":"Wu W, Dave N, Tseng GC, Richards T, Xing EP, Kaminski N: Comparison of normalization methods for CodeLink Bioarray data. BMC Bioinforma. 2005, 6: 309-10.1186\/1471-2105-6-309.","journal-title":"BMC Bioinforma"},{"key":"6864_CR24","doi-asserted-by":"publisher","first-page":"72","DOI":"10.2307\/1412159","volume":"15","author":"C Spearman","year":"1904","unstructured":"Spearman C: The proof and measurement of association between two things. Amer J Psychol. 1904, 15: 72-101. 10.2307\/1412159.","journal-title":"Amer J Psychol"},{"issue":"3","key":"6864_CR25","doi-asserted-by":"publisher","first-page":"1752","DOI":"10.1214\/11-AOAS466","volume":"5","author":"Q Li","year":"2011","unstructured":"Li Q, Brown JB, Huang H, Bickel PJ: Measuring reproducibility of high-throughput experiments. Ann Appl Stat. 2011, 5 (3): 1752-1779. 10.1214\/11-AOAS466.","journal-title":"Ann Appl Stat"},{"issue":"3","key":"6864_CR26","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1142\/S0219720006002120","volume":"4","author":"X Yang","year":"2006","unstructured":"Yang X, Bentink S, Scheid S, Spang R: Similarities of ordered gene lists. J Bioinform Comput Biol. 2006, 4 (3): 693-708. 10.1142\/S0219720006002120.","journal-title":"J Bioinform Comput Biol"},{"key":"6864_CR27","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/BF01908075","volume":"2","author":"L Hubert","year":"1985","unstructured":"Hubert L, Arabie P: Comparing partitions. J Classification. 1985, 2: 193-218. 10.1007\/BF01908075.","journal-title":"J Classification"},{"issue":"6B","key":"6864_CR28","doi-asserted-by":"publisher","first-page":"3867","DOI":"10.1214\/09-AOS697","volume":"37","author":"AB Owen","year":"2009","unstructured":"Owen AB: Karl Pearson's meta-analysis revisited. Ann Statistics. 2009, 37 (6B): 3867-3892. 10.1214\/09-AOS697.","journal-title":"Ann Statistics"},{"issue":"5","key":"6864_CR29","doi-asserted-by":"publisher","first-page":"1171","DOI":"10.1142\/S0219720005001442","volume":"3","author":"R Breitling","year":"2005","unstructured":"Breitling R, Herzyk P: Rank-based methods as a non-parametric alternative of the T-statistic for the analysis of biological microarray data. J Bioinform Comput Biol. 2005, 3 (5): 1171-1189. 10.1142\/S0219720005001442.","journal-title":"J Bioinform Comput Biol"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-14-368.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T00:47:12Z","timestamp":1716338832000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-14-368"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,12]]},"references-count":29,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2013,12]]}},"alternative-id":["6864"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-14-368","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,12]]},"assertion":[{"value":"17 August 2013","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 December 2013","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 December 2013","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"368"}}