{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T12:14:16Z","timestamp":1780056856979,"version":"3.54.0"},"reference-count":47,"publisher":"Oxford University Press (OUP)","issue":"13","license":[{"start":{"date-parts":[[2016,10,2]],"date-time":"2016-10-02T00:00:00Z","timestamp":1475366400000},"content-version":"vor","delay-in-days":2707,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/2.0\/uk\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Motivation: According to current consistency metrics such as percentage of overlapping genes (POG), lists of differentially expressed genes (DEGs) detected from different microarray studies for a complex disease are often highly inconsistent. This irreproducibility problem also exists in other high-throughput post-genomic areas such as proteomics and metabolism. A complex disease is often characterized with many coordinated molecular changes, which should be considered when evaluating the reproducibility of discovery lists from different studies.<\/jats:p><jats:p>Results: We proposed metrics percentage of overlapping genes-related (POGR) and normalized POGR (nPOGR) to evaluate the consistency between two DEG lists for a complex disease, considering correlated molecular changes rather than only counting gene overlaps between the lists. Based on microarray datasets of three diseases, we showed that though the POG scores for DEG lists from different studies for each disease are extremely low, the POGR and nPOGR scores can be rather high, suggesting that the apparently inconsistent DEG lists may be highly reproducible in the sense that they are actually significantly correlated. Observing different discovery results for a disease by the POGR and nPOGR scores will obviously reduce the uncertainty of the microarray studies. The proposed metrics could also be applicable in many other high-throughput post-genomic areas.<\/jats:p><jats:p>Contact: \u00a0guoz@ems.hrbmu.edu.cn<\/jats:p><jats:p>Supplementary information: \u00a0Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btp295","type":"journal-article","created":{"date-parts":[[2009,5,6]],"date-time":"2009-05-06T02:34:31Z","timestamp":1241577271000},"page":"1662-1668","source":"Crossref","is-referenced-by-count":96,"title":["Evaluating reproducibility of differential expression discoveries in microarray studies by considering correlated molecular changes"],"prefix":"10.1093","volume":"25","author":[{"given":"Min","family":"Zhang","sequence":"first","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lin","family":"Zhang","sequence":"additional","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinfeng","family":"Zou","sequence":"additional","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Yao","sequence":"additional","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui","family":"Xiao","sequence":"additional","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Qing","family":"Liu","sequence":"additional","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Wang","sequence":"additional","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dong","family":"Wang","sequence":"additional","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chenguang","family":"Wang","sequence":"additional","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zheng","family":"Guo","sequence":"additional","affiliation":[{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"},{"name":"1 College of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China and 2Bioinformatics Centre and School of Life Science, University of Electronic Science and Technology of China, Chengdu, 610054, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2009,5,5]]},"reference":[{"key":"2023013112140605200_B1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc. Series B (Methodol.)"},{"key":"2023013112140605200_B2","doi-asserted-by":"crossref","first-page":"13790","DOI":"10.1073\/pnas.191502998","article-title":"Classification of human lung carcinomas by mRNA expression profiling reveals distinct adenocarcinoma subclasses","volume":"98","author":"Bhattacharjee","year":"2001","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013112140605200_B3","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1186\/1471-2105-6-107","article-title":"Redefinition of Affymetrix probe sets by sequence overlap with cDNA microarray probes reduces cross-platform inconsistencies in cancer-associated gene expression measurements","volume":"6","author":"Carter","year":"2005","journal-title":"BMC Bioinformatics"},{"key":"2023013112140605200_B4","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1186\/1471-2105-8-412","article-title":"Reproducibility of microarray data: a further analysis of microarray quality control (MAQC) data","volume":"8","author":"Chen","year":"2007","journal-title":"BMC Bioinformatics"},{"key":"2023013112140605200_B5","first-page":"s11306","article-title":"Statistical strategies for avoiding false discoveries in metabolomics and related experiments","volume":"2","author":"David","year":"2006","journal-title":"Metabolomics"},{"key":"2023013112140605200_B6","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1093\/nar\/gkg014","article-title":"SOURCE: a unified genomic resource of functional annotations, ontologies, and gene expression data","volume":"31","author":"Diehn","year":"2003","journal-title":"Nucleic Acids Res."},{"key":"2023013112140605200_B7","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1198\/016214501753382129","article-title":"Empirical Bayes analysis of a microarray experiment","volume":"96","author":"Efron","year":"2001","journal-title":"J. Am. Stat. Assoc."},{"key":"2023013112140605200_B8","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1093\/bioinformatics\/bth469","article-title":"Outcome signature genes in breast cancer: is there a unique set?","volume":"21","author":"Ein-Dor","year":"2005","journal-title":"Bioinformatics"},{"key":"2023013112140605200_B9","doi-asserted-by":"crossref","first-page":"5923","DOI":"10.1073\/pnas.0601231103","article-title":"Thousands of samples are needed to generate a robust gene list for predicting outcome in cancer","volume":"103","author":"Ein-Dor","year":"2006","journal-title":"Pro.c Natl Acad. Sci. USA"},{"key":"2023013112140605200_B10","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychol. Bull."},{"key":"2023013112140605200_B11","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1038\/nrd1746","article-title":"An array of problems","volume":"4","author":"Frantz","year":"2005","journal-title":"Nat. Rev. Drug Discov."},{"key":"2023013112140605200_B12","doi-asserted-by":"crossref","first-page":"13784","DOI":"10.1073\/pnas.241500798","article-title":"Diversity of gene expression in adenocarcinoma of the lung","volume":"98","author":"Garber","year":"2001","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013112140605200_B13","doi-asserted-by":"crossref","first-page":"1162","DOI":"10.1038\/nbt1238","article-title":"Rat toxicogenomic study reveals analytical consistency across microarray platforms","volume":"24","author":"Guo","year":"2006","journal-title":"Nat. Biotechnol."},{"key":"2023013112140605200_B14","volume-title":"Analysis of Variance: Fixed, Random and Mixed Models.","author":"Hardeo","year":"2000"},{"key":"2023013112140605200_B15","doi-asserted-by":"crossref","first-page":"15000","DOI":"10.1073\/pnas.192571199","article-title":"Gene expression comparison of biopsies from Duchenne muscular dystrophy (DMD) and normal skeletal muscle","volume":"99","author":"Haslett","year":"2002","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013112140605200_B16","doi-asserted-by":"crossref","first-page":"R70","DOI":"10.1186\/gb-2003-4-10-r70","article-title":"Identifying biological themes within lists of genes with EASE","volume":"4","author":"Hosack","year":"2003","journal-title":"Genome Biol."},{"key":"2023013112140605200_B17","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1038\/nmeth756","article-title":"Multiple-laboratory comparison of microarray platforms","volume":"2","author":"Irizarry","year":"2005","journal-title":"Nat. Methods"},{"key":"2023013112140605200_B18","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1186\/1471-2105-7-359","article-title":"Comparison and evaluation of methods for generating differentially expressed gene lists from microarray data","volume":"7","author":"Jeffery","year":"2006","journal-title":"BMC Bioinformatics"},{"key":"2023013112140605200_B19","doi-asserted-by":"crossref","first-page":"1139","DOI":"10.1142\/S0219720007003041","article-title":"A multivariate extension of the gene set enrichment analysis","volume":"5","author":"Klebanov","year":"2007","journal-title":"J Bioinform Comput Biol"},{"key":"2023013112140605200_B20","doi-asserted-by":"crossref","DOI":"10.2202\/1544-6115.1189","article-title":"A new type of stochastic dependence revealed in gene expression data","volume":"5","author":"Klebanov","year":"2006","journal-title":"Stat. Appl. Genet. Mol. Biol."},{"key":"2023013112140605200_B21","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/nbt0107-25","article-title":"Statistical methods and microarray data","volume":"25","author":"Klebanov","year":"2007","journal-title":"Nat. Biotechnol."},{"key":"2023013112140605200_B22","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1073\/pnas.0304146101","article-title":"Gene expression profiling identifies clinically relevant subtypes of prostate cancer","volume":"101","author":"Lapointe","year":"2004","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013112140605200_B23","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1142\/S0219720009004011","article-title":"Evaluation of inter-laboratory and cross-platform concordance of DNA microarrays through discriminating genes and classifier transferability","volume":"7","author":"Mao","year":"2009","journal-title":"J. Bioinform. Comput. Biol."},{"key":"2023013112140605200_B24","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1126\/science.306.5696.630","article-title":"Getting the noise out of gene arrays","volume":"306","author":"Marshall","year":"2004","journal-title":"Science"},{"key":"2023013112140605200_B25","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1016\/S0140-6736(05)17866-0","article-title":"Prediction of cancer outcome with microarrays: a multiple random validation strategy","volume":"365","author":"Michiels","year":"2005","journal-title":"Lancet"},{"key":"2023013112140605200_B26","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1038\/nbt965","article-title":"Microarray reality checks in the context of a complex disease","volume":"22","author":"Miklos","year":"2004","journal-title":"Nat. Biotechnol."},{"key":"2023013112140605200_B27","doi-asserted-by":"crossref","first-page":"R2","DOI":"10.1186\/gb-2007-8-1-r2","article-title":"Normalization of boutique two-color microarrays with a high proportion of differentially expressed probes","volume":"8","author":"Oshlack","year":"2007","journal-title":"Genome Biol."},{"key":"2023013112140605200_B28","doi-asserted-by":"crossref","first-page":"1210","DOI":"10.1096\/fj.06-7285com","article-title":"Gene expression profiling in the early phases of DMD: a constant molecular signature characterizes DMD muscle from early postnatal life throughout disease progression","volume":"21","author":"Pescatori","year":"2007","journal-title":"FASEB J."},{"key":"2023013112140605200_B29","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1186\/1471-2105-6-120","article-title":"The effects of normalization on the correlation structure of microarray data","volume":"6","author":"Qiu","year":"2005","journal-title":"BMC Bioinformatics"},{"key":"2023013112140605200_B30","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1186\/1471-2105-7-50","article-title":"Assessing stability of gene selection in microarray data analysis","volume":"7","author":"Qiu","year":"2006","journal-title":"BMC Bioinformatics"},{"key":"2023013112140605200_B31","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1038\/nrc1322","article-title":"Rules of evidence for cancer molecular-marker discovery and validation","volume":"4","author":"Ransohoff","year":"2004","journal-title":"Nat. Rev. Cancer"},{"key":"2023013112140605200_B32","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1093\/jnci\/dji054","article-title":"Lessons from controversy: ovarian cancer screening and serum proteomics","volume":"97","author":"Ransohoff","year":"2005","journal-title":"J. Natl Cancer Inst."},{"key":"2023013112140605200_B33","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1593\/neo.07112","article-title":"Oncomine 3.0: genes, pathways, and networks in a collection of 18,000 cancer gene expression profiles","volume":"9","author":"Rhodes","year":"2007","journal-title":"Neoplasia"},{"key":"2023013112140605200_B34","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1038\/nbt1239","article-title":"The microarray quality control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements","volume":"24","author":"Shi","year":"2006","journal-title":"Nat. Biotechnol."},{"issue":"Suppl 2","key":"2023013112140605200_B35","doi-asserted-by":"crossref","first-page":"S12","DOI":"10.1186\/1471-2105-6-S2-S12","article-title":"Cross-platform comparability of microarray technology: intra-platform consistency and appropriate data analysis procedures are essential","volume":"6","author":"Shi","year":"2005","journal-title":"BMC Bioinformatics"},{"key":"2023013112140605200_B36","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/S1535-6108(02)00030-2","article-title":"Gene expression correlates of clinical prostate cancer behavior","volume":"1","author":"Singh","year":"2002","journal-title":"Cancer Cell"},{"key":"2023013112140605200_B37","doi-asserted-by":"crossref","first-page":"15545","DOI":"10.1073\/pnas.0506580102","article-title":"Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles","volume":"102","author":"Subramanian","year":"2005","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013112140605200_B38","doi-asserted-by":"crossref","first-page":"5676","DOI":"10.1093\/nar\/gkg763","article-title":"Evaluation of gene expression measurements from commercial microarray platforms","volume":"31","author":"Tan","year":"2003","journal-title":"Nucleic Acids Res."},{"key":"2023013112140605200_B39","doi-asserted-by":"crossref","first-page":"1132","DOI":"10.1038\/nbt1237","article-title":"Evaluation of external RNA controls for the assessment of microarray performance","volume":"24","author":"Tong","year":"2006","journal-title":"Nat. Biotechnol."},{"key":"2023013112140605200_B40","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1093\/bioinformatics\/17.6.520","article-title":"Missing value estimation methods for DNA microarrays","volume":"17","author":"Troyanskaya","year":"2001","journal-title":"Bioinformatics"},{"key":"2023013112140605200_B41","doi-asserted-by":"crossref","first-page":"5116","DOI":"10.1073\/pnas.091062498","article-title":"Significance analysis of microarrays applied to the ionizing radiation response","volume":"98","author":"Tusher","year":"2001","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"2023013112140605200_B42","doi-asserted-by":"crossref","first-page":"4280","DOI":"10.1093\/bioinformatics\/bti685","article-title":"A note on using permutation-based false discovery rate estimates to compare different analysis methods for microarray data","volume":"21","author":"Xie","year":"2005","journal-title":"Bioinformatics"},{"key":"2023013112140605200_B43","doi-asserted-by":"crossref","first-page":"1284","DOI":"10.1093\/bioinformatics\/btg155","article-title":"A comparison of parametric versus permutation methods with applications to general and temporal microarray gene expression data","volume":"19","author":"Xu","year":"2003","journal-title":"Bioinformatics"},{"key":"2023013112140605200_B44","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1093\/bioinformatics\/btm558","article-title":"Gaining confidence in biological interpretation of the microarray data: the functional consistence of the significant GO categories","volume":"24","author":"Yang","year":"2008","journal-title":"Bioinformatics"},{"key":"2023013112140605200_B45","doi-asserted-by":"crossref","first-page":"2057","DOI":"10.1093\/bioinformatics\/btn365","article-title":"Apparently low reproducibility of true differential expression discoveries in microarray studies","volume":"24","author":"Zhang","year":"2008","journal-title":"Bioinformatics"},{"key":"2023013112140605200_B46","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1186\/1471-2105-8-230","article-title":"A comprehensive evaluation of SAM, the SAM R-package and a simple modification to improve its performance","volume":"8","author":"Zhang","year":"2007","journal-title":"BMC Bioinformatics"},{"key":"2023013112140605200_B47","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/1471-2164-8-30","article-title":"GO-2D: identifying 2-dimensional cellular-localized functional modules in gene ontology","volume":"8","author":"Zhu","year":"2007","journal-title":"BMC Genomics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/25\/13\/1662\/48996635\/bioinformatics_25_13_1662.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/25\/13\/1662\/48996635\/bioinformatics_25_13_1662.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,9]],"date-time":"2025-02-09T08:40:57Z","timestamp":1739090457000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/25\/13\/1662\/196875"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,5,5]]},"references-count":47,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2009,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btp295","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2009,7,1]]},"published":{"date-parts":[[2009,5,5]]}}}