{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T02:21:00Z","timestamp":1784600460333,"version":"3.55.0"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2006,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>DNA microarrays are popular tools for measuring gene expression of biological samples. This ever increasing popularity is ensuring that a large number of microarray studies are conducted, many of which with data publicly available for mining by other investigators. Under most circumstances, validation of differential expression of genes is performed on a gene to gene basis. Thus, it is not possible to generalize validation results to the remaining majority of non-validated genes or to evaluate the<jats:italic>overall<\/jats:italic>quality of these studies.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We present an approach for the global validation of DNA microarray experiments that will allow researchers to evaluate the general quality of their experiment and to extrapolate validation results of a subset of genes to the remaining non-validated genes. We illustrate why the popular strategy of selecting only the most differentially expressed genes for validation generally fails as a global validation strategy and propose random-stratified sampling as a better gene selection method. We also illustrate shortcomings of often-used validation indices such as overlap of significant effects and the correlation coefficient and recommend the concordance correlation coefficient (CCC) as an alternative.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusion<\/jats:title><jats:p>We provide recommendations that will enhance validity checks of microarray experiments while minimizing the need to run a large number of labour-intensive individual validation assays.<\/jats:p><\/jats:sec>","DOI":"10.1186\/1471-2105-7-333","type":"journal-article","created":{"date-parts":[[2006,8,10]],"date-time":"2006-08-10T18:17:18Z","timestamp":1155233838000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":62,"title":["A methodology for global validation of microarray experiments"],"prefix":"10.1186","volume":"7","author":[{"given":"Mathieu","family":"Miron","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Owen Z","family":"Woody","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexandre","family":"Marcil","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carl","family":"Murie","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Sladek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Nadon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2006,7,5]]},"reference":[{"issue":"5","key":"1072_CR1","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1016\/S0968-0004(03)00068-9","volume":"28","author":"V Benes","year":"2003","unstructured":"Benes V, Muckenthaler M: Standardization of protocols in cDNA microarray analysis. Trends in Biochemical Sciences 2003, 28(5):244\u2013249. 10.1016\/S0968-0004(03)00068-9","journal-title":"Trends in Biochemical Sciences"},{"issue":"4","key":"1072_CR2","doi-asserted-by":"publisher","first-page":"859","DOI":"10.1002\/art.10236","volume":"46","author":"GS Firestein","year":"2002","unstructured":"Firestein GS, Pisetsky DS: DNA microarrays: Boundless technology or bound by technology? Guidelines for studies using microarray technology. Arthritis and Rheumatism 2002, 46(4):859\u2013861. 10.1002\/art.10236","journal-title":"Arthritis and Rheumatism"},{"issue":"10","key":"1072_CR3","doi-asserted-by":"publisher","first-page":"570","DOI":"10.1016\/j.tig.2003.08.006","volume":"19","author":"Y Moreau","year":"2003","unstructured":"Moreau Y, Aerts S, De Moor B, De Strooper B, Dabrowski M: Comparison and meta-analysis of microarray data: from the bench to the computer desk. Trends in Genetics 2003, 19(10):570\u2013577. 10.1016\/j.tig.2003.08.006","journal-title":"Trends in Genetics"},{"key":"1072_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1146\/annurev.pu.17.050196.000245","volume":"17","author":"F Mosteller","year":"1996","unstructured":"Mosteller F, Colditz GA: Understanding research synthesis (meta-analysis). Annual Review of Public Health 1996, 17: 1\u201323. 10.1146\/annurev.pu.17.050196.000245","journal-title":"Annual Review of Public Health"},{"issue":"14","key":"1072_CR5","doi-asserted-by":"publisher","first-page":"8348","DOI":"10.1073\/pnas.0832373100","volume":"100","author":"OG Troyanskaya","year":"2003","unstructured":"Troyanskaya OG, Dolinski K, Owen AB, Altman RB, Botstein D: A Bayesian framework for combining heterogeneous data sources for gene function prediction (in Saccharomyces cerevisiae). PNAS 2003, 100(14):8348\u20138353. 10.1073\/pnas.0832373100","journal-title":"PNAS"},{"issue":"5","key":"1072_CR6","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1038\/nmeth756","volume":"2","author":"RA Irizarry","year":"2005","unstructured":"Irizarry RA, Warren D, Spencer F, Kim IF, Biswal S, Frank BC, Gabrielson E, Garcia JG, Geoghegan J, Germino G, Griffin C, Hilmer SC, Hoffman E, Jedlicka AE, Kawasaki E, Martinez-Murillo F, Morsberger L, Lee H, Petersen D, Quackenbush J, Scott A, Wilson M, Yang Y, Ye SQ, Yu W: Multiple-laboratory comparison of microarray platforms. Nat Methods 2005, 2(5):345\u201350. Epub 2005 Apr 21.. 10.1038\/nmeth756","journal-title":"Nat Methods"},{"issue":"5","key":"1072_CR7","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1038\/nmeth757","volume":"2","author":"JE Larkin","year":"2005","unstructured":"Larkin JE, Frank BC, Gavras H, Sultana R, Quackenbush J: Independence and reproducibility across microarray platforms. Nature Methods 2005, 2(5):337\u2013343. 10.1038\/nmeth757","journal-title":"Nature Methods"},{"key":"1072_CR8","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1038\/ng1034","volume":"32","author":"RF Chuaqui","year":"2002","unstructured":"Chuaqui RF, Bonner RF, Best CJM, Gillespie JW, Flaig MJ, Hewitt SM, Phillips JL, Krizman DB, Tangrea MA, Ahram M, Linehan WM, Knezevic V, Emmert-Buck MR: Post-analysis follow-up and validation of microarray experiments. Nature Genetics 2002, 32: 509\u2013514. 10.1038\/ng1034","journal-title":"Nature Genetics"},{"key":"1072_CR9","volume-title":"A primer on regression artifacts","author":"DT Campbell","year":"2003","unstructured":"Campbell DT, Kenny DA: A primer on regression artifacts. New York, Guilford Press; 2003."},{"key":"1072_CR10","first-page":"189","volume-title":"Statistics on the table: The history of statistical concepts and methods","author":"SM Stigler","year":"1999","unstructured":"Stigler SM: Statistical concepts in psychology. In Statistics on the table: The history of statistical concepts and methods. Cambridge, MA, Harvard University Press; 1999:189\u2013199."},{"issue":"1","key":"1072_CR11","doi-asserted-by":"publisher","first-page":"255","DOI":"10.2307\/2532051","volume":"45","author":"LI Lin","year":"1989","unstructured":"Lin LI: A concordance correlation-coefficient to evaluate reproducibility. Biometrics 1989, 45(1):255\u2013268. 10.2307\/2532051","journal-title":"Biometrics"},{"issue":"2","key":"1072_CR12","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1002\/(SICI)1097-0258(20000130)19:2<255::AID-SIM293>3.0.CO;2-8","volume":"19","author":"LIK Lin","year":"2000","unstructured":"Lin LIK: Total Deviation Index for Measuring Individual Agreement With Applications in Laboratory Performance and Bioequivalence. Statistics in Medicine 2000, 19(2):255\u2013270. 10.1002\/(SICI)1097-0258(20000130)19:2<255::AID-SIM293>3.0.CO;2-8","journal-title":"Statistics in Medicine"},{"issue":"457","key":"1072_CR13","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1198\/016214502753479392","volume":"97","author":"L Lin","year":"2002","unstructured":"Lin L, Hedayat AS, Sinha B, Yang M: Statistical methods in assessing agreement: Models, issues, and tools. Journal of the American Statistical Association 2002, 97(457):257\u2013270. 10.1198\/016214502753479392","journal-title":"Journal of the American Statistical Association"},{"key":"1072_CR14","first-page":"133","volume":"24","author":"DW Zimmerman","year":"2003","unstructured":"Zimmerman DW, Zumbo BD, Williams RH: Bias in estimation and hypothesis testing of correlation. Psicol\u00f3gica 2003, 24: 133\u2013158.","journal-title":"Psicol\u00f3gica"},{"issue":"6","key":"1072_CR15","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1093\/bioinformatics\/btg071","volume":"19","author":"M Masseroli","year":"2003","unstructured":"Masseroli M, Cerveri P, Pelicci PG, Alcalay M: GAAS: Gene Array Analyzer Software for management, analysis and visualization of gene expression data. Bioinformatics 2003, 19(6):774\u2013775. 10.1093\/bioinformatics\/btg071","journal-title":"Bioinformatics"},{"key":"1072_CR16","first-page":"x, 320 p.","volume-title":"Measurement theory and practice: The world through quantification","author":"DJ Hand","year":"2004","unstructured":"Hand DJ: Measurement theory and practice: The world through quantification. LondonNew York, Arnold ;Distributed in the U.S.A. by Oxford University Press; 2004:x, 320 p.."},{"issue":"2","key":"1072_CR17","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1093\/biostatistics\/4.2.249","volume":"4","author":"RA Irizarry","year":"2003","unstructured":"Irizarry RA, Hobbs B, Collin F, Beazer-Barclay YD, Antonellis KJ, Scherf U, Speed TP: Exploration, normalization, and summaries of high density oligonucleotide array probe level data. Biostatistics 2003, 4(2):249\u2013264. 10.1093\/biostatistics\/4.2.249","journal-title":"Biostatistics"},{"issue":"1","key":"1072_CR18","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1073\/pnas.98.1.31","volume":"98","author":"C Li","year":"2001","unstructured":"Li C, Wong WH: Model-based analysis of oligonucleotide arrays: Expression index computation and outlier detection. Proceedings of the National Academy of Sciences of the United States of America 2001, 98(1):31\u201336. 10.1073\/pnas.011404098","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"1072_CR19","volume-title":"A model based background adjustment for oligonucleotide expression arrays","author":"Z Wu","year":"2004","unstructured":"Wu Z, Irizarry R, Gentleman R, Murillo F, Spencer F: A model based background adjustment for oligonucleotide expression arrays. John Hopkins University, Department of Biostatistics Working Papers, Baltimore, MD; 2004."},{"key":"1072_CR20","unstructured":"Affymetrix: Microarray Suite User Guide, Version 5.[http:\/\/www.affymetrix.com\/support\/technical\/manuals.affx]"},{"key":"1072_CR21","unstructured":"Affymetrix: Technical note for PLIER.[http:\/\/www.affymetrix.com\/support\/technical\/technotes\/plier_technote.pdf]"},{"key":"1072_CR22","doi-asserted-by":"crossref","first-page":"xxxiii, 582","DOI":"10.4135\/9781412985031","volume-title":"Methods of meta-analysis : correcting error and bias in research findings","author":"JE Hunter","year":"2004","unstructured":"Hunter JE, Schmidt FL: Methods of meta-analysis : correcting error and bias in research findings. 2nd edition. Thousand Oaks, Calif., Sage; 2004:xxxiii, 582.","edition":"2nd"},{"issue":"14","key":"1072_CR23","doi-asserted-by":"publisher","first-page":"2131","DOI":"10.1002\/sim.845","volume":"20","author":"TS King","year":"2001","unstructured":"King TS, Chinchilli VM: A generalized concordance correlation coefficient for continuous and categorical data. Statistics in Medicine 2001, 20(14):2131\u20132147. 10.1002\/sim.845","journal-title":"Statistics in Medicine"},{"issue":"2","key":"1072_CR24","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1111\/j.1469-8986.1996.tb02121.x","volume":"33","author":"AG Greenwald","year":"1996","unstructured":"Greenwald AG, Gonzalez R, Harris RJ, Guthrie D: Effect Sizes and P Values: What Should Be Reported and What Should Be Replicated? Psychophysiology 1996, 33(2):175\u2013183.","journal-title":"Psychophysiology"},{"issue":"4","key":"1072_CR25","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/ng0496-357","volume":"12","author":"E Lander","year":"1996","unstructured":"Lander E, Kruglyak L: Genetic dissection of complex traits - Reply. Nature Genetics 1996, 12(4):357\u2013358. 10.1038\/ng0496-357","journal-title":"Nature Genetics"},{"issue":"1","key":"1072_CR26","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1038\/nrg1749","volume":"7","author":"DB Allison","year":"2006","unstructured":"Allison DB, Cui X, Page GP, Sabripour M: Microarray data analysis: from disarray to consolidation and consensus. Nature Reviews Genetics 2006, 7(1):55\u201365. 10.1038\/nrg1749","journal-title":"Nature Reviews Genetics"},{"key":"1072_CR27","volume-title":"Applied multiple regression\/correlation analysis for the behavioral sciences","author":"J Cohen","year":"2003","unstructured":"Cohen J, Cohen P, West SG, Aiken L: Applied multiple regression\/correlation analysis for the behavioral sciences. Mahwah, N.J. ;, London :, L. Erlbaum Associates; 2003."},{"key":"1072_CR28","unstructured":"SAS code for CCC:[http:\/\/tigger.uic.edu\/~hedayat\/]"},{"issue":"324","key":"1072_CR29","doi-asserted-by":"publisher","first-page":"1379","DOI":"10.1080\/01621459.1968.10480934","volume":"63","author":"PK Sen","year":"1968","unstructured":"Sen PK: Estimates of regression coefficient based on Kendall's tau. Journal of the American Statistical Association 1968, 63(324):1379-&. 10.2307\/2285891","journal-title":"Journal of the American Statistical Association"},{"key":"1072_CR30","first-page":"85","volume":"12","author":"H Theil","year":"1950","unstructured":"Theil H: A rank-invariant method of linear and polynomial regression analysis. Indagationes Mathematicae 1950, 12: 85\u201391.","journal-title":"Indagationes Mathematicae"},{"key":"1072_CR31","first-page":"pp. 477","volume-title":"Applying contemporary statistical techniques","author":"RR Wilcox","year":"2003","unstructured":"Wilcox RR: Applying contemporary statistical techniques. Amsterdam ;, Boston :, Academic Press; 2003:pp. 477\u2013479 and 531\u2013533."},{"key":"1072_CR32","doi-asserted-by":"crossref","unstructured":"Irizarry RA, Bolstad BM, Collin F, Cope LM, Hobbs B, Speed TP: Summaries of affymetrix GeneChip probe level data. Nucleic Acids Research 2003., 31(4):","DOI":"10.1093\/nar\/gng015"},{"issue":"1","key":"1072_CR33","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini Y, Hochberg Y: Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B - Methodological 1995, 57(1):289\u2013300.","journal-title":"Journal of the Royal Statistical Society Series B - Methodological"},{"issue":"9","key":"1072_CR34","doi-asserted-by":"publisher","first-page":"5116","DOI":"10.1073\/pnas.091062498","volume":"98","author":"VG Tusher","year":"2001","unstructured":"Tusher VG, Tibshirani R, Chu G: Significance analysis of microarrays applied to the ionizing radiation response. Proceedings of the National Academy of Sciences 2001, 98(9):5116\u20135121. 10.1073\/pnas.091062498","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"1072_CR35","unstructured":"Primer3 web tool[http:\/\/frodo.wi.mit.edu\/cgi-bin\/primer3\/primer3_www.cgi]"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-7-333.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T12:04:49Z","timestamp":1736510689000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-7-333"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,7,5]]},"references-count":35,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2006,12]]}},"alternative-id":["1072"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-7-333","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,7,5]]},"assertion":[{"value":"30 March 2006","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 July 2006","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 July 2006","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"333"}}