{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T05:12:22Z","timestamp":1790831542251,"version":"4.1.0"},"reference-count":22,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2021,3,24]],"date-time":"2021-03-24T00:00:00Z","timestamp":1616544000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"Netherlands Organization for Scientific Research","award":["639.072.412"],"award-info":[{"award-number":["639.072.412"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,9,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Motivation<\/jats:title><jats:p>Volcano plots are used to select the most interesting discoveries when too many discoveries remain after application of Benjamini\u2013Hochberg\u2019s procedure (BH). The volcano plot suggests a double filtering procedure that selects features with both small adjusted $P$-value and large estimated effect size. Despite its popularity, this type of selection overlooks the fact that BH does not guarantee error control over filtered subsets of discoveries. Therefore the selected subset of features may include an inflated number of false discoveries.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>In this paper, we illustrate the substantially inflated type I error rate of volcano plot selection with simulation experiments and RNA-seq data. In particular, we show that the feature with the largest estimated effect is a very likely false positive result. Next, we investigate two alternative approaches for multiple testing with double filtering that do not inflate the false discovery rate. Our procedure is implemented in an interactive web application and is publicly available.<\/jats:p><\/jats:sec>","DOI":"10.1093\/bib\/bbab053","type":"journal-article","created":{"date-parts":[[2021,2,4]],"date-time":"2021-02-04T04:04:18Z","timestamp":1612411458000},"source":"Crossref","is-referenced-by-count":36,"title":["Inflated false discovery rate due to volcano plots: problem and solutions"],"prefix":"10.1093","volume":"22","author":[{"given":"Mitra","family":"Ebrahimpoor","sequence":"first","affiliation":[{"name":"Medical statistics, Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, 2333 ZA, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jelle J","family":"Goeman","sequence":"additional","affiliation":[{"name":"Medical statistics, Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, 2333 ZA, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,3,24]]},"reference":[{"issue":"5","key":"2021090815134370300_ref1","doi-asserted-by":"crossref","first-page":"2055","DOI":"10.1214\/15-AOS1337","article-title":"Controlling the false discovery rate via knockoffs","volume":"43","author":"Barber","year":"2015","journal-title":"Ann Stat"},{"issue":"1","key":"2021090815134370300_ref2","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: a practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J R Stat Soc B Methodol"},{"issue":"3","key":"2021090815134370300_ref3","doi-asserted-by":"crossref","first-page":"1281","DOI":"10.1214\/19-AOS1847","article-title":"Post-hoc confidence bounds on false positives using reference families","volume":"48","author":"Blanchard","year":"2020","journal-title":"Ann Stat"},{"issue":"21","key":"2021090815134370300_ref4","doi-asserted-by":"crossref","first-page":"9546","DOI":"10.1073\/pnas.0914005107","article-title":"Independent filtering increases detection power for high-throughput experiments","volume":"107","author":"Bourgon","year":"2010","journal-title":"Proc Natl Acad Sci"},{"key":"2021090815134370300_ref5","volume-title":"shiny: Web Application Framework for R","author":"Chang","year":"2019"},{"issue":"4","key":"2021090815134370300_ref6","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1186\/gb-2003-4-4-210","article-title":"Statistical tests for differential expression in cDNA microarray experiments","volume":"4","author":"Cui","year":"2003","journal-title":"Genome Biol"},{"issue":"1","key":"2021090815134370300_ref7","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0192082","article-title":"Shared and organism-specific host responses to childhood diarrheal diseases revealed by whole blood transcript profiling","volume":"13","author":"DeBerg","year":"2018","journal-title":"PLoS One"},{"issue":"8","key":"2021090815134370300_ref8","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1002\/1521-4036(200112)43:8<985::AID-BIMJ985>3.0.CO;2-4","article-title":"On the false discovery rate and expected type i errors","volume":"43","author":"Finner","year":"2001","journal-title":"Biom J"},{"issue":"1","key":"2021090815134370300_ref9","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1186\/1471-2105-12-449","article-title":"ReCount: a multi-experiment resource of analysis-ready RNA-seq gene count datasets","volume":"12","author":"Frazee","year":"2011","journal-title":"BMC Bioinformatics"},{"key":"2021090815134370300_ref10","volume-title":"hommel: Methods for Closed Testing with Simes Inequality, in Particular Hommel\u2019s Method","author":"Goeman","year":"2019"},{"issue":"4","key":"2021090815134370300_ref11","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1214\/11-STS356","article-title":"Multiple testing for exploratory research","volume":"26","author":"Goeman","year":"2011","journal-title":"Stat Sci"},{"issue":"11","key":"2021090815134370300_ref12","doi-asserted-by":"crossref","first-page":"1946","DOI":"10.1002\/sim.6082","article-title":"Multiple hypothesis testing in genomics","volume":"33","author":"Goeman","year":"2014","journal-title":"Stat Med"},{"key":"2021090815134370300_ref13","doi-asserted-by":"crossref","DOI":"10.1093\/biomet\/asz041","article-title":"Simultaneous control of all false discovery proportions in large-scale multiple hypothesis testing","author":"Goeman","year":"2019","journal-title":"Biometrika"},{"issue":"3","key":"2021090815134370300_ref14","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1093\/biomet\/asz021","article-title":"Permutation-based simultaneous confidence bounds for the false discovery proportion","volume":"106","author":"Hemerik","year":"2019","journal-title":"Biometrika"},{"key":"2021090815134370300_ref15","article-title":"Filtering the rejection set while preserving false discovery rate control","author":"Katsevich","year":"2018"},{"issue":"3","key":"2021090815134370300_ref16","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1093\/biomet\/63.3.655","article-title":"On closed testing procedures with special reference to ordered analysis of variance","volume":"63","author":"Marcus","year":"1976","journal-title":"Biometrika"},{"key":"2021090815134370300_ref17","volume-title":"sansSouci: Post Hoc Multiple Testing Inference","author":"Neuvial","year":"2020"},{"issue":"7","key":"2021090815134370300_ref18","doi-asserted-by":"crossref","first-page":"e47","DOI":"10.1093\/nar\/gkv007","article-title":"Limma powers differential expression analyses for RNA-sequencing and microarray studies","volume":"43","author":"Ritchie","year":"2015","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"2021090815134370300_ref19","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1093\/bioinformatics\/btp616","article-title":"edgeR: a bioconductor package for differential expression analysis of digital gene expression data","volume":"26","author":"Robinson","year":"2009","journal-title":"Bioinformatics"},{"issue":"3","key":"2021090815134370300_ref20","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1093\/biomet\/73.3.751","article-title":"An improved bonferroni procedure for multiple tests of significance","volume":"73","author":"Simes","year":"1986","journal-title":"Biometrika"},{"issue":"1","key":"2021090815134370300_ref21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2202\/1544-6115.1027","article-title":"Linear models and empirical bayes methods for assessing differential expression in microarray experiments","volume":"3","author":"Smyth","year":"2004","journal-title":"Stat Appl Genet Mol Biol"},{"issue":"1","key":"2021090815134370300_ref22","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1186\/1471-2105-10-402","article-title":"A close examination of double filtering with fold change and t test in microarray analysis","volume":"10","author":"Zhang","year":"2009","journal-title":"BMC Bioinformatics"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bib\/article-pdf\/22\/5\/bbab053\/40260042\/bbab053.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/bib\/article-pdf\/22\/5\/bbab053\/40260042\/bbab053.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T15:18:56Z","timestamp":1724426336000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbab053\/6184412"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,24]]},"references-count":22,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,9,2]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbab053","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,9]]},"published":{"date-parts":[[2021,3,24]]},"article-number":"bbab053"}}