{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T20:30:52Z","timestamp":1774470652161,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1011659","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,12,4]],"date-time":"2023-12-04T00:00:00Z","timestamp":1701648000000}}],"reference-count":37,"publisher":"Public Library of Science (PLoS)","issue":"11","license":[{"start":{"date-parts":[[2023,11,20]],"date-time":"2023-11-20T00:00:00Z","timestamp":1700438400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000057","name":"National Institute of General Medical Sciences","doi-asserted-by":"publisher","award":["1 R01 GM148972-01"],"award-info":[{"award-number":["1 R01 GM148972-01"]}],"id":[{"id":"10.13039\/100000057","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000057","name":"National Institute of General Medical Sciences","doi-asserted-by":"publisher","award":["5 T32 GM102057-10"],"award-info":[{"award-number":["5 T32 GM102057-10"]}],"id":[{"id":"10.13039\/100000057","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>\n                    By applying Differential Set Analysis (DSA) to sequence count data, researchers can determine whether groups of microbes or genes are differentially enriched. Yet sequence count data suffer from a\n                    <jats:italic>scale limitation<\/jats:italic>\n                    : these data lack information about the scale (i.e., size) of the biological system under study, leading some authors to call these data compositional (i.e., proportional). In this article, we show that commonly used DSA methods that rely on normalization make strong, implicit assumptions about the unmeasured system scale. We show that even small errors in these\n                    <jats:italic>scale assumptions<\/jats:italic>\n                    can lead to positive predictive values as low as 9%. To address this problem, we take three novel approaches. First, we introduce a sensitivity analysis framework to identify when modeling results are robust to such errors and when they are suspect. Unlike standard benchmarking studies, this framework does not require ground-truth knowledge and can therefore be applied to both simulated and real data. Second, we introduce a statistical test that provably controls Type-I error at a nominal rate despite errors in scale assumptions. Finally, we discuss how the impact of scale limitations depends on a researcher\u2019s scientific goals and provide tools that researchers can use to evaluate whether their goals are at risk from erroneous scale assumptions. Overall, the goal of this article is to catalyze future research into the impact of scale limitations in analyses of sequence count data; to illustrate that scale limitations can lead to inferential errors in practice; yet to also show that rigorous and reproducible scale reliant inference is possible if done carefully.\n                  <\/jats:p>","DOI":"10.1371\/journal.pcbi.1011659","type":"journal-article","created":{"date-parts":[[2023,11,20]],"date-time":"2023-11-20T13:39:01Z","timestamp":1700487541000},"page":"e1011659","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":12,"title":["Addressing erroneous scale assumptions in microbe and gene set enrichment analysis"],"prefix":"10.1371","volume":"19","author":[{"given":"Kyle C.","family":"McGovern","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michelle Pistner","family":"Nixon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3063-2098","authenticated-orcid":true,"given":"Justin D.","family":"Silverman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2023,11,20]]},"reference":[{"issue":"43","key":"pcbi.1011659.ref001","doi-asserted-by":"crossref","first-page":"15545","DOI":"10.1073\/pnas.0506580102","article-title":"Gene set enrichment analysis: A knowledge-based approach for interpreting genome-wide expression profiles","volume":"102","author":"A Subramanian","year":"2005","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"1","key":"pcbi.1011659.ref002","doi-asserted-by":"crossref","first-page":"21466","DOI":"10.1038\/s41598-020-78511-y","article-title":"Microbe-set enrichment analysis facilitates functional interpretation of microbiome profiling data","volume":"10","author":"Y Kou","year":"2020","journal-title":"Sci Rep"},{"issue":"1","key":"pcbi.1011659.ref003","doi-asserted-by":"crossref","first-page":"6683","DOI":"10.1038\/ncomms7683","article-title":"Decoding the regulatory landscape of melanoma reveals TEADS as regulators of the invasive cell state","volume":"6","author":"A Verfaillie","year":"2015","journal-title":"Nat Commun"},{"issue":"1","key":"pcbi.1011659.ref004","doi-asserted-by":"crossref","first-page":"1077","DOI":"10.1038\/s41467-017-01027-z","article-title":"Comprehensive analysis of normal adjacent to tumor transcriptomes","volume":"8","author":"D Aran","year":"2017","journal-title":"Nat Commun"},{"issue":"1","key":"pcbi.1011659.ref005","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1038\/sj.bjc.6605468","article-title":"Gene set enrichment analysis provides insight into novel signalling pathways in breast cancer stem cells","volume":"102","author":"M Murohashi","year":"2010","journal-title":"Br J Cancer"},{"issue":"2","key":"pcbi.1011659.ref006","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1038\/ismej.2016.117","article-title":"Absolute quantification of microbial taxon abundances","volume":"11","author":"R Props","year":"2017","journal-title":"ISME J"},{"key":"pcbi.1011659.ref007","doi-asserted-by":"crossref","DOI":"10.3389\/fmicb.2017.02224","article-title":"Microbiome Datasets Are Compositional: And This Is Not Optional","volume":"8","author":"GB Gloor","year":"2017","journal-title":"Front Microbiol"},{"issue":"3","key":"pcbi.1011659.ref008","doi-asserted-by":"crossref","first-page":"R25","DOI":"10.1186\/gb-2010-11-3-r25","article-title":"A scaling normalization method for differential expression analysis of RNA-Seq data","volume":"11","author":"MD Robinson","year":"2010","journal-title":"Genome Biol"},{"issue":"10","key":"pcbi.1011659.ref009","doi-asserted-by":"crossref","first-page":"R106","DOI":"10.1186\/gb-2010-11-10-r106","article-title":"Differential expression analysis for sequence count data","volume":"11","author":"S Anders","year":"2010","journal-title":"Genome Biol"},{"issue":"5","key":"pcbi.1011659.ref010","doi-asserted-by":"crossref","first-page":"776","DOI":"10.1093\/bib\/bbx008","article-title":"Selecting between-sample RNA-Seq normalization methods from the perspective of their assumptions","volume":"19","author":"C Evans","year":"2018","journal-title":"Brief Bioinform"},{"issue":"1","key":"pcbi.1011659.ref011","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1186\/1471-2105-11-94","article-title":"Evaluation of statistical methods for normalization and differential expression in mRNA-Seq experiments","volume":"11","author":"JH Bullard","year":"2010","journal-title":"BMC Bioinformatics"},{"key":"pcbi.1011659.ref012","doi-asserted-by":"crossref","first-page":"621690","DOI":"10.1155\/2015\/621690","article-title":"The Impact of Normalization Methods on RNA-Seq Data Analysis","volume":"2015","author":"J Zyprych-Walczak","year":"2015","journal-title":"Biomed Res Int"},{"issue":"16","key":"pcbi.1011659.ref013","doi-asserted-by":"crossref","first-page":"2870","DOI":"10.1093\/bioinformatics\/bty175","article-title":"Understanding sequencing data as compositions: an outlook and review","volume":"34","author":"TP Quinn","year":"2018","journal-title":"Bioinformatics"},{"key":"pcbi.1011659.ref014","unstructured":"Nixon MP, Letourneau J, David LA, Lazar NA, Mukherjee S, Silverman JD. Scale Reliant Inference. arXiv:2201.03616 [Preprint]. 2022 [posted 2022 Jan 10; revised 2022 Apr 28; revised 2023 Feb 10; cited 2023 Sep 9]. Available from: https:\/\/arxiv.org\/abs\/2201.03616"},{"issue":"1","key":"pcbi.1011659.ref015","doi-asserted-by":"crossref","first-page":"2719","DOI":"10.1038\/s41467-019-10656-5","article-title":"Establishing microbial composition measurement standards with reference frames","volume":"10","author":"JT Morton","year":"2019","journal-title":"Nat Commun"},{"key":"pcbi.1011659.ref016","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1214\/lnms\/1215463786","article-title":"Principles of Compositional Data Analysis","volume":"24","author":"J Aitchison","year":"1994","journal-title":"Lect Notes Monogr Ser"},{"issue":"1","key":"pcbi.1011659.ref017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0227285","article-title":"Quantitative PCR provides a simple and accessible method for quantitative microbiota profiling","volume":"15","author":"C Jian","year":"2020","journal-title":"PLoS One"},{"issue":"7681","key":"pcbi.1011659.ref018","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1038\/nature24460","article-title":"Quantitative microbiome profiling links gut community variation to microbial load","volume":"551","author":"D Vandeputte","year":"2017","journal-title":"Nature"},{"issue":"7","key":"pcbi.1011659.ref019","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1009113","article-title":"Measuring and mitigating PCR bias in microbiota datasets","volume":"17","author":"JD Silverman","year":"2021","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"pcbi.1011659.ref020","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1186\/2049-2618-2-15","article-title":"Unifying the analysis of high-throughput sequencing datasets: characterizing RNA-Seq, 16S rRNA gene sequencing and selective growth experiments by compositional data analysis","volume":"2","author":"AD Fernandes","year":"2014","journal-title":"Microbiome"},{"issue":"6","key":"pcbi.1011659.ref021","doi-asserted-by":"crossref","first-page":"3045","DOI":"10.1093\/nar\/gkz043","article-title":"RNA surveillance by uridylation-dependent RNA decay in Schizosaccharomyces pombe","volume":"47","author":"CZ Chung","year":"2019","journal-title":"Nucleic Acids Res"},{"issue":"1","key":"pcbi.1011659.ref022","doi-asserted-by":"crossref","first-page":"19471","DOI":"10.1038\/s41598-020-76570-9","article-title":"Opioid agonist and antagonist use and the gut microbiota: associations among people in addiction treatment","volume":"10","author":"RE Gicquelais","year":"2020","journal-title":"Sci Rep"},{"issue":"12","key":"pcbi.1011659.ref023","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1186\/s13059-014-0550-8","article-title":"Moderated estimation of fold change and dispersion for RNA-Seq data with DESeq2","volume":"15","author":"MI Love","year":"2014","journal-title":"Genome Biol"},{"issue":"17","key":"pcbi.1011659.ref024","doi-asserted-by":"crossref","first-page":"e133","DOI":"10.1093\/nar\/gks461","article-title":"Camera: a competitive gene set test accounting for inter-gene correlation","volume":"40","author":"D Wu","year":"2012","journal-title":"Nucleic Acids Res"},{"issue":"4","key":"pcbi.1011659.ref025","doi-asserted-by":"crossref","first-page":"434","DOI":"10.3390\/genes11040434","article-title":"Fold-Change-Specific Enrichment Analysis (FSEA): Quantification of Transcriptional Response Magnitude for Functional Gene Groups","volume":"11","author":"DS Wiebe","year":"2020","journal-title":"Genes"},{"issue":"427","key":"pcbi.1011659.ref026","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1080\/01621459.1994.10476836","article-title":"P Values Maximized Over a Confidence Set for the Nuisance Parameter","volume":"89","author":"RL Berger","year":"1994","journal-title":"J Am Stat Assoc"},{"issue":"1","key":"pcbi.1011659.ref027","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1186\/1471-2164-11-574","article-title":"Heading Down the Wrong Pathway: on the Influence of Correlation within Gene Sets","volume":"11","author":"DM Gatti","year":"2010","journal-title":"BMC Genomics"},{"issue":"1","key":"pcbi.1011659.ref028","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1177\/0962280212460441","article-title":"The limitations of simple gene set enrichment analysis assuming gene independence","volume":"25","author":"P Tamayo","year":"2016","journal-title":"Stat Methods Med Res"},{"key":"pcbi.1011659.ref029","first-page":"329","volume-title":"Finding the Centre: Compositional Asymmetry in High-Throughput Sequencing Datasets","author":"JR Wu","year":"2021"},{"key":"pcbi.1011659.ref030","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.annepidem.2019.03.005","article-title":"Tobacco exposure associated with oral microbiota oxygen utilization in the New York City Health and Nutrition Examination Study","volume":"34","author":"F Beghini","year":"2019","journal-title":"Ann Epidemiol"},{"issue":"5","key":"pcbi.1011659.ref031","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1010091","article-title":"CBEA: Competitive balances for taxonomic enrichment analysis","volume":"18","author":"QP Nguyen","year":"2022","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1011659.ref032","doi-asserted-by":"crossref","first-page":"654","DOI":"10.3389\/fgene.2020.00654","article-title":"Gene Set Analysis: Challenges, Opportunities, and Future Research","volume":"11","author":"F Maleki","year":"2020","journal-title":"Front Genet"},{"issue":"6","key":"pcbi.1011659.ref033","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1038\/ng.2653","article-title":"The Genotype-Tissue Expression (GTEx) project","volume":"45","author":"J Lonsdale","year":"2013","journal-title":"Nat Genet"},{"issue":"22","key":"pcbi.1011659.ref034","doi-asserted-by":"crossref","first-page":"3666","DOI":"10.1093\/bioinformatics\/btv377","article-title":"Alternative preprocessing of RNA-Sequencing data in The Cancer Genome Atlas leads to improved analysis results","volume":"31","author":"M Rahman","year":"2015","journal-title":"Bioinformatics"},{"issue":"6","key":"pcbi.1011659.ref035","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.cels.2015.12.004","article-title":"The Molecular Signatures Database Hallmark Gene Set Collection","volume":"1","author":"A Liberzon","year":"2015","journal-title":"Cell Syst"},{"issue":"1","key":"pcbi.1011659.ref036","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.cell.2012.08.026","article-title":"Transcriptional Amplification in Tumor Cells with Elevated c-Myc","volume":"151","author":"CY Lin","year":"2012","journal-title":"Cell"},{"issue":"12","key":"pcbi.1011659.ref037","doi-asserted-by":"crossref","first-page":"1739","DOI":"10.1093\/bioinformatics\/btr260","article-title":"Molecular signatures database (MSigDB) 3.0","volume":"27","author":"A Liberzon","year":"2011","journal-title":"Bioinformatics"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1011659","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,12,4]],"date-time":"2023-12-04T00:00:00Z","timestamp":1701648000000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011659","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,2]],"date-time":"2024-11-02T04:04:12Z","timestamp":1730520252000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011659"}},"subtitle":[],"editor":[{"given":"Nic","family":"Vega","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2023,11,20]]},"references-count":37,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,11,20]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1011659","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2023.03.10.532120","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,20]]}}}