{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T10:12:54Z","timestamp":1793873574988,"version":"4.6.1"},"reference-count":12,"publisher":"Springer Science and Business Media LLC","issue":"S24","license":[{"start":{"date-parts":[[2019,12,1]],"date-time":"2019-12-01T00:00:00Z","timestamp":1575158400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2019,12,20]],"date-time":"2019-12-20T00:00:00Z","timestamp":1576800000000},"content-version":"vor","delay-in-days":19,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>RNA sequencing technologies have allowed researchers to gain a better understanding of how the transcriptome affects disease. However, sequencing technologies often unintentionally introduce experimental error into RNA sequencing data. To counteract this, normalization methods are standardly applied with the intent of reducing the non-biologically derived variability inherent in transcriptomic measurements. However, the comparative efficacy of the various normalization techniques has not been tested in a standardized manner. Here we propose tests that evaluate numerous normalization techniques and applied them to a large-scale standard data set. These tests comprise a protocol that allows researchers to measure the amount of non-biological variability which is present in any data set after normalization has been performed, a crucial step to assessing the biological validity of data following normalization.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>In this study we present two tests to assess the validity of normalization methods applied to a large-scale data set collected for systematic evaluation purposes. We tested various RNASeq normalization procedures and concluded that transcripts per million (TPM) was the best performing normalization method based on its preservation of biological signal as compared to the other methods tested.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusion<\/jats:title>\n<jats:p>Normalization is of vital importance to accurately interpret the results of genomic and transcriptomic experiments. More work, however, needs to be performed to optimize normalization methods for RNASeq data. The present effort helps pave the way for more systematic evaluations of normalization methods across different platforms. With our proposed schema researchers can evaluate their own or future normalization methods to further improve the field of RNASeq normalization.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12859-019-3247-x","type":"journal-article","created":{"date-parts":[[2019,12,20]],"date-time":"2019-12-20T08:05:23Z","timestamp":1576829123000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":112,"title":["A protocol to evaluate RNA sequencing normalization methods"],"prefix":"10.1186","volume":"20","author":[{"given":"Zachary B.","family":"Abrams","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Travis S.","family":"Johnson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kun","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philip R. O.","family":"Payne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kevin","family":"Coombes","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,12,20]]},"reference":[{"issue":"9","key":"3247_CR1","doi-asserted-by":"publisher","first-page":"888","DOI":"10.1038\/nbt.3000","volume":"32","author":"S Li","year":"2014","unstructured":"Li S, et al. Detecting and correcting systematic variation in large-scale RNA sequencing data. Nat Biotechnol. 2014;32(9):888\u201395.","journal-title":"Nat Biotechnol"},{"key":"3247_CR2","doi-asserted-by":"publisher","first-page":"347","DOI":"10.1186\/s12859-015-0778-7","volume":"16","author":"P Li","year":"2015","unstructured":"Li P, et al. Comparing the normalization methods for the differential analysis of Illumina high-throughput RNA-Seq data. BMC Bioinform. 2015;16:347.","journal-title":"BMC Bioinform"},{"key":"3247_CR3","doi-asserted-by":"publisher","first-page":"621690","DOI":"10.1155\/2015\/621690","volume":"2015","author":"J Zyprych-Walczak","year":"2015","unstructured":"Zyprych-Walczak J, et al. The impact of normalization methods on RNA-Seq data analysis. Biomed Res Int. 2015;2015:621690.","journal-title":"Biomed Res Int"},{"issue":"6","key":"3247_CR4","doi-asserted-by":"publisher","first-page":"671","DOI":"10.1093\/bib\/bbs046","volume":"14","author":"MA Dillies","year":"2013","unstructured":"Dillies MA, et al. A comprehensive evaluation of normalization methods for Illumina high-throughput RNA sequencing data analysis. Brief Bioinform. 2013;14(6):671\u201383.","journal-title":"Brief Bioinform"},{"issue":"9","key":"3247_CR5","doi-asserted-by":"publisher","first-page":"1151","DOI":"10.1038\/nbt1239","volume":"24","author":"L Shi","year":"2006","unstructured":"Shi L, et al. The MicroArray quality control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements. Nat Biotechnol. 2006;24(9):1151\u201361.","journal-title":"Nat Biotechnol"},{"issue":"9","key":"3247_CR6","doi-asserted-by":"publisher","first-page":"896","DOI":"10.1038\/nbt.2931","volume":"32","author":"D Risso","year":"2014","unstructured":"Risso D, et al. Normalization of RNA-seq data using factor analysis of control genes or samples. Nat Biotechnol. 2014;32(9):896\u2013902.","journal-title":"Nat Biotechnol"},{"issue":"9","key":"3247_CR7","doi-asserted-by":"publisher","first-page":"903","DOI":"10.1038\/nbt.2957","volume":"32","author":"Z Su","year":"2014","unstructured":"Su Z, \u0141abaj PP, Li S, Thierry-Mieg J, Thierry-Mieg D, Shi W, Wang C, Schroth GP, Setterquist RA, Thompson JF, Jones WD. A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the Sequencing Quality Control Consortium. Nat Biotechnol. 2014;32(9):903\u201314.","journal-title":"Nat Biotechnol"},{"issue":"3","key":"3247_CR8","doi-asserted-by":"publisher","first-page":"R25","DOI":"10.1186\/gb-2010-11-3-r25","volume":"11","author":"MD Robinson","year":"2010","unstructured":"Robinson MD, Oshlack A. A scaling normalization method for differential expression analysis of RNA-seq data. Genome Biol. 2010;11(3):R25.","journal-title":"Genome Biol"},{"issue":"10","key":"3247_CR9","doi-asserted-by":"publisher","first-page":"R106","DOI":"10.1186\/gb-2010-11-10-r106","volume":"11","author":"S Anders","year":"2010","unstructured":"Anders S, Huber W. Differential expression analysis for sequence count data. Genome Biol. 2010;11(10):R106.","journal-title":"Genome Biol"},{"key":"3247_CR10","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1186\/1745-6150-4-14","volume":"4","author":"A Oshlack","year":"2009","unstructured":"Oshlack A, Wakefield MJ. Transcript length bias in RNA-seq data confounds systems biology. Biol Direct. 2009;4:14.","journal-title":"Biol Direct"},{"issue":"4","key":"3247_CR11","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1007\/s12064-012-0162-3","volume":"131","author":"GP Wagner","year":"2012","unstructured":"Wagner GP, Kin K, Lynch VJ. Measurement of mRNA abundance using RNA-seq data: RPKM measure is inconsistent among samples. Theory Biosci. 2012;131(4):281\u20135.","journal-title":"Theory Biosci"},{"issue":"2","key":"3247_CR12","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1093\/bioinformatics\/19.2.185","volume":"19","author":"BM Bolstad","year":"2003","unstructured":"Bolstad BM, et al. A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics. 2003;19(2):185\u201393.","journal-title":"Bioinformatics"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-019-3247-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12859-019-3247-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-019-3247-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,12,19]],"date-time":"2020-12-19T00:05:32Z","timestamp":1608336332000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-019-3247-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12]]},"references-count":12,"journal-issue":{"issue":"S24","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["3247"],"URL":"https:\/\/doi.org\/10.1186\/s12859-019-3247-x","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12]]},"assertion":[{"value":"20 December 2019","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"679"}}