{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,1]],"date-time":"2026-08-01T09:53:16Z","timestamp":1785577996210,"version":"3.56.0"},"reference-count":37,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T00:00:00Z","timestamp":1642636800000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["U2C CA233291"],"award-info":[{"award-number":["U2C CA233291"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["U54 CA217450"],"award-info":[{"award-number":["U54 CA217450"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["5P50CA236733-02"],"award-info":[{"award-number":["5P50CA236733-02"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000054","name":"National Cancer Institute","doi-asserted-by":"publisher","award":["5P50CA098131-18"],"award-info":[{"award-number":["5P50CA098131-18"]}],"id":[{"id":"10.13039\/100000054","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Cancer Center Support","award":["P30CA068485"],"award-info":[{"award-number":["P30CA068485"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,3,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Normalization and batch correction are critical steps in processing single-cell RNA sequencing (scRNA-seq) data, which remove technical effects and systematic biases to unmask biological signals of interest. Although a number of computational methods have been developed, there is no guidance for choosing appropriate procedures in different scenarios. In this study, we assessed the performance of 28 scRNA-seq noise reduction procedures in 55 scenarios using simulated and real datasets. The scenarios accounted for multiple biological and technical factors that greatly affect the denoising performance, including relative magnitude of batch effects, the extent of cell population imbalance, the complexity of cell group structures, the proportion and the similarity of nonoverlapping cell populations, dropout rates and variable library sizes. We used multiple quantitative metrics and visualization of low-dimensional cell embeddings to evaluate the performance on batch mixing while preserving the original cell group and gene structures. Based on our results, we specified technical or biological factors affecting the performance of each method and recommended proper methods in different scenarios. In addition, we highlighted one challenging scenario where most methods failed and resulted in overcorrection. Our studies not only provided a comprehensive guideline for selecting suitable noise reduction procedures but also pointed out unsolved issues in the field, especially the urgent need of developing metrics for assessing batch correction on imperceptible cell-type mixing.<\/jats:p>","DOI":"10.1093\/bib\/bbab565","type":"journal-article","created":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T20:13:10Z","timestamp":1639426390000},"source":"Crossref","is-referenced-by-count":42,"title":["Comprehensive evaluation of noise reduction methods for single-cell RNA sequencing data"],"prefix":"10.1093","volume":"23","author":[{"given":"Shih-Kai","family":"Chu","sequence":"first","affiliation":[{"name":"Department of Biostatistics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America"},{"name":"Center for Quantitative Sciences, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shilin","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America"},{"name":"Center for Quantitative Sciences, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Shyr","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America"},{"name":"Center for Quantitative Sciences, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8892-7078","authenticated-orcid":false,"given":"Qi","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Biostatistics, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America"},{"name":"Center for Quantitative Sciences, Vanderbilt University Medical Center, Nashville, Tennessee, United States of America"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2022,1,19]]},"reference":[{"key":"2022031506271352300_ref1","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1038\/s41586-020-2797-4","article-title":"Cells of the adult human heart","volume":"588","author":"Litvinukova","year":"2020","journal-title":"Nature"},{"issue":"23\u201338","key":"2022031506271352300_ref2","first-page":"e28","article-title":"Single-cell analysis of the liver epithelium reveals dynamic heterogeneity and an essential role for YAP in homeostasis and regeneration","volume":"25","author":"Pepe-Mooney","year":"2019","journal-title":"Cell Stem Cell"},{"key":"2022031506271352300_ref3","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1038\/s41586-020-2157-4","article-title":"Construction of a human cell landscape at single-cell level","volume":"581","author":"Han","year":"2020","journal-title":"Nature"},{"key":"2022031506271352300_ref4","doi-asserted-by":"crossref","first-page":"810","DOI":"10.1016\/j.cell.2020.12.016","article-title":"Spatiotemporal analysis of human intestinal development at single-cell resolution","volume":"184","author":"Fawkner-Corbett","year":"2021","journal-title":"Cell"},{"key":"2022031506271352300_ref5","doi-asserted-by":"crossref","DOI":"10.1126\/science.aba6500","article-title":"Developmental cell programs are co-opted in inflammatory skin disease","volume":"371","author":"Reynolds","year":"2021","journal-title":"Science"},{"key":"2022031506271352300_ref6","doi-asserted-by":"crossref","DOI":"10.1126\/science.aay3224","article-title":"A cell atlas of human thymic development defines T cell repertoire formation","volume":"367","author":"Park","year":"2020","journal-title":"Science"},{"key":"2022031506271352300_ref7","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1038\/s41586-021-03569-1","article-title":"A molecular single-cell lung atlas of lethal COVID-19","volume":"595","author":"Melms","year":"2021","journal-title":"Nature"},{"key":"2022031506271352300_ref8","doi-asserted-by":"crossref","first-page":"1153","DOI":"10.1038\/s41591-019-0468-5","article-title":"A cellular census of human lungs identifies novel cell states in health and in asthma","volume":"25","author":"Vieira Braga","year":"2019","journal-title":"Nat Med"},{"key":"2022031506271352300_ref9","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1038\/s41586-019-1631-3","article-title":"Resolving the fibrotic niche of human liver cirrhosis at single-cell level","volume":"575","author":"Ramachandran","year":"2019","journal-title":"Nature"},{"key":"2022031506271352300_ref10","doi-asserted-by":"crossref","first-page":"e1004333","DOI":"10.1371\/journal.pcbi.1004333","article-title":"BASiCS: Bayesian analysis of single-cell sequencing data","volume":"11","author":"Vallejos","year":"2015","journal-title":"PLoS Comput Biol"},{"key":"2022031506271352300_ref11","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1186\/s13059-016-0947-7","article-title":"Pooling across cells to normalize single-cell RNA sequencing data with many zero counts","volume":"17","author":"Lun","year":"2016","journal-title":"Genome Biol"},{"key":"2022031506271352300_ref12","doi-asserted-by":"crossref","first-page":"584","DOI":"10.1038\/nmeth.4263","article-title":"SCnorm: robust normalization of single-cell RNA-seq data","volume":"14","author":"Bacher","year":"2017","journal-title":"Nat Methods"},{"key":"2022031506271352300_ref13","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1186\/s13059-019-1874-1","article-title":"Normalization and variance stabilization of single-cell RNA-seq data using regularized negative binomial regression","volume":"20","author":"Hafemeister","year":"2019","journal-title":"Genome Biol"},{"key":"2022031506271352300_ref14","doi-asserted-by":"crossref","first-page":"e47","DOI":"10.1093\/nar\/gkv007","article-title":"limma powers differential expression analyses for RNA-sequencing and microarray studies","volume":"43","author":"Ritchie","year":"2015","journal-title":"Nucleic Acids Res"},{"key":"2022031506271352300_ref15","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1093\/biostatistics\/kxj037","article-title":"Adjusting batch effects in microarray expression data using empirical Bayes methods","volume":"8","author":"Johnson","year":"2007","journal-title":"Biostatistics"},{"key":"2022031506271352300_ref16","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1038\/s41467-017-02554-5","article-title":"A general and flexible method for signal extraction from single-cell RNA-seq data","volume":"9","author":"Risso","year":"2018","journal-title":"Nat Commun"},{"key":"2022031506271352300_ref17","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1038\/nbt.4091","article-title":"Batch effects in single-cell RNA-sequencing data are corrected by matching mutual nearest neighbors","volume":"36","author":"Haghverdi","year":"2018","journal-title":"Nat Biotechnol"},{"key":"2022031506271352300_ref18","doi-asserted-by":"crossref","first-page":"3573","DOI":"10.1016\/j.cell.2021.04.048","article-title":"Integrated analysis of multimodal single-cell data","volume":"184","author":"Hao","year":"2021","journal-title":"Cell"},{"key":"2022031506271352300_ref19","doi-asserted-by":"crossref","first-page":"9775","DOI":"10.1073\/pnas.1820006116","article-title":"scMerge leverages factor analysis, stable expression, and pseudoreplication to merge multiple single-cell RNA-seq datasets","volume":"116","author":"Lin","year":"2019","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2022031506271352300_ref20","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1038\/s41587-019-0113-3","article-title":"Efficient integration of heterogeneous single-cell transcriptomes using Scanorama","volume":"37","author":"Hie","year":"2019","journal-title":"Nat Biotechnol"},{"key":"2022031506271352300_ref21","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1093\/bioinformatics\/btz625","article-title":"BBKNN: fast batch alignment of single cell transcriptomes","volume":"36","author":"Polanski","year":"2020","journal-title":"Bioinformatics"},{"key":"2022031506271352300_ref22","doi-asserted-by":"crossref","first-page":"1289","DOI":"10.1038\/s41592-019-0619-0","article-title":"Fast, sensitive and accurate integration of single-cell data with Harmony","volume":"16","author":"Korsunsky","year":"2019","journal-title":"Nat Methods"},{"key":"2022031506271352300_ref23","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/s13059-019-1850-9","article-title":"A benchmark of batch-effect correction methods for single-cell RNA sequencing data","volume":"21","author":"Tran","year":"2020","journal-title":"Genome Biol"},{"key":"2022031506271352300_ref24","doi-asserted-by":"crossref","first-page":"3632","DOI":"10.1038\/s41596-020-0391-8","article-title":"Jointly defining cell types from multiple single-cell datasets using LIGER","volume":"15","author":"Liu","year":"2020","journal-title":"Nat Protoc"},{"key":"2022031506271352300_ref25","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1038\/s41592-018-0229-2","article-title":"Deep generative modeling for single-cell transcriptomics","volume":"15","author":"Lopez","year":"2018","journal-title":"Nat Methods"},{"key":"2022031506271352300_ref26","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1038\/s41467-018-07931-2","article-title":"Single-cell RNA-seq denoising using a deep count autoencoder","volume":"10","author":"Eraslan","year":"2019","journal-title":"Nat Commun"},{"key":"2022031506271352300_ref27","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1038\/s41592-019-0494-8","article-title":"scGen predicts single-cell perturbation responses","volume":"16","author":"Lotfollahi","year":"2019","journal-title":"Nat Methods"},{"key":"2022031506271352300_ref28","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cels.2016.08.011","article-title":"A single-cell transcriptomic map of the human and mouse pancreas reveals inter- and intra-cell population structure","volume":"3","author":"Baron","year":"2016","journal-title":"Cell Syst"},{"key":"2022031506271352300_ref29","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1101\/gr.212720.116","article-title":"Single-cell transcriptomes identify human islet cell signatures and reveal cell-type-specific expression changes in type 2 diabetes","volume":"27","author":"Lawlor","year":"2017","journal-title":"Genome Res"},{"key":"2022031506271352300_ref30","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1016\/j.cmet.2016.08.020","article-title":"Single-cell transcriptome profiling of human pancreatic islets in health and type 2 diabetes","volume":"24","author":"Segerstolpe","year":"2016","journal-title":"Cell Metab"},{"key":"2022031506271352300_ref31","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1038\/s41587-020-0465-8","article-title":"Systematic comparison of single-cell and single-nucleus RNA-sequencing methods","volume":"38","author":"Ding","year":"2020","journal-title":"Nat Biotechnol"},{"key":"2022031506271352300_ref32","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1038\/s41592-018-0254-1","article-title":"A test metric for assessing single-cell RNA-seq batch correction","volume":"16","author":"Buttner","year":"2019","journal-title":"Nat Methods"},{"key":"2022031506271352300_ref33","doi-asserted-by":"crossref","first-page":"e42","DOI":"10.1093\/nar\/gkab004","article-title":"Flexible comparison of batch correction methods for single-cell RNA-seq using BatchBench","volume":"49","author":"Chazarra-Gil","year":"2021","journal-title":"Nucleic Acids Res"},{"key":"2022031506271352300_ref34","article-title":"Benchmarking atlas-level data integration in single-cell genomics","author":"Luecken","year":"2021","journal-title":"Nat Methods"},{"key":"2022031506271352300_ref35","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1186\/s13059-017-1305-0","article-title":"Splatter: simulation of single-cell RNA sequencing data","volume":"18","author":"Zappia","year":"2017","journal-title":"Genome Biol"},{"key":"2022031506271352300_ref36","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","article-title":"Silhouettes: a graphical aid to the interpretation and validation of cluster analysis","volume":"20","author":"Rousseeuw","year":"1987","journal-title":"J Comput Appl Math"},{"key":"2022031506271352300_ref37","doi-asserted-by":"crossref","first-page":"e2006687","DOI":"10.1371\/journal.pbio.2006687","article-title":"Quantitative assessment of cell population diversity in single-cell landscapes","volume":"16","author":"Liu","year":"2018","journal-title":"PLoS Biol"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/2\/bbab565\/42805880\/bbab565.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/23\/2\/bbab565\/42805880\/bbab565.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,14]],"date-time":"2023-11-14T01:38:34Z","timestamp":1699925914000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbab565\/6511205"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,19]]},"references-count":37,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2022,3,10]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbab565","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,3]]},"published":{"date-parts":[[2022,1,19]]},"article-number":"bbab565"}}