{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T11:43:42Z","timestamp":1753875822873,"version":"3.41.2"},"reference-count":50,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T00:00:00Z","timestamp":1708041600000},"content-version":"vor","delay-in-days":25,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2021YFF1200902"],"award-info":[{"award-number":["2021YFF1200902"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["32270689","12126305"],"award-info":[{"award-number":["32270689","12126305"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,1,22]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The evolution in single-cell RNA sequencing (scRNA-seq) technology has opened a new avenue for researchers to inspect cellular heterogeneity with single-cell precision. One crucial aspect of this technology is cell-type annotation, which is fundamental for any subsequent analysis in single-cell data mining. Recently, the scientific community has seen a surge in the development of automatic annotation methods aimed at this task. However, these methods generally operate at a steady-state total cell-type capacity, significantly restricting the cell annotation systems'capacity for continuous knowledge acquisition. Furthermore, creating a unified scRNA-seq annotation system remains challenged by the need to progressively expand its understanding of ever-increasing cell-type concepts derived from a continuous data stream. In response to these challenges, this paper presents a novel and challenging setting for annotation, namely cell-type incremental annotation. This concept is designed to perpetually enhance cell-type knowledge, gleaned from continuously incoming data. This task encounters difficulty with data stream samples that can only be observed once, leading to catastrophic forgetting. To address this problem, we introduce our breakthrough methodology termed scEVOLVE, an incremental annotation method. This innovative approach is built upon the methodology of contrastive sample replay combined with the fundamental principle of partition confidence maximization. Specifically, we initially retain and replay sections of the old data in each subsequent training phase, then establish a unique prototypical learning objective to mitigate the cell-type imbalance problem, as an alternative to using cross-entropy. To effectively emulate a model that trains concurrently with complete data, we introduce a cell-type decorrelation strategy that efficiently scatters feature representations of each cell type uniformly. We constructed the scEVOLVE framework with simplicity and ease of integration into most deep softmax-based single-cell annotation methods. Thorough experiments conducted on a range of meticulously constructed benchmarks consistently prove that our methodology can incrementally learn numerous cell types over an extended period, outperforming other strategies that fail quickly. As far as our knowledge extends, this is the first attempt to propose and formulate an end-to-end algorithm framework to address this new, practical task. Additionally, scEVOLVE, coded in Python using the Pytorch machine-learning library, is freely accessible at https:\/\/github.com\/aimeeyaoyao\/scEVOLVE.<\/jats:p>","DOI":"10.1093\/bib\/bbae039","type":"journal-article","created":{"date-parts":[[2024,2,17]],"date-time":"2024-02-17T07:25:40Z","timestamp":1708154740000},"source":"Crossref","is-referenced-by-count":2,"title":["scEVOLVE: cell-type incremental annotation without forgetting for single-cell RNA-seq data"],"prefix":"10.1093","volume":"25","author":[{"given":"Yuyao","family":"Zhai","sequence":"first","affiliation":[{"name":"School of Mathematical Sciences, Peking University , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liang","family":"Chen","sequence":"additional","affiliation":[{"name":"Huawei Technologies Co., Ltd. , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Minghua","family":"Deng","sequence":"additional","affiliation":[{"name":"School of Mathematical Sciences, Peking University , Beijing , China"},{"name":"Center for Statistical Science, Peking University , Beijing , China"},{"name":"Center for Quantitative Biology, Peking University , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2024,2,14]]},"reference":[{"issue":"4","key":"2024021707242309100_ref1","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1016\/j.molcel.2015.04.005","article-title":"The technology and biology of single-cell RNA sequencing","volume":"58","author":"Kolodziejczyk","year":"2015","journal-title":"Mol Cell"},{"issue":"6","key":"2024021707242309100_ref2","doi-asserted-by":"crossref","first-page":"737","DOI":"10.1038\/s41587-020-0465-8","article-title":"Systematic comparison of single-cell and single-nucleus RNA-sequencing methods","volume":"38","author":"Ding","year":"2020","journal-title":"Nat Biotechnol"},{"issue":"1","key":"2024021707242309100_ref3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13059-020-1926-6","article-title":"Eleven grand challenges in single-cell data science","volume":"21","author":"L\u00e4hnemann","year":"2020","journal-title":"Genome Biol"},{"issue":"7","key":"2024021707242309100_ref4","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1038\/s41581-020-0262-0","article-title":"Tools for the analysis of high-dimensional single-cell RNA sequencing data","volume":"16","author":"Yan","year":"2020","journal-title":"Nat Rev Nephrol"},{"issue":"3","key":"2024021707242309100_ref5","doi-asserted-by":"crossref","first-page":"100882","DOI":"10.1016\/j.isci.2020.100882","article-title":"scCATCH: automatic annotation on cell types of clusters from single-cell RNA sequencing data","volume":"23","author":"Shao","year":"2020","journal-title":"Iscience"},{"key":"2024021707242309100_ref6","doi-asserted-by":"crossref","first-page":"888786","DOI":"10.3389\/fgene.2022.888786","article-title":"Gene regulatory identification based on the novel hybrid time-delayed method","volume":"13","author":"Bao","year":"2022","journal-title":"Front Genet"},{"key":"2024021707242309100_ref7","doi-asserted-by":"crossref","first-page":"1197824","DOI":"10.3389\/fnins.2023.1197824","article-title":"Golgi_df: Golgi proteins classification with deep forest","volume":"17","author":"Bao","year":"2023","journal-title":"Front Neurosci"},{"issue":"1","key":"2024021707242309100_ref8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13059-019-1795-z","article-title":"A comparison of automatic cell identification methods for single-cell RNA sequencing data","volume":"20","author":"Abdelaal","year":"2019","journal-title":"Genome Biol"},{"key":"2024021707242309100_ref9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13059-017-1382-0","article-title":"SCANPY: large-scale single-cell gene expression data analysis","volume":"19","author":"Wolf","year":"2018","journal-title":"Genome Biol"},{"issue":"7","key":"2024021707242309100_ref10","doi-asserted-by":"crossref","first-page":"792","DOI":"10.3390\/genes11070792","article-title":"Integrating deep supervised, self-supervised and unsupervised learning for single-cell RNA-seq clustering and annotation","volume":"11","author":"Chen","year":"2020","journal-title":"Genes"},{"issue":"5","key":"2024021707242309100_ref11","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1038\/nmeth.4644","article-title":"scmap: projection of single-cell RNA-seq data across data sets","volume":"15","author":"Kiselev","year":"2018","journal-title":"Nat Methods"},{"issue":"5","key":"2024021707242309100_ref12","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1038\/nbt.3192","article-title":"Spatial reconstruction of single-cell gene expression data","volume":"33","author":"Satija","year":"2015","journal-title":"Nat Biotechnol"},{"issue":"1","key":"2024021707242309100_ref13","doi-asserted-by":"crossref","first-page":"e9620","DOI":"10.15252\/msb.20209620","article-title":"Probabilistic harmonization and annotation of single-cell transcriptomics data with deep generative models","volume":"17","author":"Chenling","year":"2021","journal-title":"Mol Syst Biol"},{"issue":"12","key":"2024021707242309100_ref14","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1038\/s41592-020-00979-3","article-title":"Mars: discovering novel cell types across heterogeneous single-cell experiments","volume":"17","author":"Brbi\u0107","year":"2020","journal-title":"Nat Methods"},{"issue":"1","key":"2024021707242309100_ref15","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1038\/s41587-021-01001-7","article-title":"Mapping single-cell data to reference atlases by transfer learning","volume":"40","author":"Lotfollahi","year":"2022","journal-title":"Nat Biotechnol"},{"key":"2024021707242309100_ref16","first-page":"2001","article-title":"iCaRL: incremental classifier and representation learning","volume-title":"Proceedings of the IEEE conference on Computer Vision and Pattern Recognition","author":"Rebuffi","year":"2017"},{"issue":"12","key":"2024021707242309100_ref17","doi-asserted-by":"crossref","first-page":"2935","DOI":"10.1109\/TPAMI.2017.2773081","article-title":"Learning without forgetting","volume":"40","author":"Li","year":"2017","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"article-title":"An empirical investigation of catastrophic forgetting in gradient-based neural networks","year":"2013","author":"Goodfellow","key":"2024021707242309100_ref18"},{"key":"2024021707242309100_ref19","first-page":"3521","article-title":"Overcoming catastrophic forgetting in neural networks","volume-title":"Proc Natl Acad Sci","author":"Kirkpatrick","year":"2017"},{"key":"2024021707242309100_ref20","article-title":"Experience replay for continual learning","volume":"32","author":"Rolnick","year":"2019","journal-title":"Adv Neural Inf Process Syst"},{"key":"2024021707242309100_ref21","article-title":"Gradient episodic memory for continual learning","volume":"30","author":"Lopez-Paz","year":"2017","journal-title":"Adv Neural Inf Process Syst"},{"key":"2024021707242309100_ref22","first-page":"1320","article-title":"Encoder based lifelong learning","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Rannen","year":"2017"},{"key":"2024021707242309100_ref23","doi-asserted-by":"crossref","first-page":"2262","DOI":"10.1109\/ICPR.2018.8545895","article-title":"Rotate your networks: better weight consolidation and less catastrophic forgetting","volume-title":"2018 24th International Conference on Pattern Recognition (ICPR)","author":"Liu","year":"2018"},{"article-title":"Progressive neural networks","year":"2016","author":"Rusu","key":"2024021707242309100_ref24"},{"key":"2024021707242309100_ref25","first-page":"7765","article-title":"PackNet: adding multiple tasks to a single network by iterative pruning","volume-title":"Proceedings of the IEEE conference on Computer Vision and Pattern Recognition","author":"Mallya","year":"2018"},{"issue":"7","key":"2024021707242309100_ref26","first-page":"3366","article-title":"A continual learning survey: defying forgetting in classification tasks","volume":"44","author":"De Lange","year":"2021","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"5","key":"2024021707242309100_ref27","doi-asserted-by":"crossref","first-page":"5513","DOI":"10.1109\/TPAMI.2022.3213473","article-title":"Class-incremental learning: survey and performance evaluation on image classification","volume":"45","author":"Masana","year":"2022","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"1","key":"2024021707242309100_ref28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13059-019-1862-5","article-title":"scPred: accurate supervised method for cell-type classification from single-cell RNA-seq data","volume":"20","author":"Alquicira-Hernandez","year":"2019","journal-title":"Genome Biol"},{"issue":"1","key":"2024021707242309100_ref29","doi-asserted-by":"crossref","first-page":"3458","DOI":"10.1038\/s41467-020-17281-7","article-title":"Searching large-scale scRNA-seq databases via unbiased cell embedding with cell blast","volume":"11","author":"Cao","year":"2020","journal-title":"Nat Commun"},{"issue":"10","key":"2024021707242309100_ref30","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1038\/s42256-022-00534-z","article-title":"scBERT as a large-scale pretrained deep language model for cell type annotation of single-cell RNA-seq data","volume":"4","author":"Yang","year":"2022","journal-title":"Nat Mach Intell"},{"issue":"6","key":"2024021707242309100_ref31","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1093\/bioinformatics\/btaa908","article-title":"Single-cell RNA-seq data semi-supervised clustering and annotation via structural regularized domain adaptation","volume":"37","author":"Chen","year":"2021","journal-title":"Bioinformatics"},{"issue":"10","key":"2024021707242309100_ref32","doi-asserted-by":"crossref","first-page":"e57","DOI":"10.1093\/nar\/gkac084","article-title":"CellDART: cell type inference by domain adaptation of single-cell and spatial transcriptomic data","volume":"50","author":"Bae","year":"2022","journal-title":"Nucleic Acids Res"},{"issue":"2","key":"2024021707242309100_ref33","doi-asserted-by":"crossref","first-page":"bbad045","DOI":"10.1093\/bib\/bbad045","article-title":"scGAD: a new task and end-to-end framework for generalized cell type annotation and discovery","volume":"24","author":"Zhai","year":"2023","journal-title":"Brief Bioinform"},{"key":"2024021707242309100_ref34","first-page":"5402","article-title":"Generalized cell type annotation and discovery for single-cell RNA-seq data","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Zhai","year":"2023"},{"key":"2024021707242309100_ref35","doi-asserted-by":"crossref","first-page":"4967","DOI":"10.24963\/ijcai.2023\/552","article-title":"Realistic cell type annotation and discovery for single-cell RNA-seq data","volume-title":"Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence","author":"Zhai","year":"2023"},{"key":"2024021707242309100_ref36","doi-asserted-by":"crossref","DOI":"10.1038\/s41467-018-07931-2","article-title":"Single-cell RNA-seq denoising using a deep count autoencoder","volume":"10","author":"Eraslan","year":"2019","journal-title":"Nat Commun"},{"key":"2024021707242309100_ref37","first-page":"9729","article-title":"Momentum contrast for unsupervised visual representation learning","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"He","year":"2020"},{"key":"2024021707242309100_ref38","first-page":"18661","article-title":"Supervised contrastive learning","volume":"33","author":"Khosla","year":"2020","journal-title":"Adv Neural Inf Process Syst"},{"key":"2024021707242309100_ref39","first-page":"9598","article-title":"On feature decorrelation in self-supervised learning","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Hua","year":"2021"},{"key":"2024021707242309100_ref40","first-page":"791","article-title":"Decorrelated batch normalization","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Huang","year":"2018"},{"issue":"6352","key":"2024021707242309100_ref41","doi-asserted-by":"crossref","first-page":"661","DOI":"10.1126\/science.aam8940","article-title":"Comprehensive single-cell transcriptional profiling of a multicellular organism","volume":"357","author":"Cao","year":"2017","journal-title":"Science"},{"issue":"7727","key":"2024021707242309100_ref42","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1038\/s41586-018-0590-4","article-title":"Single-cell transcriptomics of 20 mouse organs creates a Tabula Muris: the Tabula Muris Consortium","volume":"562","author":"Schaum","year":"2018","journal-title":"Nature"},{"issue":"4","key":"2024021707242309100_ref43","doi-asserted-by":"crossref","first-page":"999","DOI":"10.1016\/j.cell.2018.06.021","article-title":"Molecular architecture of the mouse nervous system","volume":"174","author":"Zeisel","year":"2018","journal-title":"Cell"},{"key":"2024021707242309100_ref44","doi-asserted-by":"crossref","DOI":"10.1126\/science.aba7721","article-title":"A human cell atlas of fetal gene expression","volume":"370","author":"Cao","year":"2020","journal-title":"Science"},{"issue":"7","key":"2024021707242309100_ref45","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1038\/s41422-021-00467-z","article-title":"Dissecting human embryonic skeletal stem cell ontogeny by single-cell transcriptomic and functional analyses","volume":"31","author":"He","year":"2021","journal-title":"Cell Res"},{"issue":"1","key":"2024021707242309100_ref46","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s13059-019-1906-x","article-title":"scRNA-seq assessment of the human lung, spleen, and esophagus tissue stability after cold preservation","volume":"21","author":"Madissoon","year":"2020","journal-title":"Genome Biol"},{"issue":"6460","key":"2024021707242309100_ref47","doi-asserted-by":"crossref","first-page":"1461","DOI":"10.1126\/science.aat5031","article-title":"Spatiotemporal immune zonation of the human kidney","volume":"365","author":"Stewart","year":"2019","journal-title":"Science"},{"issue":"7731","key":"2024021707242309100_ref48","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1038\/s41586-018-0698-6","article-title":"Single-cell reconstruction of the early maternal\u2013fetal interface in humans","volume":"563","author":"Vento-Tormo","year":"2018","journal-title":"Nature"},{"key":"2024021707242309100_ref49","first-page":"bbad195","article-title":"CIForm as a transformer-based model for cell-type annotation of large-scale single-cell RNA-seq data","author":"Jing","year":"2023","journal-title":"Brief Bioinform"},{"issue":"11","key":"2024021707242309100_ref50","article-title":"Visualizing data using t-SNE","volume":"9","author":"Van der Maaten","year":"2008","journal-title":"J Mach Learn Res"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/2\/bbae039\/56676954\/bbae039.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/25\/2\/bbae039\/56676954\/bbae039.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,9]],"date-time":"2024-11-09T02:48:13Z","timestamp":1731120493000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbae039\/7607902"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,22]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,1,22]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbae039","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"type":"print","value":"1467-5463"},{"type":"electronic","value":"1477-4054"}],"subject":[],"published-other":{"date-parts":[[2024,3,1]]},"published":{"date-parts":[[2024,1,22]]},"article-number":"bbae039"}}