{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T17:56:04Z","timestamp":1793123764645,"version":"4.5.0"},"update-to":[{"DOI":"10.1371\/journal.pgen.1011420","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,4,2]],"date-time":"2025-04-02T00:00:00Z","timestamp":1743552000000}}],"reference-count":44,"publisher":"Public Library of Science (PLoS)","issue":"3","license":[{"start":{"date-parts":[[2025,3,19]],"date-time":"2025-03-19T00:00:00Z","timestamp":1742342400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006324","name":"National Institute for Basic Biology","doi-asserted-by":"publisher","award":["24NIBB462"],"award-info":[{"award-number":["24NIBB462"]}],"id":[{"id":"10.13039\/501100006324","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosgenetics.org"],"crossmark-restriction":false},"short-container-title":["PLoS Genet"],"abstract":"<jats:p>\n                    Deep learning techniques are increasingly utilized to analyze large-scale single-cell RNA sequencing (scRNA-seq) data, offering valuable insights from complex transcriptome datasets. Geneformer, a pre-trained model using a Transformer Encoder architecture and human scRNA-seq datasets, has demonstrated remarkable success in human transcriptome analysis. However, given the prominence of the mouse,\n                    <jats:italic>Mus musculus<\/jats:italic>\n                    , as a primary mammalian model in biological and medical research, there is an acute need for a mouse-specific version of Geneformer. In this study, we developed a mouse-specific Geneformer (mouse-Geneformer) by constructing a large transcriptome dataset consisting of 21 million mouse scRNA-seq profiles and pre-training Geneformer on this dataset. The mouse-Geneformer effectively models the mouse transcriptome and, upon fine-tuning for downstream tasks, enhances the accuracy of cell type classification. In silico perturbation experiments using mouse-Geneformer successfully identified disease-causing genes that have been validated in in vivo experiments. These results demonstrate the feasibility of analyzing mouse data with mouse-Geneformer and highlight the robustness of the Geneformer architecture, applicable to any species with large-scale transcriptome data available. Furthermore, we found that mouse-Geneformer can analyze human transcriptome data in a cross-species manner. After the ortholog-based gene name conversion, the analysis of human scRNA-seq data using mouse-Geneformer, followed by fine-tuning with human data, achieved cell type classification accuracy comparable to that obtained using the original human Geneformer. In in silico simulation experiments using human disease models, we obtained results similar to human-Geneformer for the myocardial infarction model but only partially consistent results for the COVID-19 model, a trait unique to humans (laboratory mice are not susceptible to SARS-CoV-2). These findings suggest the potential for cross-species application of the Geneformer model while emphasizing the importance of species-specific models for capturing the full complexity of disease mechanisms. Despite the existence of the original Geneformer tailored for humans, human research could benefit from mouse-Geneformer due to its inclusion of samples that are ethically or technically inaccessible for humans, such as embryonic tissues and certain disease models. Additionally, this cross-species approach indicates potential use for non-model organisms, where obtaining large-scale single-cell transcriptome data is challenging.\n                  <\/jats:p>","DOI":"10.1371\/journal.pgen.1011420","type":"journal-article","created":{"date-parts":[[2025,3,19]],"date-time":"2025-03-19T13:55:28Z","timestamp":1742392528000},"page":"e1011420","update-policy":"https:\/\/doi.org\/10.1371\/journal.pgen.corrections_policy","source":"Crossref","is-referenced-by-count":10,"title":["Mouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-2029-5116","authenticated-orcid":true,"given":"Keita","family":"Ito","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tsubasa","family":"Hirakawa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4640-2323","authenticated-orcid":true,"given":"Shuji","family":"Shigenobu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7391-4725","authenticated-orcid":true,"given":"Hironobu","family":"Fujiyoshi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Takayoshi","family":"Yamashita","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2025,3,19]]},"reference":[{"issue":"14","key":"pgen.1011420.ref001","doi-asserted-by":"crossref","first-page":"8845","DOI":"10.1093\/nar\/gku555","article-title":"Single-cell RNA-seq: advances and future challenges","volume":"42","author":"A-E Saliba","year":"2014","journal-title":"Nucleic Acids Res"},{"key":"pgen.1011420.ref002","doi-asserted-by":"crossref","first-page":"W339-44","DOI":"10.1093\/nar\/gkm368","article-title":"MiPred: classification of real and pseudo microRNA precursors using random forest prediction model with combined features","volume":"35","author":"P Jiang","year":"2007","journal-title":"Nucleic Acids Res"},{"issue":"10","key":"pgen.1011420.ref003","doi-asserted-by":"crossref","first-page":"e0205499","DOI":"10.1371\/journal.pone.0205499","article-title":"CaSTLe - classification of single cells by transfer learning: Harnessing the power of publicly available single cell RNA sequencing experiments to annotate new experiments","volume":"13","author":"Y Lieberman","year":"2018","journal-title":"PLoS One"},{"issue":"12","key":"pgen.1011420.ref004","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1038\/s41592-018-0229-2","article-title":"Deep generative modeling for single-cell transcriptomics","volume":"15","author":"R Lopez","year":"2018","journal-title":"Nat Methods"},{"issue":"8","key":"pgen.1011420.ref005","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1038\/s41592-019-0494-8","article-title":"scGen predicts single-cell perturbation responses","volume":"16","author":"M Lotfollahi","year":"2019","journal-title":"Nat Methods"},{"issue":"4","key":"pgen.1011420.ref006","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1038\/s42256-019-0037-0","article-title":"Clustering single-cell RNA-seq data with a model-based deep learning approach","volume":"1","author":"T Tian","year":"2019","journal-title":"Nat Mach Intell"},{"issue":"10","key":"pgen.1011420.ref007","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1038\/s42256-022-00534-z","article-title":"scBERT as a large-scale pretrained deep language model for cell type annotation of single-cell RNA-seq data","volume":"4","author":"F Yang","year":"2022","journal-title":"Nat Mach Intell"},{"issue":"5","key":"pgen.1011420.ref008","doi-asserted-by":"crossref","first-page":"bbad266","DOI":"10.1093\/bib\/bbad266","article-title":"scDeepInsight: a supervised cell-type identification method for scRNA-seq data with deep learning","volume":"24","author":"S Jia","year":"2023","journal-title":"Brief Bioinform"},{"issue":"11","key":"pgen.1011420.ref009","doi-asserted-by":"crossref","first-page":"e1011641","DOI":"10.1371\/journal.pcbi.1011641","article-title":"Attention-based deep clustering method for scRNA-seq cell type identification","volume":"19","author":"S Li","year":"2023","journal-title":"PLoS Comput Biol"},{"issue":"7965","key":"pgen.1011420.ref010","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1038\/s41586-023-06139-9","article-title":"Transfer learning enables predictions in network biology","volume":"618","author":"CV Theodoris","year":"2023","journal-title":"Nature"},{"key":"pgen.1011420.ref011","first-page":"4171","article-title":"BERT: pre-training of deep bidirectional transformers for language understanding.","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) [Internet]","author":"J Devlin","year":"2019"},{"key":"pgen.1011420.ref012","doi-asserted-by":"crossref","first-page":"42476","DOI":"10.1038\/srep42476","article-title":"CRISPR\/Cas9-mediated genome editing in wild-derived mice: generation of tamed wild-derived strains by mutation of the a (nonagouti) gene","volume":"7","author":"M Hirose","year":"2017","journal-title":"Sci Rep"},{"key":"pgen.1011420.ref013","first-page":"baz046","article-title":"PanglaoDB: a web server for exploration of mouse and human single-cell RNA sequencing data","author":"O Franz\u00e9n","year":"2019","journal-title":"Database (Oxford)"},{"issue":"D1","key":"pgen.1011420.ref014","doi-asserted-by":"crossref","first-page":"D129","DOI":"10.1093\/nar\/gkab1030","article-title":"Expression Atlas update: gene and protein expression in multiple species","volume":"50","author":"P Moreno","year":"2022","journal-title":"Nucleic Acids Res"},{"key":"pgen.1011420.ref015","article-title":"Single Cell Portal: an interactive home for single-cell genomics data","author":"L Tarhan","year":"2023","journal-title":"BioRxiv [Internet]"},{"issue":"5696","key":"pgen.1011420.ref016","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1126\/science.1105136","article-title":"The ENCODE (ENCyclopedia Of DNA Elements) project","volume":"306","author":"EA Feingold","year":"2004","journal-title":"Science"},{"key":"pgen.1011420.ref017"},{"key":"pgen.1011420.ref018","article-title":"cellxgene: a performant, scalable exploration platform for high dimensional sparse matrices","author":"C Megill","year":"2021","journal-title":"bioRxiv"},{"issue":"12","key":"pgen.1011420.ref019","doi-asserted-by":"crossref","first-page":"giaa151","DOI":"10.1093\/gigascience\/giaa151","article-title":"SoupX removes ambient RNA contamination from droplet-based single-cell RNA sequencing data","volume":"9","author":"MD Young","year":"2020","journal-title":"Gigascience"},{"issue":"1","key":"pgen.1011420.ref020","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1186\/s13059-020-1950-6","article-title":"Decontamination of ambient RNA in single-cell RNA-seq with DecontX","volume":"21","author":"S Yang","year":"2020","journal-title":"Genome Biol"},{"issue":"4","key":"pgen.1011420.ref021","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/j.cels.2019.03.003","article-title":"DoubletFinder: doublet detection in single-cell rna sequencing data using artificial nearest neighbors","volume":"8","author":"CS McGinnis","year":"2019","journal-title":"Cell Syst"},{"issue":"Suppl_1","key":"pgen.1011420.ref022","doi-asserted-by":"crossref","first-page":"i214","DOI":"10.1093\/bioinformatics\/btab266","article-title":"doubletD: detecting doublets in single-cell DNA sequencing data","volume":"37","author":"LL Weber","year":"2021","journal-title":"Bioinformatics"},{"issue":"16","key":"pgen.1011420.ref023","doi-asserted-by":"crossref","first-page":"4415","DOI":"10.1093\/bioinformatics\/btaa293","article-title":"scVAE: variational auto-encoders for single-cell gene expression data","volume":"36","author":"CH Gr\u00f8nbech","year":"2020","journal-title":"Bioinformatics"},{"issue":"21","key":"pgen.1011420.ref024","doi-asserted-by":"crossref","first-page":"e122","DOI":"10.1093\/nar\/gkab775","article-title":"scDeepSort: a pre-trained cell-type annotation method for single-cell transcriptomics using deep learning with a weighted graph neural network","volume":"49","author":"X Shao","year":"2021","journal-title":"Nucleic Acids Res"},{"issue":"11","key":"pgen.1011420.ref025","doi-asserted-by":"crossref","first-page":"872","DOI":"10.1002\/pros.24020","article-title":"Urethral luminal epithelia are castration-insensitive cells of the proximal prostate","volume":"80","author":"DB Joseph","year":"2020","journal-title":"Prostate"},{"issue":"7","key":"pgen.1011420.ref026","doi-asserted-by":"crossref","first-page":"1176","DOI":"10.1038\/s41588-023-01435-6","article-title":"Spatiotemporal transcriptomic maps of whole mouse embryos at the onset of organogenesis","volume":"55","author":"A Sampath Kumar","year":"2023","journal-title":"Nat Genet"},{"issue":"4","key":"pgen.1011420.ref027","doi-asserted-by":"crossref","first-page":"104097","DOI":"10.1016\/j.isci.2022.104097","article-title":"High-resolution Slide-seqV2 spatial transcriptomics enables discovery of disease-specific cell neighborhoods and pathways","volume":"25","author":"JL Marshall","year":"2022","journal-title":"iScience"},{"issue":"7817","key":"pgen.1011420.ref028","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1038\/s41586-020-2496-1","article-title":"A single-cell transcriptomic atlas characterizes ageing tissues in the mouse","volume":"583","author":"Tabula Muris Consortium","year":"2020","journal-title":"Nature"},{"key":"pgen.1011420.ref029","article-title":"Deep unsupervised clustering with gaussian mixture variational autoencoders [Internet]","author":"N Dilokthanakul","year":"2017","journal-title":"arXiv"},{"key":"pgen.1011420.ref030","article-title":"Categorical Reparameterization with Gumbel-Softmax","author":"E Jang","year":"2022"},{"key":"pgen.1011420.ref031","article-title":"The concrete distribution: a continuous relaxation of discrete random variables","author":"CJ Maddison","year":"2022"},{"key":"pgen.1011420.ref032","author":"TN Kipf","year":"2022"},{"key":"pgen.1011420.ref033","article-title":"UMAP: uniform manifold approximation and projection for dimension reduction [Internet]","author":"L McInnes","year":"2020","journal-title":"arXiv"},{"issue":"5","key":"pgen.1011420.ref034","doi-asserted-by":"crossref","first-page":"1156-1169.e12","DOI":"10.1016\/j.cell.2020.07.011","article-title":"Ubiquitin ligase COP1 suppresses neuroinflammation by degrading c\/EBP\u03b2 in microglia","volume":"182","author":"A Ndoja","year":"2020","journal-title":"Cell"},{"issue":"1","key":"pgen.1011420.ref035","article-title":"Searching the mouse genome informatics (MGI) resources for information on mouse biology from genotype to phenotype","volume":"56","author":"DR Shaw","year":"2016","journal-title":"CP Bioinf [Internet]"},{"key":"pgen.1011420.ref036","article-title":"The HUGO Gene Nomenclature Committee (HGNC)","volume-title":"Human Genetics [Internet]6","author":"109","year":"2001"},{"issue":"7972","key":"pgen.1011420.ref037","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1038\/s41586-023-06252-9","article-title":"A spatially resolved single-cell genomic atlas of the adult human breast","volume":"620","author":"T Kumar","year":"2023","journal-title":"Nature"},{"issue":"6","key":"pgen.1011420.ref038","doi-asserted-by":"crossref","first-page":"1088","DOI":"10.1016\/j.immuni.2020.03.019","article-title":"Integrated scRNA-Seq identifies human postnatal thymus seeding progenitors and regulatory dynamics of differentiating immature thymocytes","volume":"52","author":"M Lavaert","year":"2020","journal-title":"Immunity"},{"issue":"6667","key":"pgen.1011420.ref039","doi-asserted-by":"crossref","first-page":"eadd7046","DOI":"10.1126\/science.add7046","article-title":"Transcriptomic diversity of cell types across the adult human brain","volume":"382","author":"K Siletti","year":"2023","journal-title":"Science"},{"issue":"7924","key":"pgen.1011420.ref040","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1038\/s41586-022-05060-x","article-title":"Spatial multi-omic map of human myocardial infarction","volume":"608","author":"C Kuppe","year":"2022","journal-title":"Nature"},{"key":"pgen.1011420.ref041","first-page":"103115","article-title":"An interactive single cell web portal identifies gene and cell networks in COVID-19 host responses","volume-title":"iScience2024 Aug 6","author":"K Jin","year":"2021"},{"issue":"8","key":"pgen.1011420.ref042","doi-asserted-by":"crossref","first-page":"1470","DOI":"10.1038\/s41592-024-02201-0","article-title":"scGPT: toward building a foundation model for single-cell multi-omics using generative AI","volume":"21","author":"H Cui","year":"2024","journal-title":"Nat Methods"},{"issue":"1","key":"pgen.1011420.ref043","first-page":"50-58.e8","article-title":"Pathogenesis of SARS-CoV-2 in transgenic mice expressing human angiotensin-converting enzyme 2","volume":"182","author":"R-D Jiang","year":"2020","journal-title":"Cell"},{"issue":"7798","key":"pgen.1011420.ref044","doi-asserted-by":"crossref","first-page":"270","DOI":"10.1038\/s41586-020-2012-7","article-title":"A pneumonia outbreak associated with a new coronavirus of probable bat origin","volume":"579","author":"P Zhou","year":"2020","journal-title":"Nature"}],"updated-by":[{"DOI":"10.1371\/journal.pgen.1011420","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,4,2]],"date-time":"2025-04-02T00:00:00Z","timestamp":1743552000000}}],"container-title":["PLOS Genetics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pgen.1011420","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,2]],"date-time":"2025-04-02T19:45:26Z","timestamp":1743623126000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pgen.1011420"}},"subtitle":[],"editor":[{"given":"Jingjing","family":"Yang,","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2025,3,19]]},"references-count":44,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3,19]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pgen.1011420","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.09.09.611960","asserted-by":"object"}]},"ISSN":["1553-7404"],"issn-type":[{"value":"1553-7404","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,19]]}}}