{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"institution":[{"name":"bioRxiv"}],"indexed":{"date-parts":[[2026,11,16]],"date-time":"2026-11-16T19:42:56Z","timestamp":1794858176079,"version":"4.9.1"},"posted":{"date-parts":[[2025,4,29]]},"group-title":"Systems Biology","reference-count":66,"publisher":"openRxiv","license":[{"start":{"date-parts":[[2025,4,29]],"date-time":"2025-04-29T00:00:00Z","timestamp":1745884800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"accepted":{"date-parts":[[2025,10,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                <jats:p>Single-cell transcriptomics has revolutionized our understanding of cellular diversity, yet our understanding of the transcriptional programs across the tree of life remains limited. Here we present TranscriptFormer, a family of generative foundation models trained on up to 112 million cells spanning 1.53 billion years of evolution across 12 species. By jointly modeling gene identities and expression levels using a novel generative architecture, TranscriptFormer encodes multi-scale biological structure, functioning as a queryable virtual cell atlas. We demonstrate state-of-the-art performance on both in-distribution and out-of-distribution cell type classification, with robust performance even for species separated by over 685 million years of evolution. TranscriptFormer can also perform zero-shot disease state identification in human cells and accurately transfers cell state annotations across species boundaries. As a generative model, TranscriptFormer can be prompted to predict cell type-specific transcription factors and gene-gene interactions that align with independent experimental observations. Developmental trajectories, phylogenetic relationships and cellular hierarchies emerge naturally in TranscriptFormer\u2019s representations without any explicit training on these annotations. This work establishes a powerful framework for quantitative single-cell analysis, and comparative cellular biology, thus demonstrating that universal principles of cellular organization can be learned and predicted across the tree of life.<\/jats:p>","DOI":"10.1101\/2025.04.25.650731","type":"posted-content","created":{"date-parts":[[2025,4,29]],"date-time":"2025-04-29T16:35:11Z","timestamp":1745944511000},"source":"Crossref","is-referenced-by-count":37,"title":["A Cross-Species Generative Cell Atlas Across 1.5 Billion Years of Evolution: The TranscriptFormer Single-cell Model"],"prefix":"10.64898","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-4186-5516","authenticated-orcid":false,"given":"James D","family":"Pearce","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3438-3559","authenticated-orcid":false,"given":"Sara E","family":"Simmonds","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gita","family":"Mahmoudabadi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lakshmi","family":"Krishnan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8004-4462","authenticated-orcid":false,"given":"Giovanni","family":"Palla","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7953-5168","authenticated-orcid":false,"given":"Ana-Maria","family":"Istrate","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Tarashansky","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3010-2334","authenticated-orcid":false,"given":"Benjamin","family":"Nelson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9578-5449","authenticated-orcid":false,"given":"Omar","family":"Valenzuela","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3335-4537","authenticated-orcid":false,"given":"Donghui","family":"Li","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1613-0809","authenticated-orcid":false,"given":"Stephen R","family":"Quake","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0296-3092","authenticated-orcid":false,"given":"Theofanis","family":"Karaletsos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"54368","reference":[{"issue":"6568","key":"2025101502101472000_2025.04.25.650731v2.1","first-page":"717","article-title":"Profiling cellular diversity in sponges informs animal cell type and nervous system evolution","volume":"374","year":"2021","journal-title":"en. In: Science"},{"issue":"19","key":"2025101502101472000_2025.04.25.650731v2.2","first-page":"dev198614","article-title":"Developmental single-cell transcriptomics in the Lytechinus varie-gatus sea urchin embryo","volume":"148","year":"2021","journal-title":"en. In: Development"},{"issue":"1","key":"2025101502101472000_2025.04.25.650731v2.3","first-page":"8","article-title":"Updated single cell reference atlas for the starlet anemone Ne-matostella vectensis","volume":"21","year":"2024","journal-title":"en. In: Front. Zool"},{"key":"2025101502101472000_2025.04.25.650731v2.4","doi-asserted-by":"crossref","unstructured":"J. A. Briggs et al. \u201cThe dynamics of gene expression in vertebrate embryogenesis at single-cell resolution\u201d. en. In: Science 360.6392 (June 2018).","DOI":"10.1126\/science.aar5780"},{"issue":"6392","key":"2025101502101472000_2025.04.25.650731v2.5","first-page":"981","article-title":"Single-cell mapping of gene expression landscapes and lineage in the zebrafish embryo","volume":"360","year":"2018","journal-title":"en. In: Science"},{"issue":"7817","key":"2025101502101472000_2025.04.25.650731v2.6","first-page":"590","article-title":"A single-cell transcriptomic atlas characterizes ageing tissues in the mouse","volume":"583","author":"Tabula Muris Consortium","year":"2020","journal-title":"en. In: Nature"},{"issue":"4","key":"2025101502101472000_2025.04.25.650731v2.7","first-page":"543","article-title":"A single-cell Arabidopsis root atlas reveals developmental trajectories in wild-type and cell identity mutants","volume":"57","year":"2022","journal-title":"en. In: Dev. Cell"},{"issue":"D1","key":"2025101502101472000_2025.04.25.650731v2.8","first-page":"D886","article-title":"CZ CELLxGENE Discover: a single-cell data platform for scalable exploration, analysis and modeling of aggregated data","volume":"53","author":"CZI Cell Science Program","year":"2025","journal-title":"en. In: Nucleic Acids Res"},{"issue":"8048","key":"2025101502101472000_2025.04.25.650731v2.9","first-page":"1065","article-title":"The Human Cell Atlas from a cell census to a unified foundation model","volume":"637","year":"2025","journal-title":"en. In: Nature"},{"key":"2025101502101472000_2025.04.25.650731v2.10","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2019.05.031"},{"key":"2025101502101472000_2025.04.25.650731v2.11","doi-asserted-by":"publisher","DOI":"10.1038\/nbt.4096"},{"key":"2025101502101472000_2025.04.25.650731v2.12","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-0969-x"},{"key":"2025101502101472000_2025.04.25.650731v2.13","doi-asserted-by":"publisher","DOI":"10.1016\/j.cell.2021.04.048"},{"key":"2025101502101472000_2025.04.25.650731v2.14","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.66747"},{"issue":"6637","key":"2025101502101472000_2025.04.25.650731v2.15","first-page":"1123","article-title":"Evolutionary-scale prediction of atomic-level protein structure with a language model","volume":"379","year":"2023","journal-title":"en. In: Science"},{"key":"2025101502101472000_2025.04.25.650731v2.16","doi-asserted-by":"crossref","unstructured":"H. Bian et al. \u201cScMulan: A multitask generative pre-trained language model for single-cell analysis\u201d. en. In: Lecture Notes in Computer Science. Lecture notes in computer science. Cham: Springer Nature Switzerland, 2024, pp. 479\u2013482.","DOI":"10.1007\/978-1-0716-3989-4_57"},{"issue":"8","key":"2025101502101472000_2025.04.25.650731v2.17","first-page":"1481","article-title":"Large-scale foundation model on single-cell transcriptomics","volume":"21","year":"2024","journal-title":"en. In: Nat. Methods"},{"issue":"8","key":"2025101502101472000_2025.04.25.650731v2.18","first-page":"1470","article-title":"scGPT: toward building a foundation model for single-cell multi-omics using generative AI","volume":"21","year":"2024","journal-title":"en. In: Nat. Methods"},{"issue":"12","key":"2025101502101472000_2025.04.25.650731v2.19","first-page":"830","article-title":"GeneCompass: deciphering universal gene regulatory mechanisms with a knowledge-informed cross-species foundation model","volume":"34","year":"2024","journal-title":"en. In: Cell Res"},{"key":"2025101502101472000_2025.04.25.650731v2.20","doi-asserted-by":"crossref","unstructured":"A. C. Schaar et al. \u201cNicheformer: a foundation model for single-cell and spatial omics\u201d. en. In: bioRxiv (Apr. 2024), p. 2024.04.15.589472.","DOI":"10.2139\/ssrn.4803291"},{"issue":"1","key":"2025101502101472000_2025.04.25.650731v2.21","first-page":"3607","article-title":"scPRINT: pre-training on 50 million cells allows robust gene network predictions","volume":"16","year":"2025","journal-title":"en. In: Nat. Commun"},{"key":"2025101502101472000_2025.04.25.650731v2.22","doi-asserted-by":"crossref","unstructured":"Y. Rosen et al. \u201cUniversal Cell Embeddings: A Foundation Model for Cell Biology\u201d. en. In: bioRxiv (Nov. 2023), p. 2023.11.28.568918.","DOI":"10.1101\/2023.11.28.568918"},{"key":"2025101502101472000_2025.04.25.650731v2.23","doi-asserted-by":"crossref","unstructured":"G. Lample , L. Denoyer , and M. Ranzato . \u201cUnsupervised Machine Translation Using Monolingual Corpora Only\u201d. In: International Conference on Learning Representations (ICLR). 2018.","DOI":"10.18653\/v1\/D18-1549"},{"key":"2025101502101472000_2025.04.25.650731v2.24","doi-asserted-by":"crossref","unstructured":"J. Zhang et al. \u201cTahoe-100M: A Giga-Scale Single-Cell Perturbation Atlas for Context-Dependent Gene Function and Cellular Modeling\u201d. In: bioRxiv (2025), pp. 2025\u201302.","DOI":"10.1101\/2025.02.20.639398"},{"issue":"7","key":"2025101502101472000_2025.04.25.650731v2.25","first-page":"1812","article-title":"TimeTree: A resource for time-lines, timetrees, and divergence times","volume":"34","year":"2017","journal-title":"en. In: Mol. Biol. Evol"},{"key":"2025101502101472000_2025.04.25.650731v2.26","unstructured":"G. Mahmoudabadi et al. \u201cCytoType: A simple and interpretable, cross-species procedure for cell type classification from single-cell transcriptomics\u201d. In: personal communication. 2025."},{"issue":"7943","key":"2025101502101472000_2025.04.25.650731v2.27","first-page":"308","article-title":"The molecular evolution of spermatogenesis across mammals","volume":"613","year":"2023","journal-title":"en. In: Nature"},{"issue":"7730","key":"2025101502101472000_2025.04.25.650731v2.28","first-page":"197","article-title":"Gene expression variability across cells and species shapes innate immunity","volume":"563","year":"2018","journal-title":"In: Nature"},{"key":"2025101502101472000_2025.04.25.650731v2.29","doi-asserted-by":"publisher","DOI":"10.1101\/2024.11.28.625303"},{"issue":"7965","key":"2025101502101472000_2025.04.25.650731v2.30","first-page":"616","article-title":"Transfer learning enables predictions in network biology","volume":"618","year":"2023","journal-title":"en. In: Nature"},{"key":"2025101502101472000_2025.04.25.650731v2.31","doi-asserted-by":"publisher","DOI":"10.1038\/s41592-018-0229-2"},{"key":"2025101502101472000_2025.04.25.650731v2.32","unstructured":"S. R. Quake and The Tabula Sapiens Consortium. \u201cTabula Sapiens reveals transcription factor expression, senescence effects, and sex-specific features in cell types from 28 human organs and tissues\u201d. en. In: bioRxiv (Dec. 2024), p. 2024.12.03.626516."},{"key":"2025101502101472000_2025.04.25.650731v2.33","doi-asserted-by":"crossref","unstructured":"T. T.-H. Wu et al. \u201cInterstitial macrophages are a focus of viral takeover and in-flammation in COVID-19 initiation in human lung\u201d. en. In: J. Exp. Med. 221.6 (June 2024).","DOI":"10.1084\/jem.20232192"},{"key":"2025101502101472000_2025.04.25.650731v2.34","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.60005"},{"issue":"2","key":"2025101502101472000_2025.04.25.650731v2.35","first-page":"119","article-title":"Expression of a Lung Developmental Cassette in the Adult and Developing Zebrafish Swimbladder: Swimbladder Gene Expression","volume":"15","year":"2013","journal-title":"In: Evolution & Development"},{"issue":"12","key":"2025101502101472000_2025.04.25.650731v2.36","first-page":"2463","article-title":"Hematopoiesis","volume":"140","year":"2013","journal-title":"In: Development"},{"issue":"1","key":"2025101502101472000_2025.04.25.650731v2.37","first-page":"1","article-title":"Coelomocytes: Biology and Possible Immune Functions in Invertebrates with Special Remarks on Nematodes","volume":"2009","year":"2009","journal-title":"In: International Journal of Zoology"},{"issue":"D1","key":"2025101502101472000_2025.04.25.650731v2.38","first-page":"D638","article-title":"The STRING database in 2023: protein-protein association networks and functional enrichment analyses for any sequenced genome of interest","volume":"51","year":"2023","journal-title":"en. In: Nucleic Acids Res"},{"issue":"17","key":"2025101502101472000_2025.04.25.650731v2.39","first-page":"5458","article-title":"Characterization of E2F8, a novel E2F-like cell-cycle regulated repressor of E2F-activated transcription","volume":"33","year":"2005","journal-title":"en. In: Nucleic Acids Res"},{"issue":"21","key":"2025101502101472000_2025.04.25.650731v2.40","first-page":"3802","article-title":"Regulation of Geminin and Cdt1 expression by E2F transcription factors","volume":"23","year":"2004","journal-title":"en. In: Oncogene"},{"issue":"2","key":"2025101502101472000_2025.04.25.650731v2.41","first-page":"126","article-title":"FoxM1 is required for execution of the mitotic programme and chromosome stability","volume":"7","year":"2005","journal-title":"en. In: Nat. Cell Biol"},{"issue":"1","key":"2025101502101472000_2025.04.25.650731v2.42","first-page":"116","article-title":"The critical role of dysregulated Hh-FOXM1-TPX2 signaling in human hepatocellular carcinoma cell proliferation","volume":"18","year":"2020","journal-title":"en. In: Cell Commun. Signal"},{"issue":"1","key":"2025101502101472000_2025.04.25.650731v2.43","first-page":"54","article-title":"Kinesin family member 18B activates mTORC1 signaling via actin gamma 1 to promote the recurrence of human hepatocellular carcinoma","volume":"12","year":"2023","journal-title":"en. In: Oncogenesis"},{"issue":"5","key":"2025101502101472000_2025.04.25.650731v2.44","first-page":"474","article-title":"The MuvB complex sequentially recruits B-Myb and FoxM1 to promote mitotic gene expression","volume":"26","year":"2012","journal-title":"en. In: Genes Dev"},{"issue":"4","key":"2025101502101472000_2025.04.25.650731v2.45","first-page":"399","article-title":"PU.1 and Spi-B are required for normal B cell receptor-mediated signal transduction","volume":"10","year":"1999","journal-title":"en. In: Immunity"},{"key":"2025101502101472000_2025.04.25.650731v2.46","first-page":"1250719","article-title":"SpiB regulates the expression of B-cell-related genes and increases the longevity of memory B cells","volume":"14","year":"2023","journal-title":"en. In: Front. Immunol"},{"issue":"1","key":"2025101502101472000_2025.04.25.650731v2.47","first-page":"175","article-title":"UHRF1 depletion causes a G2\/M arrest, activation of DNA damage response and apoptosis","volume":"435","year":"2011","journal-title":"en. In: Biochem. J"},{"issue":"6","key":"2025101502101472000_2025.04.25.650731v2.48","first-page":"3069","article-title":"DNA hypomethylation activates Cdk4\/6 and Atr to induce DNA replication and cell cycle arrest to constrain liver outgrowth in zebrafish","volume":"52","year":"2024","journal-title":"en. In: Nucleic Acids Res"},{"key":"2025101502101472000_2025.04.25.650731v2.49","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkae1142"},{"key":"2025101502101472000_2025.04.25.650731v2.50","doi-asserted-by":"crossref","unstructured":"M. Lange et al. \u201cZebrahub \u2013 Multimodal Zebrafish Developmental Atlas Reveals the State-Transition Dynamics of Late-Vertebrate Pluripotent Axial Progenitors\u201d. en. In: bioRxiv (June 2023), p. 2023.03.06.531398.","DOI":"10.1101\/2023.03.06.531398"},{"key":"2025101502101472000_2025.04.25.650731v2.51","unstructured":"The Tabula Microcebus Consortium et al. \u201cTabula Microcebus: A transcriptomic cell atlas of mouse lemur, an emerging primate model organism\u201d. en. In: bioRxiv (Dec. 2021), p. 2021.12.12.469460."},{"key":"2025101502101472000_2025.04.25.650731v2.52","doi-asserted-by":"crossref","unstructured":"M. Jiang et al. \u201cCharacterization of the Zebrafish Cell Landscape at Single-Cell Resolution\u201d. In: Front. Cell Dev. Biol. 9 (Oct. 2021).","DOI":"10.3389\/fcell.2021.743421"},{"issue":"11","key":"2025101502101472000_2025.04.25.650731v2.53","first-page":"2973","article-title":"A stony coral cell atlas illuminates the molecular and cellular basis of coral symbiosis, calcification, and immunity","volume":"184","year":"2021","journal-title":"en. In: Cell"},{"issue":"10","key":"2025101502101472000_2025.04.25.650731v2.54","first-page":"1714","article-title":"A lamprey neural cell type atlas illuminates the origins of the vertebrate brain","volume":"7","year":"2023","journal-title":"en. In: Nat. Ecol. Evol"},{"key":"2025101502101472000_2025.04.25.650731v2.55","year":"2023","journal-title":"Attention Is All You Need"},{"key":"2025101502101472000_2025.04.25.650731v2.56","unstructured":"J. Chen , X. Ma , W. Xu , and J. Yang . \u201cFlex Attention: Efficient Transformer Training with Dynamic Sparse Attention\u201d. In: Proceedings of the 40th International Conference on Machine Learning (ICML). PMLR. 2022."},{"key":"2025101502101472000_2025.04.25.650731v2.57","article-title":"Fixing Weight Decay Regularization in Adam","year":"2017","journal-title":"In: CoRR"},{"key":"2025101502101472000_2025.04.25.650731v2.58","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","year":"2011","journal-title":"In: Journal of Machine Learning Research"},{"key":"2025101502101472000_2025.04.25.650731v2.59","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-017-1382-0"},{"key":"2025101502101472000_2025.04.25.650731v2.60","doi-asserted-by":"publisher","DOI":"10.2307\/1940179"},{"issue":"1","key":"2025101502101472000_2025.04.25.650731v2.61","first-page":"22","article-title":"Word Association Norms, Mutual Information, and Lexicography","volume":"16","year":"1990","journal-title":"In: Computational Linguistics"},{"key":"2025101502101472000_2025.04.25.650731v2.62","doi-asserted-by":"publisher","DOI":"10.1111\/J.2517-6161.1995.TB02031.X"},{"key":"2025101502101472000_2025.04.25.650731v2.63","doi-asserted-by":"publisher","DOI":"10.1126\/science.aax1971"},{"key":"2025101502101472000_2025.04.25.650731v2.64","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-023-06720-2"},{"key":"2025101502101472000_2025.04.25.650731v2.65","doi-asserted-by":"publisher","DOI":"10.1038\/s41556-023-01174-0"},{"key":"2025101502101472000_2025.04.25.650731v2.66","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.51254"}],"container-title":[],"original-title":[],"link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1101\/2025.04.25.650731","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,15]],"date-time":"2026-01-15T08:35:25Z","timestamp":1768466125000},"score":1,"resource":{"primary":{"URL":"http:\/\/biorxiv.org\/lookup\/doi\/10.1101\/2025.04.25.650731"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,29]]},"references-count":66,"URL":"https:\/\/doi.org\/10.1101\/2025.04.25.650731","relation":{},"subject":[],"published":{"date-parts":[[2025,4,29]]},"subtype":"preprint"}}