{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T11:01:18Z","timestamp":1784804478447,"version":"3.55.0"},"reference-count":43,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T00:00:00Z","timestamp":1763942400000},"content-version":"vor","delay-in-days":23,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The advent of high-throughput sequencing has led to an exponential increase in genomic data, highlighting the need for efficient and accurate models to analyze and interpret this information. In this study, we introduce a novel, exomic foundational model that leverages a combination of the human reference genome and multispecies data to improve variant detection and interpretation. Our model utilizes a short-range transformer architecture and is trained on a large dataset of human exomic sequences derived from the Tapestry study. Through a series of ablation studies and scaling experiments, we demonstrate the effectiveness of our model in predicting next token accuracy and identifying clinically pathogenic variants. We also show that our model outperforms existing models in a range of downstream tasks, including variant effect prediction and disease state identification. In fact, our largest sequence transformer for range adaptive nucleotide decoding variant (1B parameters) surpassed previous benchmarks, demonstrating a mean accuracy of 0.880 [an 8.2% improvement over the original nucleotide transformer (NT) and a 7% improvement over NT-v2]. Furthermore, we construct a unique exomic ClinVar dataset to evaluate the model\u2019s performance on pathogenicity and disease states. Our results highlight the potential of this model to improve our understanding of the human exome and its role in disease. The model and its applications have significant implications for genomics-based diagnosis and personalized medicine, including tailored therapeutic development.<\/jats:p>","DOI":"10.1093\/bib\/bbaf618","type":"journal-article","created":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T13:57:48Z","timestamp":1763992668000},"source":"Crossref","is-referenced-by-count":2,"title":["Introducing a foundational sequence transformer for range adaptive nucleotide decoding (STRAND)"],"prefix":"10.1093","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9319-9001","authenticated-orcid":false,"given":"Shant","family":"Ayanian","sequence":"first","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Collin","family":"Osborne","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Clark","family":"Xu","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carl","family":"Molnar","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pravat","family":"Das","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xoab","family":"Perez","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Natalia","family":"Vassilieva","sequence":"additional","affiliation":[{"name":"Cerebras Systems , Inc., 1237 E. Arques Ave, Sunnyvale 94085, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vinay","family":"Pondenkandath","sequence":"additional","affiliation":[{"name":"Cerebras Systems , Inc., 1237 E. Arques Ave, Sunnyvale 94085, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bhargav","family":"Kanakiya","sequence":"additional","affiliation":[{"name":"Cerebras Systems , Inc., 1237 E. Arques Ave, Sunnyvale 94085, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ganesh","family":"Venkatesh","sequence":"additional","affiliation":[{"name":"Cerebras Systems , Inc., 1237 E. Arques Ave, Sunnyvale 94085, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"May","family":"Levin","sequence":"additional","affiliation":[{"name":"Cerebras Systems , Inc., 1237 E. Arques Ave, Sunnyvale 94085, CA,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matt","family":"Redlon","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc","family":"Blasi","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vijay H","family":"Shah","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Callstrom","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Konstantinos N","family":"Lazaridis","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Panos","family":"Korfiatis","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0138-5112","authenticated-orcid":false,"given":"Alexander","family":"Ryu","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2006-1436","authenticated-orcid":false,"given":"Elena","family":"Myasoedova","sequence":"additional","affiliation":[{"name":"Mayo Clinic , 200 1st St SW, Rochester 55905, MN,","place":["United States"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2025,11,24]]},"reference":[{"key":"2025112408574475400_ref1","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1146\/annurev.genom.9.081307.164359","article-title":"Next-generation DNA sequencing methods","volume":"9","author":"Mardis","year":"2008","journal-title":"Annu Rev Genomics Hum Genet"},{"key":"2025112408574475400_ref2","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1038\/nrg2841","article-title":"Advances in understanding cancer genomes through second-generation sequencing","volume":"11","author":"Meyerson","year":"2010","journal-title":"Nat Rev Genet"},{"key":"2025112408574475400_ref3","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.1002195","volume":"13","author":"","journal-title":"PLoS Biol"},{"key":"2025112408574475400_ref4","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.cell.2013.09.006","article-title":"The next-generation sequencing revolution and its impact on genomics","volume":"155","author":"Koboldt","year":"2013","journal-title":"Cell"},{"key":"2025112408574475400_ref5","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1038\/s41576-019-0122-6","article-title":"Deep learning: new computational modelling techniques for genomics","volume":"20","author":"Eraslan","year":"2019","journal-title":"Nat Rev Genet"},{"key":"2025112408574475400_ref6","doi-asserted-by":"publisher","first-page":"1001","DOI":"10.1089\/cmb.2021.0536","article-title":"kmer2vec: a novel method for comparing DNA sequences by word2vec embedding","volume":"29","author":"Ren","year":"2022","journal-title":"J Comput Biol"},{"key":"2025112408574475400_ref7","doi-asserted-by":"publisher","first-page":"e0261531","DOI":"10.1371\/journal.pone.0261531","article-title":"Delucs: deep learning for unsupervised clustering of DNA sequences","volume":"17","author":"Mill\u00e1n Arias","year":"2022","journal-title":"PloS One"},{"key":"2025112408574475400_ref8","doi-asserted-by":"publisher","DOI":"10.1038\/s41588-018-0295-5","article-title":"A primer on deep learning in genomics","volume":"51","author":"","journal-title":"Nat Genet"},{"key":"2025112408574475400_ref9","doi-asserted-by":"publisher","first-page":"1782","DOI":"10.1109\/TCBB.2020.3040706","article-title":"New genome sequence detection via natural vector convex hull method","volume":"19","author":"Zhao","year":"2022","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"key":"2025112408574475400_ref10","doi-asserted-by":"publisher","first-page":"240","DOI":"10.1038\/s41698-024-00733-4","article-title":"Large language model use in clinical oncology","volume":"8","author":"Carl","year":"2024","journal-title":"NPJ Precis Oncol"},{"key":"2025112408574475400_ref11","doi-asserted-by":"publisher","first-page":"222","DOI":"10.1038\/s41746-024-01219-0","article-title":"A scoping review of large language model based approaches for information extraction from radiology reports","volume":"7","author":"Reichenpfader","year":"2024","journal-title":"NPJ Digit Med"},{"key":"2025112408574475400_ref12","volume-title":"2024 IEEE 42nd VLSI Test Symposium (VTS)","author":""},{"key":"2025112408574475400_ref13","doi-asserted-by":"publisher","first-page":"1033","DOI":"10.3390\/biology12071033","article-title":"Transformer architecture and attention mechanisms in genome data analysis: a comprehensive review","volume":"12","author":"Choi","year":"2023","journal-title":"Biology"},{"key":"2025112408574475400_ref14","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1038\/s41592-024-02523-z","article-title":"Nucleotide transformer: building and evaluating robust foundation models for human genomics","volume":"22","author":"Dalla-Torre","year":"2024","journal-title":"Nat Methods"},{"key":"2025112408574475400_ref15","volume-title":"Advances in Neural Information Processing Systems (NeurIPS)","author":""},{"key":"2025112408574475400_ref16","doi-asserted-by":"publisher","first-page":"835","DOI":"10.1038\/s42003-024-06465-2","article-title":"A foundational large language model for edible plant genomes","volume":"7","author":"Mendoza-Revilla","year":"2024","journal-title":"Commun Biol"},{"key":"2025112408574475400_ref17","doi-asserted-by":"publisher","first-page":"2112","DOI":"10.1093\/bioinformatics\/btab083","article-title":"DNABERT: pre-trained bidirectional encoder representations from transformers model for DNA-language in genome","volume":"37","author":"Ji","year":"2021","journal-title":"Bioinformatics"},{"key":"2025112408574475400_ref18","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkae1310","article-title":"GENA-LM: a family of open-source foundational DNA language models for long sequences","volume":"53","author":"","journal-title":"Nucleic Acids Res"},{"key":"2025112408574475400_ref19","article-title":"METAGENE-1: Metagenomic foundation model for pandemic monitoring","author":""},{"key":"2025112408574475400_ref20","article-title":"Is the epidemiology of rheumatoid arthritis changing? Results from a population-based incidence study, 1985\u20132014","volume":"79","author":"","journal-title":"Ann Rheum Dis"},{"key":"2025112408574475400_ref21","doi-asserted-by":"publisher","first-page":"2023","DOI":"10.1016\/S0140-6736(16)30173-8","article-title":"Rheumatoid arthritis","volume":"388","author":"Josef","year":"2016","journal-title":"Lancet"},{"key":"2025112408574475400_ref22","doi-asserted-by":"publisher","first-page":"771","DOI":"10.1136\/annrheumdis-2019-216243","article-title":"Economic burden of rheumatoid arthritis: a systematic review of literature in biologic era","volume":"79","author":"Ping-Hsuan","year":"2020","journal-title":"Ann Rheum Dis"},{"key":"2025112408574475400_ref23","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1002\/acr.25184","article-title":"Multimorbidity patterns and rheumatoid arthritis disease outcomes: findings from a multicenter, prospective cohort","volume":";77","author":"Dutt","journal-title":"Arthritis Care Res"},{"key":"2025112408574475400_ref24","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1002\/acr.22642","article-title":"Cause-specific mortality in male us veterans with rheumatoid arthritis","volume":"68","author":"England","year":"2016","journal-title":"Arthritis Care Res"},{"key":"2025112408574475400_ref25","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1177\/1759720X17720366","article-title":"Sustained remission in rheumatoid arthritis: latest evidence and clinical considerations","volume":"9","author":"Ajeganova","year":"2017","journal-title":"Ther Adv Musculoskelet Dis"},{"key":"2025112408574475400_ref26","doi-asserted-by":"publisher","first-page":"760","DOI":"10.1038\/s41584-024-01169-7","article-title":"Management strategies in rheumatoid arthritis","volume":"20","author":"Konzett","year":"2024","journal-title":"Nat Rev Rheumatol"},{"key":"2025112408574475400_ref27","doi-asserted-by":"publisher","first-page":"e003554","DOI":"10.1136\/bmjopen-2013-003554","article-title":"Long-term sustained remission in a cohort study of patients with rheumatoid arthritis: choice of remission criteria","volume":"3","author":"Svensson","year":"2013","journal-title":"BMJ Open"},{"key":"2025112408574475400_ref28","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1186\/s13075-020-02240-w","article-title":"A multi-biomarker disease activity score can predict sustained remission in rheumatoid arthritis","volume":"22","author":"Ma","year":"2020","journal-title":"Arthritis Res Ther"},{"key":"2025112408574475400_ref29","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1038\/s41586-025-08940-0","article-title":"Global evolution of inflammatory bowel disease across epidemiologic stages","volume":"642","author":"Hracs","year":"2025","journal-title":"Nature"},{"key":"2025112408574475400_ref30","doi-asserted-by":"publisher","first-page":"e70192","DOI":"10.1002\/jgh3.70192","article-title":"Compounding prevalence of inflammatory bowel disease in a 2024 population-based study from Canterbury, New Zealand","volume":"9","author":"Forbes","year":"2025","journal-title":"JGH Open"},{"key":"2025112408574475400_ref31","doi-asserted-by":"publisher","first-page":"853","DOI":"10.1016\/S2468-1253(23)00154-1","article-title":"Difficult-to-treat inflammatory bowel disease: results from an international consensus meeting","volume":"8","author":"Parigi","year":"2023","journal-title":"Lancet Gastroenterol Hepatol"},{"key":"2025112408574475400_ref32","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1007\/s40291-023-00678-7","article-title":"The genetics of inflammatory bowel disease","volume":"28","author":"El Hadad","year":"2024","journal-title":"Mol Diagn Ther"},{"key":"2025112408574475400_ref33","doi-asserted-by":"publisher","first-page":"D1062","DOI":"10.1093\/nar\/gkx1153","article-title":"Clinvar: improving access to variant interpretations and supporting evidence","volume":"46","author":"Landrum","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2025112408574475400_ref34","article-title":"DNABERT-2: Efficient foundation model and benchmark for multi-species genome","author":""},{"key":"2025112408574475400_ref35","doi-asserted-by":"publisher","first-page":"i255","DOI":"10.1093\/bioinformatics\/btaf188","article-title":"DNABERT-s: pioneering species differentiation with species-aware DNA embeddings","volume":"41","author":"Zhou","year":"2024","journal-title":"Bioinformatics"},{"key":"2025112408574475400_ref36","doi-asserted-by":"publisher","DOI":"10.3390\/technologies13010032","article-title":"Vision transformers for image classification: A comparative survey","volume":"13","author":"","journal-title":"Technologies"},{"key":"2025112408574475400_ref37","doi-asserted-by":"publisher","first-page":"924","DOI":"10.1002\/acr.24596","article-title":"2021 American College of Rheumatology Guideline for the treatment of rheumatoid arthritis","volume":"73","author":"Fraenkel","year":"2021","journal-title":"Arthritis Care Res (Hoboken)"},{"key":"2025112408574475400_ref38","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1136\/ard-2022-223356","article-title":"Eular recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2022 update","volume":"82","author":"Smolen","year":"2023","journal-title":"Ann Rheum Dis"},{"key":"2025112408574475400_ref39","doi-asserted-by":"publisher","first-page":"1878","DOI":"10.1016\/j.mayocp.2024.08.005","article-title":"Mayo clinic tapestry study: a large-scale decentralized whole exome sequencing study for clinical practice, research discovery, and genomic education","volume":"99","author":"Bandel","year":"2024","journal-title":"Mayo Clin Proc"},{"key":"2025112408574475400_ref40","article-title":"Rethinking addressing in language models via contextualized equivariant positional encoding","author":""},{"key":"2025112408574475400_ref41","article-title":"Linearized relative positional encoding","author":""},{"key":"2025112408574475400_ref42","article-title":"Learnable Fourier features for multi-dimensional spatial positional encoding","author":""},{"key":"2025112408574475400_ref43","article-title":"RoFormer: Enhanced transformer with rotary position embedding","author":""}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/26\/6\/bbaf618\/65490442\/bbaf618.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/26\/6\/bbaf618\/65490442\/bbaf618.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T13:57:49Z","timestamp":1763992669000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbaf618\/8341161"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,1]]},"references-count":43,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,11,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbaf618","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"value":"1467-5463","type":"print"},{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025,11]]},"published":{"date-parts":[[2025,11,1]]},"article-number":"bbaf618"}}