{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T20:46:34Z","timestamp":1790282794836,"version":"4.1.0"},"reference-count":217,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2025,6,2]],"date-time":"2025-06-02T00:00:00Z","timestamp":1748822400000},"content-version":"vor","delay-in-days":152,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Robertson Foundation and NIH","award":["HG011395"],"award-info":[{"award-number":["HG011395"]}]},{"name":"Robertson Foundation and NIH","award":["HG012473"],"award-info":[{"award-number":["HG012473"]}]},{"DOI":"10.13039\/100000865","name":"Bill & Melinda Gates Foundation","doi-asserted-by":"publisher","award":["INV-001927"],"award-info":[{"award-number":["INV-001927"]}],"id":[{"id":"10.13039\/100000865","id-type":"DOI","asserted-by":"publisher"}]},{"name":"The New Zealand Institute for Plant & Food Research Ltd Kiwifruit Royalty Investment Programme"},{"name":"SciLifeLab & Wallenberg Data Driven Life Science Program"},{"DOI":"10.13039\/501100004063","name":"Knut and Alice Wallenberg Foundation","doi-asserted-by":"publisher","award":["KAW 2020.0239"],"award-info":[{"award-number":["KAW 2020.0239"]}],"id":[{"id":"10.13039\/501100004063","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004063","name":"Knut and Alice Wallenberg Foundation","doi-asserted-by":"publisher","award":["KAW 2017.0003"],"award-info":[{"award-number":["KAW 2017.0003"]}],"id":[{"id":"10.13039\/501100004063","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Bioinformatics Infrastructure Sweden"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,1,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Variant Call Format (VCF) is the standard file format for interchanging genetic variation data and associated quality control metrics. The usual row-wise encoding of the VCF data model (either as text or packed binary) emphasizes efficient retrieval of all data for a given variant, but accessing data on a field or sample basis is inefficient. The Biobank-scale datasets currently available consist of hundreds of thousands of whole genomes and hundreds of terabytes of compressed VCF. Row-wise data storage is fundamentally unsuitable and a more scalable approach is needed.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Zarr is a format for storing multidimensional data that is widely used across the sciences, and is ideally suited to massively parallel processing. We present the VCF Zarr specification, an encoding of the VCF data model using Zarr, along with fundamental software infrastructure for efficient and reliable conversion at scale. We show how this format is far more efficient than standard VCF-based approaches, and competitive with specialized methods for storing genotype data in terms of compression ratios and single-threaded calculation performance. We present case studies on subsets of 3 large human datasets (Genomics England: $n$=78,195; Our Future Health: $n$=651,050; All of Us: $n$=245,394) along with whole genome datasets for Norway Spruce ($n$=1,063) and SARS-CoV-2 ($n$=4,484,157). We demonstrate the potential for VCF Zarr to enable a new generation of high-performance and cost-effective applications via illustrative examples using cloud computing and GPUs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Large row-encoded VCF files are a major bottleneck for current research, and storing and processing these files incurs a substantial cost. The VCF Zarr specification, building on widely used, open-source technologies, has the potential to greatly reduce these costs, and may enable a diverse ecosystem of next-generation tools for analysing genetic variation data directly from cloud-based object stores, while maintaining compatibility with existing file-oriented workflows.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/gigascience\/giaf049","type":"journal-article","created":{"date-parts":[[2025,4,2]],"date-time":"2025-04-02T09:56:52Z","timestamp":1743587812000},"source":"Crossref","is-referenced-by-count":9,"title":["Analysis-ready VCF at Biobank scale using Zarr"],"prefix":"10.1093","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4254-4255","authenticated-orcid":false,"given":"Eric","family":"Czech","sequence":"first","affiliation":[{"name":"Open Athena AI Foundation , 1245 Broadway, 16th Floor, New York, NY 10001 ,","place":["USA"]},{"name":"Related Sciences , 1312 17th St PMB 76870, Denver, CO 80202 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Will","family":"Tyler","sequence":"additional","affiliation":[{"name":"Independent researcher"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"White","sequence":"additional","affiliation":[{"name":"Tom White Consulting Ltd"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1982-6801","authenticated-orcid":false,"given":"Ben","family":"Jeffery","sequence":"additional","affiliation":[{"name":"University of Oxford Big Data Institute, Li Ka Shing Centre for Health Information and Discovery, , Oxford, OX3 7LF ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5142-8811","authenticated-orcid":false,"given":"Timothy R","family":"Millar","sequence":"additional","affiliation":[{"name":"The New Zealand Institute for Plant & Food Research Ltd , 74 Gerald Street,\u00a0 Lincoln 7608 ,","place":["New Zealand"]},{"name":"University of Otago Department of Biochemistry, School of Biomedical Sciences, . 710 Cumberland Street, Dunedin North, Dunedin 9016 ,","place":["New Zealand"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7328-4233","authenticated-orcid":false,"given":"Benjamin","family":"Elsworth","sequence":"additional","affiliation":[{"name":"Our Future Health , 2 New Bailey, 6 Stanley Street, Manchester M3 5GS ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-6406-5187","authenticated-orcid":false,"given":"J\u00e9r\u00e9my","family":"Guez","sequence":"additional","affiliation":[{"name":"Broad Institute of MIT and Harvard Program in Medical and Population Genetics, , Cambridge, MA 02142 ,","place":["USA"]},{"name":"Massachusetts General Hospital Analytic and Translational Genetics Unit, , Boston, MA 02114 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5799-5299","authenticated-orcid":false,"given":"Jonny","family":"Hancox","sequence":"additional","affiliation":[{"name":"NVIDIA Ltd , 100 Brook Drive, Green Park, Reading RG2 6UJ ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2878-4671","authenticated-orcid":false,"given":"Konrad J","family":"Karczewski","sequence":"additional","affiliation":[{"name":"Broad Institute of MIT and Harvard Program in Medical and Population Genetics, , Cambridge, MA 02142 ,","place":["USA"]},{"name":"Massachusetts General Hospital Analytic and Translational Genetics Unit, , Boston, MA 02114 ,","place":["USA"]},{"name":"Broad Institute of MIT and Harvard Novo Nordisk Foundation Center for Genomic Mechanisms of Disease, , Cambridge, MA 02142 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9018-4680","authenticated-orcid":false,"given":"Alistair","family":"Miles","sequence":"additional","affiliation":[{"name":"Wellcome Sanger Institute, Wellcome Genome Campus Genomic Surveillance Unit, , Hinxton, Cambridgeshire, CB10 1SA ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7183-6276","authenticated-orcid":false,"given":"Sam","family":"Tallman","sequence":"additional","affiliation":[{"name":"Genomics England , One Canada Square, London, E14 5AB ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5735-3315","authenticated-orcid":false,"given":"Per","family":"Unneberg","sequence":"additional","affiliation":[{"name":"Uppsala University Department of Cell and Molecular Biology, National Bioinformatics Infrastructure Sweden, Science for Life Laboratory, , Husargatan 3, SE-752 37 Uppsala ,","place":["Sweden"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-0735-7090","authenticated-orcid":false,"given":"Rafal","family":"Wojdyla","sequence":"additional","affiliation":[{"name":"Open Athena AI Foundation , 1245 Broadway, 16th Floor, New York, NY 10001 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8003-9284","authenticated-orcid":false,"given":"Shadi","family":"Zabad","sequence":"additional","affiliation":[{"name":"School of Computer Science, McGill University , Montreal, QC, H3A 2A7 ,","place":["Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6596-8563","authenticated-orcid":false,"given":"Jeff","family":"Hammerbacher","sequence":"additional","affiliation":[{"name":"Open Athena AI Foundation , 1245 Broadway, 16th Floor, New York, NY 10001 ,","place":["USA"]},{"name":"Related Sciences , 1312 17th St PMB 76870, Denver, CO 80202 ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7894-5253","authenticated-orcid":false,"given":"Jerome","family":"Kelleher","sequence":"additional","affiliation":[{"name":"University of Oxford Big Data Institute, Li Ka Shing Centre for Health Information and Discovery, , Oxford, OX3 7LF ,","place":["UK"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2025,6,2]]},"reference":[{"issue":"15","key":"2025060120021827400_bib1","doi-asserted-by":"publisher","first-page":"2156","DOI":"10.1093\/bioinformatics\/btr330","article-title":"The variant call format and VCFtools","volume":"27","author":"Danecek","year":"2011","journal-title":"Bioinformatics"},{"issue":"2","key":"2025060120021827400_bib2","doi-asserted-by":"publisher","first-page":"100029","DOI":"10.1016\/j.xgen.2021.100029","article-title":"GA4GH: international policies and standards for data sharing across genomic research and healthcare","volume":"1","author":"Rehm","year":"2021","journal-title":"Cell Genom"},{"issue":"7571","key":"2025060120021827400_bib3","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1038\/nature15393","article-title":"A global reference for human genetic variation","volume":"526","author":"The 1000 Genomes Project Consortium","year":"2015","journal-title":"Nature"},{"key":"2025060120021827400_bib4","doi-asserted-by":"publisher","first-page":"k1687","DOI":"10.1136\/bmj.k1687","article-title":"The 100 000 Genomes Project: bringing whole genome sequencing to the NHS","volume":"361","author":"Turnbull","year":"2018","journal-title":"BMJ"},{"key":"2025060120021827400_bib5","unstructured":"Caulfield M, Davies J, Dennys M, et al. \u00a0National Genomic Research Library v5.1, Genomics England. 2017. 10.6084\/m9.figshare.4530893.v7."},{"key":"2025060120021827400_bib6","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1038\/s41586-018-0579-z","article-title":"The UK Biobank resource with deep phenotyping and genomic data","volume":"562","author":"Bycroft","year":"2018","journal-title":"Nature"},{"issue":"7886","key":"2025060120021827400_bib7","doi-asserted-by":"publisher","first-page":"628","DOI":"10.1038\/s41586-021-04103-z","article-title":"Exome sequencing and analysis of 454,787 UK Biobank participants","volume":"599","author":"Backman","year":"2021","journal-title":"Nature"},{"issue":"7920","key":"2025060120021827400_bib8","doi-asserted-by":"publisher","first-page":"732","DOI":"10.1038\/s41586-022-04965-x","article-title":"The sequences of 150,119 genomes in the UK Biobank","volume":"607","author":"Halldorsson","year":"2022","journal-title":"Nature"},{"key":"2025060120021827400_bib9","doi-asserted-by":"publisher","first-page":"2023","DOI":"10.1101\/2023.12.06.23299426","article-title":"Whole-genome sequencing of half-a-million UK Biobank participants","author":"UK Biobank Whole-Genome Sequencing Consortium","year":"2023"},{"issue":"31","key":"2025060120021827400_bib10","doi-asserted-by":"publisher","first-page":"728","DOI":"10.1038\/s41591-024-03438-0","article-title":"Our Future Health: a unique global resource for discovery and translational research","author":"Cook","year":"2025","journal-title":"Nat Med"},{"key":"2025060120021827400_bib11","author":"Our Future Health","year":"2025"},{"issue":"8003","key":"2025060120021827400_bib12","doi-asserted-by":"publisher","first-page":"340","DOI":"10.1038\/s41586-023-06957-x","article-title":"Genomic data in the All of Us Research Program","volume":"627","author":"All of Us Research Program Genomics Investigators","year":"2024","journal-title":"Nature"},{"issue":"2","key":"2025060120021827400_bib13","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1038\/s41576-024-00776-0","article-title":"A call to action to scale up research and clinical genomic data sharing","volume":"26","author":"Stark","year":"2025","journal-title":"Nat Rev Genet"},{"key":"2025060120021827400_bib14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12711-019-0522-2","article-title":"Accuracy of whole-genome sequence imputation using hybrid peeling in large pedigreed livestock populations","volume":"52","author":"Ros-Freixedes","year":"2020","journal-title":"Genet Sel Evol"},{"issue":"20","key":"2025060120021827400_bib15","doi-asserted-by":"publisher","first-page":"10924","DOI":"10.1093\/nar\/gkad840","article-title":"A rice variation map derived from 10 548 rice accessions reveals the importance of rare variants","volume":"51","author":"Wang","year":"2023","journal-title":"Nucleic Acids Res"},{"issue":"6","key":"2025060120021827400_bib16","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1093\/jhered\/esac020","article-title":"Landscape genomics to enable conservation actions: the California Conservation Genomics Project","volume":"113","author":"Shaffer","year":"2022","journal-title":"J Hered"},{"key":"2025060120021827400_bib17","doi-asserted-by":"publisher","first-page":"22","DOI":"10.12688\/wellcomeopenres.18681.1","article-title":"Pf7: an open dataset of Plasmodium falciparum genome variation in 20,000 worldwide samples","volume":"8","author":"Hamid","year":"2023","journal-title":"Wellcome Open Res"},{"issue":"5","key":"2025060120021827400_bib18","doi-asserted-by":"publisher","first-page":"e1009123","DOI":"10.1371\/journal.pcbi.1009123","article-title":"A spectrum of free software tools for processing the VCF variant call format: vcflib, bio-vcf, cyvcf2, hts-nim and slivar","volume":"18","author":"Garrison","year":"2022","journal-title":"PLoS Comput Biol"},{"issue":"3","key":"2025060120021827400_bib19","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1086\/519795","article-title":"PLINK: a tool set for whole-genome association and population-based linkage analyses","volume":"81","author":"Purcell","year":"2007","journal-title":"Am J Hum Genet"},{"key":"2025060120021827400_bib20","doi-asserted-by":"crossref","unstructured":"Chang CC, Chow CC, Tellier LC, et al. \u00a0Second-generation PLINK: rising to the challenge of larger and richer datasets. Gigascience. 2015;4(1):s13742\u2013015.. 10.1186\/s13742-015-0047-8.","DOI":"10.1186\/s13742-015-0047-8"},{"key":"2025060120021827400_bib21","doi-asserted-by":"publisher","first-page":"308296","DOI":"10.1101\/308296","article-title":"BGEN: a binary file format for imputed genotype and haplotype data","author":"Band","year":"2018","journal-title":"bioRxiv"},{"issue":"1","key":"2025060120021827400_bib22","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1016\/j.ajhg.2010.11.011","article-title":"GCTA: a tool for genome-wide complex trait analysis","volume":"88","author":"Yang","year":"2011","journal-title":"Am J Hum Genet"},{"issue":"7","key":"2025060120021827400_bib23","doi-asserted-by":"publisher","first-page":"1097","DOI":"10.1038\/s41588-021-00870-7","article-title":"Computationally efficient whole-genome regression for quantitative and binary traits","volume":"53","author":"Mbatchou","year":"2021","journal-title":"Nat Genet"},{"issue":"3","key":"2025060120021827400_bib24","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1038\/ng.3190","article-title":"Efficient Bayesian mixed-model analysis increases association power in large cohorts","volume":"47","author":"Loh","year":"2015","journal-title":"Nat Genet"},{"issue":"3","key":"2025060120021827400_bib25","doi-asserted-by":"publisher","first-page":"338","DOI":"10.1016\/j.ajhg.2018.07.015","article-title":"A one-penny imputed genome from next-generation reference panels","volume":"103","author":"Browning","year":"2018","journal-title":"Am J Hum Genet"},{"issue":"9","key":"2025060120021827400_bib26","doi-asserted-by":"publisher","first-page":"1330","DOI":"10.1038\/s41588-019-0483-y","article-title":"Inferring whole-genome histories in large population datasets","volume":"51","author":"Kelleher","year":"2019","journal-title":"Nat Genet"},{"issue":"7","key":"2025060120021827400_bib27","doi-asserted-by":"publisher","first-page":"1243","DOI":"10.1038\/s41588-023-01415-w","article-title":"Accurate rare variant phasing of whole-genome and whole-exome sequencing data in the UK Biobank","volume":"55","author":"Hofmeister","year":"2023","journal-title":"Nat Genet"},{"issue":"2","key":"2025060120021827400_bib28","doi-asserted-by":"publisher","first-page":"e1608","DOI":"10.1002\/mpr.1608","article-title":"A tutorial on conducting genome-wide association studies: quality control and statistical analysis","volume":"27","author":"Marees","year":"2018","journal-title":"Int J Methods Psychiat Res"},{"key":"2025060120021827400_bib29","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1007\/978-1-4939-7868-7_3","article-title":"Quality control of common and rare variants","volume-title":"Genetic Epidemiology: Methods and Protocols","author":"Panoutsopoulou","year":"2018"},{"issue":"7993","key":"2025060120021827400_bib30","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1038\/s41586-023-06045-0","article-title":"A genomic mutational constraint map using variation in 76,156 human genomes","volume":"625","author":"Chen","year":"2024","journal-title":"Nature"},{"issue":"11","key":"2025060120021827400_bib31","doi-asserted-by":"publisher","first-page":"750","DOI":"10.1038\/s41576-024-00738-6","article-title":"Next-generation data filtering in the genomics era","volume":"25","author":"Hemstrom","year":"2024","journal-title":"Nat Rev Genet"},{"issue":"10","key":"2025060120021827400_bib32","doi-asserted-by":"publisher","first-page":"1880","DOI":"10.1016\/j.ajhg.2021.08.005","article-title":"Fast two-stage phasing of large-scale sequence data","volume":"108","author":"Browning","year":"2021","journal-title":"Am J Hum Genet"},{"issue":"1","key":"2025060120021827400_bib33","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.ajhg.2022.11.008","article-title":"Statistical phasing of 150,119 sequenced genomes in the UK Biobank","volume":"110","author":"Browning","year":"2023","journal-title":"Am J Hum Genet"},{"key":"2025060120021827400_bib34","doi-asserted-by":"publisher","first-page":"2024","DOI":"10.1101\/2024.05.06.592816","article-title":"Phasing millions of samples achieves near perfect accuracy, enabling parent-of-origin classification of variants","author":"Williams","year":"2024","journal-title":"bioRxiv"},{"issue":"11","key":"2025060120021827400_bib35","doi-asserted-by":"publisher","first-page":"e1009049","DOI":"10.1371\/journal.pgen.1009049","article-title":"Genotype imputation using the positional Burrows Wheeler transform","volume":"16","author":"Rubinacci","year":"2020","journal-title":"PLoS Genet"},{"issue":"8","key":"2025060120021827400_bib36","doi-asserted-by":"publisher","first-page":"1260","DOI":"10.1038\/s41588-021-00892-1","article-title":"Whole-exome imputation within UK Biobank powers rare coding variant association and fine-mapping analyses","volume":"53","author":"Barton","year":"2021","journal-title":"Nat Genet"},{"issue":"7","key":"2025060120021827400_bib37","doi-asserted-by":"publisher","first-page":"1088","DOI":"10.1038\/s41588-023-01438-3","article-title":"Imputation of low-coverage sequencing data from 150,119 UK Biobank genomes","volume":"55","author":"Rubinacci","year":"2023","journal-title":"Nat Genet"},{"issue":"1","key":"2025060120021827400_bib38","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1038\/s43586-021-00056-9","article-title":"Genome-wide association studies","volume":"1","author":"Uffelmann","year":"2021","journal-title":"Nat Rev Methods Primers"},{"issue":"17","key":"2025060120021827400_bib39","doi-asserted-by":"publisher","first-page":"2776","DOI":"10.1093\/bioinformatics\/btx299","article-title":"FlashPCA2: principal component analysis of Biobank-scale genotype datasets","volume":"33","author":"Abraham","year":"2017","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib40","doi-asserted-by":"publisher","first-page":"2024","DOI":"10.1101\/2024.04.07.24305438","article-title":"De novo variants in the non-coding spliceosomal snRNA gene RNU4-2 are a frequent cause of syndromic neurodevelopmental disorders","author":"Chen","year":"2024","journal-title":"medRxiv"},{"issue":"2","key":"2025060120021827400_bib41","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1109\/MCSE.2021.3059437","article-title":"Cloud-native repositories for big scientific data","volume":"23","author":"Abernathey","year":"2021","journal-title":"Comput Sci Eng"},{"issue":"1","key":"2025060120021827400_bib42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR Guiding Principles for scientific data management and stewardship","volume":"3","author":"Wilkinson","year":"2016","journal-title":"Sci Data"},{"issue":"12","key":"2025060120021827400_bib43","doi-asserted-by":"publisher","first-page":"1563","DOI":"10.1038\/nn.4404","article-title":"Ultra-rare disruptive and damaging mutations influence educational attainment in the general population","volume":"19","author":"Ganna","year":"2016","journal-title":"Nat Neurosci"},{"key":"2025060120021827400_bib44","article-title":"Hail"},{"issue":"7809","key":"2025060120021827400_bib45","doi-asserted-by":"publisher","first-page":"434","DOI":"10.1038\/s41586-020-2308-7","article-title":"The mutational constraint spectrum quantified from variation in 141,456 humans","volume":"581","author":"Karczewski","year":"2020","journal-title":"Nature"},{"key":"2025060120021827400_bib46","article-title":"Hadoop: The definitive guide","author":"White","year":"2012","edition":"3rd ed"},{"key":"2025060120021827400_bib47","article-title":"Illumina BaseSpace"},{"key":"2025060120021827400_bib48","article-title":"Seven Bridges GRAF"},{"key":"2025060120021827400_bib49","article-title":"Google Cloud Life Sciences"},{"key":"2025060120021827400_bib50","article-title":"AWS HealthOmics"},{"key":"2025060120021827400_bib51","article-title":"Microsoft Genomics"},{"key":"2025060120021827400_bib52","article-title":"TileDB"},{"key":"2025060120021827400_bib53","article-title":"GenomicsDB"},{"key":"2025060120021827400_bib54","doi-asserted-by":"crossref","unstructured":"Danecek P, Bonfield JK, Liddle J, et al. \u00a0Twelve years of SAMtools and BCFtools. Gigascience. 2021;10(2):giab008. 10.1093\/gigascience\/giab008.","DOI":"10.1093\/gigascience\/giab008"},{"issue":"9","key":"2025060120021827400_bib55","doi-asserted-by":"publisher","first-page":"1335","DOI":"10.1038\/s41588-018-0184-y","article-title":"Efficiently controlling for case-control imbalance and sample relatedness in large-scale genetic association studies","volume":"50","author":"Zhou","year":"2018","journal-title":"Nat Genet"},{"issue":"6","key":"2025060120021827400_bib56","doi-asserted-by":"publisher","first-page":"634","DOI":"10.1038\/s41588-020-0621-6","article-title":"Scalable generalized linear mixed model for region-based association tests in large biobanks and cohorts","volume":"52","author":"Zhou","year":"2020","journal-title":"Nat Genet"},{"issue":"1","key":"2025060120021827400_bib57","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2105-14-356","article-title":"Processing genome scale tabular data with wormtable","volume":"14","author":"Kelleher","year":"2013","journal-title":"BMC Bioinform"},{"issue":"1","key":"2025060120021827400_bib58","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1038\/nmeth.3654","article-title":"Efficient genotype compression and analysis of large genetic-variation data sets","volume":"13","author":"Layer","year":"2016","journal-title":"Nat Methods"},{"issue":"4","key":"2025060120021827400_bib59","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1093\/bioinformatics\/btv613","article-title":"BGT: efficient and flexible genotype query across many samples","volume":"32","author":"Li","year":"2016","journal-title":"Bioinformatics"},{"issue":"17","key":"2025060120021827400_bib60","doi-asserted-by":"publisher","first-page":"i479","DOI":"10.1093\/bioinformatics\/btw437","article-title":"GTRAC: fast retrieval from compressed collections of genomic variants","volume":"32","author":"Tatwawadi","year":"2016","journal-title":"Bioinformatics"},{"issue":"11","key":"2025060120021827400_bib61","doi-asserted-by":"publisher","first-page":"1834","DOI":"10.1093\/bioinformatics\/bty023","article-title":"GTC: how to maintain huge genotype collections in a compressed form","volume":"34","author":"Danek","year":"2018","journal-title":"Bioinformatics"},{"issue":"22-23","key":"2025060120021827400_bib62","doi-asserted-by":"publisher","first-page":"5537","DOI":"10.1093\/bioinformatics\/btaa1004","article-title":"Sparse Project VCF: efficient encoding of population genotype matrices","volume":"36","author":"Lin","year":"2020","journal-title":"Bioinformatics"},{"issue":"13","key":"2025060120021827400_bib63","doi-asserted-by":"publisher","first-page":"4091","DOI":"10.1093\/bioinformatics\/btaa290","article-title":"Genozip: a fast and efficient compression tool for VCF files","volume":"36","author":"Lan","year":"2020","journal-title":"Bioinformatics"},{"issue":"16","key":"2025060120021827400_bib64","doi-asserted-by":"publisher","first-page":"2225","DOI":"10.1093\/bioinformatics\/btab102","article-title":"Genozip: a universal extensible genomic data compressor","volume":"37","author":"Lan","year":"2021","journal-title":"Bioinformatics"},{"issue":"22","key":"2025060120021827400_bib65","doi-asserted-by":"publisher","first-page":"4248","DOI":"10.1093\/bioinformatics\/btab378","article-title":"Sparse allele vectors and the savvy software suite","volume":"37","author":"LeFaive","year":"2021","journal-title":"Bioinformatics"},{"issue":"15","key":"2025060120021827400_bib66","doi-asserted-by":"publisher","first-page":"3778","DOI":"10.1093\/bioinformatics\/btac413","article-title":"XSI\u2014a genotype compression tool for compressive genomics in large biobanks","volume":"38","author":"Wertenbroek","year":"2022","journal-title":"Bioinformatics"},{"issue":"1","key":"2025060120021827400_bib67","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13059-022-02832-6","article-title":"GBC: a parallel toolkit based on highly addressable byte-encoding blocks for extremely large-scale genotypes of species","volume":"24","author":"Zhang","year":"2023","journal-title":"Genome Biol"},{"key":"2025060120021827400_bib68","doi-asserted-by":"crossref","unstructured":"Luo X, Chen Y, Liu L, et al. \u00a0GSC: efficient lossless compression of VCF files with fast query. GigaScience. 2024;13:giae046. 10.1093\/gigascience\/giae046.","DOI":"10.1093\/gigascience\/giae046"},{"key":"2025060120021827400_bib69","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2105-13-100","article-title":"Handling the data management needs of high-throughput sequencing data: SpeedGene, a compression algorithm for the efficient storage of genetic data","volume":"13","author":"Qiao","year":"2012","journal-title":"BMC Bioinform"},{"issue":"20","key":"2025060120021827400_bib70","doi-asserted-by":"publisher","first-page":"2572","DOI":"10.1093\/bioinformatics\/btt460","article-title":"Genome compression: a novel approach for large collections","volume":"29","author":"Deorowicz","year":"2013","journal-title":"Bioinformatics"},{"issue":"21","key":"2025060120021827400_bib71","doi-asserted-by":"publisher","first-page":"3078","DOI":"10.1093\/bioinformatics\/btu495","article-title":"Compression and fast retrieval of SNP data","volume":"30","author":"Sambo","year":"2014","journal-title":"Bioinformatics"},{"issue":"22","key":"2025060120021827400_bib72","doi-asserted-by":"publisher","first-page":"4791","DOI":"10.1093\/bioinformatics\/btz508","article-title":"GTShark: genotype compression in large projects","volume":"35","author":"Deorowicz","year":"2019","journal-title":"Bioinformatics"},{"issue":"19","key":"2025060120021827400_bib73","doi-asserted-by":"publisher","first-page":"3358","DOI":"10.1093\/bioinformatics\/btab211","article-title":"VCFShark: how to squeeze a VCF file","volume":"37","author":"Deorowicz","year":"2021","journal-title":"Bioinformatics"},{"issue":"2","key":"2025060120021827400_bib74","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1038\/s43588-024-00739-9","article-title":"Enabling efficient analysis of Biobank-scale data with genotype representation graphs","volume":"5","author":"DeHaas","year":"2025","journal-title":"Nat Comput Sci"},{"issue":"9","key":"2025060120021827400_bib75","doi-asserted-by":"publisher","first-page":"1266","DOI":"10.1093\/bioinformatics\/btu014","article-title":"Efficient haplotype matching and storage using the positional Burrows\u2013Wheeler transform (PBWT)","volume":"30","author":"Durbin","year":"2014","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib76","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1002\/9781119487845.ch2","article-title":"Linkage disequilibrium, recombination and haplotype structure","author":"McVean","year":"2019","journal-title":"Handbook of Statistical Genomics"},{"issue":"3","key":"2025060120021827400_bib77","doi-asserted-by":"publisher","first-page":"btaf067","DOI":"10.1093\/bioinformatics\/btaf067","article-title":"Efficient storage and regression computation for population-scale genome sequencing studies","volume":"41","author":"Rivas","year":"2025","journal-title":"Bioinformatics"},{"issue":"7","key":"2025060120021827400_bib78","doi-asserted-by":"publisher","first-page":"e1003153","DOI":"10.1371\/journal.pcbi.1003153","article-title":"GEMINI: integrative exploration of genetic variation and genome annotations","volume":"9","author":"Paila","year":"2013","journal-title":"PLoS Comput Biol"},{"issue":"W1","key":"2025060120021827400_bib79","doi-asserted-by":"publisher","first-page":"W189","DOI":"10.1093\/nar\/gkx201","article-title":"HGVA: the human genome variation archive","volume":"45","author":"Lopez","year":"2017","journal-title":"Nucleic Acids Res"},{"issue":"3","key":"2025060120021827400_bib80","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1038\/s41591-023-02211-z","article-title":"Genetic association analysis of 77,539 genomes reveals rare disease etiologies","volume":"29","author":"Greene","year":"2023","journal-title":"Nat Med"},{"issue":"1","key":"2025060120021827400_bib81","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1186\/s12859-023-05470-2","article-title":"Critical assessment of on-premise approaches to scalable genome analysis","volume":"24","author":"Al-Aamri","year":"2023","journal-title":"BMC Bioinform"},{"issue":"15","key":"2025060120021827400_bib82","doi-asserted-by":"publisher","first-page":"2251","DOI":"10.1093\/bioinformatics\/btx145","article-title":"SeqArray\u2014a storage-efficient high-performance data format for WGS variant calls","volume":"33","author":"Zheng","year":"2017","journal-title":"Bioinformatics"},{"issue":"24","key":"2025060120021827400_bib83","doi-asserted-by":"publisher","first-page":"3326","DOI":"10.1093\/bioinformatics\/bts606","article-title":"A high-performance computing toolset for relatedness and principal component analysis of SNP data","volume":"28","author":"Zheng","year":"2012","journal-title":"Bioinformatics"},{"issue":"24","key":"2025060120021827400_bib84","doi-asserted-by":"publisher","first-page":"5346","DOI":"10.1093\/bioinformatics\/btz567","article-title":"Genetic association testing using the GENESIS R\/Bioconductor package","volume":"35","author":"Gogarten","year":"2019","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib85","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12859-020-03804-y","article-title":"simplePHENOTYPES: SIMulation of pleiotropic, linked and epistatic phenotypes","volume":"21","author":"Fernandes","year":"2020","journal-title":"BMC Bioinform"},{"issue":"21","key":"2025060120021827400_bib86","doi-asserted-by":"publisher","first-page":"2987","DOI":"10.1093\/bioinformatics\/btr509","article-title":"A statistical framework for SNP calling, mutation discovery, association mapping and population genetical parameter estimation from sequencing data","volume":"27","author":"Li","year":"2011","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib87","article-title":"Apache Parquet"},{"issue":"19","key":"2025060120021827400_bib88","doi-asserted-by":"publisher","first-page":"2818","DOI":"10.1093\/bioinformatics\/btu390","article-title":"The Scramble conversion tool","volume":"30","author":"Bonfield","year":"2014","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib89","doi-asserted-by":"publisher","first-page":"631","DOI":"10.1145\/2723372.2742787","article-title":"Rethinking data-intensive science using scalable analytics systems","author":"Nothaft","year":"2015"},{"issue":"6","key":"2025060120021827400_bib90","doi-asserted-by":"publisher","first-page":"1497","DOI":"10.1093\/bioinformatics\/btac010","article-title":"CRAM 3.1: advances in the CRAM file format","volume":"38","author":"Bonfield","year":"2022","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib91","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1145\/3148055.3148060","article-title":"Managing variant calling files the big data way: using HDFS and Apache Parquet","volume-title":"Proceedings of the Fourth IEEE\/ACM International Conference on Big Data Computing, Applications and Technologies","author":"Boufea","year":"2017"},{"issue":"9","key":"2025060120021827400_bib92","doi-asserted-by":"publisher","first-page":"1350","DOI":"10.1089\/cmb.2019.0344","article-title":"Variant-Kudu: an efficient tool kit leveraging distributed bitmap index for analysis of massive genetic variation datasets","volume":"27","author":"Fan","year":"2020","journal-title":"J Comput Biol"},{"issue":"6647","key":"2025060120021827400_bib93","doi-asserted-by":"publisher","first-page":"849","DOI":"10.1126\/science.add5300","article-title":"On the genes, genealogies, and geographies of Quebec","volume":"380","author":"Anderson-Trocm\u00e9","year":"2023","journal-title":"Science"},{"key":"2025060120021827400_bib94","doi-asserted-by":"publisher","DOI":"10.17487\/RFC8878","article-title":"RFC 8878: Zstandard Compression and the \u2018application\/zstd\u2019 Media Type","author":"Collet","year":"2021"},{"issue":"2","key":"2025060120021827400_bib95","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1109\/MCSE.2010.51","article-title":"Why modern CPUs are starving and what can be done about it","volume":"12","author":"Alted","year":"2010","journal-title":"Comput Sci Eng"},{"key":"2025060120021827400_bib96","article-title":"Bioinformatics Data Skills: Reproducible and Robust Research with Open Source Tools","author":"Buffalo","year":"2015"},{"key":"2025060120021827400_bib97","doi-asserted-by":"crossref","unstructured":"Bonfield JK, Marshall J, Danecek P, et al. \u00a0HTSlib: C library for reading\/writing high-throughput sequencing data. Gigascience. 2021;10(2):giab007. 10.1093\/gigascience\/giab007.","DOI":"10.1093\/gigascience\/giab007"},{"key":"2025060120021827400_bib98","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2833157.2833162","article-title":"Numba: a LLVM-based Python JIT compiler","volume-title":"Proceedings of the Second Workshop on the LLVM Compiler Infrastructure in HPC","author":"Lam","year":"2015"},{"issue":"7825","key":"2025060120021827400_bib99","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array programming with NumPy","volume":"585","author":"Harris","year":"2020","journal-title":"Nature"},{"issue":"11","key":"2025060120021827400_bib100","doi-asserted-by":"publisher","first-page":"2769","DOI":"10.14778\/3611479.3611486","article-title":"Exploiting cloud object storage for high-performance analytics","volume":"16","author":"Durner","year":"2023","journal-title":"Proc VLDB Endowment"},{"key":"2025060120021827400_bib101","author":"Zarr Python"},{"key":"2025060120021827400_bib102","article-title":"JZarr"},{"key":"2025060120021827400_bib103","article-title":"TensorStore"},{"issue":"5","key":"2025060120021827400_bib104","doi-asserted-by":"publisher","first-page":"718","DOI":"10.1093\/bioinformatics\/btq671","article-title":"Tabix: fast retrieval of sequence features from generic TAB-delimited files","volume":"27","author":"Li","year":"2011","journal-title":"Bioinformatics"},{"issue":"1","key":"2025060120021827400_bib105","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1093\/nar\/29.1.308","article-title":"dbSNP: the NCBI database of genetic variation","volume":"29","author":"Sherry","year":"2001","journal-title":"Nucleic Acids Res"},{"issue":"7917","key":"2025060120021827400_bib106","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1038\/s41586-022-04576-6","article-title":"Whole-genome sequencing reveals host factors underlying critical COVID-19","volume":"607","author":"Kousathanas","year":"2022","journal-title":"Nature"},{"issue":"9","key":"2025060120021827400_bib107","doi-asserted-by":"publisher","first-page":"1800","DOI":"10.1038\/s41588-024-01868-7","article-title":"A Genomics England haplotype reference panel and imputation of UK Biobank","volume":"56","author":"Shi","year":"2024","journal-title":"Nat Genet"},{"issue":"1","key":"2025060120021827400_bib108","doi-asserted-by":"publisher","first-page":"9369","DOI":"10.1038\/s41598-023-32169-4","article-title":"A genotype-to-phenotype approach suggests under-reporting of single nucleotide variants in nephrocystin-1 (NPHP1) related disease (UK 100,000 Genomes Project)","volume":"13","author":"Leggatt","year":"2023","journal-title":"Sci Rep"},{"issue":"5","key":"2025060120021827400_bib109","doi-asserted-by":"publisher","first-page":"fcad244","DOI":"10.1093\/braincomms\/fcad244","article-title":"Repeat expansions in NOP56 are a cause of spinocerebellar ataxia type 36 in the British population","volume":"5","author":"Lam","year":"2023","journal-title":"Brain Commun"},{"issue":"6484","key":"2025060120021827400_bib110","doi-asserted-by":"publisher","first-page":"eaay5012","DOI":"10.1126\/science.aay5012","article-title":"Insights into human genetic variation and population history from 929 diverse genomes","volume":"367","author":"Bergstr\u00f6m","year":"2020","journal-title":"Science"},{"key":"2025060120021827400_bib111","article-title":"Our Future Health data release 9","year":"2024"},{"key":"2025060120021827400_bib112","article-title":"Numcodecs"},{"issue":"7451","key":"2025060120021827400_bib113","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1038\/nature12211","article-title":"The Norway spruce genome sequence and conifer genome evolution","volume":"497","author":"Nystedt","year":"2013","journal-title":"Nature"},{"issue":"16","key":"2025060120021827400_bib114","doi-asserted-by":"publisher","first-page":"2078","DOI":"10.1093\/bioinformatics\/btp352","article-title":"The sequence alignment\/map format and SAMtools","volume":"25","author":"Li","year":"2009","journal-title":"Bioinformatics"},{"issue":"8032","key":"2025060120021827400_bib115","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1038\/s41586-024-07830-1","article-title":"The genomes of all lungfish inform on genome expansion and tetrapod evolution","volume":"634","author":"Schartl","year":"2024","journal-title":"Nature"},{"issue":"1","key":"2025060120021827400_bib116","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1038\/s41588-023-01622-5","article-title":"The ongoing evolution of UShER during the SARS-CoV-2 pandemic","volume":"56","author":"Hinrichs","year":"2024","journal-title":"Nat Genet"},{"issue":"6","key":"2025060120021827400_bib117","doi-asserted-by":"publisher","first-page":"809","DOI":"10.1038\/s41588-021-00862-7","article-title":"Ultrafast Sample placement on Existing tRees (UShER) enables real-time phylogenetics for the SARS-CoV-2 pandemic","volume":"53","author":"Turakhia","year":"2021","journal-title":"Nat Genet"},{"issue":"15","key":"2025060120021827400_bib118","doi-asserted-by":"publisher","first-page":"3734","DOI":"10.1093\/bioinformatics\/btac401","article-title":"matOptimize: a parallel tree optimization method enables online phylogenetics for SARS-CoV-2","volume":"38","author":"Ye","year":"2022","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib119","doi-asserted-by":"publisher","DOI":"10.1101\/2023.06.08.544212","article-title":"Towards pandemic-scale ancestral recombination graphs of SARS-CoV-2","author":"Zhan","year":"2023"},{"key":"2025060120021827400_bib120","doi-asserted-by":"publisher","DOI":"10.1101\/2024.04.29.591666","article-title":"Addressing pandemic-wide systematic errors in the SARS-CoV-2 phylogeny","author":"Hunt","year":"2024"},{"issue":"4","key":"2025060120021827400_bib121","doi-asserted-by":"publisher","first-page":"772","DOI":"10.1093\/molbev\/mst010","article-title":"MAFFT multiple sequence alignment software version 7: improvements in performance and usability","volume":"30","author":"Katoh","year":"2013","journal-title":"Mol Biol Evol"},{"key":"2025060120021827400_bib122","unstructured":"Kelleher J, Zhan SH, Jeffery B. Viridian consensus sequences and metadata (2024-10-14, batch 1 + 2), aligned with MAFFT and converted to VCF Zarr format. 2025; https:\/\/figshare.com\/articles\/dataset\/Viridian_consensus_sequences_and_metadata_2024-10-14_batch_1_2_aligned_with_MAFFT_and_converted_to_VCF_Zarr_format\/28360031. 10.6084\/m9.figshare.28360031.v2."},{"issue":"9","key":"2025060120021827400_bib123","doi-asserted-by":"publisher","first-page":"3021","DOI":"10.1093\/nar\/13.9.3021","article-title":"Nomenclature for incompletely specified bases in nucleic acid sequences: recommendations 1984","volume":"13","author":"Cornish-Bowden","year":"1985","journal-title":"Nucleic Acids Res"},{"key":"2025060120021827400_bib124","doi-asserted-by":"publisher","first-page":"e970v1","DOI":"10.7287\/peerj.preprints.970v1","article-title":"Efficient \u2018pythonic\u2019 access to FASTA files using pyfaidx","volume":"3","author":"Shirley","year":"2015","journal-title":"PeerJ PrePrints"},{"key":"2025060120021827400_bib125","article-title":"pysam: htslib interface for python"},{"issue":"3","key":"2025060120021827400_bib126","doi-asserted-by":"publisher","first-page":"918","DOI":"10.1093\/bioinformatics\/btz615","article-title":"PyRanges: efficient comparison of genomic intervals in Python","volume":"36","author":"Stovner","year":"2020","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib127","article-title":"Optimized Checkpointing with Tensorstore"},{"key":"2025060120021827400_bib128","article-title":"TensorFlow: large-scale machine learning on heterogeneous systems","author":"Abadi","year":"2015"},{"issue":"6","key":"2025060120021827400_bib129","doi-asserted-by":"publisher","first-page":"btae334","DOI":"10.1093\/bioinformatics\/btae334","article-title":"tstrait: a quantitative trait simulator for ancestral recombination graphs","author":"Tagami","year":"2024","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib130","article-title":"Best practices design patterns: optimizing Amazon S3 performance"},{"key":"2025060120021827400_bib131","article-title":"Amazon EC2 on-demand pricing"},{"key":"2025060120021827400_bib132","article-title":"Amazon S3 pricing"},{"issue":"2","key":"2025060120021827400_bib133","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/MM.2010.41","article-title":"The GPU computing era","volume":"30","author":"Nickolls","year":"2010","journal-title":"IEEE Micro"},{"issue":"2","key":"2025060120021827400_bib134","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2636342","article-title":"A survey of methods for analyzing and improving GPU energy efficiency","volume":"47","author":"Mittal","year":"2014","journal-title":"ACM Comput Surv"},{"issue":"5","key":"2025060120021827400_bib135","doi-asserted-by":"publisher","first-page":"879","DOI":"10.1109\/JPROC.2008.917757","article-title":"GPU computing","volume":"96","author":"Owens","year":"2008","journal-title":"Proc IEEE"},{"issue":"16","key":"2025060120021827400_bib136","doi-asserted-by":"publisher","first-page":"2618","DOI":"10.1002\/jcc.20829","article-title":"Accelerating molecular modeling applications with graphics processors","volume":"28","author":"Stone","year":"2007","journal-title":"J Comput Chem"},{"issue":"3","key":"2025060120021827400_bib137","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1038\/s42256-022-00463-x","article-title":"The transformational role of GPU computing and deep learning in drug discovery","volume":"4","author":"Pandey","year":"2022","journal-title":"Nat Mach Intell"},{"key":"2025060120021827400_bib138","article-title":"CuPy: a numpy-compatible library for Nvidia GPU calculations","author":"Okuta","year":"2017"},{"issue":"3","key":"2025060120021827400_bib139","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.parco.2011.09.001","article-title":"PyCUDA and PyOpenCL: a scripting-based approach to GPU run-time code generation","volume":"38","author":"Kl\u00f6ckner","year":"2012","journal-title":"Parallel Comput"},{"issue":"7553","key":"2025060120021827400_bib140","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"issue":"7873","key":"2025060120021827400_bib141","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1038\/s41586-021-03819-2","article-title":"Highly accurate protein structure prediction with AlphaFold","volume":"596","author":"Jumper","year":"2021","journal-title":"Nature"},{"issue":"7990","key":"2025060120021827400_bib142","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1038\/s41586-023-06735-9","article-title":"Scaling deep learning for materials discovery","volume":"624","author":"Merchant","year":"2023","journal-title":"Nature"},{"key":"2025060120021827400_bib143","article-title":"Pytorch: an imperative style, high-performance deep learning library","volume-title":"Advances in Neural Information Processing Systems","author":"Paszke","year":"2019"},{"issue":"18","key":"2025060120021827400_bib144","doi-asserted-by":"publisher","first-page":"3426","DOI":"10.1016\/j.cell.2022.08.004","article-title":"High-coverage whole-genome sequencing of the expanded 1000 Genomes Project cohort including 602 trios","volume":"185","author":"Byrska-Bishop","year":"2022","journal-title":"Cell"},{"key":"2025060120021827400_bib145","article-title":"KvikIO"},{"issue":"3","key":"2025060120021827400_bib146","doi-asserted-by":"publisher","first-page":"msac034","DOI":"10.1093\/molbev\/msac034","article-title":"The carbon footprint of bioinformatics","volume":"39","author":"Grealey","year":"2022","journal-title":"Mol Biol Evol"},{"issue":"1","key":"2025060120021827400_bib147","doi-asserted-by":"publisher","first-page":"btae746","DOI":"10.1093\/bioinformatics\/btae746","article-title":"The scalable variant call representation: enabling genetic analysis beyond one million genomes","volume":"41","author":"Poterba","year":"2025","journal-title":"Bioinformatics"},{"issue":"1","key":"2025060120021827400_bib148","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1093\/bioinformatics\/bty492","article-title":"htsget: a protocol for securely streaming genomic data","volume":"35","author":"Kelleher","year":"2019","journal-title":"Bioinformatics"},{"issue":"17","key":"2025060120021827400_bib149","doi-asserted-by":"publisher","first-page":"2753","DOI":"10.1093\/bioinformatics\/btab087","article-title":"Crypt4GH: a file format standard enabling native access to encrypted data","volume":"37","author":"Senf","year":"2021","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib150","doi-asserted-by":"publisher","first-page":"56","DOI":"10.25080\/Majora-92bf1922-00a","article-title":"Data structures for statistical computing in Python","author":"McKinney","year":"2010"},{"key":"2025060120021827400_bib151","doi-asserted-by":"publisher","first-page":"2825","DOI":"10.48550\/arXiv.1201.0490","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J Mach Learn Res"},{"key":"2025060120021827400_bib152","doi-asserted-by":"publisher","first-page":"87","DOI":"10.3233\/978-1-61499-649-1-87","article-title":"Jupyter Notebooks\u2014a publishing format for reproducible computational workflows","volume-title":"Positioning and Power in Academic Publishing: Players, Agents and Agendas","author":"Kluyver","year":"2016"},{"key":"2025060120021827400_bib153","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","article-title":"SciPy 1.0: fundamental algorithms for scientific computing in Python","volume":"17","author":"Virtanen","year":"2020","journal-title":"Nat. Methods"},{"issue":"1","key":"2025060120021827400_bib154","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1093\/bioinformatics\/btz540","article-title":"Cooler: scalable storage for Hi-C data and other genomically labeled arrays","volume":"36","author":"Abdennur","year":"2020","journal-title":"Bioinformatics"},{"issue":"12","key":"2025060120021827400_bib155","doi-asserted-by":"publisher","first-page":"2198","DOI":"10.1038\/s41592-024-02483-4","article-title":"BioNumPy: array programming for biology","volume":"21","author":"Rand","year":"2024","journal-title":"Nat. Methods"},{"issue":"2","key":"2025060120021827400_bib156","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btae088","article-title":"Bioframe: operations on genomic intervals in pandas dataframes","volume":"40","author":"Open2C","year":"2024","journal-title":"Bioinformatics"},{"issue":"4","key":"2025060120021827400_bib157","doi-asserted-by":"publisher","first-page":"btae148","DOI":"10.1093\/bioinformatics\/btae148","article-title":"Admix-kit: an integrated toolkit and pipeline for genetic analyses of admixed populations","volume":"40","author":"Hou","year":"2024","journal-title":"Bioinformatics"},{"issue":"1","key":"2025060120021827400_bib158","doi-asserted-by":"publisher","first-page":"10","DOI":"10.5334\/jors.148","article-title":"xarray: N-D labeled arrays and datasets in Python","volume":"5","author":"Hoyer","year":"2017","journal-title":"J Open Res Softw"},{"key":"2025060120021827400_bib159","doi-asserted-by":"publisher","first-page":"136","DOI":"10.25080\/Majora-7b98e3ed-013","article-title":"Dask: parallel computation with blocked algorithms and task scheduling","volume-title":"Proceedings of the 14th Python in Science Conference","author":"Rocklin","year":"2015"},{"key":"2025060120021827400_bib160","article-title":"Cubed"},{"key":"2025060120021827400_bib161","article-title":"Sgkit: Scalable genetics toolkit"},{"issue":"7683","key":"2025060120021827400_bib162","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1038\/nature24995","article-title":"Genetic diversity of the African malaria vector Anopheles gambiae","volume":"552","author":"Anopheles gambiae 1000 Genomes Consortium and others","year":"2017","journal-title":"Nature"},{"key":"2025060120021827400_bib163","doi-asserted-by":"crossref","first-page":"42","DOI":"10.12688\/wellcomeopenres.16168.1","article-title":"An open dataset of Plasmodium falciparum genome variation in 7,000 worldwide samples","volume":"6","author":"Ahouidi","year":"2021","journal-title":"Wellcome Open Res"},{"issue":"1","key":"2025060120021827400_bib164","doi-asserted-by":"publisher","first-page":"1411","DOI":"10.1038\/s42003-022-04352-2","article-title":"A molecular barcode and web-based data analysis tool to identify imported Plasmodium vivax malaria","volume":"5","author":"Trimarsanto","year":"2022","journal-title":"Commun Biol"},{"key":"2025060120021827400_bib165","article-title":"Malaria Vector Genome Observatory"},{"key":"2025060120021827400_bib166","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1145\/1966895.1966900","article-title":"An overview of the HDF5 technology suite and its applications","author":"Folk","year":"2011","journal-title":"Proceedings of the EDBT\/ICDT 2011 Workshop on Array Databases"},{"issue":"4","key":"2025060120021827400_bib167","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1109\/38.56302","article-title":"NetCDF: an interface for scientific data access","volume":"10","author":"Rew","year":"1990","journal-title":"IEEE Computer Graphics and Applications"},{"key":"2025060120021827400_bib168","article-title":"GDAL Zarr raster driver"},{"key":"2025060120021827400_bib169","article-title":"NetCDF C"},{"key":"2025060120021827400_bib170","article-title":"n5-zarr"},{"key":"2025060120021827400_bib171","article-title":"xtensor-zarr"},{"key":"2025060120021827400_bib172","doi-asserted-by":"publisher","first-page":"2342","DOI":"10.1038\/s41592-024-02475-4","article-title":"Image processing tools for petabyte-scale light sheet microscopy data","volume":"21","author":"Ruan","year":"2024","journal-title":"Nat Methods"},{"key":"2025060120021827400_bib173","article-title":"Zarr.js"},{"key":"2025060120021827400_bib174","article-title":"Zarr.jl"},{"key":"2025060120021827400_bib175","article-title":"Zarrs"},{"key":"2025060120021827400_bib176","article-title":"Pizzarr"},{"issue":"12","key":"2025060120021827400_bib177","doi-asserted-by":"publisher","first-page":"1496","DOI":"10.1038\/s41592-021-01326-w","article-title":"OME-NGFF: a next-generation file format for expanding bioimaging data-access strategies","volume":"18","author":"Moore","year":"2021","journal-title":"Nat Methods"},{"key":"2025060120021827400_bib178","article-title":"Task 51-cloud-optimized format study","author":"Durbin","year":"2020"},{"issue":"4","key":"2025060120021827400_bib179","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1175\/JTECH-D-21-0106.1","article-title":"Using cloud computing to analyze model output archived in Zarr format","volume":"39","author":"Gowan","year":"2022","journal-title":"J Atmos Oceanic Technol"},{"key":"2025060120021827400_bib180","doi-asserted-by":"publisher","first-page":"0097","DOI":"10.1109\/UEMCON59035.2023.10316074","article-title":"Mappin: a web native browse tool for the NASA JPL ITS_LIVE project\u2019s ice velocity dataset","author":"Fahnestock","year":"2023","journal-title":"2023 IEEE 14th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)"},{"key":"2025060120021827400_bib181","article-title":"CMIP 6 Dataset"},{"key":"2025060120021827400_bib182","doi-asserted-by":"publisher","DOI":"10.2760\/668980","article-title":"Opening new horizons: how to migrate the Copernicus Global Land Service to a cloud environment","author":"Abernathey","year":"2021"},{"key":"2025060120021827400_bib183","article-title":"Zarr Storage Specification 2.0 Community Standard","year":"2022"},{"key":"2025060120021827400_bib184","article-title":"OGC forms new GeoZarr Standards Working Group to establish a Zarr encoding for geospatial data"},{"issue":"3","key":"2025060120021827400_bib185","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1007\/s00418-023-02209-1","article-title":"OME-Zarr: a cloud-optimized bioimaging file format with international community support","volume":"160","author":"Moore","year":"2023","journal-title":"Histochem Cell Biol"},{"key":"2025060120021827400_bib186","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1016\/bs.mcb.2023.01.016","article-title":"Toward scalable reuse of vEM data: OME-Zarr to the rescue","volume-title":"Methods in Cell Biology","author":"Rzepka","year":"2023"},{"issue":"1","key":"2025060120021827400_bib187","doi-asserted-by":"publisher","first-page":"4616","DOI":"10.1038\/s41467-022-32097-3","article-title":"Scarf enables a highly memory-efficient analysis of large-scale single-cell genomics data","volume":"13","author":"Dhapola","year":"2022","journal-title":"Nat Commun"},{"issue":"5","key":"2025060120021827400_bib188","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1038\/s41587-023-01733-8","article-title":"The scverse project provides a computational ecosystem for single-cell omics data analysis","volume":"41","author":"Virshup","year":"2023","journal-title":"Nat Biotechnol"},{"key":"2025060120021827400_bib189","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1038\/s41592-024-02212-x","article-title":"SpatialData: an open and universal data framework for spatial omics","volume":"22","author":"Marconato","year":"2024","journal-title":"Nat Methods"},{"key":"2025060120021827400_bib190","doi-asserted-by":"publisher","first-page":"2023","DOI":"10.1101\/2023.06.07.543950","article-title":"emObject: domain specific data abstraction for spatial omics","author":"Baker","year":"2023","journal-title":"bioRxiv"},{"issue":"11","key":"2025060120021827400_bib191","doi-asserted-by":"publisher","first-page":"946","DOI":"10.1038\/s43588-023-00544-w","article-title":"Predictive analyses of regulatory sequences with EUGENe","volume":"3","author":"Klie","year":"2023","journal-title":"Nat Comput Sci"},{"issue":"5","key":"2025060120021827400_bib192","doi-asserted-by":"publisher","first-page":"741","DOI":"10.1016\/j.ajhg.2023.03.009","article-title":"Fast and accurate Bayesian polygenic risk modeling with variational inference","volume":"110","author":"Zabad","year":"2023","journal-title":"Am J Hum Genet"},{"key":"2025060120021827400_bib193","doi-asserted-by":"publisher","first-page":"2025","DOI":"10.1101\/2025.01.19.633789","article-title":"Towards whole-genome inference of polygenic scores with fast and memory-efficient algorithms","author":"Zabad","year":"2025","journal-title":"bioRxiv"},{"key":"2025060120021827400_bib194","doi-asserted-by":"crossref","unstructured":"K\u00f6nig P, Beier S, Mascher M, et al. \u00a0DivBrowse\u2014interactive visualization and exploratory data analysis of variant call matrices. GigaScience. 2023;12:giad025. 10.1093\/gigascience\/giad025.","DOI":"10.1093\/gigascience\/giad025"},{"key":"2025060120021827400_bib195","unstructured":"Miles A, Rodrigues MF, Ralph P, et al. \u00a0cggh\/scikit-allel: v1.3.6. Zenodo; 2023. 10.5281\/zenodo.7946569."},{"issue":"12","key":"2025060120021827400_bib196","doi-asserted-by":"publisher","first-page":"1867","DOI":"10.1093\/bioinformatics\/btx057","article-title":"cyvcf2: fast, flexible variant analysis with Python","volume":"33","author":"Pedersen","year":"2017","journal-title":"Bioinformatics"},{"key":"2025060120021827400_bib197","article-title":"VCF 4.5"},{"issue":"3","key":"2025060120021827400_bib198","doi-asserted-by":"publisher","first-page":"iyab229","DOI":"10.1093\/genetics\/iyab229","article-title":"Efficient ancestry and mutation simulation with msprime 1.0","volume":"220","author":"Baumdicker","year":"2022","journal-title":"Genetics"},{"issue":"2","key":"2025060120021827400_bib199","doi-asserted-by":"publisher","first-page":"evae005","DOI":"10.1093\/gbe\/evae005","article-title":"The promise of inferring the past using the ancestral recombination graph","volume":"16","author":"Brandt","year":"2024","journal-title":"Genome Biol Evol"},{"issue":"1","key":"2025060120021827400_bib200","doi-asserted-by":"publisher","first-page":"e1011110","DOI":"10.1371\/journal.pgen.1011110","article-title":"The era of the ARG: an introduction to ancestral recombination graphs and their significance in empirical evolutionary genomics","volume":"20","author":"Lewanski","year":"2024","journal-title":"PLoS Genet"},{"issue":"1","key":"2025060120021827400_bib201","doi-asserted-by":"publisher","first-page":"iyae100","DOI":"10.1093\/genetics\/iyae100","article-title":"A general and efficient representation of ancestral recombination graphs","volume":"228","author":"Wong","year":"2024","journal-title":"Genetics"},{"key":"2025060120021827400_bib202","doi-asserted-by":"crossref","unstructured":"Anderson-Trocm\u00e9 L . Simulated genomes from manuscript \u201cOn the genes, genealogies and geographies of Quebec\u201d. Zenodo; 2023. 10.5281\/zenodo.7702392.","DOI":"10.1126\/science.add5300"},{"issue":"11","key":"2025060120021827400_bib203","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pcbi.1006581","article-title":"Efficient pedigree recording for fast population genetics simulation","volume":"14","author":"Kelleher","year":"2018","journal-title":"PLoS Comput Biol"},{"issue":"3","key":"2025060120021827400_bib204","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1534\/genetics.120.303253","article-title":"Efficiently summarizing relationships in large samples: a general duality between statistics of genealogies and genomes","volume":"215","author":"Ralph","year":"2020","journal-title":"Genetics"},{"key":"2025060120021827400_bib205"},{"key":"2025060120021827400_bib206","article-title":"VCF\u00a0Zarr\u00a0Specification\u00a0(Version\u00a01)\u00a0[Computer\u00a0software]","volume-title":"Software\u00a0Heritage","author":"Czech","year":"2025"},{"key":"2025060120021827400_bib207","article-title":"VCF\u00a0Zarr\u00a0Publication\u00a0(Version\u00a01)\u00a0[Computer\u00a0software]","volume-title":"Software\u00a0Heritage","author":"Czech","year":"2025"},{"key":"2025060120021827400_bib208","article-title":"Bio2zarr:\u00a0convert\u00a0bioinformatics\u00a0file\u00a0formats\u00a0to\u00a0Zarr\u00a0(Version\u00a01) [Computer\u00a0software]","volume-title":"Software\u00a0Heritage","author":"Czech","year":"2025"},{"key":"2025060120021827400_bib209","article-title":"SAIGE-VCZ: SAIGE extension that supports VCF Zarr (Version 1)\u00a0[Computer software]","volume-title":"Software Heritage","author":"Czech","year":"2025"},{"key":"2025060120021827400_bib210","article-title":"Vcztools: partial reimplementation of bcftools for VCF Zarr (Version 1)\u00a0[Computer software]","volume-title":"Software Heritage","author":"Czech","year":"2025"},{"key":"2025060120021827400_bib211","article-title":"Genomics England Research Environment User Guide: Aggregated Variant Calls"},{"key":"2025060120021827400_bib212","article-title":"Genomics England: Join the Research Network"},{"key":"2025060120021827400_bib213","article-title":"Our Future Health: Apply to access the data"},{"key":"2025060120021827400_bib214","article-title":"All of Us CDRv7"},{"key":"2025060120021827400_bib215","article-title":"All of Us: How to Register"},{"key":"2025060120021827400_bib216","author":"PlantGenIE"},{"key":"2025060120021827400_bib217","author":"Our Future Health Publication policy"}],"container-title":["GigaScience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/gigascience\/article-pdf\/doi\/10.1093\/gigascience\/giaf049\/63410024\/giaf049.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/gigascience\/article-pdf\/doi\/10.1093\/gigascience\/giaf049\/63410024\/giaf049.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,1]],"date-time":"2025-06-01T20:02:28Z","timestamp":1748808148000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/gigascience\/article\/doi\/10.1093\/gigascience\/giaf049\/8154315"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025]]},"references-count":217,"URL":"https:\/\/doi.org\/10.1093\/gigascience\/giaf049","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.06.11.598241","asserted-by":"object"}]},"ISSN":["2047-217X"],"issn-type":[{"value":"2047-217X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2025]]},"published":{"date-parts":[[2025]]},"article-number":"giaf049"}}