{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T11:02:42Z","timestamp":1783335762716,"version":"3.54.6"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T00:00:00Z","timestamp":1628899200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T00:00:00Z","timestamp":1628899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000144","name":"Division of Computer and Network Systems","doi-asserted-by":"publisher","award":["1624790"],"award-info":[{"award-number":["1624790"]}],"id":[{"id":"10.13039\/100000144","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000144","name":"Division of Computer and Network Systems","doi-asserted-by":"publisher","award":["1337732"],"award-info":[{"award-number":["1337732"]}],"id":[{"id":"10.13039\/100000144","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1725729"],"award-info":[{"award-number":["1725729"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Modern Next Generation- and Third Generation- Sequencing methods such as Illumina and PacBio Circular Consensus Sequencing platforms provide accurate sequencing data. Parallel developments in Deep Learning have enabled the application of Deep Neural Networks to variant calling, surpassing the accuracy of classical approaches in many settings. DeepVariant, arguably the most popular among such methods, transforms the problem of variant calling into one of image recognition where a Deep Neural Network analyzes sequencing data that is formatted as images, achieving high accuracy. In this paper, we explore an alternative approach to designing Deep Neural Networks for variant calling, where we use meticulously designed Deep Neural Network architectures and customized variant inference functions that account for the underlying nature of sequencing data instead of converting the problem to one of image recognition.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Results from 27 whole-genome variant calling experiments spanning Illumina, PacBio and hybrid Illumina-PacBio settings suggest that our method allows vastly smaller Deep Neural Networks to outperform the Inception-v3 architecture used in DeepVariant for indel and substitution-type variant calls. For example, our method reduces the number of indel call errors by up to 18%, 55% and 65% for Illumina, PacBio and hybrid Illumina-PacBio variant calling respectively, compared to a similarly trained DeepVariant pipeline. In these cases, our models are between 7 and 14 times smaller.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>We believe that the improved accuracy and problem-specific customization of our models will enable more accurate pipelines and further method development in the field. HELLO is available at<jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/github.com\/anands-repo\/hello\">https:\/\/github.com\/anands-repo\/hello<\/jats:ext-link><\/jats:p><\/jats:sec>","DOI":"10.1186\/s12859-021-04311-4","type":"journal-article","created":{"date-parts":[[2021,8,14]],"date-time":"2021-08-14T09:02:42Z","timestamp":1628931762000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["HELLO: improved neural network architectures and methodologies for small variant calling"],"prefix":"10.1186","volume":"22","author":[{"given":"Anand","family":"Ramachandran","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven S.","family":"Lumetta","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric W.","family":"Klee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3016-0270","authenticated-orcid":false,"given":"Deming","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,8,14]]},"reference":[{"issue":"11","key":"4311_CR1","doi-asserted-by":"publisher","first-page":"745","DOI":"10.1038\/nrg3031","volume":"12","author":"MJ Bamshad","year":"2011","unstructured":"Bamshad MJ, Ng SB, Bigham AW, Tabor HK, Emond MJ, Nickerson DA, et al. Exome sequencing as a tool for Mendelian disease gene discovery. Nat Rev Genet. 2011;12(11):745\u201355.","journal-title":"Nat Rev Genet"},{"key":"4311_CR2","doi-asserted-by":"crossref","unstructured":"Dai J, Huang M, Amos CI, Hung RJ, Tardon A, Andrew A, et al. Genome-wide association study of INDELs identified four novel susceptibility loci associated with lung cancer risk. International Journal of Cancer. 2019.","DOI":"10.1002\/ijc.32698"},{"issue":"66","key":"4311_CR3","doi-asserted-by":"publisher","first-page":"110635","DOI":"10.18632\/oncotarget.22372","volume":"8","author":"N Deng","year":"2017","unstructured":"Deng N, Zhou H, Fan H, Yuan Y. Single nucleotide polymorphisms and cancer susceptibility. Oncotarget. 2017;8(66):110635\u201349.","journal-title":"Oncotarget"},{"issue":"7","key":"4311_CR4","doi-asserted-by":"publisher","first-page":"812","DOI":"10.1038\/ng.2312","volume":"44","author":"Y Jiao","year":"2012","unstructured":"Jiao Y, Zhao H, Ren L, Song W, Zeng B, Guo J, et al. Genome-wide genetic changes during modern breeding of maize. Nat Genet. 2012;44(7):812\u20135.","journal-title":"Nat Genet"},{"issue":"7571","key":"4311_CR5","doi-asserted-by":"publisher","first-page":"68","DOI":"10.1038\/nature15393","volume":"526","author":"A Auton","year":"2015","unstructured":"Auton A, Brooks LD, Durbin RM, Garrison EP, Kang HM, Korbel JO, et al. A global reference for human genetic variation. Nature. 2015;526(7571):68\u201374.","journal-title":"Nature"},{"key":"4311_CR6","doi-asserted-by":"crossref","unstructured":"Hoffmann S, Otto C, Kurtz S, Sharma CM, Khaitovich P, Vogel J, et al. Fast Mapping of Short Sequences with Mismatches, Insertions and Deletions Using Index Structures. PLOS Computational Biology. 2009; 5(9).","DOI":"10.1371\/journal.pcbi.1000502"},{"issue":"16","key":"4311_CR7","doi-asserted-by":"publisher","first-page":"2097","DOI":"10.1093\/bioinformatics\/bts330","volume":"28","author":"H Lee","year":"2012","unstructured":"Lee H, Schatz MC. Genomic dark matter. Bioinformatics. 2012;28(16):2097\u2013105.","journal-title":"Bioinformatics"},{"issue":"10","key":"4311_CR8","doi-asserted-by":"publisher","first-page":"1155","DOI":"10.1038\/s41587-019-0217-9","volume":"37","author":"AM Wenger","year":"2019","unstructured":"Wenger AM, Peluso P, Rowell WJ, Chang PC, Hall RJ, Concepcion GT, et al. Accurate circular consensus long-read sequencing improves variant detection and assembly of a human genome. Nat Biotechnol. 2019;37(10):1155\u201362.","journal-title":"Nat Biotechnol"},{"issue":"5","key":"4311_CR9","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1038\/ng.806","volume":"43","author":"MA DePristo","year":"2011","unstructured":"DePristo MA, Banks E, Poplin R, Garimella KV, Maguire JR, Hartl C, et al. A framework for variation discovery and genotyping using next-generation DNA sequencing data. Nat Genet. 2011;43(5):491\u20138.","journal-title":"Nat Genet"},{"issue":"10","key":"4311_CR10","doi-asserted-by":"publisher","first-page":"983","DOI":"10.1038\/nbt.4235","volume":"36","author":"R Poplin","year":"2018","unstructured":"Poplin R, Chang PC, Alexander D, Schwartz S, Colthurst T, Ku A, et al. A universal SNP and small-indel variant caller using deep neural networks. Nat Biotechnol. 2018;36(10):983\u20137.","journal-title":"Nat Biotechnol"},{"issue":"1","key":"4311_CR11","doi-asserted-by":"publisher","first-page":"998","DOI":"10.1038\/s41467-019-09025-z","volume":"10","author":"R Luo","year":"2019","unstructured":"Luo R, Sedlazeck FJ, Lam TW, Schatz MC. A multi-task convolutional deep neural network for variant calling in single molecule sequencing. Nat Commun. 2019;10(1):998.","journal-title":"Nat Commun"},{"key":"4311_CR12","doi-asserted-by":"crossref","unstructured":"Wagner J, Olson ND, Harris L, Khan Z, Farek J, Mahmoud M, et al. Benchmarking challenging small variants with linked and long reads. bioRxiv. 2020.","DOI":"10.1101\/2020.07.24.212712"},{"issue":"6","key":"4311_CR13","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. Commun ACM. 2017;60(6):84\u201390.","journal-title":"Commun ACM"},{"key":"4311_CR14","unstructured":"Battaglia PW, Hamrick JB, Bapst V, Sanchez-Gonzalez A, Zambaldi VF, Malinowski M, et al. Relational inductive biases, deep learning, and graph networks. arXiv preprint https:\/\/arxiv.org\/abs\/1806.01261. 2018."},{"key":"4311_CR15","unstructured":"NIST. Genome in a Bottle. [Online].; 2012. Available from: https:\/\/www.nist.gov\/programs-projects\/genome-bottle."},{"key":"4311_CR16","doi-asserted-by":"crossref","unstructured":"Zook JM, McDaniel J, Olson ND, Wagner J, Parikh H, Heaton H, et al. An open resource for accurately benchmarking small variant and reference calls. Nature Biotechnology. 2019;: 561\u2013566.","DOI":"10.1038\/s41587-019-0074-6"},{"key":"4311_CR17","unstructured":"Google. Deepvariant Docker page. [Online]. [cited 2021. Available from: https:\/\/hub.docker.com\/r\/google\/deepvariant."},{"key":"4311_CR18","unstructured":"Broad Institute. [Online]. [cited 2021. Available from: https:\/\/hub.docker.com\/r\/broadinstitute\/gatk."},{"issue":"14","key":"4311_CR19","doi-asserted-by":"publisher","first-page":"1754","DOI":"10.1093\/bioinformatics\/btp324","volume":"25","author":"H Li","year":"2009","unstructured":"Li H, Durbin R. Fast and accurate short read alignment with Burrows-Wheeler transform. Bioinformatics. 2009;25(14):1754\u201360.","journal-title":"Bioinformatics"},{"key":"4311_CR20","doi-asserted-by":"crossref","unstructured":"Martin M, Patterson , (Shilpa) SG, Fischer S, Pisanti N, Klau GW, et al. WhatsHap: fast and accurate read-based phasing. bioRxiv. 2016;: 85050.","DOI":"10.1101\/085050"},{"issue":"16","key":"4311_CR21","doi-asserted-by":"publisher","first-page":"2078","DOI":"10.1093\/bioinformatics\/btp352","volume":"25","author":"H Li","year":"2009","unstructured":"Li H, Handsaker B, Wysoker A, Fennell T, Ruan J, Homer N, et al. The Sequence Alignment\/Map format and SAMtools. Bioinformatics. 2009;25(16):2078\u20139.","journal-title":"Bioinformatics"},{"key":"4311_CR22","unstructured":"Broadinstitute. Picard tools. [Online].; 2020. Available from: http:\/\/broadinstitute.github.io\/picard\/."},{"issue":"5","key":"4311_CR23","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1038\/s41587-019-0054-x","volume":"37","author":"P Krusche","year":"2019","unstructured":"Krusche P, Trigg L, Boutros PC, Mason CE, Vega FMDL, Moore BL, et al. Best practices for benchmarking germline small-variant calls in human genomes. Nat Biotechnol. 2019;37(5):555\u201360.","journal-title":"Nat Biotechnol"},{"key":"4311_CR24","unstructured":"Broad-Institute. Germline short variant discovery. [Online].; 2020. Available from: https:\/\/gatk.broadinstitute.org\/hc\/en-us\/articles\/360035535932-Germline-short-variant-discovery-SNPs-Indels-."},{"key":"4311_CR25","unstructured":"Pacific-Biosciences. pbmm2 aligner for long reads. [Online].; 2020. Available from: https:\/\/github.com\/PacificBiosciences\/pbmm2."},{"issue":"18","key":"4311_CR26","doi-asserted-by":"publisher","first-page":"3094","DOI":"10.1093\/bioinformatics\/bty191","volume":"34","author":"H Li","year":"2018","unstructured":"Li H. Minimap2: pairwise alignment for nucleotide sequences. Bioinformatics. 2018;34(18):3094\u2013100.","journal-title":"Bioinformatics"},{"issue":"5","key":"4311_CR27","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1101\/gr.214767.116","volume":"27","author":"X Fan","year":"2017","unstructured":"Fan X, Chaisson M, Nakhleh L, Chen K. HySA: a Hybrid Structural variant Assembly approach using next-generation and single-molecule sequencing technologies. Genome Res. 2017;27(5):793\u2013800.","journal-title":"Genome Res"},{"issue":"5","key":"4311_CR28","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","volume":"2","author":"K Hornik","year":"1989","unstructured":"Hornik K, Stinchcombe M, White H. Multilayer feedforward networks are universal approximators. Neural Netw. 1989;2(5):359\u201366.","journal-title":"Neural Netw"},{"key":"4311_CR29","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2016. p. 770\u2013778.","DOI":"10.1109\/CVPR.2016.90"},{"key":"4311_CR30","unstructured":"Salimans T, Kingma DP. Weight normalization: a simple reparameterization to accelerate training of deep neural networks. In NIPS'16 Proceedings of the 30th International Conference on Neural Information Processing Systems; 2016. p. 901\u2013909."},{"key":"4311_CR31","unstructured":"Ioffe S, Szegedy C. Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. In Proceedings of The 32nd International Conference on Machine Learning; 2015. p. 448\u2013456."},{"key":"4311_CR32","unstructured":"Tange O. GNU Parallel: The Command-Line Power Tool. login Usenix Mag. 2011; 36."},{"key":"4311_CR33","doi-asserted-by":"crossref","unstructured":"Volodymyr Kindratenko DM,Z,M,HH,R,X,C,P,G. HAL: Computer System for Scalable Deep Learning. Practice and Experience in Advanced Research Computing. 2020;: 41\u201348.","DOI":"10.1145\/3311790.3396649"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04311-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-021-04311-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-021-04311-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,7]],"date-time":"2023-11-07T11:08:34Z","timestamp":1699355314000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-021-04311-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,14]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["4311"],"URL":"https:\/\/doi.org\/10.1186\/s12859-021-04311-4","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,14]]},"assertion":[{"value":"9 January 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 July 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication."}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"404"}}