{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,3]],"date-time":"2026-03-03T21:42:38Z","timestamp":1772574158716,"version":"3.50.1"},"reference-count":23,"publisher":"Oxford University Press (OUP)","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,1,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Motivation : The development of cost-effective next-generation sequencing methods has spurred the development of high-throughput bioinformatics tools for detection of sequence variation. With many disparate variant-calling algorithms available, investigators must ask, \u2018Which method is best for my data?\u2019 Machine learning research has shown that so-called ensemble methods that combine the output of multiple models can dramatically improve classifier performance. Here we describe a novel variant-calling approach based on an ensemble of variant-calling algorithms, which we term the Consensus Genotyper for Exome Sequencing (CGES). CGES uses a two-stage voting scheme among four algorithm implementations. While our ensemble method can accept variants generated by any variant-calling algorithm, we used GATK2.8, SAMtools, FreeBayes and Atlas-SNP2 in building CGES because of their performance, widespread adoption and diverse but complementary algorithms.<\/jats:p>\n               <jats:p>Results : We apply CGES to 132 samples sequenced at the Hudson Alpha Institute for Biotechnology (HAIB, Huntsville, AL) using the Nimblegen Exome Capture and Illumina sequencing technology. Our sample set consisted of 40 complete trios, two families of four, one parent\u2013child duo and two unrelated individuals. CGES yielded the fewest total variant calls ( NCGES=139\u00b0897 ), the highest Ts\/Tv ratio (3.02), the lowest Mendelian error rate across all genotypes (0.028%), the highest rediscovery rate from the Exome Variant Server (EVS; 89.3%) and 1000 Genomes (1KG; 84.1%) and the highest positive predictive value (PPV; 96.1%) for a random sample of previously validated de novo variants. We describe these and other quality control (QC) metrics from consensus data and explain how the CGES pipeline can be used to generate call sets of varying quality stringency, including consensus calls present across all four algorithms, calls that are consistent across any three out of four algorithms, calls that are consistent across any two out of four algorithms or a more liberal set of all calls made by any algorithm.<\/jats:p>\n               <jats:p>Availability and implementation : To enable accessible, efficient and reproducible analysis, we implement CGES both as a stand-alone command line tool available for download in GitHub and as a set of Galaxy tools and workflows configured to execute on parallel computers.<\/jats:p>\n               <jats:p>Contact : trubetskoy@uchicago.edu<\/jats:p>\n               <jats:p>Supplementary information: \u00a0Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btu591","type":"journal-article","created":{"date-parts":[[2014,10,1]],"date-time":"2014-10-01T07:57:30Z","timestamp":1412150250000},"page":"187-193","source":"Crossref","is-referenced-by-count":18,"title":["Consensus Genotyper for Exome Sequencing (CGES): improving the quality of exome variant genotypes"],"prefix":"10.1093","volume":"31","author":[{"given":"Vassily","family":"Trubetskoy","sequence":"first","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alex","family":"Rodriguez","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Uptal","family":"Dave","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas","family":"Campbell","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"},{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emily L.","family":"Crawford","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"},{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Edwin H.","family":"Cook","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"James S.","family":"Sutcliffe","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"},{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ian","family":"Foster","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ravi","family":"Madduri","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nancy J.","family":"Cox","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lea K.","family":"Davis","sequence":"additional","affiliation":[{"name":"1 Department of Medicine, Section of Genetic Medicine, 2 Computation Institute, University of Chicago, Chicago, IL 60637, 3 Department of Molecular Physiology and Biophysics, Vanderbilt University, Nashville, Tennessee 37232, USA, 4 Vanderbilt Brain Institute, Vanderbilt University School of Medicine, Nashville, TN 37232 and 5 Department of Psychiatry, University of Illinois at Chicago, Chicago, IL 60608, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2014,9,29]]},"reference":[{"key":"2023020116142014400_btu591-B1","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1101\/gr.112326.110","article-title":"Dindel: accurate indel calls from short-read data","volume":"21","author":"Albers","year":"2011","journal-title":"Genome Res."},{"key":"2023020116142014400_btu591-B2","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1192\/bjp.175.5.444","article-title":"Autism screening questionnaire: diagnostic validity","volume":"175","author":"Berument","year":"1999","journal-title":"Br. J. Psychiatry"},{"key":"2023020116142014400_btu591-B3","doi-asserted-by":"crossref","DOI":"10.1002\/0471142727.mb1910s89","article-title":"Galaxy: a web-based genome analysis tool for experimentalists","author":"Blankenberg","year":"2010","journal-title":"Curr. Protoc. Mol. Biol."},{"key":"2023020116142014400_btu591-B4","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/1471-2105-13-8","article-title":"An integrative variant analysis suite for whole exome next-generation sequencing data","volume":"13","author":"Challis","year":"2012","journal-title":"BMC Bioinformatics"},{"key":"2023020116142014400_btu591-B5","doi-asserted-by":"crossref","first-page":"2156","DOI":"10.1093\/bioinformatics\/btr330","article-title":"The variant call format and VCFtools","volume":"27","author":"Danecek","year":"2011","journal-title":"Bioinformatics"},{"key":"2023020116142014400_btu591-B6","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1038\/ng.806","article-title":"A framework for variation discovery and genotyping using next-generation DNA sequencing data","volume":"43","author":"DePristo","year":"2011","journal-title":"Nat. Genet."},{"key":"2023020116142014400_btu591-B7","first-page":"1","article-title":"Haplotype-based variant detection from short-read sequencing","author":"Garrison","year":"2012","journal-title":"arXiv preprint arXiv:1207.3907"},{"key":"2023020116142014400_btu591-B8","doi-asserted-by":"crossref","first-page":"1451","DOI":"10.1101\/gr.4086505","article-title":"Galaxy: a platform for interactive large-scale genome analysis","volume":"15","author":"Giardine","year":"2005","journal-title":"Genome Res."},{"key":"2023020116142014400_btu591-B9","doi-asserted-by":"crossref","first-page":"R86","DOI":"10.1186\/gb-2010-11-8-r86","article-title":"Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences","volume":"11","author":"Goecks","year":"2010","journal-title":"Genome Biol."},{"key":"2023020116142014400_btu591-B10","doi-asserted-by":"crossref","first-page":"568","DOI":"10.1101\/gr.129684.111","article-title":"VarScan 2: Somatic mutation and copy number alteration discovery in cancer by exome sequencing","volume":"22","author":"Koboldt","year":"2012","journal-title":"Genome Res."},{"key":"2023020116142014400_btu591-B11","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1007\/BF02212936","article-title":"Autism diagnostic interview: a standardized investigator-based instrument","volume":"19","author":"Le Couteur","year":"1989","journal-title":"J. Autism Dev. Disord."},{"key":"2023020116142014400_btu591-B12","doi-asserted-by":"crossref","first-page":"2078","DOI":"10.1093\/bioinformatics\/btp352","article-title":"The sequence alignment\/map format and SAMtools","volume":"25","author":"Li","year":"2009","journal-title":"Bioinformatics"},{"key":"2023020116142014400_btu591-B13","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1101\/gr.088013.108","article-title":"SNP detection for massively parallel whole-genome resequencing","volume":"19","author":"Li","year":"2009","journal-title":"Genome Res."},{"key":"2023020116142014400_btu591-B14","doi-asserted-by":"crossref","first-page":"e1003443","DOI":"10.1371\/journal.pgen.1003443","article-title":"Analysis of rare, exonic variation amongst subjects with autism spectrum disorders and population controls","volume":"9","author":"Liu","year":"2013","journal-title":"PLoS Genet."},{"key":"2023020116142014400_btu591-B15","author":"Madduri","year":"2013"},{"key":"2023020116142014400_btu591-B16","doi-asserted-by":"crossref","first-page":"2803","DOI":"10.1093\/bioinformatics\/btq526","article-title":"SeqEM: an adaptive genotype-calling approach for next-generation sequencing studies","volume":"26","author":"Martin","year":"2010","journal-title":"Bioinformatics"},{"key":"2023020116142014400_btu591-B17","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1101\/gr.107524.110","article-title":"The genome analysis toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data","volume":"20","author":"McKenna","year":"2010","journal-title":"Genome Res."},{"key":"2023020116142014400_btu591-B18","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1038\/nature11011","article-title":"Patterns and rates of exonic de novo mutations in autism spectrum disorders","volume":"485","author":"Neale","year":"2012","journal-title":"Nature"},{"key":"2023020116142014400_btu591-B19","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/gm432","article-title":"Low concordance of multiple variant-calling pipelines: practical implications for exome and genome sequencing","volume":"5","author":"O\u2019Rawe","year":"2013","journal-title":"Genome Med."},{"key":"2023020116142014400_btu591-B20","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1086\/519795","article-title":"PLINK: a tool set for whole-genome association and population-based linkage analyses","volume":"81","author":"Purcell","year":"2007","journal-title":"Am. J. Hum. Genet."},{"key":"2023020116142014400_btu591-B21","author":"Wilde","year":"2011"},{"key":"2023020116142014400_btu591-B22","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1186\/1471-2105-14-274","article-title":"Comparing a few SNP calling algorithms using low-coverage sequencing data","volume":"14","author":"Yu","year":"2013","journal-title":"BMC Bioinformatics"},{"key":"2023020116142014400_btu591-B23","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1038\/nbt.2835","article-title":"Integrating human sequence data sets provides a resource of benchmark SNP and indel genotype calls","volume":"32","author":"Zook","year":"2014","journal-title":"Nature biotechnology"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/2\/187\/49012126\/bioinformatics_31_2_187.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/31\/2\/187\/49012126\/bioinformatics_31_2_187.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T00:22:54Z","timestamp":1675297374000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/31\/2\/187\/2365164"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,9,29]]},"references-count":23,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2015,1,15]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btu591","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,1,15]]},"published":{"date-parts":[[2014,9,29]]}}}