{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T19:41:18Z","timestamp":1784230878140,"version":"3.55.0"},"reference-count":74,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2021,12,7]],"date-time":"2021-12-07T00:00:00Z","timestamp":1638835200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Institute of Biological, Environmental and Rural Sciences Aberystwyth PhD fellowship"},{"DOI":"10.13039\/501100000268","name":"Biotechnology and Biological Sciences Research Council","doi-asserted-by":"publisher","award":["BB\/E\/W\/10964A01"],"award-info":[{"award-number":["BB\/E\/W\/10964A01"]}],"id":[{"id":"10.13039\/501100000268","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000268","name":"Biotechnology and Biological Sciences Research Council","doi-asserted-by":"publisher","award":["BBS\/OS\/GC\/000011B"],"award-info":[{"award-number":["BBS\/OS\/GC\/000011B"]}],"id":[{"id":"10.13039\/501100000268","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Department of Agriculture, Food and the Marine Ireland\/DAERA Northern Ireland"},{"name":"European Commission via Horizon 2020"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,2,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>The biases in CoDing Sequence (CDS) prediction tools, which have been based on historic genomic annotations from model organisms, impact our understanding of novel genomes and metagenomes. This hinders the discovery of new genomic information as it results in predictions being biased towards existing knowledge. To date, users have lacked a systematic and replicable approach to identify the strengths and weaknesses of any CDS prediction tool and allow them to choose the right tool for their analysis.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We present an evaluation framework (ORForise) based on a comprehensive set of 12 primary and 60 secondary metrics that facilitate the assessment of the performance of CDS prediction tools. This makes it possible to identify which performs better for specific use-cases. We use this to assess 15 ab initio- and model-based tools representing those most widely used (historically and currently) to generate the knowledge in genomic databases. We find that the performance of any tool is dependent on the genome being analysed, and no individual tool ranked as the most accurate across all genomes or metrics analysed. Even the top-ranked tools produced conflicting gene collections, which could not be resolved by aggregation. The ORForise evaluation framework provides users with a replicable, data-led approach to make informed tool choices for novel genome annotations and for refining historical annotations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability and implementation<\/jats:title>\n                    <jats:p>Code and datasets for reproduction and customisation are available at https:\/\/github.com\/NickJD\/ORForise.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Supplementary information<\/jats:title>\n                    <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btab827","type":"journal-article","created":{"date-parts":[[2021,12,2]],"date-time":"2021-12-02T15:14:26Z","timestamp":1638458066000},"page":"1198-1207","source":"Crossref","is-referenced-by-count":49,"title":["No one tool to rule them all: prokaryotic gene prediction tool annotations are highly dependent on the organism of study"],"prefix":"10.1093","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3808-206X","authenticated-orcid":false,"given":"Nicholas J","family":"Dimonaco","sequence":"first","affiliation":[{"name":"Institute of Biological, Environmental and Rural Sciences, Aberystwyth University , Aberystwyth SY23 3PD, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3351-1758","authenticated-orcid":false,"given":"Wayne","family":"Aubrey","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Aberystwyth University , Aberystwyth SY23 3DB, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7074-7159","authenticated-orcid":false,"given":"Kim","family":"Kenobi","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Aberystwyth University , Aberystwyth SY23 3BZ, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8315-3659","authenticated-orcid":false,"given":"Amanda","family":"Clare","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Aberystwyth University , Aberystwyth SY23 3DB, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7183-1555","authenticated-orcid":false,"given":"Christopher J","family":"Creevey","sequence":"additional","affiliation":[{"name":"School of Biological Sciences, Queen\u2019s University Belfast , Belfast BT7 1NN, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2021,12,7]]},"reference":[{"key":"2023020108552078600_btab827-B1"},{"key":"2023020108552078600_btab827-B2","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1038\/nrg3520","article-title":"Emerging evidence for functional peptides encoded by short open reading frames","volume":"15","author":"Andrews","year":"2014","journal-title":"Nat. Rev. Genet"},{"key":"2023020108552078600_btab827-B3","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1093\/oxfordjournals.molbev.a026133","article-title":"CRITICA: coding region identification tool invoking comparative analysis","volume":"16","author":"Badger","year":"1999","journal-title":"Mol. Biol. Evol"},{"key":"2023020108552078600_btab827-B4","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1038\/nrg3963","article-title":"Augmented genetic decoding: global, local and temporal alterations of decoding processes and codon meaning","volume":"16","author":"Baranov","year":"2015","journal-title":"Nat. Rev. Genet"},{"key":"2023020108552078600_btab827-B5","doi-asserted-by":"crossref","first-page":"e89","DOI":"10.1093\/nar\/gkab477","article-title":"smORFer: a modular algorithm to detect small ORFs in prokaryotes","volume":"49","author":"Bartholom\u00e4us","year":"2021","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B6","doi-asserted-by":"crossref","first-page":"3911","DOI":"10.1093\/nar\/27.19.3911","article-title":"Heuristic approach to deriving models for gene finding","volume":"27","author":"Besemer","year":"1999","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B7","doi-asserted-by":"crossref","first-page":"W451","DOI":"10.1093\/nar\/gki487","article-title":"GeneMark: web software for gene finding in prokaryotes, eukaryotes and viruses","volume":"33","author":"Besemer","year":"2005","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B8","doi-asserted-by":"crossref","first-page":"2607","DOI":"10.1093\/nar\/29.12.2607","article-title":"GeneMarkS: a self-training method for prediction of gene starts in microbial genomes. Implications for finding sequence motifs in regulatory regions","volume":"29","author":"Besemer","year":"2001","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B9","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1016\/0097-8485(93)85004-V","article-title":"GENMARK: parallel gene recognition for both DNA strands","volume":"17","author":"Borodovsky","year":"1993","journal-title":"Comput. Chem"},{"key":"2023020108552078600_btab827-B10","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/S0168-9525(99)01706-0","article-title":"Errors in genome annotation","volume":"15","author":"Brenner","year":"1999","journal-title":"Trends Genet"},{"key":"2023020108552078600_btab827-B11","doi-asserted-by":"crossref","first-page":"1777","DOI":"10.1101\/gr.3866105","article-title":"Genome annotation past, present, and future: how to define an ORF at each locus","volume":"15","author":"Brent","year":"2005","journal-title":"Genome Res"},{"key":"2023020108552078600_btab827-B12","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1038\/nrmicro787","article-title":"The regulation of bacterial transcription initiation","volume":"2","author":"Browning","year":"2004","journal-title":"Nat. Rev. Microbiol"},{"key":"2023020108552078600_btab827-B13","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/S0959-440X(98)80069-9","article-title":"Finding the genes in genomic DNA","volume":"8","author":"Burge","year":"1998","journal-title":"Curr. Opin. Struct. Biol"},{"key":"2023020108552078600_btab827-B14","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1128\/JB.01366-13","article-title":"The giant protein Ebh is a determinant of Staphylococcus aureus cell size and complement resistance","volume":"196","author":"Cheng","year":"2014","journal-title":"J. Bacteriol"},{"key":"2023020108552078600_btab827-B15","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1038\/newbio245261a0","article-title":"Conserved terminal sequence in 18S rRNA may represent terminator anticodons","volume":"245","author":"Dalgarno","year":"1973","journal-title":"Nat. New Biol"},{"key":"2023020108552078600_btab827-B16","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/S0968-0004(98)01274-2","article-title":"Conservation of gene order: a fingerprint of proteins that physically interact","volume":"23","author":"Dandekar","year":"1998","journal-title":"Trends Biochem. Sci"},{"key":"2023020108552078600_btab827-B17","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1093\/bioinformatics\/btm009","article-title":"Identifying bacterial genes and endosymbiont DNA with Glimmer","volume":"23","author":"Delcher","year":"2007","journal-title":"Bioinformatics"},{"key":"2023020108552078600_btab827-B18","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1016\/S0168-9525(01)02348-4","article-title":"Intrinsic errors in genome annotation","volume":"17","author":"Devos","year":"2001","journal-title":"Trends Genet"},{"key":"2023020108552078600_btab827-B19","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1186\/s12864-017-3771-x","article-title":"OrthoFiller: utilising data from multiple species to improve the completeness of genome annotations","volume":"18","author":"Dunne","year":"2017","journal-title":"BMC Genomics"},{"key":"2023020108552078600_btab827-B20","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.mib.2017.09.010","article-title":"Small bacterial and phagic proteins: an updated view on a rapidly moving field","volume":"39","author":"Duval","year":"2017","journal-title":"Curr. Opin. Microbiol"},{"key":"2023020108552078600_btab827-B21","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1146\/annurev.micro.50.1.25","article-title":"Molecular biology of Mycoplasmas","volume":"50","author":"Dybvig","year":"1996","journal-title":"Annu. Rev. Microbiol"},{"key":"2023020108552078600_btab827-B22","doi-asserted-by":"crossref","first-page":"R44","DOI":"10.1186\/gb-2005-6-5-r44","article-title":"The sequence ontology: a tool for the unification of genome annotations","volume":"6","author":"Eilbeck","year":"2005","journal-title":"Genome Biol"},{"key":"2023020108552078600_btab827-B23","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1016\/j.sbi.2012.07.005","article-title":"Current challenges in genome annotation through structural biology and bioinformatics","volume":"22","author":"Furnham","year":"2012","journal-title":"Curr. Opin. Struct. Biol"},{"key":"2023020108552078600_btab827-B24","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/S0097-8485(97)00008-9","article-title":"Computational gene identification: an open problem","volume":"21","author":"Guigo","year":"1997","journal-title":"Comput. Chem"},{"key":"2023020108552078600_btab827-B25","doi-asserted-by":"crossref","first-page":"1494","DOI":"10.1038\/nprot.2013.084","article-title":"De novo transcript sequence reconstruction from RNA-seq using the Trinity platform for reference generation and analysis","volume":"8","author":"Haas","year":"2013","journal-title":"Nat. Protoc"},{"key":"2023020108552078600_btab827-B26","doi-asserted-by":"crossref","first-page":"D851","DOI":"10.1093\/nar\/gkx1068","article-title":"RefSeq: an update on prokaryotic genome annotation and curation","volume":"46","author":"Haft","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B27","doi-asserted-by":"crossref","first-page":"D689","DOI":"10.1093\/nar\/gkz890","article-title":"Ensembl Genomes 2020 \u2013 enabling non-vertebrate genomic research","volume":"48","author":"Howe","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B28","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1038\/embor.2008.142","article-title":"The paradox of model organisms: the use of model organisms in research will continue despite their shortcomings","volume":"9","author":"Hunter","year":"2008","journal-title":"EMBO Rep"},{"key":"2023020108552078600_btab827-B29","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1186\/1471-2164-15-721","article-title":"Overlapping genes: a window on gene evolvability","volume":"15","author":"Huvet","year":"2014","journal-title":"BMC Genomics"},{"key":"2023020108552078600_btab827-B30","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1186\/1471-2105-11-119","article-title":"Prodigal: prokaryotic gene recognition and translation initiation site identification","volume":"11","author":"Hyatt","year":"2010","journal-title":"BMC Bioinformatics"},{"key":"2023020108552078600_btab827-B31","doi-asserted-by":"crossref","first-page":"3801","DOI":"10.1073\/pnas.96.7.3801","article-title":"Horizontal gene transfer among genomes: the complexity hypothesis","volume":"96","author":"Jain","year":"1999","journal-title":"PNAS"},{"key":"2023020108552078600_btab827-B32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-020-03805-x","article-title":"smORFunction: a tool for predicting functions of small open reading frames and microproteins","volume":"21","author":"Ji","year":"2020","journal-title":"BMC Bioinformatics"},{"key":"2023020108552078600_btab827-B33","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12864-015-1826-4","article-title":"BEACON: automated tool for Bacterial GEnome Annotation ComparisON","volume":"16","author":"Kalkatawi","year":"2015","journal-title":"BMC Genomics"},{"key":"2023020108552078600_btab827-B34","doi-asserted-by":"crossref","first-page":"757","DOI":"10.1093\/bioinformatics\/btr010","article-title":"A novel hybrid gene prediction method employing protein multiple sequence alignments","volume":"27","author":"Keller","year":"2011","journal-title":"Bioinformatics"},{"key":"2023020108552078600_btab827-B35","doi-asserted-by":"crossref","first-page":"168","DOI":"10.4056\/sigs.2084864","article-title":"Solving the problem: genome annotation standards before the data deluge","volume":"5","author":"Klimke","year":"2011","journal-title":"Stand. Genom. Sci"},{"key":"2023020108552078600_btab827-B36","first-page":"731","article-title":"Stability and evolution of overlapping genes","volume":"54","author":"Krakauer","year":"2000","journal-title":"Evolution"},{"key":"2023020108552078600_btab827-B37","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1007\/s10142-015-0433-4","article-title":"Insights from 20 years of bacterial genome sequencing","volume":"15","author":"Land","year":"2015","journal-title":"Funct. Integr. Genomics"},{"key":"2023020108552078600_btab827-B38","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1093\/bjps\/axt055","article-title":"Model organisms are not (theoretical) models","volume":"66","author":"Levy","year":"2015","journal-title":"Br. J. Philos. Sci"},{"key":"2023020108552078600_btab827-B39","first-page":"e000341","article-title":"An assessment of genome annotation coverage across the bacterial tree of life","volume":"6","author":"Lobb","year":"2020","journal-title":"Microb. Genom"},{"key":"2023020108552078600_btab827-B40","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1101\/gr.230615.117","article-title":"Modeling leaderless transcription and atypical genes results in more accurate gene prediction in prokaryotes","volume":"28","author":"Lomsadze","year":"2018","journal-title":"Genome Res"},{"key":"2023020108552078600_btab827-B41","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1093\/nar\/26.4.1107","article-title":"GeneMark.hmm: new solutions for gene finding","volume":"26","author":"Lukashin","year":"1998","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B42","doi-asserted-by":"crossref","first-page":"708","DOI":"10.1007\/s00248-010-9717-3","article-title":"Comparison of 61 sequenced Escherichia coli genomes","volume":"60","author":"Lukjancenko","year":"2010","journal-title":"Microb. Ecol"},{"key":"2023020108552078600_btab827-B43","doi-asserted-by":"crossref","first-page":"baq001","DOI":"10.1093\/database\/baq001","article-title":"Meeting report: a workshop on best practices in genome annotation","volume":"2010","author":"Madupu","year":"2010","journal-title":"Database"},{"key":"2023020108552078600_btab827-B44","doi-asserted-by":"crossref","first-page":"4103","DOI":"10.1093\/nar\/gkf543","article-title":"Current methods of gene prediction, their strengths and weaknesses","volume":"30","author":"Math\u00e9","year":"2002","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B45","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.molcel.2019.02.017","article-title":"Retapamulin-assisted ribosome profiling reveals the alternative bacterial proteome","volume":"74","author":"Meydan","year":"2019","journal-title":"Mol. Cell"},{"key":"2023020108552078600_btab827-B46","doi-asserted-by":"crossref","first-page":"e8290","DOI":"10.15252\/msb.20188290","article-title":"Unraveling the hidden universe of small proteins in bacterial genomes","volume":"15","author":"Miravet-Verde","year":"2019","journal-title":"Mol. Syst. Biol"},{"key":"2023020108552078600_btab827-B47","doi-asserted-by":"crossref","first-page":"4322","DOI":"10.1093\/bioinformatics\/bti701","article-title":"Large-scale prokaryotic gene prediction and comparison to genome annotation","volume":"21","author":"Nielsen","year":"2005","journal-title":"Bioinformatics"},{"key":"2023020108552078600_btab827-B48","doi-asserted-by":"crossref","first-page":"5623","DOI":"10.1093\/nar\/gkl723","article-title":"MetaGene: prokaryotic gene finding from environmental genome shotgun sequences","volume":"34","author":"Noguchi","year":"2006","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B49","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1093\/dnares\/dsn027","article-title":"MetaGeneAnnotator: detecting species-specific patterns of ribosomal binding site for precise gene prediction in anonymous prokaryotic and phage genomes","volume":"15","author":"Noguchi","year":"2008","journal-title":"DNA Res"},{"key":"2023020108552078600_btab827-B50","doi-asserted-by":"crossref","first-page":"2030","DOI":"10.1128\/JB.01368-13","article-title":"Searchdogs bacteria, software that provides automated identification of potentially missed genes in annotated bacterial genomes","volume":"196","author":"\u00d3h\u00c9igeartaigh","year":"2014","journal-title":"J. Bacteriol"},{"key":"2023020108552078600_btab827-B51","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1093\/nar\/gkz734","article-title":"Alternative ORFs and small ORFs: shedding light on the dark proteome","volume":"48","author":"Orr","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B52","doi-asserted-by":"crossref","first-page":"1090","DOI":"10.1046\/j.1365-2958.1999.01431.x","article-title":"Multiple hok genes on the chromosome of Escherichia coli","volume":"32","author":"Pedersen","year":"1999","journal-title":"Mol. Microbiol"},{"key":"2023020108552078600_btab827-B53","doi-asserted-by":"crossref","first-page":"e191","DOI":"10.1093\/nar\/gkq747","article-title":"FragGeneScan: predicting genes in short and error-prone reads","volume":"38","author":"Rho","year":"2010","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B54","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1186\/s12915-017-0391-5","article-title":"Non-model model organisms","volume":"15","author":"Russell","year":"2017","journal-title":"BMC Biol"},{"key":"2023020108552078600_btab827-B55","first-page":"61","volume-title":"Metagenomics and Its Applications in Agriculture","author":"Salamov","year":"2011"},{"key":"2023020108552078600_btab827-B56","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1186\/s13059-019-1715-2","article-title":"Next-generation genome annotation: we still struggle to get it right","volume":"20","author":"Salzberg","year":"2019","journal-title":"Genome Biol"},{"key":"2023020108552078600_btab827-B57","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1037\/1082-989X.7.2.147","article-title":"Missing data: our view of the state of the art","volume":"7","author":"Schafer","year":"2002","journal-title":"Psychol. Methods"},{"key":"2023020108552078600_btab827-B58","doi-asserted-by":"crossref","first-page":"e1004463","DOI":"10.1371\/journal.pgen.1004463","article-title":"The coding and noncoding architecture of the Caulobacter crescentus genome","volume":"10","author":"Schrader","year":"2014","journal-title":"PLoS Genet"},{"key":"2023020108552078600_btab827-B59","doi-asserted-by":"crossref","first-page":"2068","DOI":"10.1093\/bioinformatics\/btu153","article-title":"Prokka: rapid prokaryotic genome annotation","volume":"30","author":"Seemann","year":"2014","journal-title":"Bioinformatics"},{"key":"2023020108552078600_btab827-B60","doi-asserted-by":"crossref","first-page":"11399","DOI":"10.1073\/pnas.1614083113","article-title":"Theory of prokaryotic genome evolution","volume":"113","author":"Sela","year":"2016","journal-title":"PNAS"},{"key":"2023020108552078600_btab827-B61","doi-asserted-by":"crossref","first-page":"e1008727","DOI":"10.1371\/journal.pcbi.1008727","article-title":"Balrog: a universal protein model for prokaryotic gene prediction","volume":"17","author":"Sommer","year":"2021","journal-title":"PLoS Comput. Biol"},{"key":"2023020108552078600_btab827-B62","doi-asserted-by":"crossref","first-page":"W465","DOI":"10.1093\/nar\/gki458","article-title":"AUGUSTUS: a web server for gene prediction in eukaryotes that allows user-defined constraints","volume":"33","author":"Stanke","year":"2005","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B63","doi-asserted-by":"crossref","first-page":"753","DOI":"10.1146\/annurev-biochem-070611-102400","article-title":"Small proteins can no longer be ignored","volume":"83","author":"Storz","year":"2014","journal-title":"Annu. Rev. Biochem"},{"key":"2023020108552078600_btab827-B64","doi-asserted-by":"crossref","first-page":"1102","DOI":"10.2144\/00286ir01","article-title":"The sequence manipulation suite: JavaScript programs for analyzing and formatting protein and DNA sequences","volume":"28","author":"Stothard","year":"2000","journal-title":"Biotechniques"},{"key":"2023020108552078600_btab827-B65","doi-asserted-by":"crossref","first-page":"286","DOI":"10.3389\/fgene.2013.00286","article-title":"Small proteins: untapped area of potential biological importance","volume":"4","author":"Su","year":"2013","journal-title":"Front. Genet"},{"key":"2023020108552078600_btab827-B66","doi-asserted-by":"crossref","first-page":"6614","DOI":"10.1093\/nar\/gkw569","article-title":"NCBI prokaryotic genome annotation pipeline","volume":"44","author":"Tatusova","year":"2016","journal-title":"Nucleic Acids Res"},{"key":"2023020108552078600_btab827-B67","volume-title":"Python 3 Reference Manual","author":"Van Rossum","year":"2009"},{"key":"2023020108552078600_btab827-B68","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1038\/s41579-020-0368-1","article-title":"Diversity within species: interpreting strains in microbiomes","volume":"18","author":"Van Rossum","year":"2020","journal-title":"Nat. Rev. Microbiol"},{"key":"2023020108552078600_btab827-B69","doi-asserted-by":"crossref","first-page":"1700064","DOI":"10.1002\/pmic.201700064","article-title":"Identifying new small proteins in Escherichia coli","volume":"18","author":"VanOrsdel","year":"2018","journal-title":"Proteomics"},{"key":"2023020108552078600_btab827-B70","doi-asserted-by":"crossref","first-page":"2559","DOI":"10.1099\/mic.0.2008\/021360-0","article-title":"An analysis of initiation codon utilization in the Domain Bacteria\u2013concerns about the quality of bacterial genome annotation","volume":"154","author":"Villegas","year":"2008","journal-title":"Microbiology"},{"key":"2023020108552078600_btab827-B71","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1186\/1471-2105-11-131","article-title":"Missing genes in the annotation of prokaryotic genomes","volume":"11","author":"Warren","year":"2010","journal-title":"BMC Bioinformatics"},{"key":"2023020108552078600_btab827-B72","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1186\/1745-6150-7-37","article-title":"Thousands of missed genes found in bacterial genomes and their analysis with COMBREX","volume":"7","author":"Wood","year":"2012","journal-title":"Biol. Direct"},{"key":"2023020108552078600_btab827-B73","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1186\/1471-2105-12-20","article-title":"Combining gene prediction methods to improve metagenomic gene annotation","volume":"12","author":"Yok","year":"2011","journal-title":"BMC Bioinformatics"},{"key":"2023020108552078600_btab827-B74","doi-asserted-by":"crossref","first-page":"e132","DOI":"10.1093\/nar\/gkq275","article-title":"Ab initio gene identification in metagenomic sequences","volume":"38","author":"Zhu","year":"2010","journal-title":"Nucleic Acids Res"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btab827\/41784931\/btab827.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/38\/5\/1198\/49009124\/btab827.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/38\/5\/1198\/49009124\/btab827.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,1]],"date-time":"2023-02-01T15:22:27Z","timestamp":1675264947000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/38\/5\/1198\/6454948"}},"subtitle":[],"editor":[{"given":"Tobias","family":"Marschall","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,12,7]]},"references-count":74,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2022,2,7]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btab827","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.05.21.445150","asserted-by":"object"}]},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,3,1]]},"published":{"date-parts":[[2021,12,7]]}}}