{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T20:52:31Z","timestamp":1776804751153,"version":"3.51.2"},"reference-count":64,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2020,11,18]],"date-time":"2020-11-18T00:00:00Z","timestamp":1605657600000},"content-version":"vor","delay-in-days":322,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,1,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Small open reading frames (ORFs) have been systematically disregarded by automatic genome annotation. The difficulty in finding patterns in tiny sequences is the main reason that makes small ORFs to be overlooked by computational procedures. However, advances in experimental methods show that small proteins can play vital roles in cellular activities. Hence, it is urgent to make progress in the development of computational approaches to speed up the identification of potential small ORFs. In this work, our focus is on bacterial genomes. We improve a previous approach to identify small ORFs in bacteria. Our method uses machine learning techniques and decoy subject sequences to filter out spurious ORF alignments. We show that an advanced multivariate analysis can be more effective in terms of sensitivity than applying the simplistic and widely used e-value cutoff. This is particularly important in the case of small ORFs for which alignments present higher e-values than usual. Experiments with control datasets show that the machine learning algorithms used in our method to curate significant alignments can achieve average sensitivity and specificity of 97.06% and 99.61%, respectively. Therefore, an important step is provided here toward the construction of more accurate computational tools for the identification of small ORFs in bacteria.<\/jats:p>","DOI":"10.1093\/database\/baaa067","type":"journal-article","created":{"date-parts":[[2020,8,4]],"date-time":"2020-08-04T19:16:59Z","timestamp":1596568619000},"source":"Crossref","is-referenced-by-count":6,"title":["OCCAM: prediction of small ORFs in bacterial genomes by means of a target-decoy database approach and machine learning techniques"],"prefix":"10.1093","volume":"2020","author":[{"given":"Fabio","family":"R. Cerqueira","sequence":"first","affiliation":[{"name":"Department of Production Engineering, Universidade Federal Fluminense, Rua Domingos Silv\u00e9rio s\/n, Petr\u00f3polis, 25\u2009650-050, Rio de Janeiro, Brazil"},{"name":"Graduate Program in Computer Science, Universidade Federal de Vi\u00e7osa, 36570-900, Minas Gerais, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ana Tereza Ribeiro","family":"Vasconcelos","sequence":"additional","affiliation":[{"name":"Laborat\u00f3rio Nacional de Computa\u00e7\u00e3o Cient\u00edfica, Rua Get\u00falio Vargas 333, Petrop\u00f3lis, 25\u2009651-071, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,11,18]]},"reference":[{"key":"2020111812061833200_R1","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1038\/nrg3520","article-title":"Emerging evidence for functional peptides encoded by short open reading frames","volume":"15","author":"Andrews","year":"2014","journal-title":"Nature Reviews Genetics"},{"key":"2020111812061833200_R2","doi-asserted-by":"publisher","first-page":"983","DOI":"10.1534\/g3.116.036939","article-title":"Identification of unannotated small genes in salmonella","volume":"7","author":"Baek","year":"2017","journal-title":"G3: Genes|Genomes|Genetics"},{"key":"2020111812061833200_R3","doi-asserted-by":"publisher","first-page":"3631","DOI":"10.1099\/mic.0.2007\/006205-0","article-title":"A genome-wide survey of short coding sequences in streptococci.","volume":"153","author":"Ibrahim","year":"2007","journal-title":"Microbiology (Reading, England)"},{"key":"2020111812061833200_R4","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1128\/JB.00872-09","article-title":"Small stress response proteins in Escherichia coli: Proteins missed by classical proteomic studies","volume":"192","author":"Hemm","year":"2010","journal-title":"Journal of bacteriology"},{"key":"2020111812061833200_R5","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0018509","article-title":"An integrated approach for finding overlooked genes in Shigella","volume":"6","author":"Peng","year":"2011","journal-title":"PloS one"},{"key":"2020111812061833200_R6","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1016\/j.mib.2011.01.007","article-title":"An expanding universe of small proteins","volume":"14","author":"Hobbs","year":"2011","journal-title":"Curr Opin Microbiol"},{"key":"2020111812061833200_R7","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1038\/sj.emboj.7601983","article-title":"Peptide-assisted degradation of the Salmonella MgtC virulence factor","volume":"27","author":"Alix","year":"2008","journal-title":"The EMBO journal"},{"key":"2020111812061833200_R8","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1016\/S0092-8674(01)00211-2","article-title":"Replication initiation proteins regulate a developmental checkpoint in Bacillus subtilis","volume":"104","author":"Burkholder","year":"2001","journal-title":"Cell"},{"key":"2020111812061833200_R9","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1016\/S1097-2765(04)00084-X","article-title":"Structure and mechanism of action of Sda, an inhibitor of the histidine kinases that regulate initiation of sporulation in Bacillus subtilis","volume":"13","author":"Rowland","year":"2004","journal-title":"Molecular cell"},{"key":"2020111812061833200_R10","doi-asserted-by":"publisher","first-page":"1510","DOI":"10.1038\/nm1656","article-title":"Identification of novel cytolytic peptides as key virulence determinants for community-associated MRSA","volume":"13","author":"Wang","year":"2007","journal-title":"Nature medicine"},{"key":"2020111812061833200_R11","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1016\/S0092-8674(00)80873-9","article-title":"6S RNA regulates E. coli RNA polymerase activity","volume":"101","author":"Wassarman","year":"2000","journal-title":"Cell"},{"key":"2020111812061833200_R12","doi-asserted-by":"publisher","first-page":"657","DOI":"10.1046\/j.1365-2958.2003.03459.x","article-title":"A novel sRNA component of the carbon storage regulatory system of Escherichia coli","volume":"48","author":"Weilbacher","year":"2003","journal-title":"Molecular Microbiology"},{"key":"2020111812061833200_R13","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1146\/annurev.micro.58.030603.123841","article-title":"The small RNA regulators of Escherichia coli: Roles and mechanisms","volume":"58","author":"Gottesman","year":"2004","journal-title":"Annual review of microbiology"},{"key":"2020111812061833200_R14","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/j.mib.2007.03.005","article-title":"Identification of small RNAs in diverse bacterial species","volume":"10","author":"Livny","year":"2007","journal-title":"Current opinion in microbiology"},{"key":"2020111812061833200_R15","first-page":"880","article-title":"Regulation by Small RNAs in Bacteria: Expanding Frontiers","volume":"43","author":"Storz","year":"2011","journal-title":"NIH Public Access"},{"key":"2020111812061833200_R16","first-page":"pp 471","volume-title":"Regulating with RNA in Bacteria and Archaea","author":"Raina","year":"2019"},{"key":"2020111812061833200_R17","first-page":"1943","article-title":"Dual-Function RNA Regulators in Bacteria","volume":"93","author":"Vanderpool","year":"2011","journal-title":"NIH Public Access"},{"key":"2020111812061833200_R18","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1016\/j.tibs.2006.08.004","article-title":"The surprising complexity of signal sequences","volume":"31","author":"Hegde","year":"2006","journal-title":"Trends in biochemical sciences"},{"key":"2020111812061833200_R19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1021\/acs.jproteome.7b00707","article-title":"Mining for Small Translated ORFs","volume":"17","author":"Chugunova","year":"2018","journal-title":"Journal of Proteome Research"},{"key":"2020111812061833200_R20","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1093\/nar\/gkz734","article-title":"Alternative ORFs and small ORFs: shedding light on the dark proteome","volume":"48","author":"Orr","year":"2019","journal-title":"Nucleic Acids Research"},{"key":"2020111812061833200_R21","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-018-2550-2","article-title":"Computational discovery and annotation of conserved small open reading frames in fungal genomes","volume":"19","author":"Mat-Sharani","year":"2019","journal-title":"BMC Bioinformatics"},{"key":"2020111812061833200_R22","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-11-131","article-title":"Setubal JaC: Missing genes in the annotation of prokaryotic genomes","volume":"11","author":"Warren","year":"2010","journal-title":"BMC bioinformatics"},{"key":"2020111812061833200_R23","doi-asserted-by":"publisher","DOI":"10.1186\/1745-6150-7-37","article-title":"Thousands of missed genes found in bacterial genomes and their analysis with COMBREX.","volume":"7","author":"Wood","year":"2012","journal-title":"Biology direct"},{"key":"2020111812061833200_R24","doi-asserted-by":"publisher","first-page":"1487","DOI":"10.1111\/mmi.2008.70.issue-6","article-title":"Small membrane proteins found by comparative genomics and ribosome binding site models","volume":"70","author":"Hemm","year":"2008","journal-title":"Mol Microbiol"},{"key":"2020111812061833200_R25","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2164-7-16","article-title":"Evidence for conservation and selection of upstream open reading frames suggests probable encoding of bioactive peptides","volume":"7","author":"Crowe","year":"2006","journal-title":"BMC Genomics"},{"key":"2020111812061833200_R26","doi-asserted-by":"publisher","DOI":"10.1186\/gb-2011-12-11-r118","article-title":"Hundreds of putatively functional small open reading frames in Drosophila","volume":"12","author":"Ladoukakis","year":"2011","journal-title":"Genome Biology"},{"key":"2020111812061833200_R27","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2164-14-648","article-title":"Combining in silico prediction and ribosome profiling in a genome-wide search for novel putatively coding sORFs","volume":"14","author":"Crapp\u00e9","year":"2013","journal-title":"BMC Genomics"},{"key":"2020111812061833200_R28","doi-asserted-by":"publisher","DOI":"10.1186\/s13059-015-0742-x","article-title":"Extensive identification and analysis of conserved small ORFs in animals","volume":"16","author":"Mackowiak","year":"2015","journal-title":"Genome Biology"},{"key":"2020111812061833200_R29","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1093\/bioinformatics\/btp688","article-title":"sORF finder: a program package to identify small open reading frames with high coding potential","volume":"26","author":"Hanada","year":"2010","journal-title":"Bioinformatics"},{"key":"2020111812061833200_R30","doi-asserted-by":"publisher","first-page":"i275","DOI":"10.1093\/bioinformatics\/btr209","article-title":"PhyloCSF: a comparative genomics method to distinguish protein coding and non-coding regions","volume":"27","author":"Lin","year":"2011","journal-title":"Bioinformatics"},{"key":"2020111812061833200_R31","doi-asserted-by":"crossref","DOI":"10.1093\/database\/bas025","article-title":"HAltORF: a database of predicted out-of-frame alternative open reading frames in human","volume":"2012","author":"Vanderperre","year":"2012","journal-title":"Database"},{"key":"2020111812061833200_R32","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-15-36","article-title":"uPEPperoni: An online tool for upstream open reading frame location and analysis of transcript conservation","volume":"15","author":"Skarshewski","year":"2014","journal-title":"BMC Bioinformatics"},{"key":"2020111812061833200_R33","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1093\/bioinformatics\/btm009","article-title":"Identifying bacterial genes and endosymbiont DNA with Glimmer","volume":"23","author":"Delcher","year":"2007","journal-title":"Bioinformatics"},{"key":"2020111812061833200_R34","first-page":"1","article-title":"EasyGene - a prokaryotic gene finder that ranks ORFs by statistical significance","volume":"15","author":"Larsen","year":"2003","journal-title":"BMC Bioinformatics"},{"key":"2020111812061833200_R35","doi-asserted-by":"publisher","first-page":"W451","DOI":"10.1093\/nar\/gki487","article-title":"GeneMark: web software for gene finding in prokaryotes, eukaryotes and viruses","volume":"33","author":"Besemer","year":"2005","journal-title":"Nucleic acids research"},{"key":"2020111812061833200_R36","doi-asserted-by":"publisher","first-page":"3389","DOI":"10.1093\/nar\/25.17.3389","article-title":"Gapped BLAST and PSI-BLAST: A new generation of protein database search programs","volume":"25","author":"Altschul","year":"1997","journal-title":"Nucleic Acids Research"},{"key":"2020111812061833200_R37","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.bbrc.2012.04.090","article-title":"The elusive short gene\u2013an ensemble method for recognition for prokaryotic genome","volume":"422","author":"Goli","year":"2012","journal-title":"Biochemical and biophysical research communications"},{"key":"2020111812061833200_R38","doi-asserted-by":"publisher","first-page":"2030","DOI":"10.1128\/JB.01368-13","article-title":"SearchDOGS Bacteria, Software That Provides Automated Identification of Potentially Missed Genes in Annotated Bacterial Genomes","volume":"196","author":"OhEigeartaigh","year":"2014","journal-title":"Journal of Bacteriology"},{"key":"2020111812061833200_R39","doi-asserted-by":"crossref","DOI":"10.1101\/2020.05.05.079178","volume-title":"sPepFinder expedites genome-wide identification of small proteins in bacteria","author":"Li","year":"2020"},{"key":"2020111812061833200_R40","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1002\/bies.201400103","article-title":"Identifying (non-) coding RNAs and small peptides: Challenges and opportunities","volume":"37","author":"Pauli","year":"2015","journal-title":"BioEssays"},{"key":"2020111812061833200_R41","doi-asserted-by":"publisher","first-page":"D61","DOI":"10.1093\/nar\/gkl842","article-title":"NCBI reference sequences (RefSeq): a curated non-redundant sequence database of genomes, transcripts and proteins.","volume":"35","author":"Pruitt","year":"2007","journal-title":"Nucleic acids research"},{"key":"2020111812061833200_R42","doi-asserted-by":"publisher","DOI":"10.1128\/ecosalplus.ESP-0031-2019","article-title":"Escherichia coli Small Proteome","volume":"9","author":"Hemm","year":"2020","journal-title":"EcoSal Plus"},{"key":"2020111812061833200_R43","article-title":"Serum metabolite markers of early Mycoplasma hyopneumoniae infection in pigs","volume":"50","author":"Surendran\u00a0Nair","year":"2019","journal-title":"Veterinary Research"},{"key":"2020111812061833200_R44","doi-asserted-by":"publisher","first-page":"2076","DOI":"10.1016\/j.bpj.2016.03.028","article-title":"The aerotactic response of Caulobacter crescentus","volume":"110","author":"Morse","year":"2016","journal-title":"Biophysical journal"},{"key":"2020111812061833200_R45","first-page":"e01037","article-title":"Reprogramming of small noncoding RNA populations in peripheral blood reveals host biomarkers for latent and active Mycobacterium tuberculosis infection","volume":"10","author":"de\u00a0Araujo","year":"2019","journal-title":"mBio"},{"key":"2020111812061833200_R46","doi-asserted-by":"publisher","DOI":"10.3389\/fmicb.2018.02489","article-title":"Evidence of illegitimate recombination between two pasteurellaceae plasmids resulting in a novel multi-resistance replicon, pM3362MDR, in Actinobacillus pleuropneumoniae","volume":"9","author":"Li","year":"2018","journal-title":"Frontiers in Microbiology"},{"key":"2020111812061833200_R47","doi-asserted-by":"publisher","first-page":"19216","DOI":"10.1021\/acsomega.9b02527","article-title":"ZrO2\u2013ZnO Nanoparticles as Antibacterial Agents","volume":"4","author":"Precious Ayanwale","year":"2019","journal-title":"ACS omega"},{"key":"2020111812061833200_R48","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1109\/TPDS.2010.101","article-title":"Coordinating computation and I\/O in massively parallel sequence search","volume":"22","author":"Lin","year":"2011","journal-title":"IEEE Trans. Parallel Distrib. Syst."},{"key":"2020111812061833200_R49","doi-asserted-by":"publisher","first-page":"1599","DOI":"10.1074\/mcp.M600469-MCP200","article-title":"Comparative evaluation of tandem MS search algorithms using a target-decoy search strategy","volume":"6","author":"Balgley","year":"2007","journal-title":"Mol. Cell. Proteomics"},{"key":"2020111812061833200_R50","doi-asserted-by":"crossref","first-page":"pp 55","DOI":"10.1007\/978-1-60761-444-9_5","volume-title":"Proteome Bioinformatics, Volume 604 of Methods in Molecular Biology","author":"Elias","year":"2010"},{"key":"2020111812061833200_R51","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1074\/mcp.O112.022863","article-title":"A non-parametric cutout index for robust evaluation of identified proteins","volume":"12","author":"Serang","year":"2013","journal-title":"Molecular & Cellular Proteomics"},{"key":"2020111812061833200_R52","article-title":"MUMAL: Multivariate analysis in shotgun proteomics using machine learning techniques","volume":"13 Suppl 5","author":"Cerqueira","year":"2012","journal-title":"BMC genomics"},{"key":"2020111812061833200_R53","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1534\/g3.113.005652","article-title":"Origin and length distribution of unidirectional prokaryotic overlapping genes","volume":"4","author":"Fonseca","year":"2014","journal-title":"G3: Genes|Genomes|Genetics"},{"key":"2020111812061833200_R54","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1038\/nbt930","article-title":"Intensity-based protein identification by machine learning from a library of tandem mass spectra","volume":"22","author":"Elias","year":"2004","journal-title":"Nat. Biotechnol."},{"key":"2020111812061833200_R55","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1038\/nbt0707-755","article-title":"How do shotgun proteomics algorithms identify proteins?","volume":"25","author":"Marcotte","year":"2007","journal-title":"Nat. Biotechnol."},{"key":"2020111812061833200_R56","doi-asserted-by":"crossref","first-page":"976","DOI":"10.1016\/1044-0305(94)80016-2","article-title":"An approach to correlate tandem mass spectral data of peptides with amino acid sequences in a protein database","volume":"5","author":"Eng","year":"1994","journal-title":"J. Am. Soc. Mass Spectrom."},{"key":"2020111812061833200_R57","doi-asserted-by":"crossref","first-page":"150","DOI":"10.4172\/jpb.1000072","article-title":"Improving Phosphopeptide\/protein Identification using a New Data Mining Framework for MS\/MS Spectra Preprocessing","volume":"2","author":"Cerqueira","year":"2009","journal-title":"J. Proteomics Bioinform."},{"key":"2020111812061833200_R58","doi-asserted-by":"crossref","first-page":"2265","DOI":"10.1021\/pr901023v","article-title":"MUDE: A New Approach for Optimizing Sensitivity in the Target-Decoy Search Strategy for Large-Scale Peptide\/Protein Identification","volume":"9","author":"Cerqueira","year":"2010","journal-title":"J. Proteome Res."},{"key":"2020111812061833200_R59","doi-asserted-by":"crossref","first-page":"1782","DOI":"10.1021\/pr800792z","article-title":"Comparison of Novel Decoy Database Designs for Optimizing Protein Identification Searches Using ABRF sPRG2006 Standard MS\/MS Data Sets","volume":"8","author":"Bianco","year":"2009","journal-title":"J. Proteome Res."},{"key":"2020111812061833200_R60","volume-title":"Data mining: Practical machine learning tools and techniques","author":"Witten","year":"2005","edition":"2nd"},{"key":"2020111812061833200_R61","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/1656274.1656278","article-title":"The WEKA data mining software: An update","volume":"11","author":"Hall","year":"2009","journal-title":"ACM SIGKDD Explorations Newsletter"},{"key":"2020111812061833200_R62","volume-title":"Introduction to data mining","author":"Tan","year":"2006"},{"key":"2020111812061833200_R63","doi-asserted-by":"crossref","DOI":"10.1186\/1471-2164-12-125","article-title":"Consistency of gene starts among Burkholderia genomes","volume":"12","author":"Dunbar","year":"2011","journal-title":"BMC Genomics"},{"key":"2020111812061833200_R64","doi-asserted-by":"crossref","first-page":"D19","DOI":"10.1093\/nar\/gkq1019","article-title":"The Sequence Read Archive","volume":"39","author":"Leinonen","year":"2010","journal-title":"Nucleic Acids Research"}],"container-title":["Database"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baaa067\/34385717\/baaa067.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baaa067\/34385717\/baaa067.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,5]],"date-time":"2022-11-05T18:49:03Z","timestamp":1667674143000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/database\/article\/doi\/10.1093\/database\/baaa067\/5989499"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,1]]},"references-count":64,"URL":"https:\/\/doi.org\/10.1093\/database\/baaa067","relation":{},"ISSN":["1758-0463"],"issn-type":[{"value":"1758-0463","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020]]},"published":{"date-parts":[[2020,1,1]]},"article-number":"baaa067"}}