{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T04:13:55Z","timestamp":1769746435768,"version":"3.49.0"},"reference-count":47,"publisher":"Oxford University Press (OUP)","issue":"12","license":[{"start":{"date-parts":[[2020,4,6]],"date-time":"2020-04-06T00:00:00Z","timestamp":1586131200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31970635"],"award-info":[{"award-number":["31970635"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"State Scholarship Fund"},{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Identification of virulence factors (VFs) is critical to the elucidation of bacterial pathogenesis and prevention of related infectious diseases. Current computational methods for VF prediction focus on binary classification or involve only several class(es) of VFs with sufficient samples. However, thousands of VF classes are present in real-world scenarios, and many of them only have a very limited number of samples available.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We first construct a large VF dataset, covering 3446 VF classes with 160\u00a0495 sequences, and then propose deep convolutional neural network models for VF classification. We show that (i) for common VF classes with sufficient samples, our models can achieve state-of-the-art performance with an overall accuracy of 0.9831 and an F1-score of 0.9803; (ii) for uncommon VF classes with limited samples, our models can learn transferable features from auxiliary data and achieve good performance with accuracy ranging from 0.9277 to 0.9512 and F1-score ranging from 0.9168 to 0.9446 when combined with different predefined features, outperforming traditional classifiers by 1\u201313% in accuracy and by 1\u201316% in F1-score.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>All of our datasets are made publicly available at http:\/\/www.mgc.ac.cn\/VFNet\/, and the source code of our models is publicly available at https:\/\/github.com\/zhengdd0422\/VFNet.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Supplementary information<\/jats:title>\n                  <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btaa230","type":"journal-article","created":{"date-parts":[[2020,4,1]],"date-time":"2020-04-01T11:23:46Z","timestamp":1585740226000},"page":"3693-3702","source":"Crossref","is-referenced-by-count":19,"title":["Learning transferable deep convolutional neural networks for the classification of bacterial virulence factors"],"prefix":"10.1093","volume":"36","author":[{"given":"Dandan","family":"Zheng","sequence":"first","affiliation":[{"name":"NHC Key Laboratory of Systems Biology of Pathogens , Institute of Pathogen Biology, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100176, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guansong","family":"Pang","sequence":"additional","affiliation":[{"name":"Australian Institute for Machine Learning , The University of Adelaide, Adelaide, SA 5005, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bo","family":"Liu","sequence":"additional","affiliation":[{"name":"NHC Key Laboratory of Systems Biology of Pathogens , Institute of Pathogen Biology, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100176, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lihong","family":"Chen","sequence":"additional","affiliation":[{"name":"NHC Key Laboratory of Systems Biology of Pathogens , Institute of Pathogen Biology, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100176, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8826-5198","authenticated-orcid":false,"given":"Jian","family":"Yang","sequence":"additional","affiliation":[{"name":"NHC Key Laboratory of Systems Biology of Pathogens , Institute of Pathogen Biology, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100176, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2020,4,6]]},"reference":[{"key":"2023063010281633900_btaa230-B1","author":"Agarap","year":"2018"},{"key":"2023063010281633900_btaa230-B2","first-page":"626507","author":"Bileschi","year":"2019"},{"key":"2023063010281633900_btaa230-B3","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1111\/j.1574-6968.2002.tb11058.x","article-title":"Identification and role in virulence of putative iron acquisition genes from Corynebacterium pseudotuberculosis","volume":"208","author":"Billington","year":"2002","journal-title":"FEMS Microbiol. Lett"},{"key":"2023063010281633900_btaa230-B4","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1093\/nar\/gkg095","article-title":"The SWISS-PROT protein knowledgebase and its supplement TrEMBL in 2003","volume":"31","author":"Boeckmann","year":"2003","journal-title":"Nucleic Acids Res"},{"key":"2023063010281633900_btaa230-B5","doi-asserted-by":"crossref","first-page":"D694","DOI":"10.1093\/nar\/gkv1239","article-title":"VFDB 2016: hierarchical and refined dataset for big data analysis\u201410 years on","volume":"44","author":"Chen","year":"2016","journal-title":"Nucleic Acids Res"},{"key":"2023063010281633900_btaa230-B6","author":"Chung","year":"2014"},{"key":"2023063010281633900_btaa230-B7","doi-asserted-by":"crossref","first-page":"17103","DOI":"10.1074\/jbc.M300091200","article-title":"Helical structure of the needle of the type III secretion system of Shigella flexneri","volume":"278","author":"Cordes","year":"2003","journal-title":"J. Biol. Chem"},{"key":"2023063010281633900_btaa230-B8","author":"Cover","year":"2006"},{"key":"2023063010281633900_btaa230-B9","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1101\/gr.849004","article-title":"WebLogo: a sequence logo generator","volume":"14","author":"Crooks","year":"2004","journal-title":"Genome Res"},{"key":"2023063010281633900_btaa230-B10","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1039\/c3mb70024k","article-title":"Computationally identifying virulence factors based on KEGG pathways","volume":"9","author":"Cui","year":"2013","journal-title":"Mol. BioSystems"},{"key":"2023063010281633900_btaa230-B11","doi-asserted-by":"crossref","first-page":"D427","DOI":"10.1093\/nar\/gky995","article-title":"The Pfam protein families database in 2019","volume":"47","author":"El-Gebali","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2023063010281633900_btaa230-B12","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1186\/s12859-018-2182-6","article-title":"Deep learning models for bacteria taxonomic classification of metagenomic data","volume":"19","author":"Fiannaca","year":"2018","journal-title":"BMC Bioinformatics"},{"key":"2023063010281633900_btaa230-B13","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1093\/femsre\/fuv047","article-title":"Editorial: the many wonders of the bacterial cell surface","volume":"40","author":"Filloux","year":"2016","journal-title":"FEMS Microbiol. Rev"},{"key":"2023063010281633900_btaa230-B14","doi-asserted-by":"crossref","first-page":"3150","DOI":"10.1093\/bioinformatics\/bts565","article-title":"CD-HIT: accelerated for clustering the next-generation sequencing data","volume":"28","author":"Fu","year":"2012","journal-title":"Bioinformatics"},{"key":"2023063010281633900_btaa230-B15","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1186\/1471-2105-9-62","article-title":"VirulentPred: a SVM based prediction method for virulent proteins in bacterial pathogens","volume":"9","author":"Garg","year":"2008","journal-title":"BMC Bioinformatics"},{"key":"2023063010281633900_btaa230-B16","author":"Goldberg","year":"2014"},{"key":"2023063010281633900_btaa230-B17","doi-asserted-by":"crossref","first-page":"e93907","DOI":"10.1371\/journal.pone.0093907","article-title":"MP3: a software tool for the prediction of pathogenic proteins in genomic and metagenomic data","volume":"9","author":"Gupta","year":"2014","journal-title":"PLoS One"},{"key":"2023063010281633900_btaa230-B18","doi-asserted-by":"crossref","first-page":"2009","DOI":"10.1093\/bioinformatics\/bty937","article-title":"Identifying antimicrobial peptides using word embedding with deep recurrent neural networks","volume":"35","author":"Hamid","year":"2019","journal-title":"Bioinformatics"},{"key":"2023063010281633900_btaa230-B19","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1093\/oxfordjournals.pan.a004868","article-title":"Logistic regression in rare events data","volume":"9","author":"King","year":"2001","journal-title":"Polit. Anal"},{"key":"2023063010281633900_btaa230-B20","author":"Kingma","year":"2014"},{"key":"2023063010281633900_btaa230-B21","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"2023063010281633900_btaa230-B22","first-page":"2177","article-title":"Neural word embedding as implicit matrix factorization","volume":"27","author":"Levy","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"2023063010281633900_btaa230-B23","doi-asserted-by":"crossref","first-page":"D687","DOI":"10.1093\/nar\/gky1080","article-title":"VFDB 2019: a comparative pathogenomic platform with an interactive web interface","volume":"47","author":"Liu","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2023063010281633900_btaa230-B24","doi-asserted-by":"crossref","first-page":"e0119317","DOI":"10.1371\/journal.pone.0119317","article-title":"T346Hunter: a novel web-based tool for the prediction of type III, type IV and type VI secretion systems in bacterial genomes","volume":"10","author":"Manuel Martinez-Garcia","year":"2015","journal-title":"PLoS One"},{"key":"2023063010281633900_btaa230-B25","first-page":"851","article-title":"Deep learning in bioinformatics","volume":"18","author":"Min","year":"2017","journal-title":"Brief. Bioinform"},{"key":"2023063010281633900_btaa230-B26","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1038\/nbt.4235","article-title":"A universal SNP and small-indel variant caller using deep neural networks","volume":"36","author":"Poplin","year":"2018","journal-title":"Nat. Biotechnol"},{"key":"2023063010281633900_btaa230-B27","doi-asserted-by":"crossref","first-page":"380","DOI":"10.6026\/97320630006380","article-title":"SSPred: a prediction server based on SVM for the identification and classification of proteins involved in bacterial secretion systems","volume":"6","author":"Pundhir","year":"2011","journal-title":"Bioinformation"},{"key":"2023063010281633900_btaa230-B28","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1093\/bioinformatics\/bti028","article-title":"SPAAN: a software program for prediction of adhesins and adhesin-like proteins using neural networks","volume":"21","author":"Sachdeva","year":"2005","journal-title":"Bioinformatics"},{"key":"2023063010281633900_btaa230-B29","doi-asserted-by":"crossref","first-page":"i254","DOI":"10.1093\/bioinformatics\/bty275","article-title":"DeepFam: deep learning based alignment-free method for protein family modeling and prediction","volume":"34","author":"Seo","year":"2018","journal-title":"Bioinformatics"},{"key":"2023063010281633900_btaa230-B30","first-page":"1929","article-title":"Dropout: a simple way to prevent neural networks from overfitting","volume":"15","author":"Srivastava","year":"2014","journal-title":"J. Mach. Learn. Res"},{"key":"2023063010281633900_btaa230-B31","first-page":"1","article-title":"Incorporating amino acids composition and functional domains for identifying bacterial toxin proteins","volume":"2014","author":"Su","year":"2014","journal-title":"BioMed Res. Int"},{"key":"2023063010281633900_btaa230-B32","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1093\/nar\/28.1.33","article-title":"The COG database: a tool for genome-scale analysis of protein functions and evolution","volume":"28","author":"Tatusov","year":"2000","journal-title":"Nucleic Acids Res"},{"key":"2023063010281633900_btaa230-B33","doi-asserted-by":"crossref","first-page":"2730","DOI":"10.1093\/bioinformatics\/bty1068","article-title":"Promoter analysis and prediction in the human genome using sequence-based deep learning models","volume":"35","author":"Umarov","year":"2019","journal-title":"Bioinformatics"},{"key":"2023063010281633900_btaa230-B34","first-page":"2579","article-title":"Visualizing data using t-SNE","volume":"9","author":"van der Maaten","year":"2008","journal-title":"J. Mach. Learn. Res"},{"key":"2023063010281633900_btaa230-B35","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1093\/femsre\/fuv029","article-title":"Targeted imaging of bacterial infections: advances, hurdles and hopes","volume":"39","author":"van Oosten","year":"2015","journal-title":"FEMS Microbiol. Rev"},{"key":"2023063010281633900_btaa230-B36","doi-asserted-by":"crossref","first-page":"2740","DOI":"10.1093\/bioinformatics\/bty179","article-title":"Deep learning improves antimicrobial peptide recognition","volume":"34","author":"Veltri","year":"2018","journal-title":"Bioinformatics"},{"key":"2023063010281633900_btaa230-B37","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1094\/MPMI-18-0877","article-title":"Bioinformatics correctly identifies many type III secretion substrates in the plant pathogen Pseudomonas syringae and the biocontrol isolate P-fluorescens SBW25","volume":"18","author":"Vinatzer","year":"2005","journal-title":"Mol. Plant-Microbe Interact"},{"key":"2023063010281633900_btaa230-B38","doi-asserted-by":"crossref","first-page":"5235","DOI":"10.1093\/bioinformatics\/btz382","article-title":"Deep learning of the back-splicing code for circular RNA formation","volume":"35","author":"Wang","year":"2019","journal-title":"Bioinformatics"},{"key":"2023063010281633900_btaa230-B39","doi-asserted-by":"crossref","first-page":"2546","DOI":"10.1093\/bioinformatics\/bty155","article-title":"Bastion6: a bioinformatics approach for accurate prediction of type VI secreted effectors","volume":"34","author":"Wang","year":"2018","journal-title":"Bioinformatics"},{"key":"2023063010281633900_btaa230-B40","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1186\/1471-2164-15-50","article-title":"Prediction of bacterial type IV secreted effectors by C-terminal features","volume":"15","author":"Wang","year":"2014","journal-title":"BMC Genomics"},{"key":"2023063010281633900_btaa230-B41","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s40537-016-0043-6","article-title":"A survey of transfer learning","volume":"3","author":"Weiss","year":"2016","journal-title":"J. Big Data"},{"key":"2023063010281633900_btaa230-B42","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/0169-7439(87)80084-9","article-title":"Principal component analysis","volume":"2","author":"Wold","year":"1987","journal-title":"Chemometr. Intell. Lab. Syst"},{"key":"2023063010281633900_btaa230-B43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jtbi.2010.08.001","article-title":"SecretP: identifying bacterial secreted proteins by fusing Chou\u2019s pseudo-amino acid composition","volume":"267","author":"Yu","year":"2010","journal-title":"J. Theor. Biol"},{"key":"2023063010281633900_btaa230-B44","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1093\/bib\/bbx078","article-title":"An account of in silico identification tools of secreted effector proteins in bacteria and future challenges","volume":"20","author":"Zeng","year":"2019","journal-title":"Brief. Bioinform"},{"key":"2023063010281633900_btaa230-B45","first-page":"649","article-title":"Character-level convolutional networks for text classification","volume":"28","author":"Zhang","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"2023063010281633900_btaa230-B46","doi-asserted-by":"crossref","first-page":"2899","DOI":"10.1093\/bioinformatics\/bty1050","article-title":"A simple convolutional neural network for prediction of enhancer\u2013promoter interactions with DNA sequence data","volume":"35","author":"Zhuang","year":"2019","journal-title":"Bioinformatics"},{"key":"2023063010281633900_btaa230-B47","doi-asserted-by":"crossref","first-page":"3135","DOI":"10.1093\/bioinformatics\/btt554","article-title":"Accurate prediction of bacterial type IV secreted effectors using amino acid composition and PSSM profiles","volume":"29","author":"Zou","year":"2013","journal-title":"Bioinformatics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bioinformatics\/advance-article-pdf\/doi\/10.1093\/bioinformatics\/btaa230\/33369373\/btaa230.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/36\/12\/3693\/50746066\/bioinformatics_36_12_3693.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/36\/12\/3693\/50746066\/bioinformatics_36_12_3693.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,30]],"date-time":"2023-06-30T10:29:02Z","timestamp":1688120942000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/36\/12\/3693\/5816592"}},"subtitle":[],"editor":[{"given":"Jinbo","family":"Xu","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2020,4,6]]},"references-count":47,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2020,6,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btaa230","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2020,6,15]]},"published":{"date-parts":[[2020,4,6]]}}}