{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,21]],"date-time":"2026-03-21T00:25:58Z","timestamp":1774052758608,"version":"3.50.1"},"reference-count":34,"publisher":"Oxford University Press (OUP)","issue":"19","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Motivation: Predicting the biological functions of proteins is one of the key challenges in the post-genomic era. Computational models have demonstrated the utility of applying machine learning methods to predict protein function. Most prediction methods explicitly require a set of negative examples\u2014proteins that are known not carrying out a particular function. However, Gene Ontology (GO) almost always only provides the knowledge that proteins carry out a particular function, and functional annotations of proteins are incomplete. GO structurally organizes more than tens of thousands GO terms and a protein is annotated with several (or dozens) of these terms. For these reasons, the negative examples of a protein can greatly help distinguishing true positive examples of the protein from such a large candidate GO space.<\/jats:p>\n               <jats:p>Results: In this paper, we present a novel approach (called NegGOA) to select negative examples. Specifically, NegGOA takes advantage of the ontology structure, available annotations and potentiality of additional annotations of a protein to choose negative examples of the protein. We compare NegGOA with other negative examples selection algorithms and find that NegGOA produces much fewer false negatives than them. We incorporate the selected negative examples into an efficient function prediction model to predict the functions of proteins in Yeast, Human, Mouse and Fly. NegGOA also demonstrates improved accuracy than these comparing algorithms across various evaluation metrics. In addition, NegGOA is less suffered from incomplete annotations of proteins than these comparing methods.<\/jats:p>\n               <jats:p>Availability and Implementation: The Matlab and R codes are available at https:\/\/sites.google.com\/site\/guoxian85\/neggoa.<\/jats:p>\n               <jats:p>Contact: \u00a0gxyu@swu.edu.cn<\/jats:p>\n               <jats:p>Supplementary information: \u00a0Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btw366","type":"journal-article","created":{"date-parts":[[2016,6,19]],"date-time":"2016-06-19T00:18:20Z","timestamp":1466295500000},"page":"2996-3004","source":"Crossref","is-referenced-by-count":34,"title":["NegGOA: negative GO annotations selection using ontology structure"],"prefix":"10.1093","volume":"32","author":[{"given":"Guangyuan","family":"Fu","sequence":"first","affiliation":[{"name":"1 College of Computer and Information Science, Southwest University, Chongqing 400715, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jun","family":"Wang","sequence":"additional","affiliation":[{"name":"1 College of Computer and Information Science, Southwest University, Chongqing 400715, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bo","family":"Yang","sequence":"additional","affiliation":[{"name":"2 Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guoxian","family":"Yu","sequence":"additional","affiliation":[{"name":"1 College of Computer and Information Science, Southwest University, Chongqing 400715, China"},{"name":"2 Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2016,6,17]]},"reference":[{"key":"2023020113452619900_btw366-B1","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/75556","article-title":"Gene Ontology: tool for the unification of biology","volume":"25","author":"Ashburner","year":"2000","journal-title":"Nat. Genet"},{"key":"2023020113452619900_btw366-B2","doi-asserted-by":"crossref","first-page":"e1003343.","DOI":"10.1371\/journal.pcbi.1003343","article-title":"Ten quick tips for using the Gene Ontology","volume":"9","author":"Blake","year":"2013","journal-title":"PLoS Comput. Biol"},{"key":"2023020113452619900_btw366-B3","first-page":"993","article-title":"Latent Dirichlet allocation","volume":"3","author":"Blei","year":"2003","journal-title":"J. Mach. Learn. Res"},{"key":"2023020113452619900_btw366-B4","doi-asserted-by":"crossref","first-page":"2235","DOI":"10.1093\/bioinformatics\/btu144","article-title":"GOssTO: a stand-alone application and a web tool for calculating semantic similarities on the Gene Ontology","volume":"30","author":"Caniza","year":"2014","journal-title":"Bioinformatics"},{"key":"2023020113452619900_btw366-B5","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1007\/s10994-011-5271-6","article-title":"Synergy of multi-label hierarchical ensembles, data fusion, and cost-sensitive methods for gene functional inference","volume":"88","author":"Cesa-Bianchi","year":"2012","journal-title":"Mach. Learn"},{"key":"2023020113452619900_btw366-B6","first-page":"213","author":"Elkan","year":"2008"},{"key":"2023020113452619900_btw366-B7","doi-asserted-by":"crossref","first-page":"S3.","DOI":"10.1186\/gb-2008-9-s1-s3","article-title":"Predicting gene function in a hierarchical context with an ensemble of classifiers","volume":"9","author":"Guan","year":"2008","journal-title":"Genome Biol"},{"key":"2023020113452619900_btw366-B8","doi-asserted-by":"crossref","first-page":"2404","DOI":"10.1093\/bioinformatics\/btp397","article-title":"The impact of incomplete knowledge on evaluation: an experimental benchmark for protein function prediction","volume":"25","author":"Huttenhower","year":"2009","journal-title":"Bioinformatics"},{"key":"2023020113452619900_btw366-B9","first-page":"296","author":"Lin","year":"1998"},{"key":"2023020113452619900_btw366-B10","doi-asserted-by":"crossref","first-page":"S4.","DOI":"10.1186\/gb-2008-9-s1-s4","article-title":"GeneMANIA: a real-time multiple association network integration algorithm for predicting gene function","volume":"9","author":"Mostafavi","year":"2008","journal-title":"Genome Biol"},{"key":"2023020113452619900_btw366-B11","first-page":"419","author":"Mostafavi","year":"2009"},{"key":"2023020113452619900_btw366-B12","doi-asserted-by":"crossref","first-page":"1759","DOI":"10.1093\/bioinformatics\/btq262","article-title":"Fast integration of heterogeneous data sources for predicting gene function with limited annotation","volume":"26","author":"Mostafavi","year":"2010","journal-title":"Bioinformatics"},{"key":"2023020113452619900_btw366-B13","doi-asserted-by":"crossref","first-page":"e1000443","DOI":"10.1371\/journal.pcbi.1000443","article-title":"Semantic similarity in biomedical ontologies","volume":"5","author":"Pesquita","year":"2009","journal-title":"PLoS Comput. Biol"},{"key":"2023020113452619900_btw366-B14","doi-asserted-by":"crossref","first-page":"S2.","DOI":"10.1186\/gb-2008-9-s1-s2","article-title":"A critical assessment of Mus musculus gene function prediction using integrated genomic evidence","volume":"9","author":"Pe\u00f1a-Castillo","year":"2008","journal-title":"Genome Biol"},{"key":"2023020113452619900_btw366-B15","doi-asserted-by":"crossref","first-page":"1812","DOI":"10.1109\/TCBB.2012.114","article-title":"A fast ranking algorithm for predicting gene functions in biomolecular networks","volume":"9","author":"Re","year":"2012","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinformatics"},{"key":"2023020113452619900_btw366-B16","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1038\/nrg2363","article-title":"Use and misuse of the gene ontology annotations","volume":"9","author":"Rhee","year":"2008","journal-title":"Nat. Rev. Genet"},{"key":"2023020113452619900_btw366-B17","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1038\/nmeth.2340","article-title":"A large-scale evaluation of computational protein function prediction","volume":"10","author":"Radivojac","year":"2013","journal-title":"Nat. Methods"},{"key":"2023020113452619900_btw366-B18","doi-asserted-by":"crossref","first-page":"e1003063","DOI":"10.1371\/journal.pcbi.1003063","article-title":"Biases in the experimental annotations of protein function and their effect on our understanding of protein function space","volume":"9","author":"Schnoes","year":"2013","journal-title":"PLoS Comput. Biol"},{"key":"2023020113452619900_btw366-B19","doi-asserted-by":"crossref","first-page":"e1002533","DOI":"10.1371\/journal.pcbi.1002533","article-title":"Quality of computationally inferred gene ontology annotations","volume":"8","author":"\u0160kunca","year":"2012","journal-title":"PLoS Comput. Biol"},{"key":"2023020113452619900_btw366-B20","doi-asserted-by":"crossref","first-page":"i529","DOI":"10.1093\/bioinformatics\/btm195","article-title":"Information theory applied to the sparse gene ontology annotation network to predict novel gene function","volume":"23","author":"Tao","year":"2007","journal-title":"Bioinformatics"},{"key":"2023020113452619900_btw366-B21","doi-asserted-by":"crossref","first-page":"e1002386","DOI":"10.1371\/journal.pcbi.1002386","article-title":"On the use of gene ontology annotations to assess functional similarity among orthologs and paralogs: a short report","volume":"8","author":"Thomas","year":"2012","journal-title":"PLoS Comput. Biol"},{"key":"2023020113452619900_btw366-B22","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1007\/s10115-007-0094-2","article-title":"Random walk with restart: fast solutions and applications","volume":"14","author":"Tong","year":"2008","journal-title":"Knowl. Inf. Syst"},{"key":"2023020113452619900_btw366-B23","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1109\/TCBB.2010.38","article-title":"True Path Rule hierarchical ensembles for genome-wide gene function prediction","volume":"8","author":"Valentini","year":"2011","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinformatics"},{"key":"2023020113452619900_btw366-B24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2014\/901419","article-title":"Hierarchical ensemble methods for protein function prediction","volume":"2014","author":"Valentini","year":"2014","journal-title":"ISRN Bioinformatics"},{"key":"2023020113452619900_btw366-B25","doi-asserted-by":"crossref","first-page":"i357","DOI":"10.1093\/bioinformatics\/btv260","article-title":"Exploiting ontology graph for predicting sparsely annotated gene function","volume":"31","author":"Wang","year":"2015","journal-title":"Bioinformatics"},{"key":"2023020113452619900_btw366-B26","doi-asserted-by":"crossref","first-page":"80","DOI":"10.2307\/3001968","article-title":"Individual comparisons by ranking methods","volume":"1","author":"Wilcoxon","year":"1945","journal-title":"Biometrics"},{"key":"2023020113452619900_btw366-B27","doi-asserted-by":"crossref","first-page":"1383","DOI":"10.1093\/bioinformatics\/bts129","article-title":"Improving GO semantic similarity measures by exploring ontology beneath the terms and modelling uncertainty","volume":"28","author":"Yang","year":"2012","journal-title":"Bioinformatics"},{"key":"2023020113452619900_btw366-B28","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.1093\/bioinformatics\/btt110","article-title":"Parametric Bayesian priors and better choice of negative examples improve protein function prediction","volume":"29","author":"Youngs","year":"2013","journal-title":"Bioinformatics"},{"key":"2023020113452619900_btw366-B29","doi-asserted-by":"crossref","first-page":"e1003644","DOI":"10.1371\/journal.pcbi.1003644","article-title":"Negative example selection for protein function prediction: the NoGO database","volume":"10","author":"Youngs","year":"2014","journal-title":"PLoS Comput. Biol"},{"key":"2023020113452619900_btw366-B30","doi-asserted-by":"crossref","first-page":"1045","DOI":"10.1109\/TCBB.2013.111","article-title":"Protein function prediction using multi-label ensemble classification","volume":"10","author":"Yu","year":"2013","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinformatics"},{"key":"2023020113452619900_btw366-B31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12859-014-0430-y","article-title":"Predicting protein function using incomplete hierarchical labels","volume":"16","author":"Yu","year":"2015","journal-title":"BMC Bioinformatics"},{"key":"2023020113452619900_btw366-B32","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1186\/s12859-015-0713-y","article-title":"Predicting protein function via downward random walks on a gene ontology","volume":"16","author":"Yu","year":"2015","journal-title":"BMC Bioinformatics"},{"key":"2023020113452619900_btw366-B33","first-page":"999","author":"Zhang","year":"2010"},{"key":"2023020113452619900_btw366-B35","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1186\/1471-2105-9-57","article-title":"Gene function prediction using labeled and unlabeled data","volume":"9","author":"Zhao","year":"2008","journal-title":"BMC Bioinformatics"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/32\/19\/2996\/49021153\/bioinformatics_32_19_2996.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/32\/19\/2996\/49021153\/bioinformatics_32_19_2996.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,1]],"date-time":"2023-02-01T23:50:49Z","timestamp":1675295449000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/32\/19\/2996\/2196619"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,6,17]]},"references-count":34,"journal-issue":{"issue":"19","published-print":{"date-parts":[[2016,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btw366","relation":{},"ISSN":["1367-4811","1367-4803"],"issn-type":[{"value":"1367-4811","type":"electronic"},{"value":"1367-4803","type":"print"}],"subject":[],"published-other":{"date-parts":[[2016,10,1]]},"published":{"date-parts":[[2016,6,17]]}}}