{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T13:25:37Z","timestamp":1782739537055,"version":"3.54.5"},"reference-count":20,"publisher":"Oxford University Press (OUP)","issue":"13","license":[{"start":{"date-parts":[[2016,10,2]],"date-time":"2016-10-02T00:00:00Z","timestamp":1475366400000},"content-version":"vor","delay-in-days":1201,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/3.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2013,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Motivation: The development of effective methods for the prediction of ontological annotations is an important goal in computational biology, with protein function prediction and disease gene prioritization gaining wide recognition. Although various algorithms have been proposed for these tasks, evaluating their performance is difficult owing to problems caused both by the structure of biomedical ontologies and biased or incomplete experimental annotations of genes and gene products.<\/jats:p>\n               <jats:p>Results: We propose an information-theoretic framework to evaluate the performance of computational protein function prediction. We use a Bayesian network, structured according to the underlying ontology, to model the prior probability of a protein\u2019s function. We then define two concepts, misinformation and remaining uncertainty, that can be seen as information-theoretic analogs of precision and recall. Finally, we propose a single statistic, referred to as semantic distance, that can be used to rank classification models. We evaluate our approach by analyzing the performance of three protein function predictors of Gene Ontology terms and provide evidence that it addresses several weaknesses of currently used metrics. We believe this framework provides useful insights into the performance of protein function prediction tools.<\/jats:p>\n               <jats:p>Contact: \u00a0predrag@indiana.edu<\/jats:p>\n               <jats:p>Supplementary information: \u00a0Supplementary data are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/btt228","type":"journal-article","created":{"date-parts":[[2013,6,27]],"date-time":"2013-06-27T05:33:26Z","timestamp":1372311206000},"page":"i53-i61","source":"Crossref","is-referenced-by-count":133,"title":["Information-theoretic evaluation of predicted ontological annotations"],"prefix":"10.1093","volume":"29","author":[{"given":"Wyatt T.","family":"Clark","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Predrag","family":"Radivojac","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2013,6,19]]},"reference":[{"key":"2023062614290223600_btt228-B20","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1038\/nbt0210-128","article-title":"Ontology engineering","volume":"28","author":"Alterovitz","year":"2010","journal-title":"Nat. Biotechnol."},{"key":"2023062614290223600_btt228-B1","doi-asserted-by":"crossref","first-page":"3389","DOI":"10.1093\/nar\/25.17.3389","article-title":"Gapped BLAST and PSI-BLAST: a new generation of protein database search programs","volume":"25","author":"Altschul","year":"1997","journal-title":"Nucleic Acids Res."},{"key":"2023062614290223600_btt228-B2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/75556","article-title":"Gene ontology: tool for the unification of biology. The gene ontology consortium","volume":"25","author":"Ashburner","year":"2000","journal-title":"Nat. Genet."},{"key":"2023062614290223600_btt228-B3","doi-asserted-by":"crossref","first-page":"2086","DOI":"10.1002\/prot.23029","article-title":"Analysis of protein function and its prediction from amino acid sequence","volume":"79","author":"Clark","year":"2011","journal-title":"Proteins"},{"key":"2023062614290223600_btt228-B4","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1093\/bib\/bbr066","article-title":"Semantic similarity analysis of protein data: assessment with biological features and issues","volume":"13","author":"Guzzi","year":"2012","journal-title":"Brief. Bioinform."},{"key":"2023062614290223600_btt228-B5","author":"Jiang","year":"1997"},{"key":"2023062614290223600_btt228-B6","volume-title":"Probabilistic Graphical Models","author":"Koller","year":"2009"},{"key":"2023062614290223600_btt228-B7","author":"Lin","year":"1998"},{"key":"2023062614290223600_btt228-B8","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1093\/bioinformatics\/btg153","article-title":"Investigating semantic similarity measures across the Gene Ontology: the relationship between sequence and annotation","volume":"19","author":"Lord","year":"2003","journal-title":"Bioinformatics"},{"key":"2023062614290223600_btt228-B9","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1186\/1471-2105-5-178","article-title":"GOtcha: a new method for prediction of protein function assessed by the annotation of seven genomes","volume":"5","author":"Martin","year":"2004","journal-title":"BMC Bioinformatics"},{"key":"2023062614290223600_btt228-B10","doi-asserted-by":"crossref","first-page":"e1000443","DOI":"10.1371\/journal.pcbi.1000443","article-title":"Semantic similarity in biomedical ontologies","volume":"5","author":"Pesquita","year":"2009","journal-title":"PLoS Comput. Biol."},{"key":"2023062614290223600_btt228-B11","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1109\/21.24528","article-title":"Development and application of a metric on semantic nets","volume":"19","author":"Rada","year":"1989","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"2023062614290223600_btt228-B12","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1038\/nmeth.2340","article-title":"A large-scale evaluation of computational protein function prediction","volume":"10","author":"Radivojac","year":"2013","journal-title":"Nat. Methods"},{"key":"2023062614290223600_btt228-B13","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1016\/j.tibtech.2009.01.002","article-title":"Protein function prediction\u2013the power of multiplicity","volume":"27","author":"Rentzsch","year":"2009","journal-title":"Trends Biotechnol."},{"key":"2023062614290223600_btt228-B14","author":"Resnik","year":"1995"},{"key":"2023062614290223600_btt228-B15","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1613\/jair.514","article-title":"Semantic similarity in a taxonomy: an information-based measure and its application to problems of ambiguity in natural language","volume":"11","author":"Resnik","year":"1999","journal-title":"J. Artif. Intell. Res."},{"key":"2023062614290223600_btt228-B16","doi-asserted-by":"crossref","DOI":"10.1201\/b10967","volume-title":"Introduction to Bio-Ontologies","author":"Robinson","year":"2011"},{"key":"2023062614290223600_btt228-B17","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1186\/1471-2105-7-302","article-title":"A new measure for functional similarity of gene products based on gene ontology","volume":"7","author":"Schlicker","year":"2006","journal-title":"BMC Bioinformatics"},{"key":"2023062614290223600_btt228-B18","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1038\/msb4100129","article-title":"Network-based prediction of protein function","volume":"3","author":"Sharan","year":"2007","journal-title":"Mol. Syst. Biol."},{"key":"2023062614290223600_btt228-B19","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.1110\/ps.062184006","article-title":"A categorization approach to automated ontological function annotation","volume":"15","author":"Verspoor","year":"2006","journal-title":"Protein Sci."}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/29\/13\/i53\/50703348\/bioinformatics_29_13_i53.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/29\/13\/i53\/50703348\/bioinformatics_29_13_i53.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,26]],"date-time":"2023-06-26T15:28:26Z","timestamp":1687793306000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/29\/13\/i53\/195366"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,6,19]]},"references-count":20,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2013,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btt228","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2013,7]]},"published":{"date-parts":[[2013,6,19]]}}}