{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T08:16:46Z","timestamp":1776154606794,"version":"3.50.1"},"reference-count":36,"publisher":"Oxford University Press (OUP)","issue":"Supplement_1","license":[{"start":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T00:00:00Z","timestamp":1719532800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Australian Research Council Discovery","award":["DP190101350"],"award-info":[{"award-number":["DP190101350"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,6,28]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>Biological background knowledge plays an important role in the manual quality assurance (QA) of biological database records. One such QA task is the detection of inconsistencies in literature-based Gene Ontology Annotation (GOA). This manual verification ensures the accuracy of the GO annotations based on a comprehensive review of the literature used as evidence, Gene Ontology (GO) terms, and annotated genes in GOA records. While automatic approaches for the detection of semantic inconsistencies in GOA have been developed, they operate within predetermined contexts, lacking the ability to leverage broader evidence, especially relevant domain-specific background knowledge. This paper investigates various types of background knowledge that could improve the detection of prevalent inconsistencies in GOA. In addition, the paper proposes several approaches to integrate background knowledge into the automatic GOA inconsistency detection process.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>We have extended a previously developed GOA inconsistency dataset with several kinds of GOA-related background knowledge, including GeneRIF statements, biological concepts mentioned within evidence texts, GO hierarchy and existing GO annotations of the specific gene. We have proposed several effective approaches to integrate background knowledge as part of the automatic GOA inconsistency detection process. The proposed approaches can improve automatic detection of self-consistency and several of the most prevalent types of inconsistencies.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>\u2002<\/jats:title>\n                  <jats:p>This is the first study to explore the advantages of utilizing background knowledge and to propose a practical approach to incorporate knowledge in automatic GOA inconsistency detection. We establish a new benchmark for performance on this task. Our methods may be applicable to various tasks that involve incorporating biological background knowledge.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>https:\/\/github.com\/jiyuc\/de-inconsistency.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/btae246","type":"journal-article","created":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T09:32:05Z","timestamp":1719567125000},"page":"i390-i400","source":"Crossref","is-referenced-by-count":5,"title":["Integration of background knowledge for automatic detection of inconsistencies in gene ontology annotation"],"prefix":"10.1093","volume":"40","author":[{"given":"Jiyu","family":"Chen","sequence":"first","affiliation":[{"name":"School of Computing and Information Systems, The University of Melbourne , Parkville 3010, VIC, Australia"},{"name":"Data61, The Commonwealth Scientific and Industrial Research Organisation , Marsfield 2122, NSW, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin","family":"Goudey","sequence":"additional","affiliation":[{"name":"School of Computing and Information Systems, The University of Melbourne , Parkville 3010, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas","family":"Geard","sequence":"additional","affiliation":[{"name":"School of Computing and Information Systems, The University of Melbourne , Parkville 3010, VIC, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8661-1544","authenticated-orcid":false,"given":"Karin","family":"Verspoor","sequence":"additional","affiliation":[{"name":"School of Computing Technologies, RMIT University , Melbourne, Victoria 3000, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2024,6,28]]},"reference":[{"key":"2024071814160515300_btae246-B1","first-page":"17","author":"Aronson","year":"2001"},{"key":"2024071814160515300_btae246-B2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1038\/75556","article-title":"Gene ontology: tool for the unification of biology","volume":"25","author":"Ashburner","year":"2000","journal-title":"Nat Genet"},{"key":"2024071814160515300_btae246-B3","doi-asserted-by":"crossref","first-page":"bat054","DOI":"10.1093\/database\/bat054","article-title":"A guide to best practices for gene ontology (GO) manual annotation","volume":"2013","author":"Balakrishnan","year":"2013","journal-title":"Database"},{"key":"2024071814160515300_btae246-B4","doi-asserted-by":"crossref","first-page":"D480","DOI":"10.1093\/nar\/gkaa1100","article-title":"UniProt: the universal protein knowledgebase in 2021","volume":"49","author":"Bateman","year":"2021","journal-title":"Nucleic Acids Res"},{"key":"2024071814160515300_btae246-B5","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/978-1-4939-3743-1_13","article-title":"Gene-category analysis","volume":"1446","author":"Bauer","year":"2017","journal-title":"Methods Mol Biol"},{"key":"2024071814160515300_btae246-B6","doi-asserted-by":"crossref","first-page":"3045","DOI":"10.1093\/bioinformatics\/btp536","article-title":"QuickGO: a web-based tool for Gene Ontology searching","volume":"25","author":"Binns","year":"2009","journal-title":"Bioinformatics"},{"key":"2024071814160515300_btae246-B7","doi-asserted-by":"crossref","first-page":"D36","DOI":"10.1093\/nar\/gku1055","article-title":"Gene: a gene-centered information resource at NCBI","volume":"43","author":"Brown","year":"2015","journal-title":"Nucleic Acids Res"},{"key":"2024071814160515300_btae246-B8","doi-asserted-by":"crossref","first-page":"D801","DOI":"10.1093\/nar\/gky1056","article-title":"Mouse genome database (MGD) 2019","volume":"47","author":"Bult","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2024071814160515300_btae246-B9","doi-asserted-by":"crossref","first-page":"S17","DOI":"10.1186\/1471-2105-6-S1-S17","article-title":"An evaluation of go annotation retrieval for biocreative and Goa","volume":"6","author":"Camon","year":"2005","journal-title":"BMC Bioinformatics"},{"key":"2024071814160515300_btae246-B10","doi-asserted-by":"crossref","first-page":"D325","DOI":"10.1093\/nar\/gkaa1113","article-title":"The gene ontology resource: enriching a GOld mine","volume":"49","author":"Carbon","year":"2021","journal-title":"Nucleic Acids Res"},{"key":"2024071814160515300_btae246-B11","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1186\/s12859-021-04479-9","article-title":"Automatic consistency assurance for literature-based gene ontology annotation","volume":"22","author":"Chen","year":"2021","journal-title":"BMC Bioinformatics"},{"key":"2024071814160515300_btae246-B12","doi-asserted-by":"crossref","first-page":"i273","DOI":"10.1093\/bioinformatics\/btac230","article-title":"Exploring automatic inconsistency detection for literature-based gene ontology annotation","volume":"38","author":"Chen","year":"2022","journal-title":"Bioinformatics"},{"key":"2024071814160515300_btae246-B13","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baw164","article-title":"Benchmarks for measurement of duplicate detection methods in nucleotide databases","volume":"2023","author":"Chen","year":"2023","journal-title":"Database"},{"key":"2024071814160515300_btae246-B14","doi-asserted-by":"crossref","first-page":"baw163","DOI":"10.1093\/database\/baw163","article-title":"Duplicates, redundancies and inconsistencies in the primary nucleotide databases: a descriptive study","volume":"2017","author":"Chen","year":"2017","journal-title":"Database"},{"key":"2024071814160515300_btae246-B15","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1186\/1471-2105-11-530","article-title":"Formalization of taxon-based constraints to detect inconsistencies in annotation and ontology development","volume":"11","author":"Deegan N\u00e9e Clark","year":"2010","journal-title":"BMC Bioinformatics"},{"key":"2024071814160515300_btae246-B16","doi-asserted-by":"crossref","first-page":"e40519","DOI":"10.1371\/journal.pone.0040519","article-title":"Mining GO annotations for improving annotation consistency","volume":"7","author":"Faria","year":"2012","journal-title":"PLoS One"},{"key":"2024071814160515300_btae246-B17","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1186\/1471-2105-15-59","article-title":"Large-scale biomedical concept recognition: an evaluation of current automatic annotators and their parameters","volume":"15","author":"Funk","year":"2014","journal-title":"BMC Bioinformatics"},{"key":"2024071814160515300_btae246-B18","doi-asserted-by":"crossref","first-page":"1641","DOI":"10.1093\/bioinformatics\/18.12.1641","article-title":"Modeling the percolation of annotation errors in a database of protein sequences","volume":"18","author":"Gilks","year":"2002","journal-title":"Bioinformatics"},{"key":"2024071814160515300_btae246-B19","doi-asserted-by":"crossref","first-page":"S9","DOI":"10.1186\/1471-2105-9-S3-S9","article-title":"Gene ontology density estimation and discourse analysis for automatic generif extraction","volume":"9","author":"Gobeill","year":"2008","journal-title":"BMC Bioinformatics"},{"key":"2024071814160515300_btae246-B20","doi-asserted-by":"crossref","first-page":"bbac416","DOI":"10.1093\/bib\/bbac416","article-title":"Propagation, detection and correction of errors using the sequence database network","volume":"23","author":"Goudey","year":"2022","journal-title":"Brief Bioinform"},{"key":"2024071814160515300_btae246-B21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3458754","article-title":"Domain-specific language model pretraining for biomedical natural language processing","volume":"3","author":"Gu","year":"2021","journal-title":"ACM Trans Comput Healthcare"},{"key":"2024071814160515300_btae246-B22","doi-asserted-by":"crossref","first-page":"1452","DOI":"10.1056\/NEJMra1615014","article-title":"Classification, ontology, and precision medicine","volume":"379","author":"Haendel","year":"2018","journal-title":"N Engl J Med"},{"key":"2024071814160515300_btae246-B23","doi-asserted-by":"crossref","first-page":"D514","DOI":"10.1093\/nar\/gki033","article-title":"Online mendelian inheritance in man (OMIM), a knowledgebase of human genes and genetic disorders","volume":"33","author":"Hamosh","year":"2005","journal-title":"Nucleic Acids Res"},{"key":"2024071814160515300_btae246-B24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/nar\/gkn923","article-title":"Bioinformatics enrichment tools: paths toward the comprehensive functional analysis of large gene lists","volume":"37","author":"Huang","year":"2009","journal-title":"Nucleic Acids Res"},{"key":"2024071814160515300_btae246-B25","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1186\/2047-217X-3-4","article-title":"Understanding how and why the Gene Ontology and its annotations evolve: the GO within UniProt","volume":"3","author":"Huntley","year":"2014","journal-title":"Gigascience"},{"key":"2024071814160515300_btae246-B26","first-page":"56","article-title":"The open biomedical annotator","volume":"2009","author":"Jonquet","year":"2009","journal-title":"Summit Transl Bioinform"},{"key":"2024071814160515300_btae246-B27","first-page":"52","volume-title":"Biocomputing 2006, Maui, Hawaii, 3 \u2013 7 January 2006","author":"Lu","year":"2006"},{"key":"2024071814160515300_btae246-B28","doi-asserted-by":"crossref","first-page":"bau086","DOI":"10.1093\/database\/bau086","article-title":"Overview of the gene ontology task at Biocreative IV","volume":"2014","author":"Mao","year":"2014","journal-title":"Database"},{"key":"2024071814160515300_btae246-B29","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1007\/978-1-4939-3743-1_4","volume-title":"Dessimoz C, \u0160kunca N(Eds.),\u00a0The Gene Ontology Handbook","author":"Poux","year":"2017"},{"key":"2024071814160515300_btae246-B30","doi-asserted-by":"crossref","first-page":"e1002533","DOI":"10.1371\/journal.pcbi.1002533","article-title":"Quality of computationally inferred gene ontology annotations","volume":"8","author":"\u0160kunca","year":"2012","journal-title":"PLoS Comput Biol"},{"key":"2024071814160515300_btae246-B31","author":"Tanenblatt","year":"2010"},{"key":"2024071814160515300_btae246-B32","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/978-1-4939-3743-1_2","volume-title":"The Gene Ontology Handbook","author":"Thomas","year":"2017"},{"key":"2024071814160515300_btae246-B33","doi-asserted-by":"crossref","first-page":"bau074","DOI":"10.1093\/database\/bau074","article-title":"BC4GO: a full-text corpus for the BioCreative IV GO task","volume":"2014","author":"Van Auken","year":"2014","journal-title":"Database"},{"key":"2024071814160515300_btae246-B34","author":"Wang","year":"2019"},{"key":"2024071814160515300_btae246-B35","doi-asserted-by":"crossref","first-page":"W587","DOI":"10.1093\/nar\/gkz389","article-title":"Pubtator Central: automated concept annotation for biomedical full text articles","volume":"47","author":"Wei","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2024071814160515300_btae246-B36","doi-asserted-by":"crossref","first-page":"200149","DOI":"10.1098\/rsob.200149","article-title":"Term matrix: a novel gene ontology annotation quality control system based on ontology term co-annotation patterns","volume":"10","author":"Wood","year":"2020","journal-title":"Open Biol"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/Supplement_1\/i390\/58585771\/btae246.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/40\/Supplement_1\/i390\/58585771\/btae246.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T15:36:28Z","timestamp":1721316988000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/40\/Supplement_1\/i390\/7700907"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,28]]},"references-count":36,"journal-issue":{"issue":"Supplement_1","published-print":{"date-parts":[[2024,6,28]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/btae246","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,7]]},"published":{"date-parts":[[2024,6,28]]}}}