{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T14:52:37Z","timestamp":1760799157424},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"1","content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2006,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Background<\/jats:title>\n            <jats:p>Ontologies and taxonomies are among the most important computational resources for molecular biology and bioinformatics. A series of recent papers has shown that the Gene Ontology (GO), the most prominent taxonomic resource in these fields, is marked by flaws of certain characteristic types, which flow from a failure to address basic ontological principles. As yet, no methods have been proposed which would allow ontology curators to pinpoint flawed terms or definitions in ontologies in a systematic way.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>We present computational methods that automatically identify terms and definitions which are defined in a circular or unintelligible way. We further demonstrate the potential of these methods by applying them to isolate a subset of 6001 problematic GO terms. By automatically aligning GO with other ontologies and taxonomies we were able to propose alternative synonyms and definitions for some of these problematic terms. This allows us to demonstrate that these other resources do not contain definitions superior to those supplied by GO.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>Our methods provide reliable indications of the quality of terms and definitions in ontologies and taxonomies. Further, they are well suited to assist ontology curators in drawing their attention to those terms that are ill-defined. We have further shown the limitations of ontology mapping and alignment in assisting ontology curators in rectifying problems, thus pointing to the need for manual curation.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1186\/1471-2105-7-212","type":"journal-article","created":{"date-parts":[[2006,4,20]],"date-time":"2006-04-20T15:47:09Z","timestamp":1145548029000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Quality control for terms and definitions in ontologies and taxonomies"],"prefix":"10.1186","volume":"7","author":[{"given":"Jacob","family":"K\u00f6hler","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katherine","family":"Munn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexander","family":"R\u00fcegg","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andre","family":"Skusa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Barry","family":"Smith","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2006,4,19]]},"reference":[{"key":"951_CR1","doi-asserted-by":"publisher","first-page":"1425","DOI":"10.1101\/gr.180801","volume":"11","author":"Gene-Ontology-Consortium","year":"2001","unstructured":"Gene-Ontology-Consortium: Creating the gene ontology resource: design and implementation. Genome Res 2001, 11: 1425\u20131433. 10.1101\/gr.180801","journal-title":"Genome Res"},{"key":"951_CR2","doi-asserted-by":"publisher","first-page":"D262","DOI":"10.1093\/nar\/gkh021","volume":"32 Database iss","author":"E Camon","year":"2004","unstructured":"Camon E, Magrane M, Barrell D, Lee V, Dimmer E, Maslen J, Binns D, Harte N, Lopez R, Apweiler R: The Gene Ontology Annotation (GOA) Database: sharing knowledge in Uniprot with Gene Ontology. Nucleic Acids Res 2004, 32 Database issue: D262\u20136. 10.1093\/nar\/gkh021","journal-title":"Nucleic Acids Res"},{"key":"951_CR3","first-page":"D258","volume":"32 Database iss","author":"MA Harris","year":"2004","unstructured":"Harris MA, Clark J, Ireland A, Lomax J, Ashburner M, Foulger R, Eilbeck K, Lewis S, Marshall B, Mungall C, Richter J, Rubin GM, Blake JA, Bult C, Dolan M, Drabkin H, Eppig JT, Hill DP, Ni L, Ringwald M, Balakrishnan R, Cherry JM, Christie KR, Costanzo MC, Dwight SS, Engel S, Fisk DG, Hirschman JE, Hong EL, Nash RS, Sethuraman A, Theesfeld CL, Botstein D, Dolinski K, Feierbach B, Berardini T, Mundodi S, Rhee SY, Apweiler R, Barrell D, Camon E, Dimmer E, Lee V, Chisholm R, Gaudet P, Kibbe W, Kishore R, Schwarz EM, Sternberg P, Gwinn M, Hannick L, Wortman J, Berriman M, Wood V, de la Cruz N, Tonellato P, Jaiswal P, Seigfried T, White R: The Gene Ontology (GO) database and informatics resource. Nucleic Acids Res 2004, 32 Database issue: D258\u201361.","journal-title":"Nucleic Acids Res"},{"key":"951_CR4","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1093\/bioinformatics\/btg420","volume":"20","author":"SG Lee","year":"2004","unstructured":"Lee SG, Hur JU, Kim YS: A graph-theoretic modeling on GO space for biological interpretation of gene clusters. Bioinformatics 2004, 20: 381\u2013388. 10.1093\/bioinformatics\/btg420","journal-title":"Bioinformatics"},{"key":"951_CR5","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1186\/1471-2105-5-16","volume":"5","author":"B Zhang","year":"2004","unstructured":"Zhang B, Schmoyer D, Kirov S, Snoddy J: GOTree Machine (GOTM): a web-based platform for interpreting sets of interesting genes using Gene Ontology hierarchies. BMC Bioinformatics 2004, 5: 16. 10.1186\/1471-2105-5-16","journal-title":"BMC Bioinformatics"},{"key":"951_CR6","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1016\/S1386-5056(02)00055-2","volume":"67","author":"G Nenadic","year":"2002","unstructured":"Nenadic G, Mima H, Spasic I, Ananiadou S, Tsujii J: Terminology-driven literature mining and knowledge acquisition in biomedicine. Int J Med Inf 2002, 67: 33\u201348. 10.1016\/S1386-5056(02)00055-2","journal-title":"Int J Med Inf"},{"key":"951_CR7","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/S1741-8364(04)02392-3","volume":"2","author":"J K\u00f6hler","year":"2004","unstructured":"K\u00f6hler J: Integration of Life Science Databases. Drugs Discovery Today: BioSilico 2004, 2: 61\u201369. 10.1016\/S1741-8364(04)02392-3","journal-title":"Drugs Discovery Today: BioSilico"},{"key":"951_CR8","first-page":"409","volume":"95","author":"C Van Buggenhout","year":"2003","unstructured":"Van Buggenhout C, Ceusters W: A novel view on information content of concepts in extremely large ontologies. Stud Health Technol Inform 2003, 95: 409\u2013414.","journal-title":"Stud Health Technol Inform"},{"key":"951_CR9","first-page":"135","volume-title":"Formal Terminology Management for Language Based Knowledge Systems: Resistance is Futile","author":"W Ceusters","year":"2001","unstructured":"Ceusters W: Formal Terminology Management for Language Based Knowledge Systems: Resistance is Futile. In Edited by: Temmerman R and Lutjeharms M. 2001, 135\u2013153."},{"key":"951_CR10","volume-title":"Pac Symp Biocomput","author":"PV Ogren","year":"2005","unstructured":"Ogren PV, Cohen KB, Hunter LT: Implications of compositionality in the Gene Ontology for its curation and usage. Pac Symp Biocomput 2005."},{"key":"951_CR11","first-page":"145","volume-title":"Stud Health Technol Inform","author":"W Ceusters","year":"2004","unstructured":"Ceusters W, Smith B, Kumar A, Dhaen D: Mistakes in Medical Ontologies: Where Do They Come From and How Can They Be Detected?: ; Rome, Italy. In Stud Health Technol Inform. Volume 102. Edited by: Pisanelli DM. IOS Press, Amsterdam.; 2004:145\u201363."},{"key":"951_CR12","first-page":"cm.","volume-title":"The semantics of relationships : an interdisciplinary perspective","author":"EH Hovy","year":"2002","unstructured":"Hovy EH: Comparing Sets of Semantic Relations in Ontologies. In The semantics of relationships : an interdisciplinary perspective. Edited by: Green R, Bean CA and Myaeng SH. Boston, Kluwer Academic Publishers; 2002:cm.."},{"key":"951_CR13","first-page":"25","volume-title":"Ontology Development 101: A Guide to Creating Your First Ontology","author":"NF Noy","year":"2001","unstructured":"Noy NF, McGuinness DL: Ontology Development 101: A Guide to Creating Your First Ontology. Stanford, Stanford Medical Informatics (SMI); 2001:25. Technical Report KSL-01-05"},{"key":"951_CR14","doi-asserted-by":"publisher","first-page":"478","DOI":"10.1016\/j.jbi.2003.11.007","volume":"36","author":"C Rosse","year":"2003","unstructured":"Rosse C, Mejino JLJ: A reference ontology for biomedical informatics: the Foundational Model of Anatomy. J Biomed Inform 2003, 36: 478\u2013500. 10.1016\/j.jbi.2003.11.007","journal-title":"J Biomed Inform"},{"key":"951_CR15","volume-title":"In Silico Biology","author":"S Schulze-Kremer","year":"2002","unstructured":"Schulze-Kremer S: Ontologies for molecular biology and bioinformatics. In Silico Biology 2002., 2, 0017: [http:\/\/www.bioinfo.de\/isb\/2002\/02\/0017\/main.html]"},{"key":"951_CR16","doi-asserted-by":"crossref","unstructured":"Smith B, K\u00f6hler J, Kumar A: On the Application of Formal Principles to Life Science Data: A Case Study in the Gene Ontology, International Workshop on Data Integration in the Life Sciences, DILS 06. Leipzig, Germany. Lecture Notes in Bioinformatics (LNBI). Volume 2994. ; 2004.","DOI":"10.1007\/978-3-540-24745-6_6"},{"key":"951_CR17","first-page":"444","volume-title":"In Proceedings, MedInfo","author":"B Smith","year":"2004","unstructured":"Smith B, Rosse C: The Role of Foundational Relations in the Alignment of Biomedical Ontologies: ; San Francisco. In In Proceedings, MedInfo. San Francisco, CA; 2004:444 -448."},{"key":"951_CR18","doi-asserted-by":"publisher","first-page":"R46","DOI":"10.1186\/gb-2005-6-5-r46","volume":"6","author":"B Smith","year":"2005","unstructured":"Smith B, Ceusters W, Klagges B, K\u00f6hler J, Kumar A, Lomax J, Mungall CJ, Neuhaus F, Rector A, Rosse C: Relations in Biomedical Ontologies. Genome Biol 2005, 6: R46.","journal-title":"Genome Biol"},{"key":"951_CR19","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1002\/cfg.435","volume":"5","author":"CJ Mungall","year":"2004","unstructured":"Mungall CJ: Obol: integrating language and meaning in bio-ontologies. Comparative and Functional Genomics 2004, 5: 509\u2013520. 10.1002\/cfg.435","journal-title":"Comparative and Functional Genomics"},{"key":"951_CR20","doi-asserted-by":"publisher","first-page":"2420","DOI":"10.1093\/bioinformatics\/btg340","volume":"19","author":"J K\u00f6hler","year":"2003","unstructured":"K\u00f6hler J, Philippi S, Lange M: SEMEDA: Ontology Based Semantic Integration of Biological Databases. Bioinformatics 2003, 19: 2420\u20132427. 10.1093\/bioinformatics\/btg340","journal-title":"Bioinformatics"},{"key":"951_CR21","first-page":"624","volume-title":"Pac Symp Biocomput","author":"CJ Wroe","year":"2003","unstructured":"Wroe CJ, Stevens R, Goble CA, Ashburner M: A methodology to migrate the Gene Ontology to a description logic environment using DAML+OIL: January 3\u20137 2003; Lihue, Hawaii, USA. In Pac Symp Biocomput. ; 2003:624\u2013635."},{"key":"951_CR22","volume-title":"Pac Symp Biocomput","author":"PV Ogren","year":"2004","unstructured":"Ogren PV, Cohen KB, Acquaah-Mensah GK, Eberlein J, Hunter LT: The Compositional Structure of Gene Ontology Terms: January 6\u201310 2004; The Fairmont Orchid, Big Island of Hawaii. In Pac Symp Biocomput. ; 2004."},{"key":"951_CR23","doi-asserted-by":"crossref","unstructured":"Kumar A, Smith B: The Unified Medical Language System and the Gene Ontology: Some Critical Reflections: ; Berlin, Germany. Lecture Notes in Computer Science 2821. Volume 2821. Edited by: G\u00fcnter A R, Kruse B, . Springer; 2003:135\u2013148.","DOI":"10.1007\/978-3-540-39451-8_11"},{"key":"951_CR24","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1109\/TKDE.2004.1269597","volume":"16","author":"S Ram","year":"2004","unstructured":"Ram S, Park J: Semantic Conflict Resolution Ontology (SCROL): An Ontology for Detecting and Resolving Data and Schema-Level Semantic Conflicts. IEEE Transactions on Knowledge and Data Engineering 2004, 16: 189\u2013202. 10.1109\/TKDE.2004.1269597","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"951_CR25","first-page":"220","volume-title":"Proceedings of the Seventeenth International Florida Artificial Intelligence Research Symposium Conference, Miami Beach, Florida, USA","author":"K Supekar","year":"2004","unstructured":"Supekar K, Patel C, Lee Y: Characterizing Quality of Knowledge on Semantic Web. In Proceedings of the Seventeenth International Florida Artificial Intelligence Research Symposium Conference, Miami Beach, Florida, USA. ; 2004:220\u2013228."},{"key":"951_CR26","first-page":"633","volume-title":"Debugging OWL ontologies, The 14th International World Wide Wed Conference, (WWW 2005)","author":"B Parsia","year":"2005","unstructured":"Parsia B, Sirin E, Kalyanpur A: Debugging OWL ontologies, The 14th International World Wide Wed Conference, (WWW 2005), Chiba, Japan. ACM Press; 2005:633\u2013640."},{"key":"951_CR27","doi-asserted-by":"crossref","unstructured":"Baclawski K, Kokar MM, Waldinger RJ, Kogut PA: Consistency Checking of Semantic Web Ontologies. In International Semantic Web Conference ISWC02 proceedings. Volume 2342. Edited by: I Horrocks ad J Hendler. Springer-Verlag, heidelberg; 2002:454\u2013459.","DOI":"10.1007\/3-540-48005-6_40"},{"key":"951_CR28","volume-title":"Comput Biol Med","author":"S Zhang","year":"2005","unstructured":"Zhang S, Bodenreider O: Law and order: Assessing and enforcing compliance with ontological modeling principles in the Foundational Model of Anatomy. Comput Biol Med 2005."},{"key":"951_CR29","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1093\/bioinformatics\/19.2.241","volume":"19","author":"I Yeh","year":"2003","unstructured":"Yeh I, Karp PD, Noy NF, Altman RB: Knowledge acquisition, consistency checking and concurrency control for Gene Ontology (GO). Bioinformatics 2003, 19: 241\u2013248. 10.1093\/bioinformatics\/19.2.241","journal-title":"Bioinformatics"},{"key":"951_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4018\/jdm.2004040101","volume":"15","author":"A Lozano-Tello","year":"2004","unstructured":"Lozano-Tello A, Gomez-Perez A: ONTOMETRIC: A Method to Choose the Appropriate Ontology. Journal of Database Management 2004, 15: 1\u201318.","journal-title":"Journal of Database Management"},{"key":"951_CR31","first-page":"xvi, 328 p.","volume-title":"Reliability assessment using stochastic finite element analysis","author":"A Haldar","year":"2000","unstructured":"Haldar A, Mahadevan S: Reliability assessment using stochastic finite element analysis. New York, John Wiley & Sons; 2000:xvi, 328 p.."},{"key":"951_CR32","first-page":"xviii, 395 p.","volume-title":"Essentials of logic","author":"IM Copi","year":"2004","unstructured":"Copi IM, Cohen C: Essentials of logic. Upper Saddle River, N.J., Pearson\/Prentice Hall; 2004:xviii, 395 p.."},{"key":"951_CR33","unstructured":"GO Editorial Guide[http:\/\/www.geneontology.org\/GO.usage.shtml]"},{"key":"951_CR34","first-page":"463","volume-title":"Proc AMIA Symp","author":"J Michael","year":"2001","unstructured":"Michael J, Mejino JLJ, Rosse C: The role of definitions in biomedical concept representation. Proc AMIA Symp 2001, 463\u2013467."},{"key":"951_CR35","doi-asserted-by":"publisher","first-page":"D438","DOI":"10.1093\/nar\/gkh100","volume":"32","author":"CJ Krieger","year":"2004","unstructured":"Krieger CJ, Zhang P, Mueller LA, Wang A, Paley S, Arnaud M, Pick J, Rhee SY, Karp PD: MetaCyc: a multiorganism database of metabolic pathways and enzymes. Nucleic Acids Res 2004, 32: D438\u201342. 10.1093\/nar\/gkh100","journal-title":"Nucleic Acids Res"},{"key":"951_CR36","first-page":"xxii, 423","volume-title":"Language, speech, and communication","author":"C Fellbaum","year":"1998","unstructured":"Fellbaum C: WordNet : an electronic lexical database. In Language, speech, and communication. Cambridge, Mass, MIT Press; 1998:xxii, 423."},{"key":"951_CR37","first-page":"265","volume":"88","author":"CE Lipscomb","year":"2000","unstructured":"Lipscomb CE: Medical Subject Headings (MeSH). Bull Med Libr Assoc 2000, 88: 265\u2013266.","journal-title":"Bull Med Libr Assoc"},{"key":"951_CR38","first-page":"xiii, 862","volume-title":"Enzyme nomenclature 1992: recommendations of the Nomenclature Committee of the International Union of Biochemistry and Molecular Biology on the nomenclature and classification of enzymes","author":"NC-IUBMB","year":"1992","unstructured":"NC-IUBMB: Enzyme nomenclature 1992: recommendations of the Nomenclature Committee of the International Union of Biochemistry and Molecular Biology on the nomenclature and classification of enzymes. San Diego, Published for the International Union of Biochemistry and Molecular Biology by Academic Press; 1992:xiii, 862."},{"key":"951_CR39","first-page":"201","volume":"13","author":"C Blaschke","year":"2002","unstructured":"Blaschke C, Valencia A: Automatic Ontology Construction from the Literature. Genome Inform Ser Workshop Genome Inform 2002, 13: 201\u2013213.","journal-title":"Genome Inform Ser Workshop Genome Inform"},{"key":"951_CR40","first-page":"206","volume-title":"Deriving concept hierarchies from text: August 15-19; Berkeley","author":"M Sanderson","year":"1999","unstructured":"Sanderson M, Croft WB: Deriving concept hierarchies from text: August 15\u201319; Berkeley, CA, USA. ACM; 1999:206\u2013213."},{"key":"951_CR41","doi-asserted-by":"publisher","first-page":"1417","DOI":"10.1093\/bioinformatics\/btg160","volume":"19","author":"JH Chiang","year":"2003","unstructured":"Chiang JH, Yu HC: MeKE: discovering the functions of gene products from biomedical literature via sentence alignment. Bioinformatics 2003, 19: 1417\u20131422. 10.1093\/bioinformatics\/btg160","journal-title":"Bioinformatics"},{"key":"951_CR42","first-page":"178","volume-title":"Pac Symp Biocomput","author":"GV Gkoutos","year":"2004","unstructured":"Gkoutos GV, Green EC, Mallon AM, Hancock JM, Davidson D: Building mouse phenotype ontologies. Pac Symp Biocomput 2004, 178\u2013189."},{"key":"951_CR43","first-page":"961","volume-title":"DEXA Workshop","author":"Y Ding","year":"2001","unstructured":"Ding Y: IR and AI: Using Co-Occurrence Theory to Generate Lightweight Ontologies: September 03 - 07 2001; Munich, Germany. In DEXA Workshop. ; 2001:961\u2013965."},{"key":"951_CR44","first-page":"33","volume":"5","author":"J K\u00f6hler","year":"2004","unstructured":"K\u00f6hler J, Rawlings C, Verrier P, Mitchell R, Skusa A, Ruegg A, Philippi S: Linking experimental results, biological networks and sequence analysis methods using Ontologies and Generalized Data Structures. In Silico Biol 2004, 5: 33\u201344.","journal-title":"In Silico Biol"},{"key":"951_CR45","unstructured":"Mappings of External Classification Systems to GO[http:\/\/www.geneontology.org\/GO.indices.shtml]"},{"issue":"11","key":"951_CR46","doi-asserted-by":"publisher","first-page":"1383","DOI":"10.1093\/bioinformatics\/btl081","volume":"22","author":"J K\u00f6hler","year":"2006","unstructured":"K\u00f6hler J, Baumbach J, Taubert J, Specht M, Skusa A, Rueegg A, Rawlings C, Verrier P, Philippi S: Graph-based analysis and visualization of experimental results with ONDEX. Bioinformatics 2006, 22(11):1383\u20131390.","journal-title":"Bioinformatics"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-7-212.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,9,1]],"date-time":"2021-09-01T03:25:36Z","timestamp":1630466736000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-7-212"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,4,19]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2006,12]]}},"alternative-id":["951"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-7-212","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,4,19]]},"assertion":[{"value":"20 June 2005","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2006","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2006","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"212"}}