{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T02:30:44Z","timestamp":1778034644702,"version":"3.51.4"},"reference-count":35,"publisher":"Oxford University Press (OUP)","license":[{"start":{"date-parts":[[2022,10,8]],"date-time":"2022-10-08T00:00:00Z","timestamp":1665187200000},"content-version":"vor","delay-in-days":280,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"Director, Office of Science, Office of Basic Energy Sciences, of the US Department of Energy","award":["DE-AC0205CH11231"],"award-info":[{"award-number":["DE-AC0205CH11231"]}]},{"DOI":"10.13039\/100000025","name":"National Institutes of Mental Health","doi-asserted-by":"crossref","award":["1RF1MH123220-01"],"award-info":[{"award-number":["1RF1MH123220-01"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"crossref"}]},{"name":"UK Biotechnology and Biological Sciences Research Council \/ US National Science Foundation Directorate of Biological Sciences","award":["BBSRC-NSF\/BIO BB\/T014008\/1"],"award-info":[{"award-number":["BBSRC-NSF\/BIO BB\/T014008\/1"]}]},{"name":"National Human Genome Research Institute \u201cPhenomics First\u201d","award":["RM1HG010860"],"award-info":[{"award-number":["RM1HG010860"]}]},{"name":"Office of the Director, National Institutes of Health","award":["R24-OD011883"],"award-info":[{"award-number":["R24-OD011883"]}]},{"DOI":"10.13039\/100000050","name":"National Heart, Lung, and Blood Institute","doi-asserted-by":"publisher","award":["5U01HG009453-03"],"award-info":[{"award-number":["5U01HG009453-03"]}],"id":[{"id":"10.13039\/100000050","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,10,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Similar to managing software packages, managing the ontology life cycle involves multiple complex workflows such as preparing releases, continuous quality control checking and dependency management. To manage these processes, a diverse set of tools is required, from command-line utilities to powerful ontology-engineering environmentsr. Particularly in the biomedical domain, which has developed a set of highly diverse yet inter-dependent ontologies, standardizing release practices and metadata and establishing shared quality standards are crucial to enable interoperability. The Ontology Development Kit (ODK) provides a set of standardized, customizable and automatically executable workflows, and packages all required tooling in a single Docker image. In this paper, we provide an overview of how the ODK works, show how it is used in practice and describe how we envision it driving standardization efforts in our community.<\/jats:p>\n               <jats:p>Database URL: https:\/\/github.com\/INCATools\/ontology-development-kit<\/jats:p>","DOI":"10.1093\/database\/baac087","type":"journal-article","created":{"date-parts":[[2022,10,8]],"date-time":"2022-10-08T13:45:43Z","timestamp":1665236743000},"source":"Crossref","is-referenced-by-count":55,"title":["Ontology Development Kit: a toolkit for building, maintaining and standardizing biomedical ontologies"],"prefix":"10.1093","volume":"2022","author":[{"given":"Nicolas","family":"Matentzoglu","sequence":"first","affiliation":[{"name":"Semanticly , Spaces Ermou Ermou 56, Athens 10563 \u0393\u0395\u039c\u0397 160976003000, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6095-8718","authenticated-orcid":false,"given":"Damien","family":"Goutte-Gattat","sequence":"additional","affiliation":[{"name":"Department of Physiology, Development and Neuroscience, University of Cambridge , Downing Street, Cambridge, CB2 3DY, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7258-9596","authenticated-orcid":false,"given":"Shawn Zheng Kai","family":"Tan","sequence":"additional","affiliation":[{"name":"Samples Phenotypes and Ontologies Team (SPOT), European Bioinformatics Institute (EMBL-EBI) , Wellcome Genome Campus, Hinxton, Cambridgeshire, CB10 1SD, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8688-6599","authenticated-orcid":false,"given":"James P","family":"Balhoff","sequence":"additional","affiliation":[{"name":"RENCI, University of North Carolina , Chapel Hill, NC, North Carolina 27517, USA"}]},{"given":"Seth","family":"Carbon","sequence":"additional","affiliation":[{"name":"Berkeley Bioinformatics Open-source Projects (BBOP), Lawrence Berkeley National Laboratory (LBNL) , 1 Cyclotron Road, Mailstop 977-0257, Berkeley, CA 94720, USA"}]},{"given":"Anita R","family":"Caron","sequence":"additional","affiliation":[{"name":"Samples Phenotypes and Ontologies Team (SPOT), European Bioinformatics Institute (EMBL-EBI) , Wellcome Genome Campus, Hinxton, Cambridgeshire, CB10 1SD, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9625-1899","authenticated-orcid":false,"given":"William D","family":"Duncan","sequence":"additional","affiliation":[{"name":"Berkeley Bioinformatics Open-source Projects (BBOP), Lawrence Berkeley National Laboratory (LBNL) , 1 Cyclotron Road, Mailstop 977-0257, Berkeley, CA 94720, USA"},{"name":"College of Dentistry; Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida , William D. Duncan: 1395 Center Dr, Gainesville, William R. Hogan: 1600 SW Archer Rd, Gainesville, FL 32610, USA"}]},{"given":"Joe E","family":"Flack","sequence":"additional","affiliation":[{"name":"School of Medicine, Johns Hopkins University , 733 N Broadway, Baltimore, Baltimore, MD 21205, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9114-8737","authenticated-orcid":false,"given":"Melissa","family":"Haendel","sequence":"additional","affiliation":[{"name":"University of Colorado Anschutz Medical Campus , 13001 E 17th Pl, Aurora, CO 80045, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6315-3707","authenticated-orcid":false,"given":"Nomi L","family":"Harris","sequence":"additional","affiliation":[{"name":"Berkeley Bioinformatics Open-source Projects (BBOP), Lawrence Berkeley National Laboratory (LBNL) , 1 Cyclotron Road, Mailstop 977-0257, Berkeley, CA 94720, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9881-1017","authenticated-orcid":false,"given":"William R","family":"Hogan","sequence":"additional","affiliation":[{"name":"College of Dentistry; Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida , William D. Duncan: 1395 Center Dr, Gainesville, William R. Hogan: 1600 SW Archer Rd, Gainesville, FL 32610, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4423-4370","authenticated-orcid":false,"given":"Charles Tapley","family":"Hoyt","sequence":"additional","affiliation":[{"name":"Laboratory of Systems Pharmacology, Harvard Medical School , 200 Longwood Avenue Armenise Building Room 109, Boston, MA 02115, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4871-5569","authenticated-orcid":false,"given":"Rebecca C","family":"Jackson","sequence":"additional","affiliation":[{"name":"Bend Informatics LLC , 5305 RIVER RD NORTH, STE B, KEIZER, OR 97303, USA"}]},{"given":"HyeongSik","family":"Kim","sequence":"additional","affiliation":[{"name":"Robert Bosch LLC , Sunnyvale, CA 94085, USA"}]},{"given":"Huseyin","family":"Kir","sequence":"additional","affiliation":[{"name":"Samples Phenotypes and Ontologies Team (SPOT), European Bioinformatics Institute (EMBL-EBI) , Wellcome Genome Campus, Hinxton, Cambridgeshire, CB10 1SD, UK"}]},{"given":"Martin","family":"Larralde","sequence":"additional","affiliation":[{"name":"Structural and Computational Biology Unit, European Molecular Biology Laboratory , Meyerhofstra\u00dfe 1, Heidelberg 69117, Germany"}]},{"given":"Julie A","family":"McMurry","sequence":"additional","affiliation":[{"name":"University of Colorado Anschutz Medical Campus , 13001 E 17th Pl, Aurora, CO 80045, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5139-5557","authenticated-orcid":false,"given":"James A","family":"Overton","sequence":"additional","affiliation":[{"name":"Knocean Inc. , Toronto, Ontario, ON M6P 2T3, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8457-6693","authenticated-orcid":false,"given":"Bjoern","family":"Peters","sequence":"additional","affiliation":[{"name":"Institute for Allergy & Immunology, La Jolla Institute for Immunology , 9420 Athena Circle, La Jolla, CA 92037, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1373-1705","authenticated-orcid":false,"given":"Clare","family":"Pilgrim","sequence":"additional","affiliation":[{"name":"Department of Physiology, Development and Neuroscience, University of Cambridge , Downing Street, Cambridge, CB2 3DY, UK"}]},{"given":"Ray","family":"Stefancsik","sequence":"additional","affiliation":[{"name":"Samples Phenotypes and Ontologies Team (SPOT), European Bioinformatics Institute (EMBL-EBI) , Wellcome Genome Campus, Hinxton, Cambridgeshire, CB10 1SD, UK"}]},{"given":"Sofia MC","family":"Robb","sequence":"additional","affiliation":[{"name":"Stowers Institute for Medical Research , 1000 E. 50th St., Kansas City, MO 64110, USA"}]},{"given":"Sabrina","family":"Toro","sequence":"additional","affiliation":[{"name":"University of Colorado Anschutz Medical Campus , 13001 E 17th Pl, Aurora, CO 80045, USA"}]},{"given":"Nicole A","family":"Vasilevsky","sequence":"additional","affiliation":[{"name":"University of Colorado Anschutz Medical Campus , 13001 E 17th Pl, Aurora, CO 80045, USA"}]},{"given":"Ramona","family":"Walls","sequence":"additional","affiliation":[{"name":"Critical Path Institute , 1730 E River Road, Tucson, AZ 85718, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6601-2165","authenticated-orcid":false,"given":"Christopher J","family":"Mungall","sequence":"additional","affiliation":[{"name":"Berkeley Bioinformatics Open-source Projects (BBOP), Lawrence Berkeley National Laboratory (LBNL) , 1 Cyclotron Road, Mailstop 977-0257, Berkeley, CA 94720, USA"}]},{"given":"David","family":"Osumi-Sutherland","sequence":"additional","affiliation":[{"name":"Samples Phenotypes and Ontologies Team (SPOT), European Bioinformatics Institute (EMBL-EBI) , Wellcome Genome Campus, Hinxton, Cambridgeshire, CB10 1SD, UK"}]}],"member":"286","published-online":{"date-parts":[[2022,10,8]]},"reference":[{"key":"2022100813172592300_R1","doi-asserted-by":"crossref","DOI":"10.1038\/sdata.2016.18","article-title":"The FAIR guiding principles for scientific data management and stewardship","volume":"3","author":"Wilkinson","year":"2016","journal-title":"Sci. Data"},{"key":"2022100813172592300_R2","article-title":"FAIR-TLC: metrics to assess value of biomedical digital repositories: response to RFI NOT-OD-16-133; (2016)","author":"Haendel","year":"2016"},{"key":"2022100813172592300_R3","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1003542","article-title":"Ten simple rules for the care and feeding of scientific data","volume":"10","author":"Goodman","year":"2014","journal-title":"PLoS Comput. Biol."},{"key":"2022100813172592300_R4","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1006906","article-title":"Ten quick tips for biocuration","volume":"15","author":"Tang","year":"2019","journal-title":"PLoS Comput. Biol."},{"key":"2022100813172592300_R5","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pbio.2001414","article-title":"Identifiers for the twenty-first century: how to design, provision, and reuse persistent identifiers to maximize utility and impact of life science data","volume":"15","author":"McMurry","year":"2017","journal-title":"PLoS Biol."},{"key":"2022100813172592300_R6","doi-asserted-by":"crossref","first-page":"1069","DOI":"10.1093\/bib\/bbv011","article-title":"The role of ontologies in biological and biomedical research: a functional perspective","volume":"16","author":"Hoehndorf","year":"2015","journal-title":"Brief. Bioinform."},{"key":"2022100813172592300_R7","doi-asserted-by":"crossref","first-page":"1251","DOI":"10.1038\/nbt1346","article-title":"The OBO Foundry: coordinated evolution of ontologies to support biomedical data integration","volume":"25","author":"Smith","year":"2007","journal-title":"Nat. Biotechnol."},{"key":"2022100813172592300_R8","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baab069","article-title":"OBO Foundry in 2021: operationalizing open data principles to evaluate ontologies","volume":"2021","author":"Jackson","year":"2021","journal-title":"Database"},{"key":"2022100813172592300_R9","doi-asserted-by":"crossref","first-page":"D1207","DOI":"10.1093\/nar\/gkaa1043","article-title":"The human phenotype ontology in 2021","volume":"49","author":"K\u00f6hler","year":"2021","journal-title":"Nucleic Acids Res."},{"key":"2022100813172592300_R10","doi-asserted-by":"crossref","DOI":"10.1186\/gb-2005-6-2-r21","article-title":"An ontology for cell types","volume":"6","author":"Bard","year":"2005","journal-title":"Genome Biol."},{"key":"2022100813172592300_R11","doi-asserted-by":"crossref","DOI":"10.1186\/s13326-016-0088-7","article-title":"The cell ontology 2016: enhanced content, modularization, and ontology interoperability","volume":"7","author":"Diehl","year":"2016","journal-title":"J. Biomed. Semant."},{"key":"2022100813172592300_R12","doi-asserted-by":"crossref","DOI":"10.1186\/gb-2012-13-1-r5","article-title":"Uberon, an integrative multi-species anatomy ontology","volume":"13","author":"Mungall","year":"2012","journal-title":"Genome Biol."},{"key":"2022100813172592300_R13","article-title":"Using ontologies to describe mouse phenotypes","volume":"6","author":"Gkoutos","year":"2005","journal-title":"Genome Biol."},{"key":"2022100813172592300_R14","doi-asserted-by":"publisher","DOI":"10.1101\/2021.10.10.463703","article-title":"Brain Data Standards Ontology: a data-driven ontology of transcriptomically defined cell types in the primary motor cortex","author":"Tan","year":"2021","journal-title":"bioRxiv"},{"key":"2022100813172592300_R15","doi-asserted-by":"crossref","DOI":"10.1186\/s12859-019-3002-3","article-title":"ROBOT: A tool for automating ontology workflows","volume":"20","author":"Jackson","year":"2019","journal-title":"BMC Bioinform."},{"key":"2022100813172592300_R16","doi-asserted-by":"crossref","DOI":"10.1186\/s13326-017-0126-0","article-title":"Dead simple OWL design patterns","volume":"8","author":"Osumi-Sutherland","year":"2017","journal-title":"J. Biomed. Semant."},{"key":"2022100813172592300_R17","article-title":"owlcollab\/owltools: 2020-04-06","author":"Mungall","year":"2020"},{"key":"2022100813172592300_R18","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.websem.2014.06.003","article-title":"Konclude: system description","volume":"27\u201328","author":"Steigmiller","year":"2014","journal-title":"J. Web Semant."},{"key":"2022100813172592300_R19","first-page":"422","article-title":"Souffl\u00e9: on synthesis of program analyzers","author":"Jordan","year":"2016"},{"key":"2022100813172592300_R20","article-title":"INCATools\/ontology-access-kit: v0.1.22","author":"Mungall","year":"2022"},{"key":"2022100813172592300_R21","doi-asserted-by":"crossref","DOI":"10.1093\/database\/baac035","article-title":"A simple standard for sharing ontological mappings (SSSOM)","volume":"2022","author":"Matentzoglu","year":"2022","journal-title":"Database"},{"key":"2022100813172592300_R22","article-title":"Docker: lightweight Linux containers for consistent development and deployment","author":"Merkel","year":"2014","journal-title":"Linux J."},{"key":"2022100813172592300_R23","article-title":"Credit where credit is due","volume":"462","year":"2009","journal-title":"Nature"},{"key":"2022100813172592300_R24","doi-asserted-by":"publisher","first-page":"D456","DOI":"10.1093\/nar\/gks1146","article-title":"The ChEBI reference database and ontology for biologically relevant chemistry: enhancements for 2013","volume":"41","author":"Hastings","year":"2012","journal-title":"Nucleic Acids Research"},{"key":"2022100813172592300_R25","first-page":"273","article-title":"Modular reuse of ontologies: theory and practice","volume":"31","author":"Grau","year":"2008","journal-title":"J. Artif. Intell."},{"key":"2022100813172592300_R26","article-title":"MkDocs","volume-title":"Project documentation with MarkDown","author":"Christie","year":"2014"},{"key":"2022100813172592300_R27","article-title":"D2.2 FAIR semantics: first recommendations","author":"Franc","year":"2020"},{"key":"2022100813172592300_R28","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1145\/2757001.2757003","article-title":"The Prot\u00e9g\u00e9 project: a look back and a look forward","volume":"1","author":"Musen","year":"2015","journal-title":"AI Matters"},{"key":"2022100813172592300_R29","first-page":"686","article-title":"WebProt\u00e9g\u00e9: a cloud-based ontology editor","author":"Horridge","year":"2019"},{"key":"2022100813172592300_R30","doi-asserted-by":"crossref","DOI":"10.1186\/s13326-017-0169-2","article-title":"The eXtensible ontology development (XOD) principles and tool implementation to support ontology interoperability","volume":"9","author":"He","year":"2018","journal-title":"J. Biomed. Semant."},{"key":"2022100813172592300_R31","doi-asserted-by":"publisher","DOI":"10.1038\/npre.2009.3576","article-title":"MIREOT: the Minimum Information to Reference an External Ontology Term","author":"Courtot","year":"2009","journal-title":"Nature Precedings"},{"key":"2022100813172592300_R32","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/978-3-642-24794-1_13","volume-title":"Ontology Engineering in a Networked World","author":"Erdmann","year":"2012"},{"key":"2022100813172592300_R33","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1007\/978-3-540-88845-1_5","volume-title":"Semantic Knowledge Management: Integrating Ontology Management, Knowledge Discovery, and Human Language Technologies","author":"Weiten","year":"2009"},{"key":"2022100813172592300_R34","first-page":"221","article-title":"OntoEdit: collaborative ontology development for the semantic web","author":"Sure","year":"2002"},{"key":"2022100813172592300_R35","first-page":"6","article-title":"WebODE: a scalable workbench for ontological engineering","author":"Arp\u00edrez","year":"2001"}],"container-title":["Database"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baac087\/46394231\/baac087.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/database\/article-pdf\/doi\/10.1093\/database\/baac087\/46394231\/baac087.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,8]],"date-time":"2022-10-08T13:46:05Z","timestamp":1665236765000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/database\/article\/doi\/10.1093\/database\/baac087\/6754192"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,1]]},"references-count":35,"URL":"https:\/\/doi.org\/10.1093\/database\/baac087","relation":{},"ISSN":["1758-0463"],"issn-type":[{"value":"1758-0463","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,1,1]]},"published":{"date-parts":[[2022,1,1]]},"article-number":"baac087"}}