{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T20:56:59Z","timestamp":1781125019865,"version":"3.54.1"},"reference-count":68,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2020,4,21]],"date-time":"2020-04-21T00:00:00Z","timestamp":1587427200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["1R35GM119770-04"],"award-info":[{"award-number":["1R35GM119770-04"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"NIH\/NHGRI","award":["HG002273"],"award-info":[{"award-number":["HG002273"]}]},{"name":"RSMS","award":["BB\/N019482\/1"],"award-info":[{"award-number":["BB\/N019482\/1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,3,22]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The fast accumulation of biological data calls for their integration, analysis and exploitation through more systematic approaches. The generation of novel, relevant hypotheses from this enormous quantity of data remains challenging. Logical models have long been used to answer a variety of questions regarding the dynamical behaviours of regulatory networks. As the number of published logical models increases, there is a pressing need for systematic model annotation, referencing and curation in community-supported and standardised formats. This article summarises the key topics and future directions of a meeting entitled \u2018Annotation and curation of computational models in biology\u2019, organised as part of the 2019 [BC]2 conference. The purpose of the meeting was to develop and drive forward a plan towards the standardised annotation of logical models, review and connect various ongoing projects of experts from different communities involved in the modelling and annotation of molecular biological entities, interactions, pathways and models. This article defines a roadmap towards the annotation and curation of logical models, including milestones for best practices and minimum standard requirements.<\/jats:p>","DOI":"10.1093\/bib\/bbaa046","type":"journal-article","created":{"date-parts":[[2020,3,9]],"date-time":"2020-03-09T12:37:39Z","timestamp":1583757459000},"page":"1848-1859","source":"Crossref","is-referenced-by-count":30,"title":["Setting the basis of best practices and standards for curation and annotation of logical models in biology\u2014highlights of the [BC]2 2019 CoLoMoTo\/SysMod Workshop"],"prefix":"10.1093","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9687-7426","authenticated-orcid":false,"given":"Anna","family":"Niarakis","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martin","family":"Kuiper","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1473-370X","authenticated-orcid":false,"given":"Marek","family":"Ostaszewski","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0705-9809","authenticated-orcid":false,"given":"Rahuman S","family":"Malik Sheriff","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cristina","family":"Casals-Casas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Denis","family":"Thieffry","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom C","family":"Freeman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Thomas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vasundra","family":"Tour\u00e9","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vincent","family":"No\u00ebl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gautier","family":"Stoll","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8552-8976","authenticated-orcid":false,"given":"Julio","family":"Saez-Rodriguez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aur\u00e9lien","family":"Naldi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1218-8170","authenticated-orcid":false,"given":"Eugenia","family":"Oshurko","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ioannis","family":"Xenarios","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5525-7418","authenticated-orcid":false,"given":"Sylvain","family":"Soliman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2350-0756","authenticated-orcid":false,"given":"Claudine","family":"Chaouiya","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3653-1906","authenticated-orcid":false,"given":"Tom\u00e1\u0161","family":"Helikar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laurence","family":"Calzone","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2020,4,21]]},"reference":[{"key":"2021032314164119800_ref1","doi-asserted-by":"crossref","first-page":"2561","DOI":"10.1073\/pnas.1802324115","article-title":"Reproducibility of research: issues and proposed remedies","volume":"115","author":"Allison","year":"2018","journal-title":"Proc Natl Acad Sci"},{"key":"2021032314164119800_ref2","doi-asserted-by":"crossref","first-page":"646","DOI":"10.3389\/fphys.2018.00646","article-title":"Logical modeling and analysis of cellular regulatory networks with GINsim 3.0","volume":"9","author":"Naldi","year":"2018","journal-title":"Front Physiol"},{"key":"2021032314164119800_ref3","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1186\/1752-0509-6-96","article-title":"The cell collective: toward an open and collaborative approach to systems biology","volume":"6","author":"Helikar","year":"2012","journal-title":"BMC Syst Biol"},{"key":"2021032314164119800_ref4","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1038\/clpt.2013.41","article-title":"A cell simulator platform: the cell collective","volume":"93","author":"Helikar","year":"2013","journal-title":"Clin Pharmacol Ther"},{"issue":"D1","key":"2021032314164119800_ref5","doi-asserted-by":"publisher","first-page":"D407","DOI":"10.1093\/nar\/gkz1055","article-title":"BioModels\u201415 years of sharing computational models in life science","volume":"48","author":"Malik-Sheriff","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref6","doi-asserted-by":"crossref","first-page":"524","DOI":"10.1093\/bioinformatics\/btg015","article-title":"The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models","volume":"19","author":"Hucka","year":"2003","journal-title":"Bioinformatics"},{"key":"2021032314164119800_ref7","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1515\/jib-2015-270","article-title":"SBML level 3 package: qualitative models, version 1, release 1","volume":"12","author":"Chaouiya","year":"2015","journal-title":"J Integr Bioinform"},{"key":"2021032314164119800_ref8","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1186\/1752-0509-7-135","article-title":"SBML qualitative models: a model representation format and infrastructure to foster interactions between qualitative modelling formalisms and tools","volume":"7","author":"Chaouiya","year":"2013","journal-title":"BMC Syst Biol"},{"issue":"7","key":"2021032314164119800_ref9","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.1093\/bioinformatics\/btv013","article-title":"Cooperative development of logical modelling standards and tools with CoLoMoTo","volume":"31","author":"Naldi","year":"2015","journal-title":"Bioinformatics"},{"key":"2021032314164119800_ref10","volume-title":"SysMod Community of Special Interest","author":"SysMod"},{"key":"2021032314164119800_ref11","author":"BASEL LIFE","year":"2019"},{"key":"2021032314164119800_ref12","volume-title":"Workshops and tutorials","author":"BaselLife","year":"2019"},{"key":"2021032314164119800_ref13","author":"BioKB"},{"key":"2021032314164119800_ref14","doi-asserted-by":"crossref","first-page":"16020","DOI":"10.1038\/npjsba.2016.20","article-title":"MINERVA-a platform for visualization and curation of molecular interaction networks","volume":"2","author":"Gawron","year":"2016","journal-title":"NPJ Syst Biol Appl"},{"key":"2021032314164119800_ref15","doi-asserted-by":"crossref","first-page":"D158","DOI":"10.1093\/nar\/gkw1099","article-title":"UniProt: the universal protein knowledgebase","volume":"45","author":"Bateman","year":"2017","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref16","doi-asserted-by":"crossref","first-page":"D548","DOI":"10.1093\/nar\/gkv1048","article-title":"SIGNOR: a database of causal relationships between biological entities","volume":"44","author":"Perfetto","year":"2016","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref17","doi-asserted-by":"crossref","first-page":"D786","DOI":"10.1093\/nar\/gky930","article-title":"Genenames.Org: the HGNC and VGNC resources in 2019","volume":"47","author":"Braschi","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref18","doi-asserted-by":"crossref","first-page":"D330","DOI":"10.1093\/nar\/gky1055","article-title":"The gene ontology resource: 20 years and still GOing strong","volume":"47","author":"The Gene Ontology Consortium","year":"2019","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref19","doi-asserted-by":"crossref","first-page":"D649","DOI":"10.1093\/nar\/gkx1132","article-title":"The Reactome pathway knowledgebase","volume":"46","author":"Fabregat","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref20","author":"The Druglogics Initiative"},{"key":"2021032314164119800_ref21","author":"vsmjs"},{"key":"2021032314164119800_ref22","author":"SciCura"},{"key":"2021032314164119800_ref23","author":"MI2CAST"},{"key":"2021032314164119800_ref24","volume-title":"BioKB - Text Mining and Semantic Technologies for the Biomedical Content Discovery","author":"Biryukov","year":"2019"},{"key":"2021032314164119800_ref25","doi-asserted-by":"crossref","first-page":"4496","DOI":"10.1093\/bioinformatics\/btz286","article-title":"MINERVA API and plugins: opening molecular network analysis and visualization to the community","volume":"35","author":"Hoksza","year":"2019","journal-title":"Bioinformatics"},{"key":"2021032314164119800_ref26","first-page":"bbaa030","article-title":"Closing the gap between formats for storing layout information in systems biology","volume":"pii","author":"Hoksza","year":"2020","journal-title":"Brief Bioinform"},{"key":"2021032314164119800_ref27","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1038\/nbt1111","article-title":"Using process diagrams for the graphical representation of biological networks","volume":"23","author":"Kitano","year":"2005","journal-title":"Nat Biotechnol"},{"key":"2021032314164119800_ref28","author":"Newt Editor"},{"key":"2021032314164119800_ref29","doi-asserted-by":"crossref","first-page":"D1248","DOI":"10.1093\/nar\/gkx1023","article-title":"BioModels: expanding horizons to include more modelling approaches and formats","volume":"46","author":"Glont","year":"2018","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref30","doi-asserted-by":"crossref","first-page":"1509","DOI":"10.1038\/nbt1156","article-title":"Minimum information requested in the annotation of biochemical models (MIRIAM)","volume":"23","author":"Le Nov\u00e8re","year":"2005","journal-title":"Nat Biotechnol"},{"key":"2021032314164119800_ref31","first-page":"D682","volume":"48","author":"Ensembl 2020","year":"2020","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref32","doi-asserted-by":"crossref","first-page":"D136","DOI":"10.1093\/nar\/gkr1178","article-title":"The NCBI taxonomy database","volume":"40","author":"Federhen","year":"2012","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref33","doi-asserted-by":"crossref","first-page":"D344","DOI":"10.1093\/nar\/gkm791","article-title":"ChEBI: a database and ontology for chemical entities of biological interest","volume":"36","author":"Degtyarenko","year":"2008","journal-title":"Nucleic Acids Res"},{"key":"2021032314164119800_ref34","author":"Mathematical Modelling Ontology"},{"key":"2021032314164119800_ref35","author":"Systems Biology Ontology"},{"key":"2021032314164119800_ref36","author":"BRENDA tissue\/enzyme source"},{"key":"2021032314164119800_ref37","doi-asserted-by":"crossref","first-page":"2018","DOI":"10.1093\/database\/bay031","article-title":"Expert curation for building network-based dynamical models: a case study on atherosclerotic plaque formation","volume":"2018","author":"Bekkar","year":"2018","journal-title":"Database (Oxford)"},{"key":"2021032314164119800_ref38","doi-asserted-by":"publisher","first-page":"680","DOI":"10.3389\/fphys.2018.00680","article-title":"The CoLoMoTo interactive notebook: accessible and reproducible computational analyses for qualitative biological networks","volume":"9","author":"Naldi","year":"2018","journal-title":"Front Physiol"},{"key":"2021032314164119800_ref39","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1186\/1752-0509-4-65","article-title":"The mEPN scheme: an intuitive and flexible graphical system for rendering biological pathways","volume":"4","author":"Freeman","year":"2010","journal-title":"BMC Syst Biol"},{"key":"2021032314164119800_ref40","article-title":"A detailed graphical and computational model of the mammalian renal circadian clock","author":"Ivy","year":"2019","journal-title":"bioRxiv"},{"key":"2021032314164119800_ref41","article-title":"Petri net-based graphical and computational modelling of biological systems","author":"Livigni","year":"2016","journal-title":"bioRxiv"},{"key":"2021032314164119800_ref42","doi-asserted-by":"crossref","article-title":"Automated inference of Boolean models from molecular interaction maps using CaSQ","author":"Aghamiri","DOI":"10.1093\/bioinformatics\/btaa484"},{"key":"2021032314164119800_ref43","first-page":"1","article-title":"Computational systems biology approach for the study of rheumatoid arthritis: from a molecular map to a dynamical model","volume":"4","author":"Singh","year":"2018","journal-title":"Genomics Comput Biol"},{"key":"2021032314164119800_ref44","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/database\/baaa017","article-title":"RA-map: building a state-of-the-art interactive knowledge base for rheumatoid arthritis","volume":"2020","author":"Singh","year":"2020","journal-title":"Database"},{"key":"2021032314164119800_ref45","doi-asserted-by":"crossref","first-page":"e1004131","DOI":"10.1371\/journal.pcbi.1004131","article-title":"Integrating interactive computational modeling in biology curricula","volume":"11","author":"Helikar","year":"2015","journal-title":"PLoS Comput Biol"},{"key":"2021032314164119800_ref46","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.biosystems.2015.11.005","article-title":"Programmatic access to logical models in the Cell Collective modeling environment via a REST API","volume":"139","author":"Kowal","year":"2016","journal-title":"Biosystems"},{"key":"2021032314164119800_ref47","doi-asserted-by":"crossref","first-page":"2226","DOI":"10.1093\/bioinformatics\/btx123","article-title":"MaBoSS 2.0: an environment for stochastic Boolean modeling","volume":"33","author":"Stoll","year":"2017","journal-title":"Bioinformatics"},{"key":"2021032314164119800_ref48","doi-asserted-by":"crossref","first-page":"1188","DOI":"10.1093\/bioinformatics\/bty766","article-title":"PhysiBoSS: a multi-scale agent-based modelling framework integrating physical dimension and cell signalling","volume":"35","author":"Letort","year":"2019","journal-title":"Bioinformatics"},{"key":"2021032314164119800_ref49"},{"key":"2021032314164119800_ref50","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1038\/nmeth.1931","article-title":"Protein interaction data curation: the international molecular exchange (IMEx) consortium","volume":"9","author":"Orchard","year":"2012","journal-title":"Nat Methods"},{"key":"2021032314164119800_ref51","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1089\/omi.2006.10.145","article-title":"The work of the Human Proteome Organisation\u2019s Proteomics Standards Initiative (HUPO PSI)","volume":"10","author":"Taylor","year":"2006","journal-title":"Omics J Integr Biol"},{"key":"2021032314164119800_ref52","author":"causalBuilder"},{"key":"2021032314164119800_ref53","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/ncomms9033","article-title":"Large-scale models of signal propagation in human cells derived from discovery phosphoproteomic data","volume":"6","author":"Terfve","year":"2015","journal-title":"Nat Commun"},{"key":"2021032314164119800_ref54","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41540-019-0118-z","article-title":"From expression footprints to causal pathways: contextualizing large signaling networks with CARNIVAL","volume":"5","author":"Liu","year":"2019","journal-title":"Npj Syst Biol Appl"},{"key":"2021032314164119800_ref55","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1038\/nmeth.4077","article-title":"OmniPath: guidelines and gateway for literature-curated signaling pathway resources","volume":"13","author":"T\u00fcrei","year":"2016","journal-title":"Nat Methods"},{"key":"2021032314164119800_ref56","article-title":"Bringing data from curated pathway resources to Cytoscape with OmniPath","author":"Ceccarelli","year":"2019","journal-title":"Bioinformatics"},{"key":"2021032314164119800_ref57","doi-asserted-by":"publisher","first-page":"1605","DOI":"10.3389\/fphys.2018.01605","article-title":"BioLQM: a java toolkit for the manipulation and conversion of logical qualitative models of biological networks","volume":"9","author":"Naldi","year":"2018","journal-title":"Front Physiol"},{"key":"2021032314164119800_ref58","volume-title":"Pint: A Static Analyzer for Transient Dynamics of Qualitative Networks with IPython Interface","author":"Paulev\u00e9","year":"2017"},{"key":"2021032314164119800_ref59","first-page":"322","article-title":"KAMIStudio: An Environment for Biocuration of Cellular Signalling Knowledge. Computational Methods in Systems Biology. CMSB 2019.","volume-title":"Lecture Notes in Computer Science","author":"Harmer"},{"key":"2021032314164119800_ref60","doi-asserted-by":"crossref","first-page":"i583","DOI":"10.1093\/bioinformatics\/bty272","article-title":"The kappa platform for rule-based modeling","volume":"34","author":"Boutillier","year":"2018","journal-title":"Bioinformatics"},{"key":"2021032314164119800_ref61","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1007\/978-1-59745-525-1_5","article-title":"Rule-based modeling of biochemical systems with BioNetGen","volume":"500","author":"Faeder","year":"2009","journal-title":"Methods Mol Biol"},{"key":"2021032314164119800_ref62","author":"Kappa-Dev\/KAMI"},{"key":"2021032314164119800_ref63","article-title":"A simple scheme for annotating SBML with references to controlled vocabularies and database entries","author":"Nov\u00e8re","year":"2005"},{"key":"2021032314164119800_ref64","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1093\/bib\/bby087","article-title":"Harmonizing semantic annotations for computational models in biology","volume":"20","author":"Neal","year":"2019","journal-title":"Brief Bioinform"},{"key":"2021032314164119800_ref65","author":"BioModels.net Qualifiers | COMBINE"},{"key":"2021032314164119800_ref66","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1093\/bioinformatics\/btw682","article-title":"PyBoolNet: a python package for the generation, analysis and visualization of boolean networks","volume":"33","author":"Klarner","year":"2017","journal-title":"Bioinforma Oxf Engl"},{"key":"2021032314164119800_ref67","doi-asserted-by":"publisher","first-page":"20170086","DOI":"10.1515\/jib-2017-0086","article-title":"Simulation experiment description markup language (SED-ML) level 1 version 3 (L1V3)","volume":"15","author":"Bergmann","year":"2018","journal-title":"J Integr Bioinform"},{"key":"2021032314164119800_ref68","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1186\/1752-0509-5-198","article-title":"Reproducible computational biology experiments with SED-ML - the simulation experiment description markup language","volume":"5","author":"Waltemath","year":"2011","journal-title":"BMC Syst Biol"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/bib\/article-pdf\/22\/2\/1848\/36654102\/bbaa046.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/bib\/article-pdf\/22\/2\/1848\/36654102\/bbaa046.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,28]],"date-time":"2023-09-28T10:17:47Z","timestamp":1695896267000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/22\/2\/1848\/5822935"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,21]]},"references-count":68,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,4,21]]},"published-print":{"date-parts":[[2021,3,22]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbaa046","relation":{},"ISSN":["1477-4054"],"issn-type":[{"value":"1477-4054","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,3]]},"published":{"date-parts":[[2020,4,21]]}}}