{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T01:38:09Z","timestamp":1777513089602,"version":"3.51.4"},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"S6","license":[{"start":{"date-parts":[[2022,7,1]],"date-time":"2022-07-01T00:00:00Z","timestamp":1656633600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,14]],"date-time":"2022-07-14T00:00:00Z","timestamp":1657756800000},"content-version":"vor","delay-in-days":13,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["RF1AG072799"],"award-info":[{"award-number":["RF1AG072799"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R56AI150272"],"award-info":[{"award-number":["R56AI150272"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R56AG074604"],"award-info":[{"award-number":["R56AG074604"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["T15LM007093"],"award-info":[{"award-number":["T15LM007093"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000968","name":"American Heart Association","doi-asserted-by":"publisher","award":["19GPSGC35180031"],"award-info":[{"award-number":["19GPSGC35180031"]}],"id":[{"id":"10.13039\/100000968","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Model card reports aim to provide informative and transparent description of machine learning models to stakeholders. This report document is of interest to the National Institutes of Health\u2019s Bridge2AI initiative to address the FAIR challenges with artificial intelligence-based machine learning models for biomedical research. We present our early undertaking in developing an ontology for capturing the conceptual-level information embedded in model card reports.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Sourcing from existing ontologies and developing the core framework, we generated the Model Card\u00a0Report Ontology. Our development efforts yielded an OWL2-based artifact that represents and formalizes model card report information. The current release of this ontology utilizes standard concepts and properties from OBO Foundry ontologies. Also, the software reasoner indicated no logical inconsistencies with the ontology. With sample model cards of machine learning models for bioinformatics research (HIV social networks and adverse outcome prediction for stent implantation), we showed the coverage and usefulness of our model in transforming static model card reports to a computable format for machine-based processing.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>The benefit of our work is that it utilizes expansive and standard terminologies and scientific rigor promoted by biomedical ontologists, as well as, generating an avenue to make model cards machine-readable using semantic web technology. Our future goal is to assess the veracity of our model and later expand the model to include additional concepts to address terminological gaps. We discuss tools and software that will utilize our ontology for potential application services.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12859-022-04797-6","type":"journal-article","created":{"date-parts":[[2022,7,14]],"date-time":"2022-07-14T14:06:15Z","timestamp":1657807575000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Toward a standard formal semantic representation of the model card report"],"prefix":"10.1186","volume":"23","author":[{"given":"Muhammad Tuan","family":"Amith","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Licong","family":"Cui","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Degui","family":"Zhi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kirk","family":"Roberts","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoqian","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fang","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Evan","family":"Yu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4267-1924","authenticated-orcid":false,"given":"Cui","family":"Tao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,7,14]]},"reference":[{"issue":"1","key":"4797_CR1","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.18","volume":"3","author":"MD Wilkinson","year":"2016","unstructured":"...Wilkinson MD, Dumontier M, Aalbersberg IJ, Appleton G, Axton M, Baak A, Blomberg N, Boiten J-W, da SilvaSantos LB, Bourne PE, Bouwman J, Brookes AJ, Clark T, Crosas M, Dillo I, Dumon O, Edmunds S, Evelo CT, Finkers R, Gonzalez-Beltran A, Gray AJG, Groth P, Goble C, Grethe JS, Heringa J, Hoen PAC, Hooft R, Kuhn T, Kok R, Kok J, Lusher SJ, Martone ME, Mons A, Packer AL, Persson B, Rocca-Serra P, Roos M, van Schaik R, Sansone S-A, Schultes E, Sengstag T, Slater T, Strawn G, Swertz MA, Thompson M, van der Lei J, van Mulligen E, Velterop J, Waagmeester A, Wittenburg P, Wolstencroft K, Zhao J, Mons B. The FAIR Guiding Principles for scientific data management and stewardship. Sci Data. 2016;3(1): 160018. https:\/\/doi.org\/10.1038\/sdata.2016.18.","journal-title":"Sci Data"},{"key":"4797_CR2","unstructured":"National Institutes of Health: Data Generation Projects for the NIH Bridge to Artificial Intelligence (Bridge2AI) Program (OT2) (2021). https:\/\/www.commonfund.nih.gov\/bridge2ai\/programresources. Accessed 9 Sept 2021"},{"key":"4797_CR3","unstructured":"National Institutes of Health: Bridge to Artificial Intelligence (2021). https:\/\/www.commonfund.nih.gov\/bridge2ai. Accessed 9 Sept 2021"},{"key":"4797_CR4","doi-asserted-by":"publisher","unstructured":"Mitchell M, Wu S, Zaldivar A, Barnes P, Vasserman L, Hutchinson B, Spitzer E, Raji ID, Gebru T. Model cards for model reporting. In: Proceedings of the conference on fairness, accountability, and transparency. FAT* \u201919, pp. 220\u2013229. Association for Computing Machinery, New York, NY, USA;2019. https:\/\/doi.org\/10.1145\/3287560.3287596. event-place: Atlanta, GA, USA. https:\/\/doi.org\/10.1145\/3287560.3287596","DOI":"10.1145\/3287560.3287596 10.1145\/3287560.3287596"},{"issue":"5","key":"4797_CR5","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1038\/scientificamerican0501-34","volume":"284","author":"T Berners-Lee","year":"2001","unstructured":"Berners-Lee T, Hendler J, Lassila O, et al. The semantic web. Sci Am. 2001;284(5):28\u201337.","journal-title":"Sci Am"},{"key":"4797_CR6","unstructured":"Insight Centre for Data Analytics: The Linked Open Data Cloud (2021). https:\/\/lod-cloud.net\/. Accessed 10 Mar 2022"},{"issue":"2","key":"4797_CR7","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1145\/3397512","volume":"64","author":"P Hitzler","year":"2021","unstructured":"Hitzler P. A review of the semantic web field. Commun ACM. 2021;64(2):76\u201383. https:\/\/doi.org\/10.1145\/3397512.","journal-title":"Commun ACM"},{"key":"4797_CR8","unstructured":"McCrae JP, Abele A, Buitelaar P, Cyganiak R, Jentzsch A, Andryushechkin V, Debattista J, Nasir J. The linked open data cloud (2019). http:\/\/lod-cloud.net\/. Accessed 9 Sept 2021"},{"key":"4797_CR9","unstructured":"The Open Biological and Biomedical Ontology (OBO) Foundry: about the OBO Foundry (2021). http:\/\/www.obofoundry.org\/about-OBO-Foundry.html. Accessed 9 Sept 2021"},{"key":"4797_CR10","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/9780262527811.001.0001","volume-title":"Building ontologies with basic formal ontology","author":"R Arp","year":"2015","unstructured":"Arp R, Smith B, Spear AD. Building ontologies with basic formal ontology. Cambridge: MIT Press; 2015."},{"issue":"4","key":"4797_CR11","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1016\/j.websem.2008.05.001","volume":"6","author":"BC Grau","year":"2008","unstructured":"Grau BC, Horrocks I, Motik B, Parsia B, Patel-Schneider P, Sattler U. OWL 2: the next step for OWL. J Web Semant. 2008;6(4):309\u201322.","journal-title":"J Web Semant"},{"key":"4797_CR12","unstructured":"Klyne G, Carroll JJ, McBride B. Resource description framework (RDF) 1.1 concepts and abstract syntax;2014. https:\/\/www.w3.org\/TR\/rdf11-concepts\/. Accessed 1 Jan 2021"},{"key":"4797_CR13","unstructured":"Beckett D, Berners-Lee T, Prud\u2019hommeaux E. Turtle-terse RDF triple language;2014. https:\/\/www.w3.org\/TR\/turtle\/. Accessed 9 Sept 2021"},{"key":"4797_CR14","unstructured":"Harris S, Seaborne A. SPARQL;2008. http:\/\/www.w3.org\/TR\/sparql11-overview\/. Accessed 15 Aug 2014"},{"key":"4797_CR15","unstructured":"O\u2019Connor M, Das A. SQWRL: a query language for OWL. In: Proceedings of the 6th international conference on owl: experiences and directions;2009; vol. 529, pp. 208\u2013215. CEUR-WS.org, Chantilly VA"},{"key":"4797_CR16","unstructured":"Zheng J. Information artifact ontology (2020). http:\/\/www.obofoundry.org\/ontology\/iao.html. Accessed 10 Mar 2022"},{"key":"4797_CR17","doi-asserted-by":"publisher","first-page":"68","DOI":"10.3233\/978-1-61499-101-4-68","volume":"180","author":"W Ceusters","year":"2012","unstructured":"Ceusters W. An information artifact ontology perspective on data collections and associated representational artifacts. Stud Health Technol Inform. 2012;180:68\u201372. https:\/\/doi.org\/10.3233\/978-1-61499-101-4-68.","journal-title":"Stud Health Technol Inform"},{"key":"4797_CR18","unstructured":"Lebo T, Sahoo S, McGuinness D. PROV-O: the PROV Ontology;2013. https:\/\/www.w3.org\/TR\/prov-o\/. Accessed 10 Mar 2022"},{"issue":"1","key":"4797_CR19","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1186\/2041-1480-4-37","volume":"4","author":"P Ciccarese","year":"2013","unstructured":"Ciccarese P, Soiland-Reyes S, Belhajjame K, Gray AJ, Goble C, Clark T. PAV ontology: provenance, authoring and versioning. J Biomed Semant. 2013;4(1):37. https:\/\/doi.org\/10.1186\/2041-1480-4-37.","journal-title":"J Biomed Semant"},{"key":"4797_CR20","unstructured":"Lister A. Software ontology;2019. https:\/\/obofoundry.org\/ontology\/swo.html. Accessed 10 Mar 2022"},{"issue":"1","key":"4797_CR21","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1186\/2041-1480-5-25","volume":"5","author":"J Malone","year":"2014","unstructured":"Malone J, Brown A, Lister AL, Ison J, Hull D, Parkinson H, Stevens R. The Software Ontology (SWO): a resource for reproducibility in biomedical data analysis, curation and digital preservation. J Biomed Semant. 2014;5(1):25. https:\/\/doi.org\/10.1186\/2041-1480-5-25.","journal-title":"J Biomed Semant"},{"key":"4797_CR22","doi-asserted-by":"crossref","unstructured":"Tsarkov D, Horrocks I. FaCT++ description logic reasoner: system description. In: Automated reasoning: third international joint conference, vol 4130. IJCAR 2006, Seattle, WA, USA, August 17\u201320, 2006, Proceedings. Seattle, WA: Springer; 2006. p. 292\u20137.","DOI":"10.1007\/11814771_26"},{"key":"4797_CR23","unstructured":"Amith M, Tao C. Model card report ontology (2022). http:\/\/github.com\/UTHealth-Ontology\/MCRO. Accessed 10 Mar 2022"},{"issue":"2","key":"4797_CR24","doi-asserted-by":"publisher","first-page":"71","DOI":"10.3233\/SW-2011-0034","volume":"2","author":"K Dentler","year":"2011","unstructured":"Dentler K, Cornet R, ten Teije A, de Keizer N. Comparison of reasoners for large ontologies in the OWL 2 EL profile. Semant Web. 2011;2(2):71\u201387. https:\/\/doi.org\/10.3233\/SW-2011-0034.","journal-title":"Semant Web"},{"key":"4797_CR25","unstructured":"Mungall C. mereotopologically related to 2022. http:\/\/purl.obolibrary.org\/obo\/RO_0002323. Accessed 10 Mar 2022"},{"key":"4797_CR26","unstructured":"Obrst L, Ceusters W, Janssen T. Ontologies, semantic technologies, and intelligence: looking toward the future. In: Proceedings of the 2010 conference on ontologies and semantic technologies for intelligence;2010. pp. 213\u2013224. IOS Press, NLD"},{"key":"4797_CR27","doi-asserted-by":"crossref","unstructured":"Peters B, Consortium O et al. Ontology for biomedical investigations. Nat Preced. 2009; 1","DOI":"10.1038\/npre.2009.3623.1"},{"issue":"1","key":"4797_CR28","doi-asserted-by":"publisher","first-page":"11","DOI":"10.3233\/SW-2011-0025","volume":"2","author":"M Horridge","year":"2011","unstructured":"Horridge M, Bechhofer S. The owl API: a Java API for owl ontologies. Semant Web. 2011;2(1):11\u201321.","journal-title":"Semant Web"},{"issue":"6","key":"4797_CR29","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1109\/MIC.2002.1067737","volume":"6","author":"B McBride","year":"2002","unstructured":"McBride B. Jena: a semantic Web toolkit. IEEE Internet Comput. 2002;6(6):55\u20139. https:\/\/doi.org\/10.1109\/MIC.2002.1067737.","journal-title":"IEEE Internet Comput"},{"issue":"3","key":"4797_CR30","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/s10817-014-9305-1","volume":"53","author":"B Glimm","year":"2014","unstructured":"Glimm B, Horrocks I, Motik B, Stoilos G, Wang Z. HermiT: an OWL 2 reasoner. J Autom Reason. 2014;53(3):245\u201369.","journal-title":"J Autom Reason"},{"key":"4797_CR31","doi-asserted-by":"crossref","unstructured":"Lanthaler M, G\u00fctl C. On using JSON-LD to create evolvable restful services. In: Proceedings of the third international workshop on RESTful design;2012. pp. 25\u201332","DOI":"10.1145\/2307819.2307827"},{"key":"4797_CR32","doi-asserted-by":"publisher","first-page":"78","DOI":"10.7717\/peerj-cs.78","volume":"2","author":"T Kuhn","year":"2016","unstructured":"Kuhn T, Chichester C, Krauthammer M, Queralt-Rosinach N, Verborgh R, Giannakopoulos G, Ngonga Ngomo A-C, Viglianti R, Dumontier M. Decentralized provenance-aware publishing with nanopublications. PeerJ Comput Sci. 2016;2:78. https:\/\/doi.org\/10.7717\/peerj-cs.78.","journal-title":"PeerJ Comput Sci"},{"key":"4797_CR33","doi-asserted-by":"crossref","unstructured":"Naja I, Markovic M, Edwards P, Cottrill C. A semantic framework to support AI system accountability and audit. In: European semantic web conference;2021. pp. 160\u2013176. Springer","DOI":"10.1007\/978-3-030-77385-4_10"},{"key":"4797_CR34","doi-asserted-by":"crossref","unstructured":"Nguyen A, Weller T, F\u00e4rber M, Sure-Vetter Y. Making neural networks fair. In: Iberoamerican knowledge graphs and semantic web conference;2020. pp. 29\u201344. Springer","DOI":"10.1007\/978-3-030-65384-2_3"},{"key":"4797_CR35","unstructured":"Nguyen A, Weller T, Faber M, Sure-Vetter Y. The FAIRnets ontology. Institute of Applied Informatics and Formal Description Methods;2019. https:\/\/w3id.org\/nno\/ontology. Accessed 1 Mar 2022"},{"key":"4797_CR36","unstructured":"Markovic M, Naja I, Edwards P. The system accountability ontology;2020. https:\/\/rains-uoa.github.io\/SAO-Ontology\/index-en.html. Accessed 1 Mar 2022"},{"key":"4797_CR37","unstructured":"Naja I, Markovic M, Edwards P. The RAInS ontology;2021. https:\/\/rains-uoa.github.io\/RAInS-Ontology\/v2.0\/index-en.html. Accessed 1 Mar 2020"},{"key":"4797_CR38","unstructured":"Noy NF, McGuinness DL. Ontology development 101: a guide to creating your first ontology. Stanford knowledge systems laboratory technical report KSL-01-05 and Stanford medical informatics technical report SMI-2001-0880, Stanford, CA;2001"},{"issue":"1","key":"4797_CR39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12859-019-3002-3","volume":"20","author":"RC Jackson","year":"2019","unstructured":"Jackson RC, Balhoff JP, Douglass E, Harris NL, Mungall CJ, Overton JA. ROBOT: a tool for automating ontology workflows. BMC Bioinform. 2019;20(1):1\u201310.","journal-title":"BMC Bioinform"},{"key":"4797_CR40","unstructured":"Miles A, Bechhofer S. SKOS simple knowledge organization system reference;2009. http:\/\/www.w3.org\/TR\/skos-reference\/. Accessed 10 Mar 2022"},{"key":"4797_CR41","unstructured":"Google, Inc.: Model Card Toolkit (2021). https:\/\/github.com\/tensorflow\/model-card-toolkit"},{"issue":"4","key":"4797_CR42","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1145\/2757001.2757003","volume":"1","author":"MA Musen","year":"2015","unstructured":"Musen MA. The Prot\u00e9G\u00e9 project: a look back and a look forward. AI Matters. 2015;1(4):4\u201312. https:\/\/doi.org\/10.1145\/2757001.2757003.","journal-title":"AI Matters"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-022-04797-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12859-022-04797-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12859-022-04797-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,14]],"date-time":"2022-07-14T14:06:38Z","timestamp":1657807598000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/s12859-022-04797-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7]]},"references-count":42,"journal-issue":{"issue":"S6","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["4797"],"URL":"https:\/\/doi.org\/10.1186\/s12859-022-04797-6","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7]]},"assertion":[{"value":"13 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 June 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"281"}}