{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T04:37:59Z","timestamp":1773203879461,"version":"3.50.1"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"S1","license":[{"start":{"date-parts":[[2023,5,9]],"date-time":"2023-05-09T00:00:00Z","timestamp":1683590400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,9]],"date-time":"2023-05-09T00:00:00Z","timestamp":1683590400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>The extensive international research for medications and vaccines for the devastating COVID-19 pandemic requires a standard reference ontology. Among the current COVID-19 ontologies, the Coronavirus Infectious Disease Ontology (CIDO) is the largest one. Furthermore, it keeps growing very frequently. Researchers using CIDO as a reference ontology, need a quick update about the content added in a recent release to know how relevant the new concepts are\u00a0to their research needs. Although CIDO is only a medium size ontology, it is still a large knowledge base posing a challenge for a user interested in obtaining the \u201cbig picture\u201d of content changes between releases. Both a theoretical framework and a proper visualization are required to provide such a \u201cbig picture\u201d.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>The child-of-based layout of the weighted aggregate partial-area taxonomy summarization network (WAT) provides a \u201cbig picture\u201d convenient visualization of the content of an ontology. In this paper we address the \u201cbig picture\u201d of content changes between two releases of an ontology. We introduce a new DIFF framework named Diff Weighted Aggregate Taxonomy (DWAT) to display the differences between the WATs of two releases of an ontology. We use a layered approach which consists first of a DWAT of major subjects in CIDO, and then drill down a major subject of interest in the top-level DWAT to obtain a DWAT of secondary subjects and even further refined layers.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>A visualization of the Diff Weighted Aggregate Taxonomy is demonstrated on the CIDO ontology. The evolution of CIDO between 2020 and 2022 is demonstrated in two perspectives. Drilling down for a DWAT of secondary subject networks is also demonstrated. We illustrate how the DWAT of CIDO provides insight into its evolution.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>The new Diff Weighted Aggregate Taxonomy enables a layered approach to view the \u201cbig picture\u201d of the changes in the content between two releases of an ontology.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-023-02184-6","type":"journal-article","created":{"date-parts":[[2023,5,10]],"date-time":"2023-05-10T07:31:40Z","timestamp":1683703900000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Big knowledge visualization of the COVID-19 CIDO ontology evolution"],"prefix":"10.1186","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6709-828X","authenticated-orcid":false,"given":"Ling","family":"Zheng","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yehoshua","family":"Perl","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongqun","family":"He","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,5,9]]},"reference":[{"key":"2184_CR1","unstructured":"WHO Coronavirus (COVID-19) Dashboard [3\/16\/2023]. Available from: https:\/\/covid19.who.int\/."},{"issue":"10302","key":"2184_CR2","doi-asserted-by":"publisher","first-page":"725","DOI":"10.1016\/S0140-6736(21)01900-0","volume":"398","author":"T Lancet","year":"2021","unstructured":"Lancet T. Understanding long COVID: a modern medical challenge. Lancet. 2021;398(10302):725.","journal-title":"Lancet"},{"key":"2184_CR3","unstructured":"WHO\u2019s response to COVID-19 - 2021 Annual Report [3\/16\/2023]. Available from: https:\/\/www.who.int\/publications\/m\/item\/who-s-response-to-covid-19-2021-annual-report."},{"key":"2184_CR4","doi-asserted-by":"crossref","unstructured":"Whetzel PL, Noy NF, Shah NH, Alexander PR, Nyulas C, Tudorache T, et al. BioPortal: enhanced functionality via new Web services from the National Center for Biomedical Ontology to access and use ontologies in software applications. Nucleic Acids Res. 2011;39(Web Server issue):W541\u20135.","DOI":"10.1093\/nar\/gkr469"},{"key":"2184_CR5","unstructured":"Coronavirus Infectious Disease Ontology [3\/16\/2023]. Available from: https:\/\/bioportal.bioontology.org\/ontologies\/CIDO."},{"issue":"1","key":"2184_CR6","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1038\/s41597-020-0523-6","volume":"7","author":"Y He","year":"2020","unstructured":"He Y, Yu H, Ong E, Wang Y, Liu Y, Huffman A, et al. CIDO, a community-based ontology for coronavirus disease knowledge and data integration, sharing, and analysis. Sci Data. 2020;7(1):181.","journal-title":"Sci Data"},{"issue":"1","key":"2184_CR7","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1186\/s13326-021-00250-4","volume":"12","author":"A Huffman","year":"2021","unstructured":"Huffman A, Masci AM, Zheng J, Sanati N, Brunson T, Wu G, et al. CIDO ontology updates and secondary analysis of host responses to COVID-19 infection based on ImmPort reports and literature. J Biomed Semantics. 2021;12(1):18.","journal-title":"J Biomed Semantics"},{"key":"2184_CR8","unstructured":"COVID-19 Ontology [3\/16\/2023]. Available from: https:\/\/bioportal.bioontology.org\/ontologies\/COVID-19."},{"issue":"24","key":"2184_CR9","doi-asserted-by":"publisher","first-page":"5703","DOI":"10.1093\/bioinformatics\/btaa1057","volume":"36","author":"A Sargsyan","year":"2020","unstructured":"Sargsyan A, Kodamullil AT, Baksi S, Darms J, Madan S, Gebel S, et al. The COVID-19 Ontology. Bioinformatics. 2020;36(24):5703\u20135.","journal-title":"Bioinformatics"},{"key":"2184_CR10","unstructured":"The COVID-19 Infectious Disease Ontology [3\/16\/2023]. Available from: https:\/\/bioportal.bioontology.org\/ontologies\/IDO-COVID-19."},{"key":"2184_CR11","unstructured":"Infectious Disease Ontology [3\/16\/2023]. Available from: https:\/\/bioportal.bioontology.org\/ontologies\/IDO."},{"key":"2184_CR12","unstructured":"Virus Infectious Disease Ontology [3\/16\/2023]. Available from: https:\/\/bioportal.bioontology.org\/ontologies\/VIDO."},{"issue":"1","key":"2184_CR13","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1186\/s13326-021-00245-1","volume":"12","author":"S Babcock","year":"2021","unstructured":"Babcock S, Beverley J, Cowell LG, Smith B. The Infectious Disease Ontology in the age of COVID-19. J Biomed Semantics. 2021;12(1):13.","journal-title":"J Biomed Semantics"},{"key":"2184_CR14","unstructured":"WHO COVID-19 Rapid Version CRF semantic data model [3\/16\/2023]. Available from: https:\/\/bioportal.bioontology.org\/ontologies\/COVIDCRFRAPID."},{"issue":"1","key":"2184_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.artmed.2015.03.005","volume":"64","author":"M Halper","year":"2015","unstructured":"Halper M, Gu H, Perl Y, Ochs C. Abstraction networks for terminologies: Supporting management of \u201cbig knowledge.\u201d Artif Intell Med. 2015;64(1):1\u201316.","journal-title":"Artif Intell Med"},{"key":"2184_CR16","doi-asserted-by":"crossref","unstructured":"Zheng L, Ochs C, Geller J, Liu H, Perl Y, De Coronado S, editors. Multi-layer Big Knowledge visualization scheme for comprehending neoplasm ontology content. 2017 IEEE International Conference on Big Knowledge (ICBK). 2017, pp. 127\u2013134.","DOI":"10.1109\/ICBK.2017.40"},{"key":"2184_CR17","first-page":"978","volume":"245","author":"L Zheng","year":"2017","unstructured":"Zheng L, Perl Y, Elhanan G, Ochs C, Geller J, Halper M. Summarizing an Ontology: A \u201cBig Knowledge\u201d Coverage Approach. Stud Health Technol Inform. 2017;245:978\u201382.","journal-title":"Stud Health Technol Inform"},{"key":"2184_CR18","doi-asserted-by":"publisher","first-page":"103861","DOI":"10.1016\/j.jbi.2021.103861","volume":"120","author":"L Zheng","year":"2021","unstructured":"Zheng L, Perl Y, He Y, Ochs C, Geller J, Liu H, et al. Visual comprehension and orientation into the COVID-19 CIDO ontology. J Biomed Inform. 2021;120:103861.","journal-title":"J Biomed Inform"},{"key":"2184_CR19","unstructured":"Structural Analysis of Biomedical Ontologies Center (SABOC) [3\/16\/2023]. Available from: https:\/\/saboc.njit.edu\/."},{"issue":"3","key":"2184_CR20","doi-asserted-by":"publisher","first-page":"628","DOI":"10.1136\/amiajnl-2014-003173","volume":"22","author":"C Ochs","year":"2015","unstructured":"Ochs C, Geller J, Perl Y, Chen Y, Agrawal A, Case JT, et al. A tribal abstraction network for SNOMED CT target hierarchies without attribute relationships. J Am Med Inform Assoc. 2015;22(3):628\u201339.","journal-title":"J Am Med Inform Assoc"},{"key":"2184_CR21","first-page":"973","volume":"2015","author":"C Ochs","year":"2015","unstructured":"Ochs C, Zheng L, Gu H, Perl Y, Geller J, Kapusnik-Uner J, et al. Drug-drug Interaction Discovery Using Abstraction Networks for \u201cNational Drug File - Reference Terminology\u201d Chemical Ingredients. AMIA Annu Symp Proc. 2015;2015:973\u201382.","journal-title":"AMIA Annu Symp Proc"},{"issue":"6","key":"2184_CR22","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1197\/jamia.M2036","volume":"13","author":"H Min","year":"2006","unstructured":"Min H, Perl Y, Chen Y, Halper M, Geller J, Wang Y. Auditing as part of the terminology design life cycle. J Am Med Inform Assoc. 2006;13(6):676\u201390.","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"2184_CR23","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1016\/j.jbi.2006.12.003","volume":"40","author":"Y Wang","year":"2007","unstructured":"Wang Y, Halper M, Min H, Perl Y, Chen Y, Spackman KA. Structural methodologies for auditing SNOMED. J Biomed Inform. 2007;40(5):561\u201381.","journal-title":"J Biomed Inform"},{"key":"2184_CR24","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1016\/j.jbi.2016.06.008","volume":"62","author":"C Ochs","year":"2016","unstructured":"Ochs C, Geller J, Perl Y, Musen MA. A unified software framework for deriving, visualizing, and exploring abstraction networks for ontologies. J Biomed Inform. 2016;62:90\u2013105.","journal-title":"J Biomed Inform"},{"key":"2184_CR25","unstructured":"The Ontology Abstraction Framework (OAF) [3\/16\/2023]. Available from: https:\/\/saboc.njit.edu\/software.php."},{"key":"2184_CR26","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.jbi.2015.05.018","volume":"56","author":"C Ochs","year":"2015","unstructured":"Ochs C, Perl Y, Geller J, Haendel M, Brush M, Arabandi S, et al. Summarizing and visualizing structural changes during the evolution of biomedical ontologies using a Diff Abstraction Network. J Biomed Inform. 2015;56:127\u201344.","journal-title":"J Biomed Inform"},{"issue":"1","key":"2184_CR27","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1186\/s13326-022-00279-z","volume":"13","author":"Y He","year":"2022","unstructured":"He Y, Yu H, Huffman A, Lin AY, Natale DA, Beverley J, et al. A comprehensive update on CIDO: the community-based coronavirus infectious disease ontology. J Biomed Semantics. 2022;13(1):25.","journal-title":"J Biomed Semantics"},{"key":"2184_CR28","unstructured":"Ochs C, He Z, Perl Y, Arabandi S, editors. Choosing the Granularity of Abstraction Networks for Orientation and Quality Assurance of the Sleep Domain Ontology. CEUR Workshop Proceedings. 2013;1060:84\u201389."},{"issue":"1","key":"2184_CR29","doi-asserted-by":"publisher","first-page":"R5","DOI":"10.1186\/gb-2012-13-1-r5","volume":"13","author":"CJ Mungall","year":"2012","unstructured":"Mungall CJ, Torniai C, Gkoutos GV, Lewis SE, Haendel MA. Uberon, an integrative multi-species anatomy ontology. Genome Biol. 2012;13(1):R5.","journal-title":"Genome Biol"},{"key":"2184_CR30","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1186\/1756-0500-3-175","volume":"3","author":"Z Xiang","year":"2010","unstructured":"Xiang Z, Courtot M, Brinkman RR, Ruttenberg A, He Y. OntoFox: web-based support for ontology reuse. BMC Res Notes. 2010;3:175.","journal-title":"BMC Res Notes"},{"key":"2184_CR31","doi-asserted-by":"crossref","unstructured":"Tang YW, Schmitz JE, Persing DH, Stratton CW. Laboratory Diagnosis of COVID-19: Current Issues and Challenges. J Clin Microbiol. 2020;58(6).","DOI":"10.1128\/JCM.00512-20"},{"key":"2184_CR32","doi-asserted-by":"publisher","first-page":"112752","DOI":"10.1016\/j.bios.2020.112752","volume":"172","author":"M Yuce","year":"2021","unstructured":"Yuce M, Filiztekin E, Ozkaya KG. COVID-19 diagnosis -A review of current methods. Biosens Bioelectron. 2021;172:112752.","journal-title":"Biosens Bioelectron"},{"issue":"23","key":"2184_CR33","doi-asserted-by":"publisher","first-page":"3182","DOI":"10.1016\/j.vaccine.2022.04.041","volume":"40","author":"L Li","year":"2022","unstructured":"Li L, Honda-Okubo Y, Baldwin J, Bowen R, Bielefeldt-Ohmann H, Petrovsky N. Covax-19\/Spikogen(R) vaccine based on recombinant spike protein extracellular domain with Advax-CpG55.2 adjuvant provides single dose protection against SARS-CoV-2 infection in hamsters. Vaccine. 2022;40(23):3182\u201392.","journal-title":"Vaccine"},{"key":"2184_CR34","doi-asserted-by":"crossref","unstructured":"King RG, Silva-Sanchez A, Peel JN, Botta D, Dickson AM, Pinto AK, et al. Single-Dose Intranasal Administration of AdCOVID Elicits Systemic and Mucosal Immunity against SARS-CoV-2 and Fully Protects Mice from Lethal Challenge. Vaccines (Basel). 2021;9(8).","DOI":"10.3390\/vaccines9080881"},{"issue":"24","key":"2184_CR35","doi-asserted-by":"publisher","first-page":"9035","DOI":"10.1007\/s00253-021-11676-2","volume":"105","author":"M Bhattacharya","year":"2021","unstructured":"Bhattacharya M, Chatterjee S, Sharma AR, Agoramoorthy G, Chakraborty C. D614G mutation and SARS-CoV-2: impact on S-protein structure, function, infectivity, and immunity. Appl Microbiol Biotechnol. 2021;105(24):9035\u201345.","journal-title":"Appl Microbiol Biotechnol"},{"issue":"7","key":"2184_CR36","doi-asserted-by":"publisher","first-page":"1062","DOI":"10.1007\/s11427-020-1893-9","volume":"64","author":"AC Shi","year":"2021","unstructured":"Shi AC, Xie X. Making sense of spike D614G in SARS-CoV-2 transmission. Sci China Life Sci. 2021;64(7):1062\u20137.","journal-title":"Sci China Life Sci"},{"issue":"1","key":"2184_CR37","doi-asserted-by":"publisher","first-page":"4541","DOI":"10.1038\/s41467-020-18319-6","volume":"11","author":"J Yang","year":"2020","unstructured":"Yang J, Petitjean SJL, Koehler M, Zhang Q, Dumitru AC, Chen W, et al. Molecular interaction and inhibition of SARS-CoV-2 binding to the ACE2 receptor. Nat Commun. 2020;11(1):4541.","journal-title":"Nat Commun"},{"key":"2184_CR38","doi-asserted-by":"publisher","first-page":"110231","DOI":"10.1016\/j.mehy.2020.110231","volume":"144","author":"OJ Wiese","year":"2020","unstructured":"Wiese OJ, Allwood BW, Zemlin AE. COVID-19 and the renin-angiotensin system (RAS): A spark that sets the forest alight? Med Hypotheses. 2020;144:110231.","journal-title":"Med Hypotheses"},{"issue":"Database issue","key":"2184_CR39","first-page":":D344","volume":"36","author":"P de Matos","year":"2008","unstructured":"de Matos P, Ennis M, Hastings J, Zbinden M, McNaught A, et al. ChEBI: a database and ontology for chemical entities of biological interest. Nucleic Acids Res. 2008;36(Database issue)::D344-50.","journal-title":"Nucleic Acids Res"},{"issue":"5","key":"2184_CR40","doi-asserted-by":"publisher","first-page":"905","DOI":"10.1007\/s10096-020-04138-6","volume":"40","author":"S Beyerstedt","year":"2021","unstructured":"Beyerstedt S, Casaro EB, Rangel EB. COVID-19: angiotensin-converting enzyme 2 (ACE2) expression and tissue susceptibility to SARS-CoV-2 infection. Eur J Clin Microbiol Infect Dis. 2021;40(5):905\u201319.","journal-title":"Eur J Clin Microbiol Infect Dis"},{"key":"2184_CR41","first-page":"279","volume":"121","author":"K Donnelly","year":"2006","unstructured":"Donnelly K. SNOMED-CT: The advanced terminology and coding system for eHealth. Stud Health Technol Inform. 2006;121:279\u201390.","journal-title":"Stud Health Technol Inform"},{"issue":"8","key":"2184_CR42","doi-asserted-by":"publisher","first-page":"648","DOI":"10.1002\/cfg.445","volume":"5","author":"G Fragoso","year":"2004","unstructured":"Fragoso G, de Coronado S, Haber M, Hartel F, Wright L. Overview and utilization of the NCI thesaurus. Comp Funct Genomics. 2004;5(8):648\u201354.","journal-title":"Comp Funct Genomics"},{"issue":"Database issue","key":"2184_CR43","first-page":"D258","volume":"32","author":"MA Harris","year":"2004","unstructured":"Harris MA, Clark J, Ireland A, Lomax J, Ashburner M, Foulger R, et al. The Gene Ontology (GO) database and informatics resource. Nucleic Acids Res. 2004;32(Database issue):D258-61.","journal-title":"Nucleic Acids Res"},{"key":"2184_CR44","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.jbi.2017.02.006","volume":"67","author":"C Ochs","year":"2017","unstructured":"Ochs C, Case JT, Perl Y. Analyzing structural changes in SNOMED CT\u2019s Bacterial infectious diseases using a visual semantic delta. J Biomed Inform. 2017;67:101\u201316.","journal-title":"J Biomed Inform"},{"key":"2184_CR45","first-page":"974","volume":"2016","author":"C Ochs","year":"2016","unstructured":"Ochs C, Case JT, Perl Y. Tracking the Remodeling of SNOMED CT\u2019s Bacterial Infectious Diseases. AMIA Annu Symp Proc. 2016;2016:974\u201383.","journal-title":"AMIA Annu Symp Proc"},{"key":"2184_CR46","first-page":"1157","volume":"2018","author":"L Zheng","year":"2018","unstructured":"Zheng L, Liu H, Perl Y, Geller J, Ochs C, Case JT. Overlapping Complex Concepts Have More Commission Errors, Especially in Intensive Terminology Auditing. AMIA Annu Symp Proc. 2018;2018:1157\u201366.","journal-title":"AMIA Annu Symp Proc"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02184-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-023-02184-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-023-02184-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T08:17:52Z","timestamp":1725956272000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-023-02184-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,9]]},"references-count":46,"journal-issue":{"issue":"S1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2184"],"URL":"https:\/\/doi.org\/10.1186\/s12911-023-02184-6","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,9]]},"assertion":[{"value":"5 September 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"88"}}