{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,18]],"date-time":"2025-10-18T15:17:39Z","timestamp":1760800659284,"version":"3.41.2"},"reference-count":65,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,8,3]],"date-time":"2023-08-03T00:00:00Z","timestamp":1691020800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Res. Metr. Anal."],"abstract":"<jats:p>The COVID-19 pandemic highlighted two critical barriers hindering rapid response to novel pathogens. These include inefficient use of existing biological knowledge about treatments, compounds, gene interactions, proteins, etc. to fight new diseases, and the lack of assimilation and analysis of the fast-growing knowledge about new diseases to quickly develop new treatments, vaccines, and compounds. Overcoming these critical challenges has the potential to revolutionize global preparedness for future pandemics. Accordingly, this article introduces a novel knowledge graph application that functions as both a repository of life science knowledge and an analytics platform capable of extracting time-sensitive insights to uncover evolving disease dynamics and, importantly, researchers' evolving understanding. Specifically, we demonstrate how to extract time-bounded key concepts, also leveraging existing ontologies, from evolving scholarly articles to create a single temporal connected source of truth specifically related to COVID-19. By doing so, current knowledge can be promptly accessed by both humans and machines, from which further understanding of disease outbreaks can be derived. We present key findings from the temporal analysis, applied to a subset of the resulting knowledge graph known as the temporal keywords knowledge graph, and delve into the detailed capabilities provided by this innovative approach.<\/jats:p>","DOI":"10.3389\/frma.2023.1204801","type":"journal-article","created":{"date-parts":[[2023,8,3]],"date-time":"2023-08-03T23:06:37Z","timestamp":1691103997000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Analysis of the evolution of COVID-19 disease understanding through temporal knowledge graphs"],"prefix":"10.3389","volume":"8","author":[{"given":"Alessandro","family":"Negro","sequence":"first","affiliation":[]},{"given":"Fabio","family":"Montagna","sequence":"additional","affiliation":[]},{"given":"Michael N.","family":"Teng","sequence":"additional","affiliation":[]},{"given":"Tempestt","family":"Neal","sequence":"additional","affiliation":[]},{"given":"Sylvia","family":"Thomas","sequence":"additional","affiliation":[]},{"given":"Sayde","family":"King","sequence":"additional","affiliation":[]},{"given":"Ridita","family":"Khan","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,8,3]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1038\/s41591-020-0820-9","article-title":"The proximal origin of SARS-CoV-2","volume":"26","author":"Andersen","year":"2020","journal-title":"Nat. Med."},{"key":"B2","doi-asserted-by":"publisher","first-page":"D523","DOI":"10.1093\/nar\/gkac1052","article-title":"UniProt: the universal protein knowledgebase in 2023","volume":"51","author":"Bateman","year":"2022","journal-title":"Nucleic Acids Res"},{"key":"B3","doi-asserted-by":"publisher","first-page":"1014","DOI":"10.1126\/science.abd0831","article-title":"Antibody cocktail to SARS-CoV-2 spike protein prevents rapid mutational escape seen with individual antibodies","volume":"369","author":"Baum","year":"2020","journal-title":"Science."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2458-11-2","article-title":"Perceived risk, anxiety, and behavioural responses of the general public during the early phase of the Influenza A (H1N1) pandemic in the Netherlands: results of three consecutive online surveys","volume":"11","author":"Bults","year":"2011","journal-title":"BMC Public Health."},{"key":"B5","first-page":"1","article-title":"\u201cKnowledge diffusion and complex networks: a model of high-tech geographical industrial clusters,\u201d","volume-title":"Proceedings of the 6th Europeanconference on organizational knowledge, Learning, and Capabilities","author":"Canals","year":"2005"},{"key":"B6","unstructured":"Centers for Disease Control and Prevention"},{"key":"B7","doi-asserted-by":"publisher","first-page":"100254","DOI":"10.1136\/bmjhci-2020-100254","article-title":"Network graph representation of COVID-19 scientific publications to aid knowledge discovery","volume":"28","author":"Cernile","year":"2021","journal-title":"BMJ."},{"key":"B8","doi-asserted-by":"publisher","first-page":"1579","DOI":"10.1111\/anae.15057","article-title":"Social media for rapid knowledge dissemination: early experience from the COVID-19 pandemic","volume":"75","author":"Chan","year":"2020","journal-title":"Anaesthesia"},{"key":"B9","doi-asserted-by":"publisher","first-page":"4597","DOI":"10.1093\/bioinformatics\/btab694","article-title":"COVID-19 Knowledge Graph from semantic integration of biomedical literature and databases","volume":"37","author":"Chen","year":"2021","journal-title":"Bioinformatics."},{"key":"B10","doi-asserted-by":"publisher","first-page":"787","DOI":"10.1145\/3097983.3098126","article-title":"\u201cAugust. GRAM: graph-based attention model for healthcare representation learning,\u201d","author":"Choi","year":"2017","journal-title":"Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining"},{"key":"B11","doi-asserted-by":"publisher","first-page":"101057","DOI":"10.1016\/j.joi.2020.101057","article-title":"Mining temporal evolution of knowledge graphs and genealogical features for literature-based discovery prediction","volume":"14","author":"Choudhury","year":"2020","journal-title":"J. Informetr."},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.2196\/19161","article-title":"Knowledge and behaviors toward COVID-19 among US residents during the early days of the pandemic: cross-sectional online questionnaire","volume":"6","author":"Clements","year":"2020","journal-title":"JMIR Public Health Surveill."},{"key":"B13","unstructured":"\u201cSPECTER: Document-level representation learning using citation-informed transformers,\u201d22702282 CohanA. FeldmanS. BeltagyI. DowneyD. WeldD. S. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics2020"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1205","DOI":"10.1038\/s41591-020-0962-9","article-title":"Age-dependent effects in the transmission and control of COVID-19 epidemics","volume":"26","author":"Davies","year":"2020","journal-title":"Nat. Med."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1635","DOI":"10.1002\/asi.21075","article-title":"How to normalize cooccurrence data? An analysis of some well-known similarity measures","volume":"60","author":"Eck","year":"2009","journal-title":"J. Assoc. Inf. Sci. Technol"},{"key":"B16","first-page":"226","article-title":"\u201cA Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise,\u201d","volume-title":"Proceedings of the Second International Conference on Knowledge Discovery and Data Mining","author":"Ester","year":"1996"},{"key":"B17","doi-asserted-by":"publisher","first-page":"D950","DOI":"10.1093\/nar\/gkac957","article-title":"GenomicKB: a knowledge graph for the human genome","volume":"51","author":"Feng","year":"2022","journal-title":"Nucleic Acids Res"},{"key":"B18","doi-asserted-by":"publisher","first-page":"D258","DOI":"10.1093\/nar\/gkh036","article-title":"The Gene Ontology (GO) database and informatics resource","volume":"32","year":"2004","journal-title":"Nucleic Acids Res"},{"key":"B19","doi-asserted-by":"publisher","first-page":"2","DOI":"10.12688\/f1000research.72843.2","article-title":"An empirical study on Resource Description Framework reification for trustworthiness in knowledge graphs","volume":"10","author":"Govindapillai","year":"2021","journal-title":"F1000Research"},{"key":"B20","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1109\/MIS.2015.68","article-title":"Information extraction","volume":"30","author":"Grishman","year":"2015","journal-title":"IEEE Intell. Syst."},{"key":"B21","doi-asserted-by":"crossref","unstructured":"\u201cMessage understanding conference- 6: A brief history,\u201d GrishmanR. SundheimB. COLING 1996 Volume 1: The 16th International Conference on Computational Linguistics1996","DOI":"10.3115\/992628.992709"},{"key":"B22","doi-asserted-by":"publisher","first-page":"672","DOI":"10.1038\/s41591-020-0869-5","article-title":"Temporal dynamics in viral shedding and transmissibility of COVID-19","volume":"26","author":"He","year":"2020","journal-title":"Nat. Med."},{"key":"B23","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1145\/2339530.2339723","article-title":"\u201cRolX: structural role extraction & mining in large graphs,\u201d","author":"Henderson","year":"2012","journal-title":"Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining"},{"key":"B24","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1145\/2020408.2020512","article-title":"\u201cIt's who you know: graph mining using recursive structural features,\u201d","author":"Henderson","year":"2011","journal-title":"Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining"},{"key":"B25","doi-asserted-by":"publisher","first-page":"e26726","DOI":"10.7554\/eLife.26726.017","article-title":"Systematic integration of biomedical knowledge prioritizes drugs for repurposing","volume":"6","author":"Himmelstein","year":"2017","journal-title":"Elife."},{"key":"B26","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1126\/science.aaa8685","article-title":"Advances in natural language processing","volume":"349","author":"Hirschberg","year":"2015","journal-title":"Science."},{"key":"B27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3447772","article-title":"Knowledge graphs","volume":"54","author":"Hogan","year":"2021","journal-title":"ACM."},{"key":"B28","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-1-4614-1767-5_1","article-title":"\u201cThe joy of data-a cookbook for publishing linked government data on the web,\u201d","volume-title":"Linking Government Data","author":"Hyland","year":"2011"},{"key":"B29","unstructured":"IoannidisV. N. SongX. ManchandaS. LiM. PanX. ZhengD. 35246025DRKG - Drug Repurposing Knowledge Graph for COVID-192020"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1145\/3340531.3412685","article-title":"\u201cOctober. AliMeKG: Domain knowledge graph construction and application in e-commerce,\u201d","author":"Li","year":"2020","journal-title":"Proceedings of the 29th ACM International Conference on Information & Knowledge Management"},{"key":"B31","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-17140-6_29","article-title":"\u201cAttacKG: constructing technique knowledge graph from cyber threat intelligence reports,\u201d","volume-title":"European Symposium on Research in Computer Security.","author":"Li","year":"2022"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1471-2334-11-128","article-title":"Knowledge, attitudes and practices (KAP) related to the pandemic (H1N1) 2009 among Chinese general population: a telephone survey","volume":"11","author":"Lin","year":"2011","journal-title":"BMC Infect. Dis."},{"key":"B33","first-page":"265","article-title":"Medical subject headings (MeSH)","volume":"88","author":"Lipscomb","year":"2000","journal-title":"Bullet. Med. Library Assoc"},{"key":"B34","doi-asserted-by":"publisher","first-page":"2901","DOI":"10.1609\/aaai.v34i03.5681","article-title":"\u201cK-bert: Enabling language representation with knowledge graph,\u201d","author":"Liu","year":"2020","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"B35","doi-asserted-by":"publisher","first-page":"9202457","DOI":"10.1155\/2019\/9202457","article-title":"Anticipating stock market of the renowned companies: a knowledge graph approach","volume":"2019","author":"Liu","year":"2019","journal-title":"Complexity."},{"key":"B36","unstructured":"\u201cMulti-task identification of entities, relations, and conference for scientific knowledge graph construction,\u201d32193232 LuanY. HeL. OstendorfM. HajishirziH. BrusselsAssociation for Computational LinguisticsProceedings of the 2018 Conference on Empirical Methods in Natural Language Processing2018"},{"key":"B37","doi-asserted-by":"publisher","first-page":"1033","DOI":"10.1016\/S0140-6736(20)30628-0","article-title":"COVID-19: consider cytokine storm syndromes and immunosuppression","volume":"395","author":"Mehta","year":"2020","journal-title":"Lancet."},{"key":"B38","first-page":"294","article-title":"\u201cCovid-on-the-Web: Knowledge graph and services to advance COVID-19 research. In The Semantic Web\u2013ISWC 2020:19th International Semantic Web Conference, Athens, Greece, November 2\u20136, 2020,\u201d","volume-title":"Proceedings, Part II 19","author":"Michel","year":"2020"},{"key":"B39","doi-asserted-by":"publisher","first-page":"e66344","DOI":"10.1371\/journal.pone.0066344","article-title":"Keywords and co-occurrence patterns in the voynich manuscript: an information-theoretic analysis","volume":"8","author":"Montemurro","year":"2013","journal-title":"PLoS ONE."},{"volume-title":"Graph-Powered Machine Learning","year":"2021","author":"Negro","key":"B40"},{"volume-title":"Knowledge Graph Applied","year":"2023","author":"Negro","key":"B41"},{"key":"B42","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-10587-1_1","article-title":"\u201cIntroduction to linked data and its lifecycle on the web,\u201d","volume-title":"Reasoning Web. Reasoning on the Web in the Big Data Era. Reasoning Web 2014. Lecture Notes in Computer Science, Vol. 8714","author":"Ngomo","year":"2014"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1101\/2020.02.28.20029272","article-title":"Closed environments facilitate secondary transmission of coronavirus disease 2019 (COVID-19)","author":"Nishiura","year":"2020","journal-title":"medRxiv [Preprint]"},{"key":"B44","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1038\/srep00551","article-title":"The evolution of interdisciplinarity in physics research","volume":"2","author":"Pan","year":"2012","journal-title":"Sci. Rep."},{"key":"B45","first-page":"2672","article-title":"\u201cDecember. Semantic property graph for scalable knowledge graph analytics,\u201d in 2021 IEEE International Conference on Big Data (Big Data)","author":"Purohit","year":"2021"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2006.10637","article-title":"Temporal graph networks for deep learning on dynamic graphs","author":"Rossi","year":"2020","journal-title":"arXiv"},{"key":"B47","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1145\/2187980.2188234","article-title":"\u201cRole-Dynamics: Fast Mining of Large Dynamic Networks,\u201d","author":"Rossi","year":"2012","journal-title":"Proceedings of the 21st International Conference on World Wide Web"},{"key":"B48","article-title":"\u201cSemantic relation discovery by using co-occurrence information,\u201d","volume-title":"4th Workshop on Building and Evaluating Resources for Health and Biomedical Text Processing (BioTxtM 2014), held at the Ninth International Conference on Language Resources and Evaluation","author":"Schulz","year":"2014"},{"key":"B49","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1038\/s41586-020-2179-y","article-title":"Structural basis of receptor recognition by SARS-CoV-2","volume":"581","author":"Shang","year":"2020","journal-title":"Nature."},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1126\/scitranslmed.aal3653","article-title":"Broad-spectrum antiviral GS-5734 inhibits both epidemic and zoonotic coronaviruses","author":"Sheahan","year":"2017","journal-title":"Sci. Transl. Med"},{"key":"B51","doi-asserted-by":"publisher","first-page":"2498957","DOI":"10.1155\/2017\/2498957","article-title":"miRNA-disease association prediction with collaborative matrix factorization","volume":"2017","author":"Shen","year":"2017","journal-title":"Complexity."},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0084639","article-title":"Discovering implicit entity relation with the gene-citation-gene network","author":"Song","year":"2013","journal-title":"PLoS ONE"},{"key":"B53","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1007\/s11192-010-0259-8","article-title":"Mapping knowledge structure by keyword co-occurrence: a first look at journal papers in technology foresight","volume":"85","author":"Su","year":"2010","journal-title":"Scientometrics."},{"key":"B54","first-page":"205","article-title":"\u201cBuilding and using a knowledge graph to combat human trafficking,\u201d","volume-title":"International Semantic Web Conference","author":"Szekely","year":"2015"},{"key":"B55","first-page":"693","article-title":"Dexamethasone in hospitalized patients with COVID-19\u2014preliminary report","volume":"84","year":"2020","journal-title":"N. Engl. J. Med"},{"key":"B56","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1007\/978-1-4614-1767-5_2","article-title":"Methodological guidelines for publishing government linked data","author":"Villaz\u00f3n-Terrazas","year":"2011","journal-title":"Linking Gov. Data."},{"key":"B57","doi-asserted-by":"crossref","unstructured":"WahltinezO. CheungA. AlcantaraR. CheungD. DaswaniM. ErlingerA. 35413965COVID-19 Open-Data a Global-Scale Spatially Granular Meta-Dataset for Coronavirus Disease2022","DOI":"10.1038\/s41597-022-01263-z"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2004.10706","article-title":"CORD-19: The COVID-19 open research dataset","author":"Wang","year":"2020","journal-title":"arXiv [Preprint]."},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-demos.8","article-title":"COVID-19 literature knowledge graph construction and drug repurposing report generation","author":"Wang","year":"2020","journal-title":"arXiv"},{"key":"B61","article-title":"\u201cCOVID-19 knowledge graph: accelerating information retrieval and discovery for scientific literature,\u201d","author":"Wise","year":"2020","journal-title":"AACL-IJCNLP 2020 Workshop on Integrating Structured Knowledge and Neural Networks for NLP (KNLP)."},{"key":"B62","doi-asserted-by":"publisher","first-page":"1260","DOI":"10.1126\/science.abb2507","article-title":"Cryo-EM structure of the 2019-nCoV spike in the prefusion conformation","volume":"367","author":"Wrapp","year":"2020","journal-title":"Science."},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.1145\/3336191.3371778","article-title":"\u201cProduct knowledge graph embedding for e-commerce,\u201d","author":"Xu","year":"2020","journal-title":"Proceedings of the 13th International Conference on Web Search and Data Mining"},{"key":"B64","doi-asserted-by":"publisher","first-page":"659","DOI":"10.1007\/s11192-011-0541-4","article-title":"Integration of three visualization methods based on co-word analysis","volume":"90","author":"Yang","year":"2011","journal-title":"Scientometrics."},{"key":"B65","doi-asserted-by":"crossref","first-page":"1006","DOI":"10.1145\/3394486.3403143","article-title":"\u201cImproving conversational recommender systems via knowledge graph based semantic fusion,\u201d","volume-title":"Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & amp; Data Mining (KDD '20)","author":"Zhou","year":"2020"},{"key":"B66","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1038\/s41586-020-2548-6","article-title":"Potently neutralizing and protective human antibodies against SARS-CoV-2","volume":"584","author":"Zost","year":"2020","journal-title":"Nature."}],"container-title":["Frontiers in Research Metrics and Analytics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2023.1204801\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T17:30:43Z","timestamp":1729877443000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frma.2023.1204801\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,3]]},"references-count":65,"alternative-id":["10.3389\/frma.2023.1204801"],"URL":"https:\/\/doi.org\/10.3389\/frma.2023.1204801","relation":{},"ISSN":["2504-0537"],"issn-type":[{"type":"electronic","value":"2504-0537"}],"subject":[],"published":{"date-parts":[[2023,8,3]]},"article-number":"1204801"}}