{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T13:39:15Z","timestamp":1777815555017,"version":"3.51.4"},"reference-count":30,"publisher":"Walter de Gruyter GmbH","issue":"2","license":[{"start":{"date-parts":[[2022,4,25]],"date-time":"2022-04-25T00:00:00Z","timestamp":1650844800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,5,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Given the information overload of scientific literature, there is an increasing need for computable biomedical knowledge buried in free text. This study aimed to develop a novel approach to extracting and measuring uncertain biomedical knowledge from scientific statements.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design\/methodology\/approach<\/jats:title>\n                    <jats:p>Taking cardiovascular research publications in China as a sample, we extracted subject\u2013predicate\u2013object triples (SPO triples) as knowledge units and unknown\/hedging\/conflicting uncertainties as the knowledge context. We introduced information entropy (IE) as potential metric to quantify the uncertainty of epistemic status of scientific knowledge represented at subject-object pairs (SO pairs) levels.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Findings<\/jats:title>\n                    <jats:p>The results indicated an extraordinary growth of cardiovascular publications in China while only a modest growth of the novel SPO triples. After evaluating the uncertainty of biomedical knowledge with IE, we identified the Top 10 SO pairs with highest IE, which implied the epistemic status pluralism. Visual presentation of the SO pairs overlaid with uncertainty provided a comprehensive overview of clusters of biomedical knowledge and contending topics in cardiovascular research.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Research limitations<\/jats:title>\n                    <jats:p>The current methods didn\u2019t distinguish the specificity and probabilities of uncertainty cue words. The number of sentences surrounding a given triple may also influence the value of IE.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Practical implications<\/jats:title>\n                    <jats:p>Our approach identified major uncertain knowledge areas such as diagnostic biomarkers, genetic polymorphism and co-existing risk factors related to cardiovascular diseases in China. These areas are suggested to be prioritized; new hypotheses need to be verified, while disputes, conflicts, and contradictions need to be settled.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Originality\/value<\/jats:title>\n                    <jats:p>We provided a novel approach by combining natural language processing and computational linguistics with informetric methods to extract and measure uncertain knowledge from scientific statements.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.2478\/jdis-2022-0008","type":"journal-article","created":{"date-parts":[[2022,4,25]],"date-time":"2022-04-25T20:42:10Z","timestamp":1650919330000},"page":"6-30","source":"Crossref","is-referenced-by-count":3,"title":["Extracting and Measuring Uncertain Biomedical Knowledge from Scientific Statements"],"prefix":"10.2478","volume":"7","author":[{"given":"Xin","family":"Guo","sequence":"first","affiliation":[{"name":"Department of Cardiology and Institute of Vascular Medicine , Peking University Third Hospital , Beijing , China"},{"name":"NHC Key Laboratory of Cardiovascular Molecular Biology and Regulatory Peptides , Beijing , China"},{"name":"Key Laboratory of Molecular Cardiovascular Science, Ministry of Education , Beijing , China"},{"name":"Beijing Key Laboratory of Cardiovascular Receptors Research , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuming","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Epidemiology and Biostatistics, School of Public Health , Peking University , Beijing , China"},{"name":"Medical Informatics Center , Peking University , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Du","sequence":"additional","affiliation":[{"name":"Key Laboratory of Molecular Cardiovascular Science, Ministry of Education , Beijing , China"},{"name":"National Institute of Health Data Science , Peking University , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erdan","family":"Dong","sequence":"additional","affiliation":[{"name":"Department of Cardiology and Institute of Vascular Medicine , Peking University Third Hospital , Beijing , China"},{"name":"NHC Key Laboratory of Cardiovascular Molecular Biology and Regulatory Peptides , Beijing , China"},{"name":"Key Laboratory of Molecular Cardiovascular Science, Ministry of Education , Beijing , China"},{"name":"Beijing Key Laboratory of Cardiovascular Receptors Research , Beijing , China"},{"name":"Institute of Cardiovascular Sciences , Peking University , Beijing , China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","published-online":{"date-parts":[[2022,4,25]]},"reference":[{"key":"2026042921120481055_j_jdis-2022-0008_ref_001","doi-asserted-by":"crossref","unstructured":"Bornmann, L., Wray, K.B., & Haunschild, R. (2020). Citation concept analysis (CCA): a new form of citation analysis revealing the usefulness of concepts for other researchers illustrated by exemplary case studies including classic books by Thomas S. Kuhn and Karl R. Popper. Scientometrics, 122(2), 1051\u20131074. doi:10.1007\/s11192-019-03326-2","DOI":"10.1007\/s11192-019-03326-2"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_002","doi-asserted-by":"crossref","unstructured":"Chen, C. (2020). A Glimpse of the First Eight Months of the COVID-19 Literature on Microsoft Academic Graph: Themes, Citation Contexts, and Uncertainties. Frontiers in Research Metrics and Analytics, 5, 607286\u2013607286. doi:10.3389\/frma.2020.607286","DOI":"10.3389\/frma.2020.607286"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_003","doi-asserted-by":"crossref","unstructured":"Chen, C., Song, M., & Heo, G.E. (2018). A scalable and adaptive method for finding semantically equivalent cue words of uncertainty. Journal of Informetrics, 12(1), 158\u2013180. doi:10.1016\/j.joi.2017.12.004","DOI":"10.1016\/j.joi.2017.12.004"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_004","doi-asserted-by":"crossref","unstructured":"Chen, C., & Song, M. (2017). Visual Analytic Observatory of Scientific Knowledge. In: Representing Scientific Knowledge. Springer, Cham. doi:10.1007\/978-3-319-62543-0_9","DOI":"10.1007\/978-3-319-62543-0_9"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_005","doi-asserted-by":"crossref","unstructured":"Elkin, P.L., Carter, J.S., Nabar, M., Tuttle, M., Lincoln, M., & Brown, S.H. (2011). Drug knowledge expressed as computable semantic triples. Stud Health Technol Inform, 166, 38\u201347. doi:10.3233\/978-1-60750-740-6-38","DOI":"10.3233\/978-1-60750-740-6-38"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_006","doi-asserted-by":"crossref","unstructured":"Elsworth, B., & Gaunt, T.R. (2021). MELODI Presto: a fast and agile tool to explore semantic triples derived from biomedical literature. Bioinformatics, 37(4), 583\u2013585. doi:10.1093\/bioinformatics\/btaa726","DOI":"10.1093\/bioinformatics\/btaa726"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_007","doi-asserted-by":"crossref","unstructured":"Fabris, E., Kuhn, T., & Silvello, G. (2019). A Framework for Citing Nanopublications. In: Doucet, A., Isaac, A., Golub, K., Aalberg, T., Jatowt, A. (eds) Digital Libraries for Open Knowledge. TPDL 2019. Lecture Notes in Computer Science, vol 11799. Springer, Cham. doi:10.1007\/978-3-030-30760-8_6","DOI":"10.1007\/978-3-030-30760-8_6"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_008","doi-asserted-by":"crossref","unstructured":"Fabris, E., Kuhn, T., & Silvello, G. (2020). Nanocitation: Complete and Interoperable Citations of Nanopublications. In: Ceci, M., Ferilli, S., Poggi, A. (eds) Digital Libraries: The Era of Big Data and Data Science. IRCDL 2020. Communications in Computer and Information Science, vol 1177. Springer, Cham. doi:10.1007\/978-3-030-39905-4_18","DOI":"10.1007\/978-3-030-39905-4_18"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_009","unstructured":"Vol. 1177 CCIS. Communications in Computer and Information Science (pp. 182\u2013187)."},{"key":"2026042921120481055_j_jdis-2022-0008_ref_010","doi-asserted-by":"crossref","unstructured":"Flynn, A.J., Friedman, C.P., Boisvert, P., Landis-Lewis, Z., & Lagoze, C. (2018). The Knowledge Object Reference Ontology (KORO): A formalism to support management and sharing of computable biomedical knowledge for learning health systems. Learn Health Syst, 2(2), e10054. doi:10.1002\/lrh2.10054","DOI":"10.1002\/lrh2.10054"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_011","doi-asserted-by":"crossref","unstructured":"Fortunato, S., Bergstrom, C.T., Boerner, K., Evans, J.A., Helbing, D., Milojevic, S., . . . Barabasi, A.-L. (2018). Science of science. Science, 359(6379). doi:10.1126\/science.aao0185","DOI":"10.1126\/science.aao0185"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_012","doi-asserted-by":"crossref","unstructured":"Friedman, C.P., & Flynn, A.J. (2019). Computable knowledge: An imperative for Learning Health Systems. Learn Health Syst, 3(4), e10203. doi:10.1002\/lrh2.10203","DOI":"10.1002\/lrh2.10203"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_013","doi-asserted-by":"crossref","unstructured":"Groth, P., Gibson, A., & Velterop, J. (2010). The anatomy of a nanopublication. Information Services and Use, 30(1\u20132), 51\u201356. doi:10.3233\/ISU-2010-0613","DOI":"10.3233\/ISU-2010-0613"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_014","doi-asserted-by":"crossref","unstructured":"Guo, X., Chen, Y., Du, J., & Dong, E. (2022). 259067 Subject-Predicate-Object triples extracted from scientific documents regarding cardiovascular research in China during 2000\u20132020. V2. Science Data Bank. [2022-04-01]. doi:10.11922\/sciencedb.01660","DOI":"10.11922\/sciencedb.01660"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_015","doi-asserted-by":"crossref","unstructured":"Herrera-perez, D., Haslam, A., Crain, T., Gill, J., Livingston, C., Kaestner, V., . . . Prasad, V. (2019). A comprehensive review of randomized clinical trials in three medical journals reveals 396 medical reversals. ELIFE, 8. doi:10.7554\/eLife.45183","DOI":"10.7554\/eLife.45183"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_016","doi-asserted-by":"crossref","unstructured":"Kilicoglu, H., Rosemblat, G., Fiszman, M., & Shin, D. (2020). Broad-coverage biomedical relation extraction with SemRep. BMC Bioinformatics, 21(1), 188. doi:10.1186\/s12859-020-3517-7","DOI":"10.1186\/s12859-020-3517-7"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_017","doi-asserted-by":"crossref","unstructured":"Kilicoglu, H., Rosemblat, G., & Rindflesch, T.C. (2017). Assigning factuality values to semantic relations extracted from biomedical research literature. PLoS One, 12(7), e0179926. doi:10.1371\/journal.pone.0179926","DOI":"10.1371\/journal.pone.0179926"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_018","doi-asserted-by":"crossref","unstructured":"Kilicoglu, H., Shin, D., Fiszman, M., Rosemblat, G., & Rindflesch, T.C. (2012). SemMedDB: a PubMed-scale repository of biomedical semantic predications. Bioinformatics, 28(23), 3158\u20133160. doi:10.1093\/bioinformatics\/bts591","DOI":"10.1093\/bioinformatics\/bts591"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_019","doi-asserted-by":"crossref","unstructured":"Li, X., Peng, S., & Du, J. (2021). Towards medical knowmetrics: representing and computing medical knowledge using semantic predications as the knowledge unit and the uncertainty as the knowledge context. Scientometrics, 1\u201327. doi:10.1007\/s11192-021-03880-8","DOI":"10.1007\/s11192-021-03880-8"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_020","unstructured":"Malec, S.A., & Boyce, R.D. (2020). Exploring Novel Computable Knowledge in Structured Drug Product Labels. AMIA Jt Summits Transl Sci Proc, 2020, 403\u2013412."},{"key":"2026042921120481055_j_jdis-2022-0008_ref_021","doi-asserted-by":"crossref","unstructured":"Mons, B. (2019). FAIR Science for Social Machines: Let's Share Metadata Knowlets in the Internet of FAIR Data and Services. Data Intelligence, 1(1), 22\u201342. doi:10.1162\/dint_a_00002","DOI":"10.1162\/dint_a_00002"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_022","doi-asserted-by":"crossref","unstructured":"Mons, B., van Haagen, H., Chichester, C., t Hoen, P.-B., den Dunnen, J.T., van Ommen, G., . . . Schultes, E. (2011). The value of data. Nature Genetics, 43(4), 281\u2013283. doi:10.1038\/ng0411-281","DOI":"10.1038\/ng0411-281"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_023","unstructured":"Murray, D., Lamers, W., Boyack, K., Lariviere, V., Sugimoto, C.R., van Eck, N.J., & Waltman, L. (2019). Measuring disagreement in science. Proceedings of the 17th International Conference on Scientometrics & Informetrics (ISSI 2019), Vol. II."},{"key":"2026042921120481055_j_jdis-2022-0008_ref_024","doi-asserted-by":"crossref","unstructured":"Rindflesch, T.C., & Fiszman, M. (2003). The interaction of domain knowledge and linguistic structure in natural language processing: Interpreting hypernymic propositions in biomedical text. Journal of Biomedical Informatics, 36(6), 462\u2013477. doi:10.1016\/j.jbi.2003.11.003","DOI":"10.1016\/j.jbi.2003.11.003"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_025","doi-asserted-by":"crossref","unstructured":"Simpkin, A.L., & Schwartzstein, R.M. (2016). Tolerating Uncertainty\u2014The Next Medical Revolution? New England Journal of Medicine, 375(18), 1713\u20131715. doi:10.1056\/NEJMp1606402","DOI":"10.1056\/NEJMp1606402"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_026","doi-asserted-by":"crossref","unstructured":"Small, H. (2020). Past as prologue: Approaches to the study of confirmation in science. Quantitative Science Studies, 1(3), 1025\u20131040. doi:10.1162\/qss_a_00063","DOI":"10.1162\/qss_a_00063"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_027","doi-asserted-by":"crossref","unstructured":"Szarvas, G., Vincze, V., Farkas, R., Mora, G., & Gurevych, I. (2012). Cross-genre and cross-domain detection of semantic uncertainty. Computational Linguistics, 38(2), 335\u2013367. doi:10.1162\/COLI_a_00098","DOI":"10.1162\/COLI_a_00098"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_028","doi-asserted-by":"crossref","unstructured":"van der Bles, A.M., van der Linden, S., Freeman, A.L.J., Mitchell, J., Galvao, A.B., Zaval, L., & Spiegelhalter, D.J. (2019). Communicating uncertainty about facts, numbers and science. Royal Society Open Science, 6(5). doi:10.1098\/rsos.181870","DOI":"10.1098\/rsos.181870"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_029","doi-asserted-by":"crossref","unstructured":"Williams, A.J., Harland, L., Groth, P., Pettifer, S., Chichester, C., Willighagen, E.L., . . . Mons, B. (2012). Open PHACTS: Semantic interoperability for drug discovery. Drug Discovery Today, 17(21\u201322), 1188\u20131198. doi:10.1016\/j.drudis.2012.05.016","DOI":"10.1016\/j.drudis.2012.05.016"},{"key":"2026042921120481055_j_jdis-2022-0008_ref_030","doi-asserted-by":"crossref","unstructured":"Wyatt, J., & Scott, P. (2020). Computable knowledge is the enemy of disease. BMJ Health Care Inform, 27(2). doi:10.1136\/bmjhci-2020-100200","DOI":"10.1136\/bmjhci-2020-100200"}],"container-title":["Journal of Data and Information Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.2478\/jdis-2022-0008\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.2478\/jdis-2022-0008\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T21:16:23Z","timestamp":1777497383000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.2478\/jdis-2022-0008\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,25]]},"references-count":30,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,4,25]]},"published-print":{"date-parts":[[2022,5,1]]}},"alternative-id":["10.2478\/jdis-2022-0008"],"URL":"https:\/\/doi.org\/10.2478\/jdis-2022-0008","relation":{},"ISSN":["2543-683X"],"issn-type":[{"value":"2543-683X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,25]]}}}