{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,14]],"date-time":"2026-11-14T19:19:22Z","timestamp":1794683962114,"version":"4.9.1"},"reference-count":33,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2024,3,26]],"date-time":"2024-03-26T00:00:00Z","timestamp":1711411200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004329","name":"Slovenian Research Agency","doi-asserted-by":"publisher","award":["H017002"],"award-info":[{"award-number":["H017002"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Young Researchers grant"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,5,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Objectives<\/jats:title>\n                  <jats:p>This study focuses on refining temporal relation extraction within medical documents by introducing an innovative bimodal architecture. The overarching goal is to enhance our understanding of narrative processes in the medical domain, particularly through the analysis of extensive reports and notes concerning patient experiences.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and Methods<\/jats:title>\n                  <jats:p>Our approach involves the development of a bimodal architecture that seamlessly integrates information from both text documents and knowledge graphs. This integration serves to infuse common knowledge about events into the temporal relation extraction process. Rigorous testing was conducted on diverse clinical datasets, emulating real-world scenarios where the extraction of temporal relationships is paramount.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The performance of our proposed bimodal architecture was thoroughly evaluated across multiple clinical datasets. Comparative analyses demonstrated its superiority over existing methods reliant solely on textual information for temporal relation extraction. Notably, the model showcased its effectiveness even in scenarios where not provided with additional information.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Discussion<\/jats:title>\n                  <jats:p>The amalgamation of textual data and knowledge graph information in our bimodal architecture signifies a notable advancement in the field of temporal relation extraction. This approach addresses the critical need for a more profound understanding of narrative processes in medical contexts.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusion<\/jats:title>\n                  <jats:p>In conclusion, our study introduces a pioneering bimodal architecture that harnesses the synergy of text and knowledge graph data, exhibiting superior performance in temporal relation extraction from medical documents. This advancement holds significant promise for improving the comprehension of patients\u2019 healthcare journeys and enhancing the overall effectiveness of extracting temporal relationships in complex medical narratives.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/jamia\/ocae059","type":"journal-article","created":{"date-parts":[[2024,3,27]],"date-time":"2024-03-27T02:25:11Z","timestamp":1711506311000},"page":"1380-1387","source":"Crossref","is-referenced-by-count":12,"title":["Multimodal learning for temporal relation extraction in clinical texts"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7506-5739","authenticated-orcid":false,"given":"Timotej","family":"Knez","sequence":"first","affiliation":[{"name":"Faculty of Computer and Information Science, University of Ljubljana , Ljubljana 1000, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Slavko","family":"\u017ditnik","sequence":"additional","affiliation":[{"name":"Faculty of Computer and Information Science, University of Ljubljana , Ljubljana 1000, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2024,3,26]]},"reference":[{"key":"2024052019462166100_ocae059-B1","doi-asserted-by":"crossref","first-page":"104347","DOI":"10.1016\/j.jbi.2023.104347","article-title":"Contextualized medication event extraction with levitated markers","volume":"141","author":"Vasilakes","journal-title":"J Biomed Inform"},{"key":"2024052019462166100_ocae059-B2","doi-asserted-by":"crossref","first-page":"103784","DOI":"10.1016\/j.jbi.2021.103784","article-title":"Review of temporal reasoning in the clinical domain for timeline extraction: where we are and where we need to be","volume":"118","author":"Olex","journal-title":"J Biomed Inform"},{"key":"2024052019462166100_ocae059-B3","first-page":"841","author":"Ning","year":"2018"},{"key":"2024052019462166100_ocae059-B4","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1613\/jair.1.11727","article-title":"A survey on temporal reasoning for temporal information extraction from text","volume":"66","author":"Leeuwenberg","year":"2019","journal-title":"JAIR"},{"issue":"5","key":"2024052019462166100_ocae059-B5","doi-asserted-by":"crossref","first-page":"806","DOI":"10.1136\/amiajnl-2013-001628","article-title":"Evaluating temporal relations in clinical text: 2012 i2b2 challenge","volume":"20","author":"Sun","year":"2013","journal-title":"J Am Med Inform Assoc"},{"key":"2024052019462166100_ocae059-B6","author":"Caufield","year":"2019"},{"key":"2024052019462166100_ocae059-B7","first-page":"1052","author":"Bethard","year":"2016"},{"key":"2024052019462166100_ocae059-B8","author":"Pustejovsky","year":"2003"},{"key":"2024052019462166100_ocae059-B9","first-page":"188","author":"Gaizauskas","year":"2006"},{"issue":"6","key":"2024052019462166100_ocae059-B10","doi-asserted-by":"crossref","first-page":"1681","DOI":"10.1016\/j.ipm.2007.01.008","article-title":"Exploiting aspectual features and connecting words for summarization-inspired temporal-relation extraction","volume":"43","author":"Dorr","year":"2007","journal-title":"Inf Process Manage"},{"issue":"Suppl","key":"2024052019462166100_ocae059-B11","doi-asserted-by":"crossref","first-page":"S54","DOI":"10.1016\/j.jbi.2013.09.007","article-title":"Tempting system: a hybrid method of rule and machine learning for temporal relation extraction in patient discharge summaries","volume":"46","author":"Chang","year":"2013","journal-title":"J Biomed Inform"},{"key":"2024052019462166100_ocae059-B12","first-page":"753","author":"Mani","year":"2006"},{"key":"2024052019462166100_ocae059-B13","first-page":"10","author":"Bethard","year":"2013"},{"issue":"2","key":"2024052019462166100_ocae059-B14","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1093\/jamia\/ocv113","article-title":"Multilayered temporal modeling for the clinical domain","volume":"23","author":"Lin","year":"2016","journal-title":"J Am Med Inform Assoc"},{"key":"2024052019462166100_ocae059-B15","first-page":"224","author":"Tourille","year":"2017"},{"key":"2024052019462166100_ocae059-B16","first-page":"1","author":"Cheng","year":"2017"},{"key":"2024052019462166100_ocae059-B17","first-page":"1237","author":"Leeuwenberg","year":"2018"},{"key":"2024052019462166100_ocae059-B18","first-page":"65","author":"Lin","year":"2019"},{"key":"2024052019462166100_ocae059-B19","author":"Zhou","year":"2021"},{"key":"2024052019462166100_ocae059-B20","author":"Lin","year":"2021"},{"key":"2024052019462166100_ocae059-B21","first-page":"6203","author":"Ning","year":"2019"},{"key":"2024052019462166100_ocae059-B22","doi-asserted-by":"crossref","first-page":"104415","DOI":"10.1016\/j.jbi.2023.104415","article-title":"Multimodal learning on graphs for disease relation extraction","volume":"143","author":"Lin","year":"2023","journal-title":"J Biomed Inform"},{"key":"2024052019462166100_ocae059-B23","first-page":"37309","article-title":"Deep bidirectional language-knowledge graph pretraining","volume":"35","author":"Yasunaga","year":"2022","journal-title":"Adv Neural Inf Process Syst"},{"key":"2024052019462166100_ocae059-B24","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.neucom.2022.01.096","article-title":"Knowledge graph informed fake news classification via heterogeneous representation ensembles","volume":"496","author":"Koloski","year":"2022","journal-title":"Neurocomputing"},{"issue":"Database issue","key":"2024052019462166100_ocae059-B25","doi-asserted-by":"crossref","first-page":"D267","DOI":"10.1093\/nar\/gkh061","article-title":"The unified medical language system (UMLS): integrating biomedical terminology","volume":"32","author":"Bodenreider","year":"2004","journal-title":"Nucleic Acids Res"},{"key":"2024052019462166100_ocae059-B26","first-page":"593","author":"Schlichtkrull","year":"2018"},{"key":"2024052019462166100_ocae059-B27","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1162\/tacl_a_00172","article-title":"Temporal annotation in the clinical domain","volume":"2","author":"Styler","year":"2014","journal-title":"TACL"},{"key":"2024052019462166100_ocae059-B28","author":"Caufield","year":"2020"},{"key":"2024052019462166100_ocae059-B29","author":"Ul Haq","year":"2022"},{"key":"2024052019462166100_ocae059-B30","doi-asserted-by":"crossref","first-page":"103309","DOI":"10.1016\/j.jbi.2019.103309","article-title":"Associative attention networks for temporal relation extraction from electronic health records","volume":"99","author":"Zhao","journal-title":"J Biomed Inform"},{"key":"2024052019462166100_ocae059-B31","first-page":"103","author":"Wang","year":"2022"},{"key":"2024052019462166100_ocae059-B32","first-page":"3436","author":"Leeuwenberg"},{"issue":"Suppl 0","key":"2024052019462166100_ocae059-B33","doi-asserted-by":"crossref","first-page":"S5","DOI":"10.1016\/j.jbi.2013.07.004","article-title":"Annotating temporal information in clinical narratives","volume":"46","author":"Sun","year":"2013","journal-title":"J Biomed Inform"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/6\/1380\/57768956\/ocae059.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/31\/6\/1380\/57768956\/ocae059.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,20]],"date-time":"2024-05-20T19:47:03Z","timestamp":1716234423000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/31\/6\/1380\/7635381"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,26]]},"references-count":33,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,3,26]]},"published-print":{"date-parts":[[2024,5,20]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocae059","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,6,1]]},"published":{"date-parts":[[2024,3,26]]}}}