{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T10:44:12Z","timestamp":1776077052874,"version":"3.50.1"},"reference-count":149,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2021,9,17]],"date-time":"2021-09-17T00:00:00Z","timestamp":1631836800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Brazilian Government Agency Coordination for the Improvement of Higher Education Personnel"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2022,9,30]]},"abstract":"<jats:p>Unstructured data in electronic health records, represented by clinical texts, are a vast source of healthcare information because they describe a patient's journey, including clinical findings, procedures, and information about the continuity of care. The publication of several studies on temporal relation extraction from clinical texts during the last decade and the realization of multiple shared tasks highlight the importance of this research theme. Therefore, we propose a review of temporal relation extraction in clinical texts. We analyzed 105 articles and verified that relations between events and document creation time, a coarse temporality type, were addressed with traditional machine learning\u2013based models with few recent initiatives to push the state-of-the-art with deep learning\u2013based models. For temporal relations between entities (event and temporal expressions) in the document, factors such as dataset imbalance because of candidate pair generation and task complexity directly affect the system's performance. The state-of-the-art resides on attention-based models, with contextualized word representations being fine-tuned for temporal relation extraction. However, further experiments and advances in the research topic are required until real-time clinical domain applications are released. Furthermore, most of the publications mainly reside on the same dataset, hindering the need for new annotation projects that provide datasets for different medical specialties, clinical text types, and even languages.<\/jats:p>","DOI":"10.1145\/3462475","type":"journal-article","created":{"date-parts":[[2021,9,17]],"date-time":"2021-09-17T16:19:48Z","timestamp":1631895588000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["Temporal Relation Extraction in Clinical Texts"],"prefix":"10.1145","volume":"54","author":[{"given":"Yohan Bonescki","family":"Gumiel","sequence":"first","affiliation":[{"name":"Graduate Program in Health Technology, Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba, Paran\u00e1, Brazil"}]},{"given":"Lucas Emanuel","family":"Silva e Oliveira","sequence":"additional","affiliation":[{"name":"Graduate Program in Health Technology, Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba, Paran\u00e1, Brazil"}]},{"given":"Vincent","family":"Claveau","sequence":"additional","affiliation":[{"name":"IRISA - CRNS, Universit\u00e9 de Rennes 1, Rennes, Rennes, France"}]},{"given":"Natalia","family":"Grabar","sequence":"additional","affiliation":[{"name":"CRNS, Univ. Lille, Lille, 59000 Lille, France"}]},{"given":"Emerson Cabrera","family":"Paraiso","sequence":"additional","affiliation":[{"name":"Graduate Program in Informatics, Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba, Paran\u00e1, Brazil"}]},{"given":"Claudia","family":"Moro","sequence":"additional","affiliation":[{"name":"Graduate Program in Health Technology, Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba, Paran\u00e1, Brazil"}]},{"given":"Deborah Ribeiro","family":"Carvalho","sequence":"additional","affiliation":[{"name":"Graduate Program in Health Technology, Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba, Paran\u00e1, Brazil"}]}],"member":"320","published-online":{"date-parts":[[2021,9,17]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1038\/nrg3208"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.13063\/2327-9214.1079"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2017.11.011"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2017.07.012"},{"key":"e_1_2_1_5_1","volume-title":"Recent advances in clinical natural language processing in support of semantic analysis. Yearbook of medical informatics 10","author":"Velupillai Sumithra","year":"2015","unstructured":"Sumithra Velupillai , Danielle Mowery , Brett South , Maria Kvist , and Hercules Dalianis . 2015. Recent advances in clinical natural language processing in support of semantic analysis. Yearbook of medical informatics 10 ( 2015 ), 183\u201393. DOI:https:\/\/doi.org\/10.15265\/IY-2015-009 10.15265\/IY-2015-009 Sumithra Velupillai, Danielle Mowery, Brett South, Maria Kvist, and Hercules Dalianis. 2015. Recent advances in clinical natural language processing in support of semantic analysis. Yearbook of medical informatics 10 (2015), 183\u201393. DOI:https:\/\/doi.org\/10.15265\/IY-2015-009"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00172"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2013.11.001"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.2196\/12239"},{"key":"e_1_2_1_9_1","volume-title":"Noncommunicable Diseases: Progress Monitor","author":"World Health Organization","year":"2020","unstructured":"World Health Organization . 2020 . Noncommunicable Diseases: Progress Monitor 2020. World Health Organization . vi, 224 pages. World Health Organization. 2020. Noncommunicable Diseases: Progress Monitor 2020. World Health Organization. vi, 224 pages."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/182.358434"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001635"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocv113"},{"key":"e_1_2_1_13_1","volume-title":"C","author":"Leaman Robert","year":"2015","unstructured":"Robert Leaman , Ritu Khare , and Zhiyong Lu. 2015. Challenges in clinical natural language processing for automated disorder normalization. Journal of Biomedical Informatics 57 , C ( 2015 ), 28\u201337. DOI:https:\/\/doi.org\/10.1016\/j.jbi.2015.07.010 10.1016\/j.jbi.2015.07.010 Robert Leaman, Ritu Khare, and Zhiyong Lu. 2015. Challenges in clinical natural language processing for automated disorder normalization. Journal of Biomedical Informatics 57, C (2015), 28\u201337. DOI:https:\/\/doi.org\/10.1016\/j.jbi.2015.07.010"},{"key":"e_1_2_1_14_1","volume-title":"Hurdle","author":"Meystre Stephane M.","year":"2008","unstructured":"Stephane M. Meystre , Guergana K. Savova , Karin C. Kipper-Schuler , and John F . Hurdle . 2008 . Extracting information from textual documents in the electronic health record: A review of recent research. Yearbook of Medical Informatics ( 2008), 128\u2013144. Stephane M. Meystre, Guergana K. Savova, Karin C. Kipper-Schuler, and John F. Hurdle. 2008. Extracting information from textual documents in the electronic health record: A review of recent research. Yearbook of Medical Informatics (2008), 128\u2013144."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001628"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S15-2136"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1165"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2093"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1000097"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001760"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2020.103488"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC\u201910)","author":"Pustejovsky James","year":"2010","unstructured":"James Pustejovsky , Kiyong Lee , Harry Bunt , and Laurent Romary . 2010 . ISO-TimeML: An international standard for semantic annotation . In Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC\u201910) . European Language Resources Association (ELRA), Valletta, Malta, 394\u2013397. James Pustejovsky, Kiyong Lee, Harry Bunt, and Laurent Romary. 2010. ISO-TimeML: An international standard for semantic annotation. In Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC\u201910). European Language Resources Association (ELRA), Valletta, Malta, 394\u2013397."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2013.09.010"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-005-7882-7"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-005-7884-5"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. The COLING 2016 Organizing Committee","author":"Derczynski Leon","year":"2016","unstructured":"Leon Derczynski . 2016 . Representation and learning of temporal relations . In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. The COLING 2016 Organizing Committee , Osaka, Japan , 1937\u20131948. Leon Derczynski. 2016. Representation and learning of temporal relations. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers. The COLING 2016 Organizing Committee, Osaka, Japan, 1937\u20131948."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.5555\/2018966.2018985"},{"key":"e_1_2_1_28_1","first-page":"16","volume-title":"Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval\u201916)","author":"Khalifa Abdulrahman","year":"2016","unstructured":"Abdulrahman Khalifa , Sumithra Velupillai , and Stephane Meystre . 2016 . UtahBMI at SemEval-2016 Task 12: Extracting temporal information from clinical text . In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval\u201916) . Association for Computational Linguistics, San Diego, California, 1256\u20131262. DOI:https:\/\/doi.org\/10. 18653\/v1\/S 16 - 1195 10.18653\/v1 Abdulrahman Khalifa, Sumithra Velupillai, and Stephane Meystre. 2016. UtahBMI at SemEval-2016 Task 12: Extracting temporal information from clinical text. In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval\u201916). Association for Computational Linguistics, San Diego, California, 1256\u20131262. DOI:https:\/\/doi.org\/10.18653\/v1\/S16-1195"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1136\/jamia.2009.001560"},{"key":"e_1_2_1_30_1","volume-title":"Proceedings AMIA Symposium","author":"Aronson Alan R.","year":"2001","unstructured":"Alan R. Aronson . 2001 . Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program . Proceedings AMIA Symposium (2001), 17\u201321. Alan R. Aronson. 2001. Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program. Proceedings AMIA Symposium (2001), 17\u201321."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-2117"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2016.06.006"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 2013 Workshop on Biomedical Natural Language Processing. Association for Computational Linguistics","author":"Miller Timothy","year":"2013","unstructured":"Timothy Miller , Steven Bethard , Dmitriy Dligach , Sameer Pradhan , Chen Lin , and Guergana Savova . 2013 . Discovering temporal narrative containers in clinical text . In Proceedings of the 2013 Workshop on Biomedical Natural Language Processing. Association for Computational Linguistics , Sofia, Bulgaria, 18\u201326. Timothy Miller, Steven Bethard, Dmitriy Dligach, Sameer Pradhan, Chen Lin, and Guergana Savova. 2013. Discovering temporal narrative containers in clinical text. In Proceedings of the 2013 Workshop on Biomedical Natural Language Processing. Association for Computational Linguistics, Sofia, Bulgaria, 18\u201326."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-2014"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s41666-019-00049-0"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-2303"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-5026"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-018-0627-5"},{"key":"e_1_2_1_39_1","first-page":"1","article-title":"Data-driven information extraction from Chinese electronic medical records","volume":"10","author":"Xu Dong","year":"2015","unstructured":"Dong Xu , Meizhuo Zhang , Tianwan Zhao , Chen Ge , Weiguo Gao , Jia Wei , and Kenny Q. Zhu . 2015 . Data-driven information extraction from Chinese electronic medical records . PLOS ONE 10 , 8 (2015), 1 \u2013 18 . DOI:https:\/\/doi.org\/10.1371\/journal.pone.0136270 10.1371\/journal.pone.0136270 Dong Xu, Meizhuo Zhang, Tianwan Zhao, Chen Ge, Weiguo Gao, Jia Wei, and Kenny Q. Zhu. 2015. Data-driven information extraction from Chinese electronic medical records. PLOS ONE 10, 8 (2015), 1\u201318. DOI:https:\/\/doi.org\/10.1371\/journal.pone.0136270","journal-title":"PLOS ONE"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2019.01.007"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0735-x"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2019.103985"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2016.10.021"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.4258\/hir.2018.24.3.179"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-014-0373-3"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2019.103219"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.08.013"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2020.101860"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10579-017-9382-y"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001612"},{"key":"e_1_2_1_51_1","first-page":"83","article-title":"Learning signals of adverse drug-drug interactions from the unstructured text of electronic health records","volume":"2013","author":"Iyer Srinivasan V.","year":"2013","unstructured":"Srinivasan V. Iyer , Paea Lependu , Rave Harpaz , Anna Bauer-Mehren , and Nigam H. Shah . 2013 . Learning signals of adverse drug-drug interactions from the unstructured text of electronic health records . AMIA Joint Summits on Translational Science Proceedings 2013 (2013), 83 \u2013 87 . Srinivasan V. Iyer, Paea Lependu, Rave Harpaz, Anna Bauer-Mehren, and Nigam H. Shah. 2013. Learning signals of adverse drug-drug interactions from the unstructured text of electronic health records. AMIA Joint Summits on Translational Science Proceedings 2013 (2013), 83\u201387.","journal-title":"AMIA Joint Summits on Translational Science Proceedings"},{"key":"e_1_2_1_52_1","first-page":"47","article-title":"Using temporal patterns in medical records to discern adverse drug events from indications","volume":"2012","author":"Liu Yi","year":"2012","unstructured":"Yi Liu , Paea Lependu , Srinivasan Iyer , and Nigam H. Shah . 2012 . Using temporal patterns in medical records to discern adverse drug events from indications . AMIA Joint Summits on Translational Science Proceedings 2012 (2012), 47 \u2013 56 . Yi Liu, Paea Lependu, Srinivasan Iyer, and Nigam H. Shah. 2012. Using temporal patterns in medical records to discern adverse drug events from indications. AMIA Joint Summits on Translational Science Proceedings 2012 (2012), 47\u201356.","journal-title":"AMIA Joint Summits on Translational Science Proceedings"},{"key":"e_1_2_1_53_1","first-page":"185","article-title":"A comparative study of different methods for automatic identification of clopidogrel-induced bleedings in electronic health records","volume":"2017","author":"Lee Hee-Jin","year":"2017","unstructured":"Hee-Jin Lee , Min Jiang , Yonghui Wu , Christian M. Shaffer , John H. Cleator , Eitan A. Friedman , Joshua P. Lewis , Dan M. Roden , Josh Denny , and Hua Xu . 2017 . A comparative study of different methods for automatic identification of clopidogrel-induced bleedings in electronic health records . AMIA Joint Summits on Translational Science Proceedings 2017 (2017), 185 \u2013 192 . Hee-Jin Lee, Min Jiang, Yonghui Wu, Christian M. Shaffer, John H. Cleator, Eitan A. Friedman, Joshua P. Lewis, Dan M. Roden, Josh Denny, and Hua Xu. 2017. A comparative study of different methods for automatic identification of clopidogrel-induced bleedings in electronic health records. AMIA Joint Summits on Translational Science Proceedings 2017 (2017), 185\u2013192.","journal-title":"AMIA Joint Summits on Translational Science Proceedings"},{"key":"e_1_2_1_54_1","volume-title":"AMIA Annual Symposium Proceedings 2013","author":"Bejan Cosmin A.","year":"2013","unstructured":"Cosmin A. Bejan , Lucy Vanderwende , Heather L. Evans , Mark M. Wurfel , and Meliha Yetisgen-Yildiz . 2013 . On-time clinical phenotype prediction based on narrative reports . AMIA Annual Symposium Proceedings 2013 (2013), 103\u2013110. Cosmin A. Bejan, Lucy Vanderwende, Heather L. Evans, Mark M. Wurfel, and Meliha Yetisgen-Yildiz. 2013. On-time clinical phenotype prediction based on narrative reports. AMIA Annual Symposium Proceedings 2013 (2013), 103\u2013110."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-002463"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2009.05.002"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIME.2006.27"},{"key":"e_1_2_1_58_1","volume-title":"Richard Tzong-Han Tsai, and Wen-Lian Hsu","author":"Chang Nai-Wen","year":"2015","unstructured":"Nai-Wen Chang , Hong-Jie Dai , Jitendra Jonnagaddala , Chih-Wei Chen , Richard Tzong-Han Tsai, and Wen-Lian Hsu . 2015 . A context-aware approach for progression tracking of medical concepts in electronic medical records. Journal of Biomedical Informatics 58, S (2015), S150\u2013S157. DOI:https:\/\/doi.org\/10.1016\/j.jbi.2015.09.013 10.1016\/j.jbi.2015.09.013 Nai-Wen Chang, Hong-Jie Dai, Jitendra Jonnagaddala, Chih-Wei Chen, Richard Tzong-Han Tsai, and Wen-Lian Hsu. 2015. A context-aware approach for progression tracking of medical concepts in electronic medical records. Journal of Biomedical Informatics 58, S (2015), S150\u2013S157. DOI:https:\/\/doi.org\/10.1016\/j.jbi.2015.09.013"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.09.002"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.06.030"},{"key":"e_1_2_1_61_1","first-page":"61","article-title":"A probabilistic reasoning method for predicting the progression of clinical findings from electronic medical records","volume":"2015","author":"Goodwin Travis","year":"2015","unstructured":"Travis Goodwin and Sanda M. Harabagiu . 2015 . A probabilistic reasoning method for predicting the progression of clinical findings from electronic medical records . AMIA Joint Summits on Translational Science Proceedings 2015 (2015), 61 \u2013 65 . Travis Goodwin and Sanda M. Harabagiu. 2015. A probabilistic reasoning method for predicting the progression of clinical findings from electronic medical records. AMIA Joint Summits on Translational Science Proceedings 2015 (2015), 61\u201365.","journal-title":"AMIA Joint Summits on Translational Science Proceedings"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.06.014"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1155\/2015\/636371"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.06.013"},{"key":"e_1_2_1_65_1","volume-title":"S","author":"Khalifa Abdulrahman","year":"2015","unstructured":"Abdulrahman Khalifa and St\u00e9phane Meystre . 2015. Adapting existing natural language processing resources for cardiovascular risk factors identification in clinical notes. Journal of Biomedical Informatics 58 , S ( 2015 ), S128\u2013S132. DOI:https:\/\/doi.org\/10.1016\/j.jbi.2015.08.002 10.1016\/j.jbi.2015.08.002 Abdulrahman Khalifa and St\u00e9phane Meystre. 2015. Adapting existing natural language processing resources for cardiovascular risk factors identification in clinical notes. Journal of Biomedical Informatics 58, S (2015), S128\u2013S132. DOI:https:\/\/doi.org\/10.1016\/j.jbi.2015.08.002"},{"key":"e_1_2_1_66_1","volume-title":"S","author":"Roberts Kirk","year":"2015","unstructured":"Kirk Roberts , Sonya E. Shooshan , Laritza Rodriguez , Swapna Abhyankar , Halil Kilicoglu , and Dina Demner-Fushman . 2015. The role of fine-grained annotations in supervised recognition of risk factors for heart disease from EHRs. Journal of Biomedical Informatics 58 , S ( 2015 ), S111\u2013S119. DOI:https:\/\/doi.org\/10.1016\/j.jbi.2015.06.010 10.1016\/j.jbi.2015.06.010 Kirk Roberts, Sonya E. Shooshan, Laritza Rodriguez, Swapna Abhyankar, Halil Kilicoglu, and Dina Demner-Fushman. 2015. The role of fine-grained annotations in supervised recognition of risk factors for heart disease from EHRs. Journal of Biomedical Informatics 58, S (2015), S111\u2013S119. DOI:https:\/\/doi.org\/10.1016\/j.jbi.2015.06.010"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.08.025"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.08.011"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.08.009"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.09.006"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2013.09.007"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001624"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2013.08.003"},{"key":"e_1_2_1_74_1","volume-title":"Knowledge-rich temporal relation identification and classification in clinical notes. Database 2014 (11","author":"D'Souza Jennifer","year":"2014","unstructured":"Jennifer D'Souza and Vincent Ng. 2014. Knowledge-rich temporal relation identification and classification in clinical notes. Database 2014 (11 2014 ). DOI:https:\/\/doi.org\/10.1093\/database\/bau109 10.1093\/database Jennifer D'Souza and Vincent Ng. 2014. Knowledge-rich temporal relation identification and classification in clinical notes. Database 2014 (11 2014). DOI:https:\/\/doi.org\/10.1093\/database\/bau109"},{"key":"e_1_2_1_75_1","volume-title":"Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC\u201914)","author":"D'Souza Jennifer","year":"2014","unstructured":"Jennifer D'Souza and Vincent Ng . 2014 . Annotating inter-sentence temporal relations in clinical notes . In Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC\u201914) . European Language Resources Association (ELRA), Reykjavik, Iceland, 2758\u20132765. Jennifer D'Souza and Vincent Ng. 2014. Annotating inter-sentence temporal relations in clinical notes. In Proceedings of the 9th International Conference on Language Resources and Evaluation (LREC\u201914). European Language Resources Association (ELRA), Reykjavik, Iceland, 2758\u20132765."},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001627"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-020-01208-9"},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the BioNLP 2009 Workshop. Association for Computational Linguistics","author":"Mowery Danielle","year":"2009","unstructured":"Danielle Mowery , Henk Harkema , John Dowling , Jonathan Lustgarten , and Wendy Chapman . 2009 . Distinguishing historical from current problems in clinical reports\u2014which textual features help? . In Proceedings of the BioNLP 2009 Workshop. Association for Computational Linguistics , Boulder, Colorado, 10\u201318. Danielle Mowery, Henk Harkema, John Dowling, Jonathan Lustgarten, and Wendy Chapman. 2009. Distinguishing historical from current problems in clinical reports\u2014which textual features help?. In Proceedings of the BioNLP 2009 Workshop. Association for Computational Linguistics, Boulder, Colorado, 10\u201318."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.5555\/2390665.2390683"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.5555\/2391123.2391128"},{"key":"e_1_2_1_81_1","volume-title":"Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics","author":"Raghavan Preethi","year":"2012","unstructured":"Preethi Raghavan , Eric Fosler-Lussier , and Albert Lai . 2012 . Exploring semi-supervised coreference resolution of medical concepts using semantic and temporal features . In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics , Montr\u00e9al, Canada, 731\u2013741. Preethi Raghavan, Eric Fosler-Lussier, and Albert Lai. 2012. Exploring semi-supervised coreference resolution of medical concepts using semantic and temporal features. In Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Association for Computational Linguistics, Montr\u00e9al, Canada, 731\u2013741."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2014-002642"},{"key":"e_1_2_1_83_1","first-page":"16","volume-title":"Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval\u201916)","author":"Barros Marcia","year":"1865","unstructured":"Marcia Barros , Andre Lamurias , Gon\u00e7alo Figueiro , Marta Antunes , Joana Teixeira , Alexandre Pinheiro , and Francisco M. Couto . 2016. ULISBOA at SemEval-2016 Task 12: Extraction of temporal expressions, clinical events and relations using IBEnt . In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval\u201916) . Association for Computational Linguistics, San Diego, California, 1263\u20131267. DOI:https:\/\/doi.org\/10. 1865 3\/v1\/S 16 - 1196 10.18653\/v1 Marcia Barros, Andre Lamurias, Gon\u00e7alo Figueiro, Marta Antunes, Joana Teixeira, Alexandre Pinheiro, and Francisco M. Couto. 2016. ULISBOA at SemEval-2016 Task 12: Extraction of temporal expressions, clinical events and relations using IBEnt. In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval\u201916). Association for Computational Linguistics, San Diego, California, 1263\u20131267. DOI:https:\/\/doi.org\/10.18653\/v1\/S16-1196"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1193"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1192"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1194"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-2118"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1198"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.5715\/jnlp.27.383"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5607"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1190"},{"key":"e_1_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5620"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-019-00671-x"},{"key":"e_1_2_1_94_1","first-page":"16","volume-title":"Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval\u201916)","author":"Lee Hee-Jin","year":"2016","unstructured":"Hee-Jin Lee , Hua Xu , Jingqi Wang , Yaoyun Zhang , Sungrim Moon , Jun Xu , and Yonghui Wu . 2016 . UTHealth at SemEval\u201916 Task 12: An end-to-end system for temporal information extraction from clinical notes . In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval\u201916) . Association for Computational Linguistics, San Diego, California, 1292\u20131297. DOI:https:\/\/doi.org\/10. 18653\/v1\/S 16 - 1201 10.18653\/v1 Hee-Jin Lee, Hua Xu, Jingqi Wang, Yaoyun Zhang, Sungrim Moon, Jun Xu, and Yonghui Wu. 2016. UTHealth at SemEval\u201916 Task 12: An end-to-end system for temporal information extraction from clinical notes. In Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval\u201916). Association for Computational Linguistics, San Diego, California, 1292\u20131297. DOI:https:\/\/doi.org\/10.18653\/v1\/S16-1201"},{"key":"e_1_2_1_95_1","volume-title":"Proceedings of the 27th International Conference on Computational Linguistics. Association for Computational Linguistics","author":"Leeuwenberg Artuur","year":"2018","unstructured":"Artuur Leeuwenberg and Marie-Francine Moens . 2018 . Word-level loss extensions for neural temporal relation classification . In Proceedings of the 27th International Conference on Computational Linguistics. Association for Computational Linguistics , Santa Fe, New Mexico, 3436\u20133447. Artuur Leeuwenberg and Marie-Francine Moens. 2018. Word-level loss extensions for neural temporal relation classification. In Proceedings of the 27th International Conference on Computational Linguistics. Association for Computational Linguistics, Santa Fe, New Mexico, 3436\u20133447."},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1199"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/E17-1108"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1197"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W18-5619"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W16-2914"},{"key":"e_1_2_1_101_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W17-2341"},{"key":"e_1_2_1_102_1","first-page":"19","volume-title":"Proceedings of the 2nd Clinical Natural Language Processing Workshop. Association for Computational Linguistics","author":"Lin Chen","year":"2019","unstructured":"Chen Lin , Timothy Miller , Dmitriy Dligach , Steven Bethard , and Guergana Savova . 2019 . A BERT-based universal model for both within- and cross-sentence clinical temporal relation extraction . In Proceedings of the 2nd Clinical Natural Language Processing Workshop. Association for Computational Linguistics , Minneapolis, Minnesota, 65\u201371. DOI:https:\/\/doi.org\/10. 18653\/v1\/W 19 - 1908 10.18653\/v1 Chen Lin, Timothy Miller, Dmitriy Dligach, Steven Bethard, and Guergana Savova. 2019. A BERT-based universal model for both within- and cross-sentence clinical temporal relation extraction. In Proceedings of the 2nd Clinical Natural Language Processing Workshop. Association for Computational Linguistics, Minneapolis, Minnesota, 65\u201371. DOI:https:\/\/doi.org\/10.18653\/v1\/W19-1908"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.bionlp-1.7"},{"key":"e_1_2_1_104_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-1917"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P17-2035"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S16-1175"},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2019.103309"},{"key":"e_1_2_1_108_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2177"},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2181"},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2178"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2180"},{"key":"e_1_2_1_112_1","first-page":"17","volume-title":"Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval\u201917)","author":"Manikandan Ravikiran Sarath P. R.","year":"2017","unstructured":"Sarath P. R. Manikandan Ravikiran , and Yoshiki Niwa . 2017 . Hitachi at SemEval-2017 Task 12: System for temporal information extraction from clinical notes . In Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval\u201917) . Association for Computational Linguistics, Vancouver, Canada, 1005\u20131009. DOI:https:\/\/doi.org\/10. 18653\/v1\/S 17 - 2176 10.18653\/v1 Sarath P. R. Manikandan Ravikiran, and Yoshiki Niwa. 2017. Hitachi at SemEval-2017 Task 12: System for temporal information extraction from clinical notes. In Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval\u201917). Association for Computational Linguistics, Vancouver, Canada, 1005\u20131009. DOI:https:\/\/doi.org\/10.18653\/v1\/S17-2176"},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S17-2098"},{"key":"e_1_2_1_114_1","volume-title":"AMIA Annual Symposium Proceedings 2017","author":"Rumeng Li","year":"2017","unstructured":"Li Rumeng , Jagannatha Abhyuday N, and Yu Hong . 2017 . A hybrid neural network model for joint prediction of presence and period assertions of medical events in clinical notes . AMIA Annual Symposium Proceedings 2017 (2017), 1149\u20131158. Li Rumeng, Jagannatha Abhyuday N, and Yu Hong. 2017. A hybrid neural network model for joint prediction of presence and period assertions of medical events in clinical notes. AMIA Annual Symposium Proceedings 2017 (2017), 1149\u20131158."},{"key":"e_1_2_1_115_1","volume-title":"AMIA Annual Symposium Proceedings 2012","author":"Li Min","year":"2012","unstructured":"Min Li and Jon Patrick . 2012 . Extracting temporal information from electronic patient records . AMIA Annual Symposium Proceedings 2012 (2012), 542\u2013551. Min Li and Jon Patrick. 2012. Extracting temporal information from electronic patient records. AMIA Annual Symposium Proceedings 2012 (2012), 542\u2013551."},{"key":"e_1_2_1_116_1","doi-asserted-by":"publisher","DOI":"10.1136\/jamia.2010.004804"},{"key":"e_1_2_1_117_1","first-page":"221","article-title":"Correlating lab test results in clinical notes with structured lab data: A case study in HbA1c and glucose","volume":"2017","author":"Liu Sijia","year":"2017","unstructured":"Sijia Liu , Liwei Wang , Donna Ihrke , Vipin Chaudhary , Cui Tao , Chunhua Weng , and Hongfang Liu . 2017 . Correlating lab test results in clinical notes with structured lab data: A case study in HbA1c and glucose . AMIA Joint Summits on Translational Science Proceedings 2017 (2017), 221 \u2013 228 . Sijia Liu, Liwei Wang, Donna Ihrke, Vipin Chaudhary, Cui Tao, Chunhua Weng, and Hongfang Liu. 2017. Correlating lab test results in clinical notes with structured lab data: A case study in HbA1c and glucose. AMIA Joint Summits on Translational Science Proceedings 2017 (2017), 221\u2013228.","journal-title":"AMIA Joint Summits on Translational Science Proceedings"},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2011-000295"},{"key":"e_1_2_1_119_1","first-page":"418","article-title":"Annotating temporal relations to determine the onset of psychosis symptoms","volume":"264","author":"Viani Natalia","year":"2019","unstructured":"Natalia Viani , Joyce Kam , Lucia Yin , Somain Verma , Robert Stewart , Rashmi Patel , and Sumithra Velupillai . 2019 . Annotating temporal relations to determine the onset of psychosis symptoms . Studies in Health Technology and Informatics 264 (2019), 418 \u2013 422 . DOI:https:\/\/doi.org\/10.3233\/SHTI190255 10.3233\/SHTI190255 Natalia Viani, Joyce Kam, Lucia Yin, Somain Verma, Robert Stewart, Rashmi Patel, and Sumithra Velupillai. 2019. Annotating temporal relations to determine the onset of psychosis symptoms. Studies in Health Technology and Informatics 264 (2019), 418\u2013422. DOI:https:\/\/doi.org\/10.3233\/SHTI190255","journal-title":"Studies in Health Technology and Informatics"},{"key":"e_1_2_1_120_1","doi-asserted-by":"publisher","DOI":"10.5555\/1869961.1869981"},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1197\/jamia.M2467"},{"key":"e_1_2_1_122_1","first-page":"46","article-title":"ClinicalTime: Identification of patients with acute kidney injury using temporal abstractions and temporal pattern matching","volume":"2015","author":"Capurro Daniel","year":"2015","unstructured":"Daniel Capurro , Mario Barbe , Claudio Daza , Josefa Santa Mar\u00eda , Javier Trincado , and Ignacio Gomez . 2015 . ClinicalTime: Identification of patients with acute kidney injury using temporal abstractions and temporal pattern matching . AMIA Joint Summits on Translational Science Proceedings 2015 (2015), 46 \u2013 50 . Daniel Capurro, Mario Barbe, Claudio Daza, Josefa Santa Mar\u00eda, Javier Trincado, and Ignacio Gomez. 2015. ClinicalTime: Identification of patients with acute kidney injury using temporal abstractions and temporal pattern matching. AMIA Joint Summits on Translational Science Proceedings 2015 (2015), 46\u201350.","journal-title":"AMIA Joint Summits on Translational Science Proceedings"},{"key":"e_1_2_1_123_1","volume-title":"AMIA Annual Symposium Proceedings 2006","author":"Bramsen Philip","year":"2006","unstructured":"Philip Bramsen , Pawan Deshpande , Yoong Keok Lee , and Regina Barzilay . 2006 . Finding temporal order in discharge summaries . AMIA Annual Symposium Proceedings 2006 (2006), 81\u201385. Philip Bramsen, Pawan Deshpande, Yoong Keok Lee, and Regina Barzilay. 2006. Finding temporal order in discharge summaries. AMIA Annual Symposium Proceedings 2006 (2006), 81\u201385."},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.5555\/1610075.1610105"},{"key":"e_1_2_1_125_1","volume-title":"Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics","author":"Raghavan Preethi","unstructured":"Preethi Raghavan , Eric Fosler-Lussier , No\u00e9mie Elhadad , and Albert M. Lai . 2014. Cross-narrative temporal ordering of medical events . In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics , Baltimore, Maryland, 998\u20131008. DOI:https:\/\/doi.org\/10.3115\/v1\/P14-1094 10.3115\/v1 Preethi Raghavan, Eric Fosler-Lussier, No\u00e9mie Elhadad, and Albert M. Lai. 2014. Cross-narrative temporal ordering of medical events. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). Association for Computational Linguistics, Baltimore, Maryland, 998\u20131008. DOI:https:\/\/doi.org\/10.3115\/v1\/P14-1094"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2015.05.009"},{"key":"e_1_2_1_127_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2012-001607"},{"key":"e_1_2_1_128_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/S15-2137"},{"key":"e_1_2_1_129_1","first-page":"19","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin , Ming-Wei Chang , Kenton Lee , and Kristina Toutanova . 2019 . BERT: Pre-training of deep bidirectional transformers for language understanding . In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171\u20134186. DOI:https:\/\/doi.org\/10. 18653\/v1\/N 19 - 1423 10.18653\/v1 Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, Minneapolis, Minnesota, 4171\u20134186. DOI:https:\/\/doi.org\/10.18653\/v1\/N19-1423"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001619"},{"key":"e_1_2_1_131_1","unstructured":"Roser Saur\u00ed Jessica Moszkowicz Bob Knippen Rob Gaizauskas Andrea Setzer and James Pustejovsky. 2006. TimeML Annotation Guidelines Version 1.2.1. (2006).  Roser Saur\u00ed Jessica Moszkowicz Bob Knippen Rob Gaizauskas Andrea Setzer and James Pustejovsky. 2006. TimeML Annotation Guidelines Version 1.2.1. (2006)."},{"key":"e_1_2_1_132_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273513"},{"key":"e_1_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P16-1105"},{"key":"e_1_2_1_134_1","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz682"},{"key":"e_1_2_1_135_1","doi-asserted-by":"publisher","DOI":"10.1136\/amiajnl-2013-001622"},{"key":"e_1_2_1_136_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W19-1909"},{"key":"e_1_2_1_137_1","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.35"},{"key":"e_1_2_1_138_1","first-page":"1","article-title":"A survey on deep learning for named entity recognition","volume":"01","author":"Li Jing","year":"2020","unstructured":"Jing Li , Aixin Sun , Jianglei Han , and Chenliang Li . 2020 . A survey on deep learning for named entity recognition . IEEE Transactions on Knowledge Data Engineering 01 (2020), 1 \u2013 1 . DOI:https:\/\/doi.org\/10.1109\/TKDE.2020.2981314 10.1109\/TKDE.2020.2981314 Jing Li, Aixin Sun, Jianglei Han, and Chenliang Li. 2020. A survey on deep learning for named entity recognition. IEEE Transactions on Knowledge Data Engineering 01 (2020), 1\u20131. DOI:https:\/\/doi.org\/10.1109\/TKDE.2020.2981314","journal-title":"IEEE Transactions on Knowledge Data Engineering"},{"key":"e_1_2_1_139_1","volume-title":"Proceedings of Corpus Linguistics (Jan","author":"Gaizauskas Rob","year":"2003","unstructured":"James Pustejovsky, Patrick Hanks, Roser Saur\u00ed, Andrew See, Rob Gaizauskas , Andrea Setzer , Dragomir Radev , Beth Sundheim , David Day , Lisa Ferro , and Marcia Lazo . 2003 . The TimeBank corpus . Proceedings of Corpus Linguistics (Jan 2003). James Pustejovsky, Patrick Hanks, Roser Saur\u00ed, Andrew See, Rob Gaizauskas, Andrea Setzer, Dragomir Radev, Beth Sundheim, David Day, Lisa Ferro, and Marcia Lazo. 2003. The TimeBank corpus. Proceedings of Corpus Linguistics (Jan 2003)."},{"key":"e_1_2_1_140_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-2082"},{"key":"e_1_2_1_141_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00182"},{"key":"e_1_2_1_142_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/P19-1280"},{"key":"e_1_2_1_143_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K19-1062"},{"key":"e_1_2_1_144_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1642"},{"key":"e_1_2_1_145_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N18-1202"},{"key":"e_1_2_1_146_1","volume-title":"Hajira Dambha-Miller, Ai Oishi, Hiroko Tagashira, Anistasiya Verho, and John Holden.","author":"Irving Greg","year":"2017","unstructured":"Greg Irving , Ana Luisa Neves , Hajira Dambha-Miller, Ai Oishi, Hiroko Tagashira, Anistasiya Verho, and John Holden. 2017 . International variations in primary care physician consultation time: A systematic review of 67 countries. BMJ Open 7, 10 (2017). DOI:https:\/\/doi.org\/10.1136\/bmjopen-2017-017902 10.1136\/bmjopen-2017-017902 Greg Irving, Ana Luisa Neves, Hajira Dambha-Miller, Ai Oishi, Hiroko Tagashira, Anistasiya Verho, and John Holden. 2017. International variations in primary care physician consultation time: A systematic review of 67 countries. BMJ Open 7, 10 (2017). DOI:https:\/\/doi.org\/10.1136\/bmjopen-2017-017902"},{"key":"e_1_2_1_147_1","unstructured":"Victor Sanh Lysandre Debut Julien Chaumond and Thomas Wolf. 2019. DistilBERT a distilled version of BERT: smaller faster cheaper and lighter. (2019). arXiv:1910.01108. Retrieved from https:\/\/arxiv.org\/abs\/1910.01108.  Victor Sanh Lysandre Debut Julien Chaumond and Thomas Wolf. 2019. DistilBERT a distilled version of BERT: smaller faster cheaper and lighter. (2019). arXiv:1910.01108. Retrieved from https:\/\/arxiv.org\/abs\/1910.01108."},{"key":"e_1_2_1_148_1","unstructured":"Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. (2019). arXiv:1907.11692. Retrieved from https:\/\/arxiv.org\/abs\/1907.11692.  Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy Mike Lewis Luke Zettlemoyer and Veselin Stoyanov. 2019. RoBERTa: A robustly optimized BERT pretraining approach. (2019). arXiv:1907.11692. Retrieved from https:\/\/arxiv.org\/abs\/1907.11692."},{"key":"e_1_2_1_149_1","volume-title":"Le","author":"Yang Zhilin","year":"2019","unstructured":"Zhilin Yang , Zihang Dai , Yiming Yang , Jaime Carbonell , Russ R Salakhutdinov , and Quoc V . Le . 2019 . XLNet: Generalized autoregressive pretraining for language understanding. In Advances in Neural Information Processing Systems, 32. Curran Associates, Inc . Zhilin Yang, Zihang Dai, Yiming Yang, Jaime Carbonell, Russ R Salakhutdinov, and Quoc V. Le. 2019. XLNet: Generalized autoregressive pretraining for language understanding. In Advances in Neural Information Processing Systems, 32. Curran Associates, Inc."}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462475","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3462475","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:19:02Z","timestamp":1750191542000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3462475"}},"subtitle":["A Systematic Review"],"short-title":[],"issued":{"date-parts":[[2021,9,17]]},"references-count":149,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2022,9,30]]}},"alternative-id":["10.1145\/3462475"],"URL":"https:\/\/doi.org\/10.1145\/3462475","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,17]]},"assertion":[{"value":"2019-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-09-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}