{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,22]],"date-time":"2026-02-22T21:25:28Z","timestamp":1771795528145,"version":"3.50.1"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2025,5,10]],"date-time":"2025-05-10T00:00:00Z","timestamp":1746835200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,5,10]],"date-time":"2025-05-10T00:00:00Z","timestamp":1746835200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Innovation Fund 2019 Amsterdam UMC","award":["23088"],"award-info":[{"award-number":["23088"]}]},{"DOI":"10.13039\/501100001826","name":"The Netherlands Organization for Health Research and Development","doi-asserted-by":"crossref","award":["848018004"],"award-info":[{"award-number":["848018004"]}],"id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Lang Resources &amp; Evaluation"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Our objective was to create a gold standard Dutch language annotated corpus of clinical notes with adverse drug event (ADE) mentions, specifically for Intensive Care patients with drug-related acute kidney injury. We used anonymized clinical notes from 102 adult intensive care unit (ICU) patients suspected of acute kidney injury (AKI) and admitted to Amsterdam University Medical Centre, The Netherlands, over a four-year period (November 2015\u2013 January 2020). The notes were extracted from the electronic health record (EHR) system and manually reviewed for drug-related causes. Each clinical note contained at least one ADE mention (drug-related AKI). Annotation guidelines were developed over three rounds of annotation based on review of annotations and clarifications during the process. Two clinical expert annotators labelled mentions of drugs and disorders, as well as the relationship between these entities indicating an ADE. The final gold standard corpus was a result of adjudication of the two sets of expert labels. The corpus contains 102 notes with 16,470 labels, consisting of 8,914 Disorder entities, 5,307 Drug entities, 134 Qualitative Concept entities, 1,501 Indication relations, and 614 ADE relations. Annotation reached high agreement for all entities (F1 score 0.7724) with an expected lower agreement for relations (F1 score 0.4327). The Dutch ADE corpus is a real-world data set that can be used to evaluate natural language processing pipelines for ADE detection tasks. Although the corpus was developed for drug-related AKI, 158 additional ADEs were identified. The combination of iterative annotation guideline development and double annotation followed by adjudication produced high quality annotations. Future work will use this gold standard annotated corpus to train and validate NLP models to detect ADEs in Dutch clinical text.<\/jats:p>","DOI":"10.1007\/s10579-025-09832-5","type":"journal-article","created":{"date-parts":[[2025,5,10]],"date-time":"2025-05-10T05:24:12Z","timestamp":1746854652000},"page":"2763-2779","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Creation of a gold standard Dutch corpus of clinical notes for adverse drug event detection: the Dutch ADE corpus"],"prefix":"10.1007","volume":"59","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2602-5658","authenticated-orcid":false,"given":"Rachel M.","family":"Murphy","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8477-6671","authenticated-orcid":false,"given":"Dave A.","family":"Dongelmans","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6651-1730","authenticated-orcid":false,"given":"Nicolette F.","family":"de Keizer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rosa J.","family":"Jongeneel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christiaan H.","family":"Koster","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0444-8569","authenticated-orcid":false,"given":"Kitty J.","family":"Jager","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4324-7954","authenticated-orcid":false,"given":"Ameen","family":"Abu-Hanna","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6244-7906","authenticated-orcid":false,"given":"Iacer","family":"Calixto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9707-5740","authenticated-orcid":false,"given":"Joanna E.","family":"Klopotowska","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,5,10]]},"reference":[{"issue":"2","key":"9832_CR1","doi-asserted-by":"publisher","first-page":"906","DOI":"10.1016\/j.jaip.2020.09.027","volume":"9","author":"S Alvarez-Arango","year":"2021","unstructured":"Alvarez-Arango, S., Yerneni, S., Tang, O., Zhou, L., Mancini, C. M., Blackley, S. V., Keet, C. A., & Blumenthal, K. G. (2021). Vancomycin hypersensitivity reactions documented in electronic health records. The Journal of Allergy and Clinical Immunology: in Practice, 9(2), 906\u2013912. https:\/\/doi.org\/10.1016\/j.jaip.2020.09.027","journal-title":"The Journal of Allergy and Clinical Immunology: in Practice"},{"issue":"4","key":"9832_CR2","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1001\/jama.1997.03540280045032","volume":"277","author":"DW Bates","year":"1997","unstructured":"Bates, D. W., Spell, N., Cullen, D. J., Burdick, E., Laird, N., Petersen, L. A., Small, S. D., Sweitzer, B. J., & Leape, L. L. (1997). The costs of adverse drug events in hospitalized patients. Adverse drug events prevention study group. Jama, 277(4), 307\u2013311.","journal-title":"Jama"},{"issue":"10","key":"9832_CR3","doi-asserted-by":"publisher","first-page":"1585","DOI":"10.1093\/jamia\/ocaa150","volume":"27","author":"Y Bitton","year":"2020","unstructured":"Bitton, Y., Cohen, R., Schifter, T., Bachmat, E., Elhadad, M., & Elhadad, N. (2020). Cross-lingual unified medical Language system entity linking in online health communities. Journal of the American Medical Informatics Association, 27(10), 1585\u20131592. https:\/\/doi.org\/10.1093\/jamia\/ocaa150","journal-title":"Journal of the American Medical Informatics Association"},{"key":"9832_CR4","unstructured":"Cabot, P. L. H., & a., N. (2021). Roberto. November 7\u201311, 2021). REBEL: Relation extraction by end-to-end language generation Findings of the Association for Computational Linguistics: EMNLP."},{"issue":"4","key":"9832_CR5","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1001\/jama.1997.03540280039031","volume":"277","author":"DC Classen","year":"1997","unstructured":"Classen, D. C., Pestotnik, S. L., Evans, R. S., Lloyd, J. F., & Burke, J. P. (1997). Adverse drug events in hospitalized patients. Excess length of stay, extra costs, and attributable mortality. Jama, 277(4), 301\u2013306.","journal-title":"Jama"},{"key":"9832_CR6","unstructured":"Concepts and Concept Identifiers (2009). In UMLS Reference Manual [Internet]. National Library of Medicine (US). https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK9684\/"},{"key":"9832_CR7","doi-asserted-by":"crossref","unstructured":"D\u2019Oosterlinck, K., Remy, F., Deleu, J., Demeester, T., Develder, C., Zaporojets, K., Ghodsi, A., Ellershaw, S., Collins, J., & Potts, C. (2023, December). BioDEX Large-Scale Biomedical Adverse Drug Event Extraction for Real-World Pharmacovigilance. In H. Bouamor, J. Pino, & K. Bali, Findings of the Association for Computational Linguistics EMNLP 2023 Singapore.","DOI":"10.18653\/v1\/2023.findings-emnlp.896"},{"key":"9832_CR8","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1016\/j.jbi.2014.01.014","volume":"50","author":"L Deleger","year":"2014","unstructured":"Deleger, L., Lingren, T., Ni, Y., Kaiser, M., Stoutenborough, L., Marsolo, K., Kouril, M., Molnar, K., & Solti, I. (2014). Preparing an annotated gold standard corpus to share with extramural investigators for de-identification research. Journal of Biomedical Informatics, 50, 173\u2013183. https:\/\/doi.org\/10.1016\/j.jbi.2014.01.014","journal-title":"Journal of Biomedical Informatics"},{"issue":"2","key":"9832_CR9","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1093\/jamia\/ocz194","volume":"27","author":"A Geva","year":"2020","unstructured":"Geva, A., Abman, S. H., Manzi, S. F., Ivy, D. D., Mullen, M. P., Griffin, J., Lin, C., Savova, G. K., & Mandl, K. D. (2020). Adverse drug event rates in pediatric pulmonary hypertension: A comparison of real-world data sources. Journal of the American Medical Informatics Association, 27(2), 294\u2013300. https:\/\/doi.org\/10.1093\/jamia\/ocz194","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"6","key":"9832_CR10","doi-asserted-by":"publisher","first-page":"661","DOI":"10.1093\/jamia\/ocx139","volume":"25","author":"FR Goss","year":"2017","unstructured":"Goss, F. R., Lai, K. H., Topaz, M., Acker, W. W., Kowalski, L., Plasek, J. M., Blumenthal, K. G., Seger, D. L., Slight, S. P., Wah Fung, K., Chang, F. Y., Bates, D. W., & Zhou, L. (2017). A value set for documenting adverse reactions in electronic health records. Journal of the American Medical Informatics Association, 25(6), 661\u2013669. https:\/\/doi.org\/10.1093\/jamia\/ocx139","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"5","key":"9832_CR11","doi-asserted-by":"publisher","first-page":"885","DOI":"10.1016\/j.jbi.2012.04.008","volume":"45","author":"H Gurulingappa","year":"2012","unstructured":"Gurulingappa, H., Rajput, A. M., Roberts, A., Fluck, J., Hofmann-Apitius, M., & Toldo, L. (2012). Development of a benchmark corpus to support the automatic extraction of drug-related adverse effects from medical case reports. Journal of Biomedical Informatics, 45(5), 885\u2013892. https:\/\/doi.org\/10.1016\/j.jbi.2012.04.008","journal-title":"Journal of Biomedical Informatics"},{"issue":"5","key":"9832_CR12","doi-asserted-by":"publisher","first-page":"385","DOI":"10.2165\/00002018-200629050-00003","volume":"29","author":"L Hazell","year":"2006","unstructured":"Hazell, L., & Shakir, S. A. (2006). Under-reporting of adverse drug reactions: A systematic review. Drug Safety, 29(5), 385\u2013396. https:\/\/doi.org\/10.2165\/00002018-200629050-00003","journal-title":"Drug Safety"},{"key":"9832_CR13","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1016\/j.jbi.2015.08.013","volume":"57","author":"A Henriksson","year":"2015","unstructured":"Henriksson, A., Kvist, M., Dalianis, H., & Duneld, M. (2015). Identifying adverse drug event information in clinical notes with distributional semantic representations of context. Journal of Biomedical Informatics, 57, 333\u2013349. https:\/\/doi.org\/10.1016\/j.jbi.2015.08.013","journal-title":"Journal of Biomedical Informatics"},{"issue":"1","key":"9832_CR14","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1093\/jamia\/ocz166","volume":"27","author":"S Henry","year":"2020","unstructured":"Henry, S., Buchan, K., Filannino, M., Stubbs, A., & Uzuner, O. (2020). 2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records. Journal of the American Medical Informatics Association, 27(1), 3\u201312. https:\/\/doi.org\/10.1093\/jamia\/ocz166","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"3","key":"9832_CR15","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1136\/amiajnl-2013-002116","volume":"21","author":"CM Hohl","year":"2014","unstructured":"Hohl, C. M., Karpov, A., Reddekopp, L., Doyle-Waters, M., & Stausberg, J. (2014). ICD-10 codes used to identify adverse drug events in administrative data: A systematic review. Journal of the American Medical Informatics Association, 21(3), 547\u2013557. https:\/\/doi.org\/10.1136\/amiajnl-2013-002116","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"3","key":"9832_CR16","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1197\/jamia.M1733","volume":"12","author":"G Hripcsak","year":"2005","unstructured":"Hripcsak, G., & Rothschild, A. S. (2005). Agreement, the f-measure, and reliability in information retrieval. Journal of the American Medical Informatics Association, 12(3), 296\u2013298. https:\/\/doi.org\/10.1197\/jamia.M1733","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"1","key":"9832_CR17","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/s40264-018-0762-z","volume":"42","author":"A Jagannatha","year":"2019","unstructured":"Jagannatha, A., Liu, F., Liu, W., & Yu, H. (2019). Overview of the first natural Language processing challenge for extracting medication, indication, and adverse drug events from electronic health record notes (MADE 1.0). Drug Safety, 42(1), 99\u2013111. https:\/\/doi.org\/10.1007\/s40264-018-0762-z","journal-title":"Drug Safety"},{"issue":"2","key":"9832_CR18","doi-asserted-by":"publisher","first-page":"ooab025","DOI":"10.1093\/jamiaopen\/ooab025","volume":"4","author":"M Kittner","year":"2021","unstructured":"Kittner, M., Lamping, M., Rieke, D. T., G\u00f6tze, J., Bajwa, B., Jelas, I., R\u00fcter, G., Hautow, H., S\u00e4nger, M., Habibi, M., Zettwitz, M., de Bortoli, T., Ostermann, L., \u0160eva, J., Starlinger, J., Kohlbacher, O., Malek, N. P., Keilholz, U., & Leser, U. (2021). Annotation and initial evaluation of a large annotated German oncological corpus. JAMIA Open, 4(2), ooab025. https:\/\/doi.org\/10.1093\/jamiaopen\/ooab025","journal-title":"JAMIA Open"},{"issue":"1","key":"9832_CR19","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1186\/s12882-017-0487-8","volume":"18","author":"J Koeze","year":"2017","unstructured":"Koeze, J., Keus, F., Dieperink, W., van der Horst, I. C., Zijlstra, J. G., & van Meurs, M. (2017). Incidence, timing and outcome of AKI in critically ill patients varies with the definition used and the addition of urine output criteria. Bmc Nephrology, 18(1), 70. https:\/\/doi.org\/10.1186\/s12882-017-0487-8","journal-title":"Bmc Nephrology"},{"issue":"5","key":"9832_CR20","doi-asserted-by":"publisher","first-page":"948","DOI":"10.1093\/jamia\/ocv037","volume":"22","author":"JA Kors","year":"2015","unstructured":"Kors, J. A., Clematide, S., Akhondi, S. A., van Mulligen, E. M., & Rebholz-Schuhmann, D. (2015). A multilingual gold-standard corpus for biomedical concept recognition: The mantra GSC. Journal of the American Medical Informatics Association, 22(5), 948\u2013956. https:\/\/doi.org\/10.1093\/jamia\/ocv037","journal-title":"Journal of the American Medical Informatics Association"},{"key":"9832_CR21","doi-asserted-by":"publisher","first-page":"e49007","DOI":"10.2196\/49007","volume":"12","author":"T Mehra","year":"2024","unstructured":"Mehra, T., Wekhof, T., & Keller, D. I. (2024). Additional value from Free-Text diagnoses in electronic health records: Hybrid dictionary and machine learning classification study [Original Paper]. JMIR Med Inform, 12, e49007. https:\/\/doi.org\/10.2196\/49007","journal-title":"JMIR Med Inform"},{"key":"9832_CR22","doi-asserted-by":"publisher","unstructured":"Murphy, R. M., Dongelmans, D. A., Kom, I. Y., Calixto, I., Abu-Hanna, A., Jager, K. J., de Keizer, N. F., & Klopotowska, J. E. (2023a). Drug-related causes attributed to acute kidney injury and their Documentation in intensive care patients. Journal of Critical Care, 154292. https:\/\/doi.org\/10.1016\/j.jcrc.2023.154292","DOI":"10.1016\/j.jcrc.2023.154292"},{"issue":"1","key":"9832_CR23","doi-asserted-by":"publisher","first-page":"e0279842","DOI":"10.1371\/journal.pone.0279842","volume":"18","author":"RM Murphy","year":"2023","unstructured":"Murphy, R. M., Klopotowska, J. E., de Keizer, N. F., Jager, K. J., Leopold, J. H., Dongelmans, D. A., Abu-Hanna, A., & Schut, M. C. (2023b). Adverse drug event detection using natural Language processing: A scoping review of supervised learning methods. Plos One, 18(1), e0279842. https:\/\/doi.org\/10.1371\/journal.pone.0279842","journal-title":"Plos One"},{"key":"9832_CR24","unstructured":"Nakayama, H., Kubo, T., Kamura, J., Taniguchi, Y., & Liang, X. (2018). doccano: Text Annotation Tool for Human. Software available from https:\/\/github.com\/doccano\/doccano"},{"issue":"10","key":"9832_CR25","doi-asserted-by":"publisher","first-page":"2761","DOI":"10.1007\/s00262-021-02880-0","volume":"70","author":"A Nashed","year":"2021","unstructured":"Nashed, A., Zhang, S., Chiang, C. W., Zitu, M., Otterson, G. A., Presley, C. J., Kendra, K., Patel, S. H., Johns, A., Li, M., Grogan, M., Lopez, G., Owen, D. H., & Li, L. (2021). Comparative assessment of manual chart review and ICD claims data in evaluating immunotherapy-related adverse events. Cancer Immunology, Immunotherapy, 70(10), 2761\u20132769. https:\/\/doi.org\/10.1007\/s00262-021-02880-0","journal-title":"Cancer Immunology, Immunotherapy"},{"issue":"10","key":"9832_CR26","doi-asserted-by":"publisher","first-page":"795","DOI":"10.7326\/0003-4819-140-10-200405180-00009","volume":"140","author":"JR Nebeker","year":"2004","unstructured":"Nebeker, J. R., Barach, P., & Samore, M. H. (2004). Clarifying adverse drug events: A clinician\u2019s guide to terminology, documentation, and reporting. Annals of Internal Medicine, 140(10), 795\u2013801. https:\/\/doi.org\/10.7326\/0003-4819-140-10-200405180-00009","journal-title":"Annals of Internal Medicine"},{"issue":"1","key":"9832_CR27","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1136\/qshc.2005.017616","volume":"16","author":"S Olsen","year":"2007","unstructured":"Olsen, S., Neale, G., Schwab, K., Psaila, B., Patel, T., Chapman, E. J., & Vincent, C. (2007). Hospital staff should use more than one method to detect adverse events and potential adverse events: Incident reporting, pharmacist surveillance and local real-time record review May all have a place. Quality Management in Health Care, 16(1), 40\u201344. https:\/\/doi.org\/10.1136\/qshc.2005.017616","journal-title":"Quality Management in Health Care"},{"key":"9832_CR28","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1016\/j.jbi.2015.06.016","volume":"56","author":"M Oronoz","year":"2015","unstructured":"Oronoz, M., Gojenola, K., Perez, A., de Ilarraza, A. D., & Casillas, A. (2015). On the creation of a clinical gold standard corpus in Spanish: Mining adverse drug reactions. Journal of Biomedical Informatics, 56, 318\u2013332. https:\/\/doi.org\/10.1016\/j.jbi.2015.06.016","journal-title":"Journal of Biomedical Informatics"},{"key":"9832_CR29","unstructured":"Orphadata Scientific Knowledge base release of July 2023 (Dutch)https:\/\/www.orphadata.com\/alignments\/"},{"issue":"1","key":"9832_CR30","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1007\/s00228-022-03419-7","volume":"79","author":"TK Patel","year":"2023","unstructured":"Patel, T. K., Patel, P. B., Bhalla, H. L., Dwivedi, P., Bajpai, V., & Kishore, S. (2023). Impact of suspected adverse drug reactions on mortality and length of hospital stay in the hospitalised patients: A meta-analysis. European Journal of Clinical Pharmacology, 79(1), 99\u2013116. https:\/\/doi.org\/10.1007\/s00228-022-03419-7","journal-title":"European Journal of Clinical Pharmacology"},{"key":"9832_CR31","doi-asserted-by":"publisher","first-page":"505","DOI":"10.2147\/ceor.S71301","volume":"6","author":"V Perrone","year":"2014","unstructured":"Perrone, V., Conti, V., Venegoni, M., Scotto, S., Degli Esposti, L., Sangiorgi, D., Prestini, L., Radice, S., Clementi, E., & Vighi, G. (2014). Seriousness, preventability, and burden impact of reported adverse drug reactions in Lombardy emergency departments: A retrospective 2-year characterization. Clinicoecon Outcomes Res, 6, 505\u2013514. https:\/\/doi.org\/10.2147\/ceor.S71301","journal-title":"Clinicoecon Outcomes Res"},{"key":"9832_CR32","first-page":"1366","volume":"2012","author":"P Raghavan","year":"2012","unstructured":"Raghavan, P., Fosler-Lussier, E., & M Lai, A. (2012). Inter-annotator reliability of medical events, coreferences and Temporal relations in clinical narratives by annotators with varying levels of clinical expertise. Amia. Annual Symposium Proceedings \/ Amia Symposium. Amia Symposium, 2012, 1366\u20131374.","journal-title":"Amia.. Annual Symposium Proceedings \/ Amia Symposium. Amia Symposium"},{"issue":"2","key":"9832_CR33","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1136\/jamia.2010.007237","volume":"18","author":"ST Rosenbloom","year":"2011","unstructured":"Rosenbloom, S. T., Denny, J. C., Xu, H., Lorenzi, N., Stead, W. W., & Johnson, K. B. (2011). Data from clinical notes: A perspective on the tension between structure and flexible Documentation. Journal of the American Medical Informatics Association, 18(2), 181\u2013186. https:\/\/doi.org\/10.1136\/jamia.2010.007237","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"2","key":"9832_CR34","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1016\/j.jaip.2019.07.017","volume":"8","author":"CRF Rukasin","year":"2020","unstructured":"Rukasin, C. R. F., Henderlight, S., Bosen, T., Nelson, S. D., & Phillips, E. J. (2020). Implications of electronic health record transition on drug allergy labels. J Allergy Clin Immunol Pract, 8(2), 764\u2013766. https:\/\/doi.org\/10.1016\/j.jaip.2019.07.017","journal-title":"J Allergy Clin Immunol Pract"},{"key":"9832_CR35","unstructured":"The UMLS Semantic Network. https:\/\/lhncbc.nlm.nih.gov\/semanticnetwork\/"},{"issue":"1","key":"9832_CR36","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1186\/s12859-022-05130-x","volume":"24","author":"B van Es","year":"2023","unstructured":"van Es, B., Reteig, L. C., Tan, S. C., Schraagen, M., Hemker, M. M., Arends, S. R. S., Rios, M. A. R., & Haitjema, S. (2023). Negation detection in Dutch clinical texts: An evaluation of rule-based And machine learning methods. Bmc Bioinformatics, 24(1), 10. https:\/\/doi.org\/10.1186\/s12859-022-05130-x","journal-title":"Bmc Bioinformatics"},{"issue":"3","key":"9832_CR37","doi-asserted-by":"publisher","first-page":"1235","DOI":"10.1111\/bcp.15068","volume":"88","author":"A Wasylewicz","year":"2022","unstructured":"Wasylewicz, A., van de Burgt, B., Weterings, A., Jessurun, N., Korsten, E., Egberts, T., Bouwman, A., Kerskes, M., Grouls, R., & van der Linden, C. (2022). Identifying adverse drug reactions from free-text electronic hospital health record notes. British Journal of Clinical Pharmacology, 88(3), 1235\u20131245. https:\/\/doi.org\/10.1111\/bcp.15068","journal-title":"British Journal of Clinical Pharmacology"},{"key":"9832_CR38","doi-asserted-by":"publisher","unstructured":"Wissler, L., Almashraee, M., Monett, D., & Paschke, A. (2014). The Gold Standard in Corpus Annotation. https:\/\/doi.org\/10.13140\/2.1.4316.3523","DOI":"10.13140\/2.1.4316.3523"},{"issue":"2","key":"9832_CR39","doi-asserted-by":"publisher","first-page":"291","DOI":"10.1111\/bcp.14139","volume":"86","author":"SA Woo","year":"2020","unstructured":"Woo, S. A., Cragg, A., Wickham, M. E., Villanyi, D., Scheuermeyer, F., Hau, J. P., & Hohl, C. M. (2020). Preventable adverse drug events: Descriptive epidemiology. British Journal of Clinical Pharmacology, 86(2), 291\u2013302. https:\/\/doi.org\/10.1111\/bcp.14139","journal-title":"British Journal of Clinical Pharmacology"},{"key":"9832_CR40","unstructured":"Xia, F., & Yetisgen-Yildiz, M. (2012). Corpus Annotation: Challenges and Strategies."},{"key":"9832_CR41","doi-asserted-by":"publisher","unstructured":"Zitu, M. M., Zhang, S., Owen, D. H., Chiang, C., & Li, L. (2023). Generalizability of machine learning methods in detecting adverse drug events from clinical narratives in electronic medical records [Original Research]. Frontiers in Pharmacology, 14. https:\/\/doi.org\/10.3389\/fphar.2023.1218679","DOI":"10.3389\/fphar.2023.1218679"}],"container-title":["Language Resources and Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-025-09832-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10579-025-09832-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10579-025-09832-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,6]],"date-time":"2025-09-06T14:23:54Z","timestamp":1757168634000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10579-025-09832-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,10]]},"references-count":41,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["9832"],"URL":"https:\/\/doi.org\/10.1007\/s10579-025-09832-5","relation":{},"ISSN":["1574-020X","1574-0218"],"issn-type":[{"value":"1574-020X","type":"print"},{"value":"1574-0218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,10]]},"assertion":[{"value":"16 April 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 May 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was exempted from requiring ethics approval on 03\/06\/2019 (non-WMO waiver W19_207 # 19.252) by the Medical Ethics Committee of the Amsterdam University Medical Centre, location University of Amsterdam, The Netherlands, as it did not fall within the scope of the Dutch Medical Research Involving Human Subjects Act (WMO). Prior to obtaining the data from Research Data Management office of Amsterdam UMC, we performed a Data Protection Impact Assessment which was assessed and approved by the privacy officer of Amsterdam UMC. In accordance with Dutch and Amsterdam UMC regulation regarding reuse of routine care data for research, informed consent of patients is not required for anonymised data. Patients who do not agree to the reuse of their routine care data for research are excluded from data extractions by the Research Data Management office.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical considerations"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}