{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:20:09Z","timestamp":1772166009794,"version":"3.50.1"},"reference-count":59,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T00:00:00Z","timestamp":1708041600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T00:00:00Z","timestamp":1708041600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Electronic health records (EHRs) contain valuable information for clinical research; however, the sensitive nature of healthcare data presents security and confidentiality challenges. De-identification is therefore essential to protect personal data in EHRs and comply with government regulations. Named entity recognition (NER) methods have been proposed to remove personal identifiers, with deep learning-based models achieving better performance. However, manual annotation of training data is time-consuming and expensive. The aim of this study was to develop an automatic de-identification pipeline for all kinds of clinical documents based on a distant supervised method to significantly reduce the cost of manual annotations and to facilitate the transfer of the de-identification pipeline to other clinical centers.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We proposed an automated annotation process for French clinical de-identification, exploiting data from the eHOP clinical data warehouse (CDW) of the CHU de Rennes and national knowledge bases, as well as other features. In addition, this paper proposes an assisted data annotation solution using the Prodigy annotation tool. This approach aims to reduce the cost required to create a reference corpus for the evaluation of state-of-the-art NER models. Finally, we evaluated and compared the effectiveness of different NER methods.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>A French de-identification dataset was developed in this work, based on EHRs provided by the eHOP CDW at Rennes University Hospital, France. The dataset was rich in terms of personal information, and the distribution of entities was quite similar in the training and test datasets. We evaluated a Bi-LSTM\u2009+\u2009CRF sequence labeling architecture, combined with Flair\u2009+\u2009FastText word embeddings, on a test set of manually annotated clinical reports. The model outperformed the other tested models with a significant F1 score of 96,96%, demonstrating the effectiveness of our automatic approach for deidentifying sensitive information.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This study provides an automatic de-identification pipeline for clinical notes, which can facilitate the reuse of EHRs for secondary purposes such as clinical research. Our study highlights the importance of using advanced NLP techniques for effective de-identification, as well as the need for innovative solutions such as distant supervision to overcome the challenge of limited annotated data in the medical domain.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-024-02422-5","type":"journal-article","created":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T01:02:41Z","timestamp":1708045361000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Automatic de-identification of French electronic health records: a cost-effective approach exploiting distant supervision and deep learning models"],"prefix":"10.1186","volume":"24","author":[{"given":"Mohamed El","family":"Azzouzi","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gouenou","family":"Coatrieux","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Reda","family":"Bellafqira","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Denis","family":"Delamarre","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christine","family":"Riou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Naima","family":"Oubenali","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sandie","family":"Cabon","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marc","family":"Cuggia","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guillaume","family":"Bouzill\u00e9","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,2,16]]},"reference":[{"issue":"6","key":"2422_CR1","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1111\/joim.12119","volume":"274","author":"P Coorevits","year":"2013","unstructured":"Coorevits P, Sundgren M, Klein GO, Bahr A, Claerhout B, Daniel C, et al. Electronic health records: new opportunities for clinical research. J Intern Med. 2013;274(6):547\u201360.","journal-title":"J Intern Med"},{"key":"2422_CR2","doi-asserted-by":"publisher","first-page":"136947","DOI":"10.1109\/ACCESS.2020.3011099","volume":"8","author":"SM Shah","year":"2020","unstructured":"Shah SM, Khan RA. Secondary use of electronic health record: opportunities and challenges. IEEE Access. 2020;8:136947\u201365.","journal-title":"IEEE Access"},{"issue":"1\u20132","key":"2422_CR3","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1016\/S0933-3657(02)00050-7","volume":"26","author":"JJ Berman","year":"2002","unstructured":"Berman JJ. Confidentiality issues for medical data miners. Artif Intell Med. 2002;26(1\u20132):25\u201336.","journal-title":"Artif Intell Med"},{"key":"2422_CR4","doi-asserted-by":"crossref","unstructured":"Bourdois L, Avalos M, Chenais G, Thiessard F, Revel P, Gil-Jardine C, et al. De-identification of Emergency Medical Records in French: Survey and Comparison of State-of-the-Art Automated Systems. Int FLAIRS Conf Proc [Internet]. 2021;34. [cited 2024 Jan 19]. Available from: https:\/\/journals.flvc.org\/FLAIRS\/article\/view\/128480.","DOI":"10.32473\/flairs.v34i1.128480"},{"issue":"1","key":"2422_CR5","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1186\/1471-2288-10-70","volume":"10","author":"SM Meystre","year":"2010","unstructured":"Meystre SM, Friedlin FJ, South BR, Shen S, Samore MH. Automatic de-identification of textual documents in the electronic health record: a review of recent research. BMC Med Res Methodol. 2010;10(1):70.","journal-title":"BMC Med Res Methodol"},{"key":"2422_CR6","doi-asserted-by":"publisher","first-page":"19097","DOI":"10.1109\/ACCESS.2021.3054479","volume":"9","author":"R Catelli","year":"2021","unstructured":"Catelli R, Gargiulo F, Casola V, De Pietro G, Fujita H, Esposito M. A novel covid-19 data set and an effective deep learning approach for the de-identification of italian medical records. Ieee Access. 2021;9:19097\u2013110.","journal-title":"Ieee Access"},{"issue":"5","key":"2422_CR7","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1197\/jamia.M2702","volume":"15","author":"FJ Friedlin","year":"2008","unstructured":"Friedlin FJ, McDonald CJ. A software tool for removing patient identifying information from clinical documents. J Am Med Inform Assoc. 2008;15(5):601\u201310.","journal-title":"J Am Med Inform Assoc"},{"issue":"1","key":"2422_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1472-6947-8-32","volume":"8","author":"I Neamatullah","year":"2008","unstructured":"Neamatullah I, Douglass MM, Lehman LWH, Reisner A, Villarroel M, Long WJ, et al. Automated de-identification of free-text medical records. BMC Med Inform Decis Mak. 2008;8(1):1\u201317.","journal-title":"BMC Med Inform Decis Mak"},{"key":"2422_CR9","unstructured":"Paris N, Doutreligne M, Parrot A, Tannier X. D\u00e9sidentification de comptes-rendus hospitaliers dans une base de donn\u00e9es OMOP. In: TALMED 2019\u00a0: Symposium satellite francophone sur le traitement automatique des langues dans le domaine biom\u00e9dical [Internet]. Lyon; 2019 [cited 2023 Jan 9]. Available from: https:\/\/hal.archives-ouvertes.fr\/hal-02564721."},{"key":"2422_CR10","unstructured":"Tannier X, Wajsb\u00fcrt P, Calliger A, Dura B, Mouchet A, Hilka M, et al. Development and validation of a natural language processing algorithm to pseudonymize documents in the context of a clinical data warehouse [Internet]. arXiv; 2023 [cited 2023 Jul 6]. Available from: http:\/\/arxiv.org\/abs\/2303.13451."},{"issue":"3","key":"2422_CR11","doi-asserted-by":"publisher","first-page":"596","DOI":"10.1093\/jamia\/ocw156","volume":"24","author":"F Dernoncourt","year":"2017","unstructured":"Dernoncourt F, Lee JY, Uzuner O, Szolovits P. De-identification of patient notes with recurrent neural networks. J Am Med Inform Assoc. 2017;24(3):596\u2013606.","journal-title":"J Am Med Inform Assoc"},{"key":"2422_CR12","unstructured":"i2b2: Informatics for Integrating Biology & the Bedside [Internet]. [cited 2022 Dec 12]. Available from: https:\/\/www.i2b2.org\/NLP\/DataSets\/."},{"key":"2422_CR13","unstructured":"Johnson, Alistair, Pollard, Tom, Mark, Roger. MIMIC-III Clinical Database [Internet]. PhysioNet; 2015 [cited 2022 Dec 12]. Available from: https:\/\/physionet.org\/content\/mimiciii\/1.4\/."},{"key":"2422_CR14","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1016\/j.jbi.2014.05.002","volume":"50","author":"BR South","year":"2014","unstructured":"South BR, Mowery D, Suo Y, Leng J, Ferr\u00e1ndez \u00d3, Meystre SM, et al. Evaluating the effects of machine pre-annotation and an interactive annotation interface on manual de-identification of clinical text. J Biomed Inform. 2014;50:162\u201372.","journal-title":"J Biomed Inform"},{"issue":"3","key":"2422_CR15","doi-asserted-by":"publisher","first-page":"e17984","DOI":"10.2196\/17984","volume":"8","author":"I Spasic","year":"2020","unstructured":"Spasic I, Nenadic G. Clinical text data in machine learning: systematic review. JMIR Med Inform. 2020;8(3):e17984.","journal-title":"JMIR Med Inform"},{"key":"2422_CR16","doi-asserted-by":"crossref","unstructured":"Hathurusinghe R, Nejadgholi I, Bolic M. A Privacy-Preserving Approach to Extraction of Personal Information through Automatic Annotation and Federated Learning [Internet]. arXiv; 2021 [cited 2023 Jan 22]. Available from: http:\/\/arxiv.org\/abs\/2105.09198.","DOI":"10.18653\/v1\/2021.privatenlp-1.5"},{"key":"2422_CR17","unstructured":"Tarcar AK, Tiwari A, Dhaimodker VN, Rebelo P, Desai R, Rao D. Healthcare NER Models Using Language Model Pretraining [Internet]. arXiv; 2020 [cited 2023 Jan 22]. Available from: http:\/\/arxiv.org\/abs\/1910.11241."},{"issue":"5","key":"2422_CR18","first-page":"106:1","volume":"51","author":"A Smirnova","year":"2018","unstructured":"Smirnova A, Cudr\u00e9-Mauroux P. Relation extraction using distant supervision: a survey. ACM Comput Surv. 2018;51(5):106:1\u2013106:35.","journal-title":"ACM Comput Surv."},{"key":"2422_CR19","doi-asserted-by":"crossref","unstructured":"Meng Y, Zhang Y, Huang J, Wang X, Zhang Y, Ji H, et al. Distantly-supervised named entity recognition with noise-robust learning and language model augmented self-training [Internet]. arXiv; 2021 [cited 2023 Jan 22]. Available from: http:\/\/arxiv.org\/abs\/2109.05003.","DOI":"10.18653\/v1\/2021.emnlp-main.810"},{"issue":"3","key":"2422_CR20","doi-asserted-by":"publisher","first-page":"269","DOI":"10.14778\/3157794.3157797","volume":"11","author":"A Ratner","year":"2017","unstructured":"Ratner A, Bach SH, Ehrenberg H, Fries J, Wu S, R\u00e9 C. Snorkel: rapid training data creation with weak supervision. Proc VLDB Endow. 2017;11(3):269\u201382.","journal-title":"Proc VLDB Endow"},{"key":"2422_CR21","doi-asserted-by":"crossref","unstructured":"Gardner J, Xiong L. HIDE: An integrated system for health information de-identification. In: 2008 21st IEEE international symposium on computer-based medical systems. 2008. p. 254\u20139.","DOI":"10.1109\/CBMS.2008.129"},{"key":"2422_CR22","unstructured":"Computational analysis and understanding of natural languages: principles, methods and applications. Elsevier; 2018. 540."},{"issue":"2","key":"2422_CR23","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1309\/E6K33GBPE5C27FYU","volume":"121","author":"D Gupta","year":"2004","unstructured":"Gupta D, Saul M, Gilbertson J. Evaluation of a de-identification (De-Id) software engine to share pathology reports and clinical documents for research. Am J Clin Pathol. 2004;121(2):176\u201386.","journal-title":"Am J Clin Pathol"},{"key":"2422_CR24","first-page":"23","volume":"244","author":"V Foufi","year":"2017","unstructured":"Foufi V, Gaudet-Blavignac C, Chevrier R, Lovis C. De-identification of medical narrative data. Stud Health Technol Inf. 2017;244:23\u20137.","journal-title":"Stud Health Technol Inf"},{"key":"2422_CR25","unstructured":"Amirat Y. Extraction d\u2019entit\u00e9s nomm\u00e9es par apprentissage profond [Internet]. Montr\u00e9al (Qu\u00e9bec, Canada): Universit\u00e9 du Qu\u00e9bec \u00e0 Montr\u00e9al; 2020 [cited 2022 Dec 12]. Available from: https:\/\/archipel.uqam.ca\/14076\/."},{"issue":"4","key":"2422_CR26","doi-asserted-by":"publisher","first-page":"586","DOI":"10.1111\/0824-7935.00129","volume":"16","author":"S Baluja","year":"2000","unstructured":"Baluja S, Mittal VO, Sukthankar R. Applying machine learning for high-performance named-entity extraction. Comput Intell. 2000;16(4):586\u201395.","journal-title":"Comput Intell"},{"key":"2422_CR27","unstructured":"Guo Y, Gaizauskas R, Roberts I, Demetriou G, Hepple M. Identifying personal health information using support vector machines.\u00a0i2b2 workshop on challenges in natural language processing for clinical data. 2006."},{"key":"2422_CR28","doi-asserted-by":"publisher","first-page":"S39","DOI":"10.1016\/j.jbi.2015.08.012","volume":"58","author":"B He","year":"2015","unstructured":"He B, Guan Y, Cheng J, Cen K, Hua W. CRFs based de-identification of medical records. J Biomed Inform. 2015;58:S39\u201346.","journal-title":"J Biomed Inform"},{"key":"2422_CR29","doi-asserted-by":"publisher","first-page":"S47","DOI":"10.1016\/j.jbi.2015.06.009","volume":"58","author":"Z Liu","year":"2015","unstructured":"Liu Z, Chen Y, Tang B, Wang X, Chen Q, Li H, et al. Automatic de-identification of electronic medical records using token-level and character-level conditional random fields. J Biomed Inform. 2015;58:S47\u201352.","journal-title":"J Biomed Inform"},{"key":"2422_CR30","doi-asserted-by":"publisher","first-page":"S30","DOI":"10.1016\/j.jbi.2015.06.015","volume":"58","author":"H Yang","year":"2015","unstructured":"Yang H, Garibaldi JM. Automatic detection of protected health information from clinic narratives. J Biomed Inform. 2015;58:S30\u20138.","journal-title":"J Biomed Inform"},{"issue":"5","key":"2422_CR31","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1136\/amiajnl-2011-000163","volume":"18","author":"M Jiang","year":"2011","unstructured":"Jiang M, Chen Y, Liu M, Rosenbloom ST, Mani S, Denny JC, et al. A study of machine-learning-based approaches to extract clinical entities and their assertions from discharge summaries. J Am Med Inform Assoc JAMIA. 2011;18(5):601\u20136.","journal-title":"J Am Med Inform Assoc JAMIA"},{"key":"2422_CR32","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-D\u00edez I, P\u00e9rez-Moraga R, L\u00f3pez-Cerd\u00e1n A, Salinas-Serrano JM, la Iglesia-Vay\u00e1 M, de. De-identifying Spanish medical texts-named entity recognition applied to radiology reports. J Biomed Semant. 2021;12(1):1\u201313.","DOI":"10.1186\/s13326-021-00236-2"},{"key":"2422_CR33","doi-asserted-by":"crossref","unstructured":"zhang W, Jiang S, Zhao S, Hou K, Liu Y, Zhang L. A BERT-BiLSTM-CRF Model for Chinese Electronic Medical Records Named Entity Recognition. In: 2019 12th International Conference on Intelligent Computation Technology and Automation (ICICTA). 2019. p. 166\u20139.","DOI":"10.1109\/ICICTA49267.2019.00043"},{"key":"2422_CR34","first-page":"165","volume":"253","author":"P Richter-Pechanski","year":"2018","unstructured":"Richter-Pechanski P, Riezler S, Dieterich C. De-identification of german medical admission notes. Stud Health Technol Inform. 2018;253:165\u20139.","journal-title":"Stud Health Technol Inform"},{"issue":"8","key":"2422_CR35","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735\u201380.","journal-title":"Neural Comput"},{"key":"2422_CR36","unstructured":"Huang Z, Xu W, Yu K. Bidirectional LSTM-CRF models for sequence tagging. ArXiv Prepr ArXiv150801991. 2015;"},{"issue":"Suppl","key":"2422_CR37","doi-asserted-by":"publisher","first-page":"S34","DOI":"10.1016\/j.jbi.2017.05.023","volume":"75","author":"Z Liu","year":"2017","unstructured":"Liu Z, Tang B, Wang X, Chen Q. De-identification of clinical notes via recurrent neural network and conditional random field. J Biomed Inform. 2017;75(Suppl):S34\u201342.","journal-title":"J Biomed Inform"},{"key":"2422_CR38","first-page":"857","volume":"2019","author":"B Tang","year":"2020","unstructured":"Tang B, Jiang D, Chen Q, Wang X, Yan J, Shen Y. De-identification of clinical text via bi-LSTM-CRF with neural language models. AMIA Annu Symp Proc. 2020;2019:857\u201363.","journal-title":"AMIA Annu Symp Proc"},{"key":"2422_CR39","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. ArXiv Prepr ArXiv181004805. 2018;"},{"key":"2422_CR40","doi-asserted-by":"crossref","unstructured":"Martin L, Muller B, Su\u00e1rez PJO, Dupont Y, Romary L, de La Clergerie \u00c9V, et al. CamemBERT: a tasty French language model. ArXiv Prepr ArXiv191103894. 2019;","DOI":"10.18653\/v1\/2020.acl-main.645"},{"key":"2422_CR41","unstructured":"Le H, Vial L, Frej J, Segonne V, Coavoux M, Lecouteux B, et al. Flaubert: Unsupervised language model pre-training for french. ArXiv Prepr ArXiv191205372. 2019;"},{"key":"2422_CR42","unstructured":"Devlin J, Chang MW, Lee K, Toutanova K. BERT: Pre-training of deep bidirectional transformers for language understanding. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for computational linguistics: human language technologies, (Long and Short Papers). Minneapolis: Association for Computational Linguistics; 2019;1:4171\u201386. [cited 2022 Dec 12]. Available from: https:\/\/aclanthology.org\/N19-1423."},{"key":"2422_CR43","unstructured":"Su\u00e1rez PJO, Dupont Y, Muller B, Romary L, Sagot B. Establishing a new state-of-the-art for French named entity recognition [Internet]. arXiv; 2020 [cited 2022 Oct 21]. Available from: http:\/\/arxiv.org\/abs\/2005.13236."},{"key":"2422_CR44","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning C. GloVe: Global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Doha: Association for Computational Linguistics; 2014;1532\u201343. [cited 2022 Nov 29]. Available from: https:\/\/aclanthology.org\/D14-1162.","DOI":"10.3115\/v1\/D14-1162"},{"key":"2422_CR45","unstructured":"Mikolov T, Chen K, Corrado G, Dean J. Efficient Estimation of Word Representations in Vector Space [Internet]. arXiv; 2013 [cited 2022 Nov 29]. Available from: http:\/\/arxiv.org\/abs\/1301.3781."},{"key":"2422_CR46","unstructured":"Liu Y, Ott M, Goyal N, Du J, Joshi M, Chen D, et al. RoBERTa: A Robustly Optimized BERT Pretraining Approach [Internet]. arXiv; 2019 [cited 2022 Nov 29]. Available from: http:\/\/arxiv.org\/abs\/1907.11692."},{"key":"2422_CR47","unstructured":"Akbik A, Blythe D, Vollgraf R. Contextual string embeddings for sequence labeling. In: Proceedings of the 27th international conference on computational linguistics. 2018. 1638\u201349."},{"key":"2422_CR48","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1162\/tacl_a_00051","volume":"5","author":"P Bojanowski","year":"2017","unstructured":"Bojanowski P, Grave E, Joulin A, Mikolov T. Enriching word vectors with subword information. Trans Assoc Comput Linguist. 2017;5:135\u201346.","journal-title":"Trans Assoc Comput Linguist"},{"key":"2422_CR49","unstructured":"Li Y, Liu T, Li D, Li Q, Shi J, Wang Y. Character-based BiLSTM-CRF incorporating POS and dictionaries for Chinese opinion target extraction. In: Proceedings of the 10th Asian Conference on machine learning [Internet]. PMLR; 2018 [cited 2022 Nov 29]. p. 518\u201333. Available from: https:\/\/proceedings.mlr.press\/v95\/li18d.html."},{"key":"2422_CR50","unstructured":"Lafferty J, McCallum A, Pereira F. Conditional random fields: probabilistic models for segmenting and labeling sequence data. Dep Pap CIS [Internet]. 2001; Available from: https:\/\/repository.upenn.edu\/cis_papers\/159."},{"key":"2422_CR51","first-page":"1536","volume":"264","author":"J Madec","year":"2019","unstructured":"Madec J, Bouzill\u00e9 G, Riou C, van Hille P, Merour C, Artigny ML, et al. eHOP clinical data warehouse: from a prototype to the creation of an inter-regional clinical data centers network. Stud Health Technol Inform. 2019;264:1536\u20137.","journal-title":"Stud Health Technol Inform"},{"key":"2422_CR52","unstructured":"Base Adresse Nationale (BAN) - data.gouv.fr [Internet]. [cited 2023 Jun 28]. Available from: https:\/\/www.data.gouv.fr\/fr\/datasets\/base-adresse-nationale\/."},{"key":"2422_CR53","unstructured":"Extractions en libre acc\u00e8s - L\u2019Annuaire Sant\u00e9 [Internet]. [cited 2023 Jul 10]. Available from: https:\/\/annuaire.sante.fr\/web\/site-pro\/extractions-publiques."},{"key":"2422_CR54","unstructured":"Ramshaw L, Marcus M. Text Chunking using transformation-based learning. In: Third Workshop on very large corpora [Internet]. 1995 [cited 2022 Dec 12]. Available from: https:\/\/aclanthology.org\/W95-0107."},{"key":"2422_CR55","unstructured":"flairNLP\/flair [Internet]. flair; 2022 [cited 2022 Dec 12]. Available from: https:\/\/github.com\/flairNLP\/flair."},{"key":"2422_CR56","unstructured":"Su\u00e1rez PJO, Sagot B, Romary L. Asynchronous pipeline for processing huge corpora on medium to low resource infrastructures. In Leibniz-Institut f\u00fcr Deutsche Sprache; 2019 [cited 2022 Nov 29]. Available from: https:\/\/hal.inria.fr\/hal-02148693."},{"key":"2422_CR57","unstructured":"Transformers [Internet]. [cited 2022 Dec 12]\u00a0. Available from: https:\/\/huggingface.co\/docs\/transformers\/index."},{"key":"2422_CR58","unstructured":"Montani I, Honnibal M. Prodigy: A new annotation tool for radically efficient machine teaching.\u00a0Artificial Intelligence to appear. 2018."},{"issue":"1","key":"2422_CR59","doi-asserted-by":"publisher","first-page":"23","DOI":"10.3390\/asi4010023","volume":"4","author":"U Naseem","year":"2021","unstructured":"Naseem U, Khushi M, Khan SK, Shaukat K, Moni MA. A comparative analysis of active learning for biomedical text mining. Appl Syst Innov. 2021;4(1):23.","journal-title":"Appl Syst Innov"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02422-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-024-02422-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-024-02422-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,16]],"date-time":"2024-02-16T01:03:46Z","timestamp":1708045426000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-024-02422-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,16]]},"references-count":59,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["2422"],"URL":"https:\/\/doi.org\/10.1186\/s12911-024-02422-5","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-3316615\/v1","asserted-by":"object"}]},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,16]]},"assertion":[{"value":"1 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authorization to conduct research with the Rennes clinical data warehouse was granted by the CNIL-Commission Nationale Informatique et Libert\u00e9s (authorization number 2020\u2013028 issued on 27 February 2020). Informed consent has been waived by the CNIL-Commission Nationale Informatique et Libert\u00e9s (authorization number 2020\u2013028 issued on February 27, 2020). This research is conducted in compliance with the principles of the Declaration of Helsinki.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"54"}}