{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T17:57:25Z","timestamp":1755799045078,"version":"3.40.5"},"reference-count":0,"publisher":"IOS Press","isbn-type":[{"type":"electronic","value":"9781643685335"}],"license":[{"start":{"date-parts":[[2024,8,22]],"date-time":"2024-08-22T00:00:00Z","timestamp":1724284800000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,8,22]]},"abstract":"<jats:p>Named Entity Recognition (NER) models based on Transformers have gained prominence for their impressive performance in various languages and domains. This work delves into the often-overlooked aspect of entity-level metrics and exposes significant discrepancies between token and entity-level evaluations. The study utilizes a corpus of synthetic French oncological reports annotated with entities representing oncological morphologies. Four different French BERT-based models are fine-tuned for token classification, and their performance is rigorously assessed at both token and entity-level. In addition to fine-tuning, we evaluate ChatGPT\u2019s ability to perform NER through prompt engineering techniques. The findings reveal a notable disparity in model effectiveness when transitioning from token to entity-level metrics, highlighting the importance of comprehensive evaluation methodologies in NER tasks. Furthermore, in comparison to BERT, ChatGPT remains limited when it comes to detecting advanced entities in French.<\/jats:p>","DOI":"10.3233\/shti240502","type":"book-chapter","created":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T09:37:24Z","timestamp":1724405844000},"source":"Crossref","is-referenced-by-count":1,"title":["Beyond Tokens: Fair Evaluation of French Large Language Models for Clinical Named Entity Recognition"],"prefix":"10.3233","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8209-6098","authenticated-orcid":false,"given":"Jamil","family":"Zaghir","sequence":"first","affiliation":[{"name":"Division of Medical Information Sciences, Geneva University Hospitals, Geneva, Switzerland"},{"name":"Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland"}]},{"given":"Mina","family":"Bjelogrlic","sequence":"additional","affiliation":[{"name":"Division of Medical Information Sciences, Geneva University Hospitals, Geneva, Switzerland"},{"name":"Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland"}]},{"given":"Jean-Philippe","family":"Goldman","sequence":"additional","affiliation":[{"name":"Division of Medical Information Sciences, Geneva University Hospitals, Geneva, Switzerland"},{"name":"Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland"}]},{"given":"Adel","family":"Bensahla","sequence":"additional","affiliation":[{"name":"Division of Medical Information Sciences, Geneva University Hospitals, Geneva, Switzerland"},{"name":"Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland"}]},{"given":"Yuanyuan","family":"Zheng","sequence":"additional","affiliation":[{"name":"Division of Medical Information Sciences, Geneva University Hospitals, Geneva, Switzerland"},{"name":"Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland"}]},{"given":"Christian","family":"Lovis","sequence":"additional","affiliation":[{"name":"Division of Medical Information Sciences, Geneva University Hospitals, Geneva, Switzerland"},{"name":"Department of Radiology and Medical Informatics, University of Geneva, Geneva, Switzerland"}]}],"member":"7437","container-title":["Studies in Health Technology and Informatics","Digital Health and Informatics Innovations for Sustainable Health Care Systems"],"original-title":[],"link":[{"URL":"https:\/\/ebooks.iospress.nl\/pdf\/doi\/10.3233\/SHTI240502","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T09:37:25Z","timestamp":1724405845000},"score":1,"resource":{"primary":{"URL":"https:\/\/ebooks.iospress.nl\/doi\/10.3233\/SHTI240502"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,22]]},"ISBN":["9781643685335"],"references-count":0,"URL":"https:\/\/doi.org\/10.3233\/shti240502","relation":{},"ISSN":["0926-9630","1879-8365"],"issn-type":[{"type":"print","value":"0926-9630"},{"type":"electronic","value":"1879-8365"}],"subject":[],"published":{"date-parts":[[2024,8,22]]}}}