{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T11:52:33Z","timestamp":1790941953066,"version":"4.1.0"},"reference-count":32,"publisher":"Oxford University Press (OUP)","issue":"10","license":[{"start":{"date-parts":[[2026,8,8]],"date-time":"2026-08-08T00:00:00Z","timestamp":1786147200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006259","name":"Bern University of Applied Sciences","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100006259","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,10,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Information extraction (IE) from clinical texts has advanced rapidly with recent advances in natural language processing, particularly the advent of large language models (LLMs). However, inconsistent and incomplete reporting of methodologies limits reproducibility, comparability, and clinical translation. We aimed to develop a consensus-based reporting guideline tailored to clinical IE studies.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Material and Methods<\/jats:title>\n                    <jats:p>We developed the Clinical Information Extraction Reporting Guideline (CINEX) through a multi-phase process. The initiative was prospectively registered on the EQUATOR Network as a reporting guideline under development, and a detailed Delphi study protocol was published in advance. A scoping review informed an initial set of items, which was refined through a 3-round electronic Delphi study with 20 international experts, followed by a final consensus meeting. Items were iteratively refined based on predefined inclusion criteria and expert feedback.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The final CINEX guideline comprises 29 checklist items grouped into 5 domains: information model, architecture, data, annotation, and outcomes. The 3 eDelphi rounds included 20, 15, and 12 experts, respectively. Two items were added after round one. Consensus for inclusion was reached for a 21 and additional 7 items after rounds 2 and 3, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>CINEX provides a structured framework to improve transparency, reproducibility, and interpretability in clinical IE research. By standardizing reporting of key methodological components, such as data provenance, annotation processes, and evaluation strategies, it facilitates meaningful comparison across studies and supports safer clinical implementation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>CINEX complements existing AI reporting standards by addressing domain-specific challenges in clinical IE.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocag136","type":"journal-article","created":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T11:33:42Z","timestamp":1784633622000},"page":"2040-2050","source":"Crossref","is-referenced-by-count":1,"title":["The consensus-based CINEX guideline for reporting clinical information extraction studies"],"prefix":"10.1093","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8052-3359","authenticated-orcid":false,"given":"Daniel","family":"Reichenpfader","sequence":"first","affiliation":[{"name":"School of Life Sciences, Faculty of Medicine, University of Geneva , Geneva, 1206,","place":["Switzerland"]},{"name":"Institute for Patient-Centered Digital Health, Bern University of Applied Sciences , Biel, 2502,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jamil","family":"Zaghir","sequence":"additional","affiliation":[{"name":"Division of Medical Information Sciences, Geneva University Hospitals , Geneva, 1202,","place":["Switzerland"]},{"name":"Department of Radiology and Medical Informatics, University of Geneva , Geneva, 1202,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elsa","family":"C\u00e9cilia-Joseph","sequence":"additional","affiliation":[{"name":"Universit\u00e9 de Rennes, CHU Rennes, INSERM, LTSI\u2014UMR 1099 , Rennes, F-35000,","place":["France"]},{"name":"CHU Martinique, Centre de Donn\u00e9es Cliniques , Martinique, F-97200,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Boris","family":"Delange","sequence":"additional","affiliation":[{"name":"Universit\u00e9 de Rennes, CHU Rennes, INSERM, LTSI\u2014UMR 1099 , Rennes, F-35000,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anastassia","family":"Shaitarova","sequence":"additional","affiliation":[{"name":"Department of Computational Linguistics, University of Zurich , Zurich, 8050,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emmanuelle","family":"Sylvestre","sequence":"additional","affiliation":[{"name":"Universit\u00e9 de Rennes, CHU Rennes, INSERM, LTSI\u2014UMR 1099 , Rennes, F-35000,","place":["France"]},{"name":"CHU Martinique, Centre de Donn\u00e9es Cliniques , Martinique, F-97200,","place":["France"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabio","family":"Dennst\u00e4dt","sequence":"additional","affiliation":[{"name":"Department of Radiation Oncology, Inselspital, Bern University Hospital and University of Bern , Bern, 3010,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Boya","family":"Zhang","sequence":"additional","affiliation":[{"name":"Faculty of Medicine, University of Geneva , Geneva, 1211,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6238-4503","authenticated-orcid":false,"given":"Douglas","family":"Teodoro","sequence":"additional","affiliation":[{"name":"Department of Radiology and Medical Informatics, University of Geneva , Geneva, 1202,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7632-9625","authenticated-orcid":false,"given":"St\u00e9phane","family":"Meystre","sequence":"additional","affiliation":[{"name":"Institute of Digital Technologies for Personalised Healthcare (MeDiTech), University of Applied Sciences and Arts of Southern Switzerland (SUPSI) , Lugano, 6962,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Henning","family":"M\u00fcller","sequence":"additional","affiliation":[{"name":"Department of Radiology and Medical Informatics, University of Geneva , Geneva, 1202,","place":["Switzerland"]},{"name":"Informatics Institute, HES-SO Valais-Wallis , Sierre, 3960,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kerstin","family":"Denecke","sequence":"additional","affiliation":[{"name":"Institute for Patient-Centered Digital Health, Bern University of Applied Sciences , Biel, 2502,","place":["Switzerland"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,8,8]]},"reference":[{"key":"2026100116373051500_ocag136-B1","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1055\/s-0041-1733909","article-title":"Interaction time with electronic health records: a systematic review","volume":"12","author":"Pinevich","year":"2021","journal-title":"Appl Clin Inform."},{"key":"2026100116373051500_ocag136-B2","doi-asserted-by":"crossref","first-page":"e2344713","DOI":"10.1001\/jamanetworkopen.2023.44713","article-title":"System-level factors and time spent on electronic health records by primary care physicians","volume":"6","author":"Rotenstein","year":"2023","journal-title":"JAMA Netw Open."},{"key":"2026100116373051500_ocag136-B3","author":"Okurowski","year":"1993"},{"key":"2026100116373051500_ocag136-B4","article-title":"Towards a reporting guideline for studies on information extraction from clinical texts","volume-title":"Studies in Health Technology and Informatics","author":"Reichenpfader","year":"2024"},{"key":"2026100116373051500_ocag136-B5","author":"Jurafsky","year":"2026"},{"key":"2026100116373051500_ocag136-B6","volume-title":"Advances In Neural Information Processing Systems","author":"Vaswani","year":"2017"},{"key":"2026100116373051500_ocag136-B7","doi-asserted-by":"crossref","first-page":"100089","DOI":"10.1016\/j.tbench.2023.100089","article-title":"An era of ChatGPT as a significant futuristic support tool: a study on features, abilities, and challenges","volume":"2","author":"Haleem","year":"2022","journal-title":"BenchCouncil Trans Benchmarks Stand Eval"},{"key":"2026100116373051500_ocag136-B8","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1038\/s42254-023-00581-4","article-title":"Science in the age of large language models","volume":"5","author":"Birhane","year":"2023","journal-title":"Nat Rev Phys."},{"key":"2026100116373051500_ocag136-B9","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1038\/s41586-023-06291-2","article-title":"Large language models encode clinical knowledge","volume":"620","author":"Singhal","year":"2023","journal-title":"Nature."},{"key":"2026100116373051500_ocag136-B10","doi-asserted-by":"crossref","first-page":"943","DOI":"10.1038\/s41591-024-03423-7","article-title":"Toward expert-level medical question answering with large language models","volume":"31","author":"Singhal","year":"2025","journal-title":"Nat Med"},{"key":"2026100116373051500_ocag136-B11","doi-asserted-by":"crossref","first-page":"1134","DOI":"10.1038\/s41591-024-02855-5","article-title":"Adapted large language models can outperform medical experts in clinical text summarization","volume":"30","author":"Van Veen","year":"2024","journal-title":"Nat Med"},{"key":"2026100116373051500_ocag136-B12","first-page":"1998","author":"Agrawal","year":"2022"},{"key":"2026100116373051500_ocag136-B13","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1038\/s43856-025-00808-8","article-title":"Comprehensive testing of large language models for extraction of structured data in pathology","volume":"5","author":"Grothey","year":"2025","journal-title":"Commun Med (Lond)"},{"key":"2026100116373051500_ocag136-B14","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1038\/s41746-025-01963-x","article-title":"The evaluation illusion of large language models in medicine","volume":"8","author":"Agrawal","year":"2025","journal-title":"Npj Digit Med"},{"key":"2026100116373051500_ocag136-B15","doi-asserted-by":"crossref","first-page":"e549","DOI":"10.1016\/S2589-7500(20)30219-3","article-title":"Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension","volume":"2","author":"Cruz Rivera","year":"2020","journal-title":"Lancet Digit Health."},{"key":"2026100116373051500_ocag136-B16","doi-asserted-by":"crossref","first-page":"e537","DOI":"10.1016\/S2589-7500(20)30218-1","article-title":"Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension","volume":"2","author":"Liu","year":"2020","journal-title":"Lancet Digit Health."},{"key":"2026100116373051500_ocag136-B17","doi-asserted-by":"crossref","first-page":"e078378","DOI":"10.1136\/bmj-2023-078378","article-title":"TRIPOD\u2009+\u2009AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods","volume":"385","author":"Collins","year":"2024","journal-title":"Bmj."},{"key":"2026100116373051500_ocag136-B18","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1038\/s41591-024-03425-5","article-title":"The TRIPOD-LLM reporting guideline for studies using large language models","volume":"31","author":"Gallifant","year":"2025","journal-title":"Nat Med"},{"key":"2026100116373051500_ocag136-B19","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1038\/s41746-020-00336-w","article-title":"Best practices for authors of healthcare-related artificial intelligence manuscripts","volume":"3","author":"Kakarmath","year":"2020","journal-title":"Npj Digit Med"},{"key":"2026100116373051500_ocag136-B20","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1038\/s43856-024-00492-0","article-title":"Reporting guidelines in medical artificial intelligence: a systematic review and meta-analysis","volume":"4","author":"Kolbinger","year":"2024","journal-title":"Commun Med (Lond)"},{"key":"2026100116373051500_ocag136-B21","doi-asserted-by":"crossref","first-page":"e1000217","DOI":"10.1371\/journal.pmed.1000217","article-title":"Guidance for developers of health research reporting guidelines","volume":"7","author":"Moher","year":"2010","journal-title":"PLoS Med"},{"key":"2026100116373051500_ocag136-B22","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1038\/s41746-024-01219-0","article-title":"A scoping review of large language model based approaches for information extraction from radiology reports","volume":"7","author":"Reichenpfader","year":"2024","journal-title":"Npj Digit Med"},{"key":"2026100116373051500_ocag136-B23","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-658-01928-0","volume-title":"Delphi-Befragungen: Ein Arbeitsbuch","author":"H\u00e4der","year":"2014"},{"key":"2026100116373051500_ocag136-B24","doi-asserted-by":"crossref","first-page":"116","DOI":"10.5662\/wjm.v11.i4.116","article-title":"Delphi methodology in healthcare research: how to decide its appropriateness","volume":"11","author":"Nasa","year":"2021","journal-title":"World J Methodol"},{"key":"2026100116373051500_ocag136-B25","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/j.eujim.2015.07.002","article-title":"Delphi methodology in health research: how to do it?","volume":"7","author":"Trevelyan","year":"2015","journal-title":"Eur J Integr Med."},{"key":"2026100116373051500_ocag136-B26","first-page":"e48245","article-title":"Protocol for a consensus-based reporting guideline for studies on information extraction from clinical texts (CINEX) (preprint)","volume":"12","author":"Reichenpfader","year":"2025","journal-title":"JMIR Res Protoc"},{"key":"2026100116373051500_ocag136-B27","doi-asserted-by":"crossref","first-page":"e1004326","DOI":"10.1371\/journal.pmed.1004326","article-title":"ACCORD (ACcurate COnsensus Reporting Document): a reporting guideline for consensus methods in biomedicine developed via a modified delphi","volume":"21","author":"Gattrell","year":"2024","journal-title":"PLoS Med."},{"key":"2026100116373051500_ocag136-B28","author":"Limesurvey","year":"2025"},{"key":"2026100116373051500_ocag136-B29","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1016\/j.cmi.2024.12.021","article-title":"Guidance on reporting the use of natural language processing methods","volume":"31","author":"Gilad-Bachrach","year":"2025","journal-title":"Clin Microbiol Infect"},{"key":"2026100116373051500_ocag136-B30","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1186\/s13326-020-00231-z","article-title":"Natural language processing algorithms for mapping clinical text fragments onto ontology concepts: a systematic review and recommendations for future studies","volume":"11","author":"Kersloot","year":"2020","journal-title":"J Biomed Semantics"},{"key":"2026100116373051500_ocag136-B31","doi-asserted-by":"crossref","first-page":"1971","DOI":"10.1038\/s41598-023-27481-y","article-title":"Evaluation of the portability of computable phenotypes with natural language processing in the eMERGE network","volume":"13","author":"Pacheco","year":"2023","journal-title":"Sci Rep"},{"key":"2026100116373051500_ocag136-B32","doi-asserted-by":"crossref","first-page":"e32829","DOI":"10.1097\/MD.0000000000032829","article-title":"Use of delphi in health sciences research: a narrative review","volume":"102","author":"Shang","year":"2023","journal-title":"Medicine (Baltimore)"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocag136\/70558541\/ocag136.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/10\/2040\/70558541\/ocag136.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jamia\/article-pdf\/33\/10\/2040\/70558541\/ocag136.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T20:37:42Z","timestamp":1790887062000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/33\/10\/2040\/8756974"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,8]]},"references-count":32,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2026,8,8]]},"published-print":{"date-parts":[[2026,10,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocag136","relation":{},"ISSN":["1067-5027","1527-974X"],"issn-type":[{"value":"1067-5027","type":"print"},{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,10]]},"published":{"date-parts":[[2026,8,8]]}}}