{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,19]],"date-time":"2026-04-19T22:47:55Z","timestamp":1776638875471,"version":"3.51.2"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,2,8]],"date-time":"2022-02-08T00:00:00Z","timestamp":1644278400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,2,8]],"date-time":"2022-02-08T00:00:00Z","timestamp":1644278400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Unstructured data from electronic health records represent a wealth of information. Doc\u2019EDS is a pre-screening tool based on textual and semantic analysis. The Doc\u2019EDS system provides a graphic user interface to search documents in French. The aim of this study was to present the Doc\u2019EDS tool and to provide a formal evaluation of its semantic features.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Doc\u2019EDS is a search tool built on top of the clinical data warehouse developed at Rouen University Hospital. This tool is a multilevel search engine combining structured and unstructured data. It also provides basic analytical features and semantic utilities. A formal evaluation was conducted to measure the impact of Natural Language Processing algorithms.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Approximately 18.1 million narrative documents are stored in Doc\u2019EDS. The formal evaluation was conducted in 5000 clinical concepts that were manually collected. The F-measures of negative concepts and hypothetical concepts were respectively 0.89 and 0.57.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>In this formal evaluation, we have shown that Doc\u2019EDS is able to deal with language subtleties to enhance an advanced full text search in French health documents. The Doc\u2019EDS tool is currently used on a daily basis to help researchers to identify patient cohorts thanks to unstructured data.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12911-022-01762-4","type":"journal-article","created":{"date-parts":[[2022,2,8]],"date-time":"2022-02-08T06:05:08Z","timestamp":1644300308000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":26,"title":["Evaluation of Doc\u2019EDS: a French semantic search tool to query health documents from a clinical data warehouse"],"prefix":"10.1186","volume":"22","author":[{"given":"Thibaut","family":"Pressat-Laffouilh\u00e8re","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pierre","family":"Balay\u00e9","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Badisse","family":"Dahamna","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Romain","family":"Lelong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"K\u00e9vin","family":"Billey","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"St\u00e9fan J.","family":"Darmoni","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7446-644X","authenticated-orcid":false,"given":"Julien","family":"Grosjean","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,2,8]]},"reference":[{"key":"1762_CR1","unstructured":"Raghavan P, Chen JL, Fosler-Lussier E, Lai AM. How essential are unstructured clinical narratives and information fusion to clinical trial recruitment? 6."},{"key":"1762_CR2","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.ijmedinf.2019.05.018","volume":"129","author":"SM Meystre","year":"2019","unstructured":"Meystre SM, Heider PM, Kim Y, Aruch DB, Britten CD. Automatic trial eligibility surveillance based on unstructured clinical data. Int J Med Inform. 2019;129:13\u20139.","journal-title":"Int J Med Inform"},{"key":"1762_CR3","doi-asserted-by":"crossref","unstructured":"Garcelon N, Neuraz A, Benoit V, Salomon R, Burgun A. Improving a full-text search engine: the importance of negation detection and family history context to identify cases in a biomedical data warehouse. J Am Med Inform Assoc. 2016;144.","DOI":"10.1093\/jamia\/ocw144"},{"issue":"2","key":"1762_CR4","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1136\/jamia.2010.007237","volume":"18","author":"ST Rosenbloom","year":"2011","unstructured":"Rosenbloom ST, Denny JC, Xu H, Lorenzi N, Stead WW, Johnson KB. Data from clinical notes: a perspective on the tension between structure and flexible documentation. J Am Med Inform Assoc. 2011;18(2):181\u20136.","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"1762_CR5","first-page":"380","volume":"36","author":"M Karami","year":"2017","unstructured":"Karami M, Rahimi A, Shahmirzadi AH. Clinical data warehouse: an effective tool to create intelligence in disease management. Health Prog. 2017;36(4):380\u20134.","journal-title":"Health Prog"},{"key":"1762_CR6","doi-asserted-by":"publisher","first-page":"156","DOI":"10.1016\/j.ijmedinf.2017.04.002","volume":"102","author":"M Plantier","year":"2017","unstructured":"Plantier M, Havet N, Durand T, Caquot N, Amaz C, Biron P, et al. Does adoption of electronic health records improve the quality of care management in France? Results from the French e-SI (PREPS-SIPS) study. Int J Med Inform. 2017;102:156\u201365.","journal-title":"Int J Med Inform"},{"issue":"6","key":"1762_CR7","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1177\/0009922819834278","volume":"58","author":"L Grammatico-Guillon","year":"2019","unstructured":"Grammatico-Guillon L, Shea K, Jafarzadeh SR, Camelo I, Maakaroun-Vermesse Z, Figueira M, et al. Antibiotic prescribing in outpatient children: a cohort from a clinical data warehouse. Clin Pediatr (Phila). 2019;58(6):681\u201390.","journal-title":"Clin Pediatr (Phila)"},{"issue":"2","key":"1762_CR8","doi-asserted-by":"publisher","first-page":"124","DOI":"10.4258\/hir.2019.25.2.124","volume":"25","author":"J Kang","year":"2019","unstructured":"Kang J, Kim JH, Lee KH, Lee WS, Chang HW, Kim JS, et al. Risk factor analysis of extended opioid use after coronary artery bypass grafting: a clinical data warehouse-based study. Healthcare Inform Res. 2019;25(2):124.","journal-title":"Healthcare Inform Res"},{"key":"1762_CR9","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.ijmedinf.2017.02.006","volume":"102","author":"A-S Jannot","year":"2017","unstructured":"Jannot A-S, Zapletal E, Avillach P, Mamzer M-F, Burgun A, Degoulet P. The Georges Pompidou University hospital clinical data warehouse: a 8-years follow-up experience. Int J Med Inform. 2017;102:21\u20138.","journal-title":"Int J Med Inform"},{"key":"1762_CR10","unstructured":"Murphy SN, Mendis ME, Berkowitz DA, Kohane I, Chueh HC. Integration of clinical and genetic data in the i2b2 architecture. In: AMIA annu symposium proceedings 2006;1040."},{"key":"1762_CR11","unstructured":"Lowe HJ, Ferris TA, Nd PMH, Weber SC. STRIDE-an integrated standards-based translational research informatics platform 5."},{"key":"1762_CR12","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.jbi.2014.02.003","volume":"52","author":"I Danciu","year":"2014","unstructured":"Danciu I, Cowan JD, Basford M, Wang X, Saip A, Osgood S, et al. Secondary use of clinical data: The vanderbilt approach. J Biomed Inform. 2014;52:28\u201335.","journal-title":"J Biomed Inform"},{"key":"1762_CR13","doi-asserted-by":"crossref","unstructured":"Khalaf Hamoud A, Salah Hashim A, Akeel Awadh W. Clinical data warehouse a review. Ijci. 2018 [cited 2019 Jul 2];44(2).","DOI":"10.25195\/2017\/4424"},{"key":"1762_CR14","doi-asserted-by":"crossref","unstructured":"Vydiswaran VGV, Strayhorn A, Zhao X, Robinson P, Agarwal M, Bagazinski E, et al. Hybrid bag of approaches to characterize selection criteria for cohort identification. J Am Med Inform Assoc. 2019;ocz079.","DOI":"10.1093\/jamia\/ocz079"},{"key":"1762_CR15","doi-asserted-by":"publisher","first-page":"103943","DOI":"10.1016\/j.ijmedinf.2019.08.003","volume":"130","author":"X Zhou","year":"2019","unstructured":"Zhou X, Wang Y, Sohn S, Therneau TM, Liu H, Knopman DS. Automatic extraction and assessment of lifestyle exposures for Alzheimer\u2019s disease using natural language processing. Int J Med Inform. 2019;130:103943.","journal-title":"Int J Med Inform"},{"key":"1762_CR16","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1016\/j.jbi.2015.05.003","volume":"55","author":"DA Hanauer","year":"2015","unstructured":"Hanauer DA, Mei Q, Law J, Khanna R, Zheng K. Supporting information retrieval from electronic health records: a report of University of Michigan\u2019s nine-year experience in developing and using the electronic medical record search engine (EMERSE). J Biomed Inform. 2015;55:290\u2013300.","journal-title":"J Biomed Inform"},{"key":"1762_CR17","unstructured":"Liu S, Wang Y, Wen A, Wang L, Hong N, Shen F, et al. CREATE: cohort retrieval enhanced by analysis of text from electronic health records using OMOP common data model. 14."},{"key":"1762_CR18","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.jbi.2018.02.019","volume":"80","author":"N Garcelon","year":"2018","unstructured":"Garcelon N, Neuraz A, Salomon R, Faour H, Benoit V, Delapalme A, et al. A clinician friendly data warehouse oriented toward narrative reports: Dr. Warehouse. J Biomed Inform. 2018;80:52\u201363.","journal-title":"J Biomed Inform"},{"key":"1762_CR19","unstructured":"Cuggia M, Garcelon N, Campillo-Gimenez B, Bernicot T, Laurent JF, Garin E, Happe A, Duvauferrier R. Roogle: an information retrieval engine for clinical data warehouse. Stud Health Technol Inform 2011;584\u2013588."},{"key":"1762_CR20","first-page":"949","volume":"180","author":"J Grosjean","year":"2012","unstructured":"Grosjean J, Merabti T, Griffon N, Dahamna B, Darmoni SJ. Teaching medicine with a terminology\/ontology portal. Stud Health Technol Inform. 2012;180:949\u201353.","journal-title":"Stud Health Technol Inform"},{"key":"1762_CR21","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1055\/s-0038-1634945","volume":"32","author":"DAB Lindberg","year":"1993","unstructured":"Lindberg DAB, Humphreys BL, McCray AT. The unified medical language system. Methods Inf Med. 1993;32:281\u201391.","journal-title":"Methods Inf Med"},{"key":"1762_CR22","first-page":"126","volume":"235","author":"C Cabot","year":"2017","unstructured":"Cabot C, Soualmia LF, Grosjean J, Griffon N, Darmoni SJ. Evaluation of the terminology coverage in the French Corpus LiSSa. Stud Health Technol Inform. 2017;235:126\u201330.","journal-title":"Stud Health Technol Inform"},{"issue":"7","key":"1762_CR23","doi-asserted-by":"publisher","first-page":"465","DOI":"10.1016\/j.medmal.2018.03.007","volume":"48","author":"L De L\u00e9otoing","year":"2018","unstructured":"De L\u00e9otoing L, Barbier F, Dinh A, Breilh D, Chaize G, Vainchtock A, et al. French hospital discharge database (PMSI) and bacterial resistance: is coding adapted to hospital epidemiology? Med Mal Infect. 2018;48(7):465\u201373.","journal-title":"Med Mal Infect"},{"issue":"1","key":"1762_CR24","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.respe.2017.10.002","volume":"66","author":"A Perozziello","year":"2018","unstructured":"Perozziello A, Gauss T, Diop A, Frank-Soltysiak M, Rufat P, Raux M, et al. La codification PMSI identifie mal les traumatismes graves. Revue d\u2019\u00c9pid\u00e9miologie et de Sant\u00e9 Publique. 2018;66(1):43\u201352.","journal-title":"Revue d\u2019\u00c9pid\u00e9miologie et de Sant\u00e9 Publique"},{"issue":"5","key":"1762_CR25","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1097\/01.mlr.0000160417.39497.a9","volume":"43","author":"E Birman-Deych","year":"2005","unstructured":"Birman-Deych E, Waterman AD, Yan Y, Nilasena DS, Radford MJ, Gage BF. Accuracy of ICD-9-CM codes for identifying cardiovascular and stroke risk factors. Med Care. 2005;43(5):480\u20135.","journal-title":"Med Care"},{"issue":"01","key":"1762_CR26","doi-asserted-by":"publisher","first-page":"191","DOI":"10.4338\/ACI-2013-08-CR-0065","volume":"05","author":"P Biron","year":"2014","unstructured":"Biron P, Metzger MH, Pezet C, Sebban C, Barthuet E, Durand T. An information retrieval system for computerized patient records in the context of a daily hospital practice: the example of the L\u00e9on B\u00e9rard Cancer Center (France). Appl Clin Inform. 2014;05(01):191\u2013205.","journal-title":"Appl Clin Inform"}],"updated-by":[{"DOI":"10.1186\/s12911-022-01839-0","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2022,4,22]],"date-time":"2022-04-22T00:00:00Z","timestamp":1650585600000}}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01762-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-022-01762-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-022-01762-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,4,23]],"date-time":"2022-04-23T02:02:39Z","timestamp":1650679359000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-022-01762-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,8]]},"references-count":26,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["1762"],"URL":"https:\/\/doi.org\/10.1186\/s12911-022-01762-4","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-59497\/v1","asserted-by":"object"}]},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,8]]},"assertion":[{"value":"2 September 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 January 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 February 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 April 2022","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1186\/s12911-022-01839-0","URL":"https:\/\/doi.org\/10.1186\/s12911-022-01839-0","order":7,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The French Data Protection Authority (CNIL) approved the construction and the usage of the Rouen University Hospital Clinical DataWarehouse, based on a declaration compatible with the General Data Protection Regulation applicable in France. As collecting consents on more than 2 million people is not possible, a global public information has been made and individual information is provided for each new patient in the hospital.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"This publication does not contain personal data and the Rouen University Hospital Clinical DataWarehouse only stores deidentified data.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"34"}}