{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T00:11:01Z","timestamp":1772237461626,"version":"3.50.1"},"reference-count":40,"publisher":"JMIR Publications Inc.","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Med Inform"],"abstract":"\n Background<\/jats:title>\n Electronic health records store large amounts of patient clinical data. Despite efforts to structure patient data, clinical notes containing rich patient information remain stored as free text, greatly limiting its exploitation. This includes family history, which is highly relevant for applications such as diagnosis and prognosis.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aims to develop automatic strategies for annotating family history information in clinical notes, focusing not only on the extraction of relevant entities such as family members and disease mentions but also on the extraction of relations between the identified entities.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This study extends a previous contribution for the 2019 track on family history extraction from national natural language processing clinical challenges by improving a previously developed rule-based engine, using deep learning (DL) approaches for the extraction of entities from clinical notes, and combining both approaches in a hybrid end-to-end system capable of successfully extracting family member and observation entities and the relations between those entities. Furthermore, this study analyzes the impact of factors such as the use of external resources and different types of embeddings in the performance of DL models.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n The approaches developed were evaluated in a first task regarding entity extraction and in a second task concerning relation extraction. The proposed DL approach improved observation extraction, obtaining F1 scores of 0.8688 and 0.7907 in the training and test sets, respectively. However, DL approaches have limitations in the extraction of family members. The rule-based engine was adjusted to have higher generalizing capability and achieved family member extraction F1 scores of 0.8823 and 0.8092 in the training and test sets, respectively. The resulting hybrid system obtained F1 scores of 0.8743 and 0.7979 in the training and test sets, respectively. For the second task, the original evaluator was adjusted to perform a more exact evaluation than the original one, and the hybrid system obtained F1 scores of 0.6480 and 0.5082 in the training and test sets, respectively.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n We evaluated the impact of several factors on the performance of DL models, and we present an end-to-end system for extracting family history information from clinical notes, which can help in the structuring and reuse of this type of information. The final hybrid solution is provided in a publicly available code repository.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/22898","type":"journal-article","created":{"date-parts":[[2020,11,3]],"date-time":"2020-11-03T10:25:03Z","timestamp":1604399103000},"page":"e22898","source":"Crossref","is-referenced-by-count":7,"title":["Extraction of Family History Information From Clinical Notes: Deep Learning and Heuristics Approach"],"prefix":"10.2196","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5535-754X","authenticated-orcid":false,"given":"Jo\u00e3o Figueira","family":"Silva","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0729-2264","authenticated-orcid":false,"given":"Jo\u00e3o Rafael","family":"Almeida","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1941-3983","authenticated-orcid":false,"given":"S\u00e9rgio","family":"Matos","sequence":"additional","affiliation":[]}],"member":"1010","published-online":{"date-parts":[[2020,12,29]]},"reference":[{"key":"ref1","author":"Katehakis, DG","year":"2006","journal-title":"Wiley Encyclopedia of Biomedical Engineering"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.5220\/0007349300590067"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2007.07.001"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1109\/cbms.2019.00046"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.2196\/12239"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1038\/srep46226"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1136\/jamia.2010.007237"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.2196\/17984"},{"key":"ref9","first-page":"662","author":"Stearns, MQ","year":"2001","journal-title":"Proc AMIA Symp"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1109\/MITP.2005.122"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMsb042979"},{"key":"ref12","author":"Dick, RS","year":"1997","journal-title":"The Computer-Based Patient Record: An Essential Technology for Health Care, Revised Edition"},{"key":"ref13","first-page":"104","volume":"2017","author":"Wang, Y","year":"2017","journal-title":"AMIA Jt Summits Transl Sci Proc"},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1145\/3341105.3374000"},{"key":"ref15","unstructured":"PatientFM: An end-to-end system for extracting family history information from clinical notesGitHub20202020-12-18https:\/\/github.com\/bioinformatics-ua\/PatientFM"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1098\/rsif.2017.0387"},{"key":"ref17","first-page":"247","author":"Goryachev, S","year":"2008","journal-title":"AMIA Annu Symp Proc"},{"key":"ref18","first-page":"-","author":"Friedlin, J","year":"2006","journal-title":"AMIA Annu Symp Proc"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1017\/s1351324904003523"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.3115\/974281.974299"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.1136\/jamia.2009.001560"},{"key":"ref22","author":"Bird, S","year":"2009","journal-title":"Natural Language Processing with Python: Analyzing Text with the Natural Language Toolkit 1st Edition"},{"key":"ref23","unstructured":"Welcome to Apache OpenNLP The Apache OpenNLP library is a machine learning based toolkit for the processing of natural language textApache OpenNLP2020-06-01http:\/\/opennlp.apache.org\/"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/p14-5010"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.1093\/jamia\/ocx132"},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2105-14-281"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.1186\/s13321-018-0317-4"},{"key":"ref28","unstructured":"MikolovTSutskeverIChenKCorradoGDeanJDistributed Representations of Words and Phrases and Their CompositionalityProceedings of the 26th International Conference on Neural Information Processing Systems - Volume 22013NIPS'13December 5-10, 2013Lake Tahoe31119"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-019-0055-0"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/n18-1202"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.3115\/1614108"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/btz682"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/w19-1909"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1109\/cisp-bmei48845.2019.8965823"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0933-6"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1186\/s12911-019-0995-5"},{"key":"ref37","unstructured":"2019 n2c2 Shared-task and Workshop, Track 2: n2c2\/ohnlp Track on Family History ExtractionHarvard Medical School2020-06-01https:\/\/n2c2.dbmi.hms.harvard.edu\/track2"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.1093\/nar\/gkh061"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/s14-2007"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.3390\/app9183658"}],"container-title":["JMIR Medical Informatics"],"original-title":[],"language":"en","deposited":{"date-parts":[[2020,12,29]],"date-time":"2020-12-29T08:16:06Z","timestamp":1609229766000},"score":1,"resource":{"primary":{"URL":"http:\/\/medinform.jmir.org\/2020\/12\/e22898\/"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,29]]},"references-count":40,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020]]}},"URL":"https:\/\/doi.org\/10.2196\/22898","relation":{"has-preprint":[{"id-type":"doi","id":"10.2196\/preprints.22898","asserted-by":"object"}]},"ISSN":["2291-9694"],"issn-type":[{"value":"2291-9694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,29]]}}}