{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T14:35:45Z","timestamp":1781188545868,"version":"3.54.1"},"reference-count":47,"publisher":"Oxford University Press (OUP)","issue":"e1","content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2015,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Background Radiology reports are usually narrative, unstructured text, a format which hinders the ability to input report contents into decision support systems. In addition, reports often describe multiple lesions, and it is challenging to automatically extract information on each lesion and its relationships to characteristics, anatomic locations, and other information that describes it. The goal of our work is to develop natural language processing (NLP) methods to recognize each lesion in free-text mammography reports and to extract its corresponding relationships, producing a complete information frame for each lesion.<\/jats:p>\n               <jats:p>Materials and methods We built an NLP information extraction pipeline in the General Architecture for Text Engineering (GATE) NLP toolkit. Sequential processing modules are executed, producing an output information frame required for a mammography decision support system. Each lesion described in the report is identified by linking it with its anatomic location in the breast. In order to evaluate our system, we selected 300 mammography reports from a hospital report database.<\/jats:p>\n               <jats:p>Results The gold standard contained 797 lesions, and our system detected 815 lesions (780 true positives, 35 false positives, and 17 false negatives). The precision of detecting all the imaging observations with their modifiers was 94.9, recall was 90.9, and the F measure was 92.8.<\/jats:p>\n               <jats:p>Conclusions Our NLP system extracts each imaging observation and its characteristics from mammography reports. Although our application focuses on the domain of mammography, we believe our approach can generalize to other domains and may narrow the gap between unstructured clinical report text and structured information extraction needed for data mining and decision support.<\/jats:p>","DOI":"10.1136\/amiajnl-2014-003009","type":"journal-article","created":{"date-parts":[[2014,10,29]],"date-time":"2014-10-29T03:49:40Z","timestamp":1414554580000},"page":"e81-e92","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":33,"title":["Automatic abstraction of imaging observations with their characteristics from mammography reports"],"prefix":"10.1093","volume":"22","author":[{"given":"Selen","family":"Bozkurt","sequence":"first","affiliation":[{"name":"Department of Biostatistics and Medical Informatics, Akdeniz University Faculty of Medicine, Antalya, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jafi A","family":"Lipson","sequence":"additional","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Utku","family":"Senol","sequence":"additional","affiliation":[{"name":"Department of Radiology, Akdeniz University Faculty of Medicine, Antalya, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel L","family":"Rubin","sequence":"additional","affiliation":[{"name":"Department of Radiology, Stanford University, Stanford, California, USA"},{"name":"Department of Medicine (Biomedical Informatics Research), Stanford University, Stanford, California, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2014,10,28]]},"reference":[{"key":"2020110613001857300_R1","doi-asserted-by":"crossref","first-page":"1493","DOI":"10.1056\/NEJM199412013312206","article-title":"Variability in radiologists\u2019 interpretations of mammograms","volume":"331","author":"Elmore","year":"1994","journal-title":"N Engl J Med"},{"key":"2020110613001857300_R2","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1148\/radiol.220001257","article-title":"Potential of computer-aided diagnosis to reduce variability in radiologists\u2019 interpretations of mammograms depicting microcalcifications","volume":"220","author":"Jiang","year":"2001","journal-title":"Radiology"},{"key":"2020110613001857300_R3","doi-asserted-by":"crossref","first-page":"1801","DOI":"10.1093\/jnci\/90.23.1801","article-title":"Variability and accuracy in mammographic interpretation using the American College of Radiology Breast Imaging Reporting and Data System","volume":"90","author":"Kerlikowske","year":"1998","journal-title":"J Natl Cancer Inst"},{"key":"2020110613001857300_R4","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1016\/S0033-8389(01)00017-3","article-title":"Breast imaging reporting and data system (BI-RADS)","volume":"40","author":"Liberman","year":"2002","journal-title":"Radiol Clin North Am"},{"key":"2020110613001857300_R5","doi-asserted-by":"crossref","first-page":"397","DOI":"10.3348\/kjr.2007.8.5.397","article-title":"Observer agreement using the ACR Breast Imaging Reporting and Data System (BI-RADS)-ultrasound, First Edition (2003)","volume":"8","author":"Park","year":"2007","journal-title":"Korean J Radiol"},{"key":"2020110613001857300_R6","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1016\/j.jacr.2009.07.023","article-title":"The ACR BI-RADS experience: learning from history","volume":"6","author":"Burnside","year":"2009","journal-title":"J Am Coll Radiol"},{"key":"2020110613001857300_R7","doi-asserted-by":"crossref","first-page":"666","DOI":"10.1148\/radiol.2403051096","article-title":"Bayesian network to predict breast cancer risk of mammographic microcalcifications and reduce number of benign biopsy results: initial experience","volume":"240","author":"Burnside","year":"2006","journal-title":"Radiology"},{"key":"2020110613001857300_R8","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1148\/radiol.2513081346","article-title":"Probabilistic computer model developed from clinical data in national mammography database format to classify mammographic findings","volume":"251","author":"Burnside","year":"2009","journal-title":"Radiology"},{"key":"2020110613001857300_R9","doi-asserted-by":"crossref","first-page":"832509","DOI":"10.1155\/2013\/832509","article-title":"Artificial neural networks in mammography interpretation and diagnostic decision making","volume":"2013","author":"Ayer","year":"2013","journal-title":"Comput Math Methods Med"},{"key":"2020110613001857300_R10","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1148\/radiology.187.1.8451441","article-title":"Artificial neural networks in mammography: application to decision making in the diagnosis of breast cancer","volume":"187","author":"Wu","year":"1993","journal-title":"Radiology"},{"key":"2020110613001857300_R11","first-page":"227","article-title":"Decision support for image interpretation: a mammography workstation","volume":"3","author":"Taylor","year":"1995","journal-title":"Inf Process Med Imaging"},{"key":"2020110613001857300_R12","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1259\/bjr\/33620087","article-title":"Decision support systems for clinical radiological practice\u2014towards the next generation","volume":"83","author":"Stivaros","year":"2010","journal-title":"Br J Radiol"},{"key":"2020110613001857300_R13","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1016\/j.jbi.2009.08.007","article-title":"What can natural language processing do for clinical decision support?","volume":"42","author":"Demner-Fushman","year":"2009","journal-title":"J Biomed Inform"},{"key":"2020110613001857300_R14","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1136\/jamia.1994.95236146","article-title":"A general natural-language text processor for clinical radiology","volume":"1","author":"Friedman","year":"1994","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613001857300_R15","first-page":"216","article-title":"Comparing expert systems for identifying chest x-ray reports that support pneumonia","author":"Chapman","year":"1999","journal-title":"Proc AMIA Symp"},{"key":"2020110613001857300_R16","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1136\/jamia.2009.001560","article-title":"Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications","volume":"17","author":"Savova","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613001857300_R17","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/1472-6947-6-30","article-title":"Extracting principal diagnosis, co-morbidity and smoking status for asthma research: evaluation of a natural language processing system","volume":"6","author":"Zeng","year":"2006","journal-title":"BMC Med Inform Decis Mak"},{"key":"2020110613001857300_R18","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1136\/jamia.2009.002295","article-title":"caTIES: a grid based system for coding and retrieval of surgical pathology reports and tissue specimens in support of translational research","volume":"17","author":"Crowley","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613001857300_R19","first-page":"195","article-title":"The KnowledgeMap project: development of a concept-based medical school curriculum database","author":"Denny","year":"2003","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613001857300_R20","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/S1386-5056(02)00053-9","article-title":"MEDSYNDIKATE\u2014a natural language system for the extraction of medical information from findings reports","volume":"67","author":"Hahn","year":"2002","journal-title":"Int J Med Inform"},{"key":"2020110613001857300_R21","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1136\/jamia.2009.002733","article-title":"An overview of MetaMap: historical perspective and recent advances","volume":"17","author":"Aronson","year":"2010","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613001857300_R22","doi-asserted-by":"crossref","first-page":"28","DOI":"10.2174\/1874431101206010028","article-title":"Retrieval of radiology reports citing critical findings with disease-specific customization","volume":"6","author":"Lacson","year":"2012","journal-title":"Open Med Inform J"},{"key":"2020110613001857300_R23","first-page":"692","article-title":"Natural language processing for lines and devices in portable chest x-rays","volume":"2010","author":"Rubin","year":"2010","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613001857300_R24","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1007\/s10278-012-9531-1","article-title":"Automatic retrieval of bone fracture knowledge using natural language processing","volume":"26","author":"Do","year":"2013","journal-title":"J Digit Imaging"},{"key":"2020110613001857300_R25","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s10278-009-9215-7","article-title":"Discerning tumor status from unstructured MRI reports\u2014completeness of information in existing reports and utility of automated natural language processing","volume":"23","author":"Cheng","year":"2010","journal-title":"J Digit Imaging"},{"key":"2020110613001857300_R26","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.jbi.2012.12.005","article-title":"A text processing pipeline to extract recommendations from radiology reports","volume":"46","author":"Yetisgen-Yildiz","year":"2013","journal-title":"J Biomed Inform"},{"key":"2020110613001857300_R27","first-page":"1593","article-title":"Automatic identification of critical follow-up recommendation sentences in radiology reports","volume":"2011","author":"Yetisgen-Yildiz","year":"2011","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613001857300_R28","first-page":"128","article-title":"Extracting information from textual documents in the electronic health record: a review of recent research","volume":"35","author":"Meystre","year":"2008","journal-title":"Yearb Med Inform"},{"key":"2020110613001857300_R29","first-page":"26","article-title":"Indexing anatomical phrases in neuro-radiology reports to the UMLS 2005AA","author":"Bashyam","year":"2005","journal-title":"AMIA Annu Symp Proc"},{"key":"2020110613001857300_R30","first-page":"449","article-title":"Automated indexing of mammography reports using linear least squares fit","volume":"1214","author":"Burnside","year":"2000","journal-title":"International congress; 14th Computer assisted radiology and surgery; Cars 2000: Comput Assist Radiol Surg"},{"key":"2020110613001857300_R31","first-page":"829","article-title":"Identification of findings suspicious for breast cancer based on natural language processing of mammogram reports","author":"Jain","year":"1997","journal-title":"Proc AMIA Annu Fall Symp"},{"key":"2020110613001857300_R32","first-page":"37","article-title":"Information Extraction for Clinical Data Mining: A Mammography Case Study","author":"Nassif","year":"2009"},{"key":"2020110613001857300_R33","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1016\/j.jbi.2009.07.007","article-title":"Rule-based information extraction from patients\u2019 clinical data","volume":"42","author":"Mykowiecka","year":"2009","journal-title":"J Biomed Inform"},{"key":"2020110613001857300_R34","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/j.jbi.2013.01.006","article-title":"An enhanced CRFs-based system for information extraction from radiology reports","volume":"46","author":"Esuli","year":"2013","journal-title":"J Biomed Inform"},{"key":"2020110613001857300_R35","first-page":"542","article-title":"Identification of suspected tuberculosis patients based on natural language processing of chest radiograph reports","author":"Jain","year":"1996","journal-title":"Proc AMIA Annu Fall Symp"},{"key":"2020110613001857300_R36","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1007\/s10278-011-9411-0","article-title":"Automatically correlating clinical findings and body locations in radiology reports using MedLEE","volume":"25","author":"Sevenster","year":"2012","journal-title":"J Digit Imaging"},{"key":"2020110613001857300_R37","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1136\/amiajnl-2011-000464","article-title":"Natural language processing: an introduction","volume":"18","author":"Nadkarni","year":"2011","journal-title":"J Am Med Inform Assoc"},{"key":"2020110613001857300_R38","doi-asserted-by":"crossref","first-page":"1595","DOI":"10.1148\/rg.266065168","article-title":"RadLex: a new method for indexing online educational materials","volume":"26","author":"Langlotz","year":"2006","journal-title":"Radiographics"},{"key":"2020110613001857300_R39","doi-asserted-by":"crossref","first-page":"e1002854","DOI":"10.1371\/journal.pcbi.1002854","article-title":"Getting more out of biomedical documents with GATE's full lifecycle open source text analytics","volume":"9","author":"Cunningham","year":"2013","journal-title":"PLoS Comput Biol"},{"key":"2020110613001857300_R40","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1016\/j.jbi.2009.05.002","article-title":"ConText: an algorithm for determining negation, experiencer, and temporal status from clinical reports","volume":"42","author":"Harkema","year":"2009","journal-title":"J Biomed Inform"},{"key":"2020110613001857300_R41","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1016\/j.jbi.2011.08.006","article-title":"Coreference resolution: a review of general methodologies and applications in the clinical domain","volume":"44","author":"Zheng","year":"2011","journal-title":"J Biomed Inform"},{"key":"2020110613001857300_R42","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1016\/j.jbi.2012.02.012","article-title":"Lexical patterns, features and knowledge resources for coreference resolution in clinical notes","volume":"45","author":"Gooch","year":"2012","journal-title":"J Biomed Inform"},{"key":"2020110613001857300_R43","article-title":"Metrics for evaluation of ontology-based information extraction","author":"Maynard","year":"2006"},{"key":"2020110613001857300_R44","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1016\/j.jbi.2005.11.004","article-title":"Natural language processing to extract medical problems from electronic clinical documents: performance evaluation","volume":"39","author":"Meystre","year":"2006","journal-title":"J Biomed Inform"},{"key":"2020110613001857300_R45","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/978-1-84882-448-5_16","article-title":"Natural language processing, electronic health records, and clinical research","volume-title":"Clinical research informatics","author":"Liu","year":"2012"},{"key":"2020110613001857300_R46","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1016\/j.jbi.2013.06.004","article-title":"Natural language processing: state of the art and prospects for significant progress, a workshop sponsored by the National Library of Medicine","volume":"46","author":"Friedman","year":"2013","journal-title":"J Biomed Inform"},{"key":"2020110613001857300_R47","first-page":"261","article-title":"Information extraction.","volume":"1","author":"Sarawagi","year":"2008"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/22\/e1\/e81\/34146143\/amiajnl-2014-003009.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/22\/e1\/e81\/34146143\/amiajnl-2014-003009.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T18:43:12Z","timestamp":1604688192000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/22\/e1\/e81\/702315"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,10,28]]},"references-count":47,"journal-issue":{"issue":"e1","published-online":{"date-parts":[[2014,10,28]]},"published-print":{"date-parts":[[2015,4,1]]}},"URL":"https:\/\/doi.org\/10.1136\/amiajnl-2014-003009","relation":{},"ISSN":["1527-974X","1067-5027"],"issn-type":[{"value":"1527-974X","type":"electronic"},{"value":"1067-5027","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,4]]},"published":{"date-parts":[[2014,10,28]]}}}