{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T15:14:59Z","timestamp":1784387699338,"version":"3.55.0"},"reference-count":35,"publisher":"Oxford University Press (OUP)","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Objective Clinical documents made available for secondary use play an increasingly important role in discovery of clinical knowledge, development of research methods, and education. An important step in facilitating secondary use of clinical document collections is easy access to descriptions and samples that represent the content of the collections. This paper presents an approach to developing a collection of radiology examinations, including both the images and radiologist narrative reports, and making them publicly available in a searchable database.<\/jats:p>\n               <jats:p>Materials and Methods The authors collected 3996 radiology reports from the Indiana Network for Patient Care and 8121 associated images from the hospitals\u2019 picture archiving systems. The images and reports were de-identified automatically and then the automatic de-identification was manually verified. The authors coded the key findings of the reports and empirically assessed the benefits of manual coding on retrieval.<\/jats:p>\n               <jats:p>Results The automatic de-identification of the narrative was aggressive and achieved 100% precision at the cost of rendering a few findings uninterpretable. Automatic de-identification of images was not quite as perfect. Images for two of 3996 patients (0.05%) showed protected health information. Manual encoding of findings improved retrieval precision.<\/jats:p>\n               <jats:p>Conclusion Stringent de-identification methods can remove all identifiers from text radiology reports. DICOM de-identification of images does not remove all identifying information and needs special attention to images scanned from film. Adding manual coding to the radiologist narrative reports significantly improved relevancy of the retrieved clinical documents. The de-identified Indiana chest X-ray collection is available for searching and downloading from the National Library of Medicine ( http:\/\/openi.nlm.nih.gov\/ ).<\/jats:p>","DOI":"10.1093\/jamia\/ocv080","type":"journal-article","created":{"date-parts":[[2015,7,3]],"date-time":"2015-07-03T19:57:26Z","timestamp":1435953446000},"page":"304-310","source":"Crossref","is-referenced-by-count":933,"title":["Preparing a collection of radiology examinations for distribution and retrieval"],"prefix":"10.1093","volume":"23","author":[{"given":"Dina","family":"Demner-Fushman","sequence":"first","affiliation":[{"name":"Staff Scientist, Lister Hill National Center for Biomedical Communications National Library of Medicine, National Institutes of Health Bldg. 38A, Room 10S-1022, 8600 Rockville Pike MSC-3824 Bethesda, MD 20894, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc D.","family":"Kohli","sequence":"additional","affiliation":[{"name":"Assistant Professor, Director of Informatics, Department of Radiology and Imaging Sciences, Indiana University School of Medicine, Indianapolis, IN, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc B.","family":"Rosenman","sequence":"additional","affiliation":[{"name":"Associate Professor, Children's Health Services Research, Department of Pediatrics, Indiana University School of Medicine, Indianapolis, IN, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sonya E.","family":"Shooshan","sequence":"additional","affiliation":[{"name":"Computer Science Branch, Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD 20894, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laritza","family":"Rodriguez","sequence":"additional","affiliation":[{"name":"Computer Science Branch, Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD 20894, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sameer","family":"Antani","sequence":"additional","affiliation":[{"name":"Staff Scientist, Communications Engineering Branch, Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD 20894, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"George R.","family":"Thoma","sequence":"additional","affiliation":[{"name":"Branch Chief, Communications Engineering Branch, Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD 20894, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Clement J.","family":"McDonald","sequence":"additional","affiliation":[{"name":"Director, Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, Bethesda, MD 20894, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2015,7,1]]},"reference":[{"key":"2020110613032295900_ocv080-B1"},{"issue":"5","key":"2020110613032295900_ocv080-B2","first-page":"806","article-title":"Evaluating temporal relations in clinical text: 2012 i2b2 Challenge","volume":"20","author":"Sun","year":"2013","journal-title":"JAMIA."},{"key":"2020110613032295900_ocv080-B3"},{"issue":"2","key":"2020110613032295900_ocv080-B4","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1109\/TMI.2013.2284099","article-title":"Automatic tuberculosis screening using chest radiographs","volume":"33","author":"Jaeger","year":"2014","journal-title":"IEEE Trans Med Imaging."},{"issue":"2","key":"2020110613032295900_ocv080-B5","doi-asserted-by":"crossref","first-page":"68","DOI":"10.5626\/JCSE.2012.6.2.168","article-title":"Design and development of a multimodal biomedical information retrieval system","volume":"6","author":"Demner-Fushman","year":"2012","journal-title":"JCSE."},{"key":"2020110613032295900_ocv080-B6","first-page":"105","article-title":"Evaluation of negation phrases in narrative clinical reports","author":"Chapman","year":"2001","journal-title":"Proc AMIA Symp."},{"key":"2020110613032295900_ocv080-B7","volume-title":"Information Retrieval: A Health and Biomedical Perspective","author":"Hersh","year":"2008"},{"key":"2020110613032295900_ocv080-B8"},{"key":"2020110613032295900_ocv080-B9","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.compmedimag.2014.03.004","article-title":"Evaluating performance of biomedical image retrieval systems\u2014An overview of the medical image retrieval task at ImageCLEF 2004\u20132013","volume":"39","author":"Kalpathy-Cramer","year":"2015","journal-title":"Comput Med Imaging Graph."},{"key":"2020110613032295900_ocv080-B10"},{"key":"2020110613032295900_ocv080-B11"},{"key":"2020110613032295900_ocv080-B12","first-page":"601","article-title":"A software tool for removing patient identifying information from clinical documents","volume":"15","author":"Friedlin","year":"2008","journal-title":"JAMIA."},{"key":"2020110613032295900_ocv080-B13"},{"key":"2020110613032295900_ocv080-B14"},{"key":"2020110613032295900_ocv080-B15"},{"issue":"12","key":"2020110613032295900_ocv080-B16","doi-asserted-by":"crossref","first-page":"e28071","DOI":"10.1371\/journal.pone.0028071","article-title":"A systematic review of re-identification attacks on health data","volume":"6","author":"El Emam","year":"2011","journal-title":"PLoS One."},{"key":"2020110613032295900_ocv080-B17"},{"key":"2020110613032295900_ocv080-B18"},{"key":"2020110613032295900_ocv080-B19","first-page":"114","article-title":"Medical subject headings","volume":"51","author":"Rogers","year":"1963","journal-title":"Bull Med Libr Assoc."},{"key":"2020110613032295900_ocv080-B20"},{"issue":"6","key":"2020110613032295900_ocv080-B21","doi-asserted-by":"crossref","first-page":"1595","DOI":"10.1148\/rg.266065168","article-title":"RadLex: a new method for indexing online educational materials","volume":"26","author":"Langlotz","year":"2006","journal-title":"Radiographics."},{"key":"2020110613032295900_ocv080-B22"},{"key":"2020110613032295900_ocv080-B23"},{"key":"2020110613032295900_ocv080-B24","author":"Mork"},{"issue":"3","key":"2020110613032295900_ocv080-B25","first-page":"229","article-title":"An overview of MetaMap: historical perspective and recent advances","volume":"17","author":"Aronson","year":"2010","journal-title":"JAMIA."},{"key":"2020110613032295900_ocv080-B26","volume-title":"TREC: Experiment and Evaluation in Information Retrieval","author":"Voorhees","year":"2005"},{"key":"2020110613032295900_ocv080-B27"},{"key":"2020110613032295900_ocv080-B28","volume-title":"Nonparametric Statistics for the Behavioral Sciences","author":"Siegel","year":"1988","edition":"2nd ed"},{"issue":"6","key":"2020110613032295900_ocv080-B29","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1016\/j.hrthm.2011.01.012","article-title":"Cardiac rhythm device identification algorithm using X-Rays: CaRDIA-X","volume":"8","author":"Jacob","year":"2011","journal-title":"Heart Rhythm."},{"key":"2020110613032295900_ocv080-B30"},{"key":"2020110613032295900_ocv080-B31","first-page":"506","article-title":"Automatic real-patient medical data de-identification for research purposes","volume":"52","author":"Vcelak","year":"2011","journal-title":"Int J Sci, Eng Technol."},{"issue":"3","key":"2020110613032295900_ocv080-B32","doi-asserted-by":"crossref","first-page":"934","DOI":"10.1016\/j.patcog.2011.08.027","article-title":"Dental biometrics: Human identification based on teeth and dental works in bitewing radiographs","volume":"45","author":"Lin","year":"2012","journal-title":"Pattern Recogn."},{"key":"2020110613032295900_ocv080-B33","doi-asserted-by":"crossref","first-page":"S9","DOI":"10.1186\/1471-2105-9-S11-S9","article-title":"The BioScope corpus: biomedical texts annotated for uncertainty, negation and their scopes","volume":"9","author":"Vincze","year":"2008","journal-title":"BMC Bioinformatics."},{"key":"2020110613032295900_ocv080-B34","author":"Ruch"},{"key":"2020110613032295900_ocv080-B35"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/23\/2\/304\/34147537\/ocv080.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/23\/2\/304\/34147537\/ocv080.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T18:58:26Z","timestamp":1604689106000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/23\/2\/304\/2572395"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,1]]},"references-count":35,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2015,7,1]]},"published-print":{"date-parts":[[2016,3,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocv080","relation":{},"ISSN":["1527-974X","1067-5027"],"issn-type":[{"value":"1527-974X","type":"electronic"},{"value":"1067-5027","type":"print"}],"subject":[],"published-other":{"date-parts":[[2016,3]]},"published":{"date-parts":[[2015,7,1]]}}}