{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T03:54:20Z","timestamp":1773114860018,"version":"3.50.1"},"reference-count":10,"publisher":"Oxford University Press (OUP)","issue":"e1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2016,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Given the increasing emphasis on delivering high-quality, cost-efficient healthcare, improved methodologies are needed to measure the accuracy and utility of ordered diagnostic examinations in achieving the appropriate diagnosis. Here, we present a data-driven approach for performing automated quality assessment of radiologic interpretations using other clinical information (e.g., pathology) as a reference standard for individual radiologists, subspecialty sections, imaging modalities, and entire departments. Downstream diagnostic conclusions from the electronic medical record are utilized as \u201ctruth\u201d to which upstream diagnoses generated by radiology are compared. The described system automatically extracts and compares patient medical data to characterize concordance between clinical sources. Initial results are presented in the context of breast imaging, matching 18\u00a0101 radiologic interpretations with 301 pathology diagnoses and achieving a precision and recall of 84% and 92%, respectively. The presented data-driven method highlights the challenges of integrating multiple data sources and the application of information extraction tools to facilitate healthcare quality improvement.<\/jats:p>","DOI":"10.1093\/jamia\/ocv161","type":"journal-article","created":{"date-parts":[[2015,11,26]],"date-time":"2015-11-26T03:03:28Z","timestamp":1448507008000},"page":"e152-e156","source":"Crossref","is-referenced-by-count":17,"title":["A data-driven approach for quality assessment of radiologic interpretations"],"prefix":"10.1093","volume":"23","author":[{"given":"William","family":"Hsu","sequence":"first","affiliation":[{"name":"Department of Radiological Sciences, UCLA David Geffen School of Medicine, Los Angeles, CA, USA"}]},{"given":"Simon X","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, UCLA David Geffen School of Medicine, Los Angeles, CA, USA"}]},{"given":"Corey W","family":"Arnold","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, UCLA David Geffen School of Medicine, Los Angeles, CA, USA"}]},{"given":"Alex AT","family":"Bui","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, UCLA David Geffen School of Medicine, Los Angeles, CA, USA"}]},{"given":"Dieter R","family":"Enzmann","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, UCLA David Geffen School of Medicine, Los Angeles, CA, USA"}]}],"member":"286","published-online":{"date-parts":[[2015,11,25]]},"reference":[{"issue":"1","key":"2020110612431666600_ocv161-B1","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/S1546-1440(03)00002-4","article-title":"RADPEER quality assurance program: a multifacility study of interpretive disagreement rates","volume":"1","author":"Borgstede","year":"2004","journal-title":"J Am College Radiol."},{"issue":"4","key":"2020110612431666600_ocv161-B2","doi-asserted-by":"crossref","first-page":"951","DOI":"10.1148\/rg.294095006","article-title":"Developing a radiology quality and safety program: a primer","volume":"29","author":"Johnson","year":"2009","journal-title":"Radiographics."},{"issue":"5","key":"2020110612431666600_ocv161-B3","doi-asserted-by":"crossref","first-page":"1221","DOI":"10.1148\/rg.295095086","article-title":"Peer review in diagnostic radiology: current state and a vision for the future","volume":"29","author":"Mahgerefteh","year":"2009","journal-title":"Radiographics."},{"issue":"4","key":"2020110612431666600_ocv161-B4","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1016\/S0033-8389(05)70199-8","article-title":"The Mammography Quality Standards Act: an overview of the regulations and guidance","volume":"38","author":"Monsees","year":"2000","journal-title":"Radiol Clin North America."},{"issue":"1","key":"2020110612431666600_ocv161-B5","doi-asserted-by":"crossref","first-page":"35","DOI":"10.2214\/ajr.171.1.9648759","article-title":"The breast imaging reporting and data system: positive predictive value of mammographic features and final assessment categories","volume":"171","author":"Liberman","year":"1998","journal-title":"Am J Roentgenol."},{"issue":"1","key":"2020110612431666600_ocv161-B6","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/S1072-7515(99)00080-0","article-title":"Positive predictive value of the breast imaging reporting and data system","volume":"189","author":"Lacquement","year":"1999","journal-title":"J Am College Surgeons."},{"issue":"3\u20134","key":"2020110612431666600_ocv161-B7","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1017\/S1351324904003523","article-title":"UIMA: an architectural approach to unstructured information processing in the corporate research environment","volume":"10","author":"Ferrucci","year":"2004","journal-title":"Nat Lang Eng."},{"key":"2020110612431666600_ocv161-B8","article-title":"Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data","author":"Lafferty","year":"2001"},{"key":"2020110612431666600_ocv161-B9","article-title":"MALLET: A Machine Learning for Language Toolkit","author":"McCallum","year":"2002"},{"issue":"11","key":"2020110612431666600_ocv161-B10","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.1001\/jama.2015.1405","article-title":"Diagnostic concordance among pathologists interpreting breast biopsy specimens","volume":"313","author":"Elmore","year":"2015","journal-title":"JAMA."}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/23\/e1\/e152\/34148853\/ocv161.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/23\/e1\/e152\/34148853\/ocv161.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,6]],"date-time":"2020-11-06T18:09:50Z","timestamp":1604686190000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/23\/e1\/e152\/2379904"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,11,25]]},"references-count":10,"journal-issue":{"issue":"e1","published-online":{"date-parts":[[2015,11,25]]},"published-print":{"date-parts":[[2016,4,1]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocv161","relation":{},"ISSN":["1527-974X","1067-5027"],"issn-type":[{"value":"1527-974X","type":"electronic"},{"value":"1067-5027","type":"print"}],"subject":[],"published-other":{"date-parts":[[2016,4]]},"published":{"date-parts":[[2015,11,25]]}}}