{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,16]],"date-time":"2026-11-16T18:07:34Z","timestamp":1794852454978,"version":"4.9.1"},"reference-count":28,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"16","license":[{"start":{"date-parts":[[2021,4,23]],"date-time":"2021-04-23T00:00:00Z","timestamp":1619136000000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0"}],"funder":[{"name":"Lunit Incorporation","award":["Not applicable"],"award-info":[{"award-number":["Not applicable"]}]}],"content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"abstract":"<jats:sec>\n            <jats:title>Abstract<\/jats:title>\n            <jats:p>Along with recent developments in deep learning techniques, computer-aided diagnosis (CAD) has been growing rapidly in the medical imaging field. In this work, we evaluate the deep learning-based CAD algorithm (DCAD) for detecting and localizing 3 major thoracic abnormalities visible on chest radiographs (CR) and to compare the performance of physicians with and without the assistance of the algorithm. A subset of 244 subjects (60% abnormal CRs) was evaluated. Abnormal findings included mass\/nodules (55%), consolidation (21%), and pneumothorax (24%). Observer performance tests were conducted to assess whether the performance of physicians could be enhanced with the algorithm. The area under the receiver operating characteristic (ROC) curve (AUC) and the area under the jackknife alternative free-response ROC (JAFROC) were measured to evaluate the performance of the algorithm and physicians in image classification and lesion detection, respectively. The AUCs for nodule\/mass, consolidation, and pneumothorax were 0.9883, 1.000, and 0.9997, respectively. For the image classification, the overall AUC of the pooled physicians was 0.8679 without DCAD and 0.9112 with DCAD. Regarding lesion detection, the pooled observers exhibited a weighted JAFROC figure of merit (FOM) of 0.8426 without DCAD and 0.9112 with DCAD. DCAD for CRs could enhance physicians\u2019 performance in the detection of 3 major thoracic abnormalities.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1097\/md.0000000000025663","type":"journal-article","created":{"date-parts":[[2021,4,21]],"date-time":"2021-04-21T13:38:47Z","timestamp":1619012327000},"page":"e25663","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":22,"title":["Evaluation of a deep learning-based computer-aided detection algorithm on chest radiographs"],"prefix":"10.1097","volume":"100","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0044-3333","authenticated-orcid":false,"given":"Soo Yun","family":"Choi","sequence":"first","affiliation":[{"name":"College of Medicine, Seoul National University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3391-0345","authenticated-orcid":false,"given":"Sunggyun","family":"Park","sequence":"additional","affiliation":[{"name":"Lunit Incorporated"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1449-9124","authenticated-orcid":false,"given":"Minchul","family":"Kim","sequence":"additional","affiliation":[{"name":"Lunit Incorporated"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9808-6823","authenticated-orcid":false,"given":"Jongchan","family":"Park","sequence":"additional","affiliation":[{"name":"Lunit Incorporated"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2455-1718","authenticated-orcid":false,"given":"Ye Ra","family":"Choi","sequence":"additional","affiliation":[{"name":"Department of Radiology, Seoul Metropolitan Government, Seoul National University, Boramae Medical Center, Seoul, Korea."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5494-9113","authenticated-orcid":false,"given":"Kwang Nam","family":"Jin","sequence":"additional","affiliation":[{"name":"College of Medicine, Seoul National University"},{"name":"Department of Radiology, Seoul Metropolitan Government, Seoul National University, Boramae Medical Center, Seoul, Korea."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2021,4,23]]},"reference":[{"key":"R1-20250504","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.lungcan.2018.12.024","article-title":"Chest radiography surveillance for lung cancer: results from a National Health Insurance database in South Korea","volume":"128","author":"Koo","year":"2019","journal-title":"Lung Cancer"},{"key":"R2-20250504","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1111\/j.1754-9485.2012.02348.x","article-title":"Common patterns in 558 diagnostic radiology errors","volume":"56","author":"Donald","year":"2012","journal-title":"J Med Imaging Radiat Oncol"},{"key":"R3-20250504","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1148\/radiol.2018181371","article-title":"Detection of breast cancer with mammography: effect of an artificial intelligence support system","volume":"290","author":"Rodriguez-Ruiz","year":"2019","journal-title":"Radiology"},{"key":"R4-20250504","first-page":"219","article-title":"Artificial intelligence methods for the diagnosis of breast cancer by image processing: a review","volume":"10","author":"Sadoughi","year":"2018","journal-title":"Breast Cancer (Dove Med Press)"},{"key":"R5-20250504","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1148\/radiol.2018181928","article-title":"Emerging applications of artificial intelligence in neuro-oncology","volume":"290","author":"Rudie","year":"2019","journal-title":"Radiology"},{"key":"R6-20250504","doi-asserted-by":"crossref","first-page":"672","DOI":"10.3748\/wjg.v25.i6.672","article-title":"Artificial intelligence in medical imaging of the liver","volume":"25","author":"Zhou","year":"2019","journal-title":"World J Gastroenterol"},{"key":"R7-20250504","doi-asserted-by":"crossref","first-page":"1524","DOI":"10.1109\/TMI.2019.2952939","article-title":"Privileged modality distillation for vessel border detection in intracoronary imaging","volume":"39","author":"Gao","year":"2020","journal-title":"IEEE Trans Med Imaging"},{"key":"R8-20250504","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.neunet.2019.11.017","article-title":"Learning physical properties in complex visual scenes: an intelligent machine for perceiving blood flow dynamics from static CT angiography imaging","volume":"123","author":"Gao","year":"2020","journal-title":"Neural Networks"},{"key":"R9-20250504","doi-asserted-by":"crossref","first-page":"739","DOI":"10.1093\/cid\/ciy967","article-title":"Development and validation of a deep learning-based automatic detection algorithm for active pulmonary tuberculosis on chest radiographs","volume":"69","author":"Hwang","year":"2019","journal-title":"Clin Infect Dis"},{"key":"R10-20250504","doi-asserted-by":"crossref","first-page":"e0204155","DOI":"10.1371\/journal.pone.0204155","article-title":"Deep learning in chest radiography: detection of findings and presence of change","volume":"13","author":"Singh","year":"2018","journal-title":"PLoS One"},{"key":"R11-20250504","doi-asserted-by":"crossref","first-page":"e191095","DOI":"10.1001\/jamanetworkopen.2019.1095","article-title":"Development and validation of a deep learning-based automated detection algorithm for major thoracic diseases on chest radiographs","volume":"2","author":"Hwang","year":"2019","journal-title":"JAMA Netw Open"},{"key":"R12-20250504","doi-asserted-by":"crossref","first-page":"5341","DOI":"10.1007\/s00330-019-06130-x","article-title":"Application of deep learning-based computer-aided detection system: detecting pneumothorax on chest radiograph after biopsy","volume":"29","author":"Park","year":"2019","journal-title":"Eur Radiol"},{"key":"R13-20250504","doi-asserted-by":"crossref","first-page":"17417","DOI":"10.1038\/s41598-020-74626-4","article-title":"Reproducibility of abnormality detection on chest radiographs using convolutional neural network in paired radiographs obtained within a short-term interval","volume":"10","author":"Cho","year":"2020","journal-title":"Sci Rep"},{"key":"R14-20250504","article-title":"Chest X-ray 8: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases","author":"Wang","year":"2017","journal-title":"Paper presented at: 2017 IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"R15-20250504","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1148\/radiol.2019182465","article-title":"Deep convolutional neural network-based software improves radiologist detection of malignant lung nodules on chest radiographs","volume":"294","author":"Sim","year":"2020","journal-title":"Radiology"},{"key":"R16-20250504","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1007\/978-3-319-65981-7_12","article-title":"Deep learning for medical image processing: overview, challenges and the future","author":"Razzak","year":"2018","journal-title":"Classification in Bioapps: Automation of Decision Making"},{"key":"R17-20250504","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1007\/s10278-012-9451-0","article-title":"An interactive system for computer-aided diagnosis of breast masses","volume":"25","author":"Wang","year":"2012","journal-title":"J Digit Imaging"},{"key":"R18-20250504","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1186\/1472-6947-12-38","article-title":"Developing an algorithm to identify people with chronic obstructive pulmonary disease (COPD) using administrative data","volume":"12","author":"Smidth","year":"2012","journal-title":"BMC Med Inform Decis Mak"},{"key":"R19-20250504","article-title":"TB detection in chest radiograph using deep learning architecture","author":"Rohilla","year":"2017","journal-title":"Paper presented at: Proceeding of 5th International Conference on Emerging Trends in Engineering, Technology, Science and Management (ICETETSM-17)"},{"key":"R20-20250504","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1148\/radiol.2522081319","article-title":"Use of a computer-aided detection system to detect missed lung cancer at chest radiography","volume":"252","author":"White","year":"2009","journal-title":"Radiology"},{"key":"R21-20250504","doi-asserted-by":"crossref","first-page":"1517","DOI":"10.1378\/chest.128.3.1517","article-title":"Computer-aided diagnosis as a second reader: spectrum of findings in CT studies of the chest interpreted as normal","volume":"128","author":"Peldschus","year":"2005","journal-title":"Chest"},{"key":"R22-20250504","doi-asserted-by":"crossref","first-page":"1332","DOI":"10.1016\/j.ejrad.2013.02.005","article-title":"Computer-aided detection of lung nodules on multidetector CT in concurrent-reader and second-reader modes: a comparative study","volume":"82","author":"Matsumoto","year":"2013","journal-title":"Eur J Radiol"},{"key":"R23-20250504","doi-asserted-by":"crossref","first-page":"573","DOI":"10.1148\/radiol.2019191225","article-title":"Deep learning for chest radiograph diagnosis in the emergency department","volume":"293","author":"Hwang","year":"2019","journal-title":"Radiology"},{"key":"R24-20250504","doi-asserted-by":"crossref","first-page":"739","DOI":"10.2214\/AJR.16.16963","article-title":"Interpretive error in radiology","volume":"208","author":"Waite","year":"2017","journal-title":"Am J Roentgenol"},{"key":"R25-20250504","first-page":"443","article-title":"The quality of emergency room radiograph interpretations","volume":"20","author":"McLain","year":"1985","journal-title":"J Fam Pract"},{"key":"R26-20250504","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1007\/s11547-008-0279-0","article-title":"The legal implications of error in radiology","volume":"113","author":"Olivetti","year":"2008","journal-title":"Radiol Med"},{"key":"R27-20250504","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s13244-016-0534-1","article-title":"Error and discrepancy in radiology: inevitable or avoidable?","volume":"8","author":"Brady","year":"2017","journal-title":"Insights Imaging"},{"key":"R29-20250504","doi-asserted-by":"crossref","first-page":"02","DOI":"10.18590\/mjm.2018.vol4.iss2.2","article-title":"Why introduce machine learning to rural health care?","volume":"4","author":"Cecchetti","year":"2018","journal-title":"Marshall J Med"}],"container-title":["Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/MD.0000000000025663","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,4]],"date-time":"2025-05-04T06:12:25Z","timestamp":1746339145000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/MD.0000000000025663"}},"subtitle":["Case\u2013control study"],"short-title":[],"issued":{"date-parts":[[2021,4,23]]},"references-count":28,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021]]}},"URL":"https:\/\/doi.org\/10.1097\/md.0000000000025663","relation":{},"ISSN":["0025-7974","1536-5964"],"issn-type":[{"value":"0025-7974","type":"print"},{"value":"1536-5964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,23]]},"assertion":[{"value":"2020-08-26","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-05","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}