{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,20]],"date-time":"2025-10-20T18:47:25Z","timestamp":1760986045270,"version":"build-2065373602"},"reference-count":21,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,6,29]],"date-time":"2021-06-29T00:00:00Z","timestamp":1624924800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>We aimed to set up an Automated Radiology Alert System (ARAS) for the detection of pneumothorax in chest radiographs by a deep learning model, and to compare its efficiency and diagnostic performance with the existing Manual Radiology Alert System (MRAS) at the tertiary medical center. This study retrospectively collected 1235 chest radiographs with pneumothorax labeling from 2013 to 2019, and 337 chest radiographs with negative findings in 2019 were separated into training and validation datasets for the deep learning model of ARAS. The efficiency before and after using the model was compared in terms of alert time and report time. During parallel running of the two systems from September to October 2020, chest radiographs prospectively acquired in the emergency department with age more than 6 years served as the testing dataset for comparison of diagnostic performance. The efficiency was improved after using the model, with mean alert time improving from 8.45 min to 0.69 min and the mean report time from 2.81 days to 1.59 days. The comparison of the diagnostic performance of both systems using 3739 chest radiographs acquired during parallel running showed that the ARAS was better than the MRAS as assessed in terms of sensitivity (recall), area under receiver operating characteristic curve, and F1 score (0.837 vs. 0.256, 0.914 vs. 0.628, and 0.754 vs. 0.407, respectively), but worse in terms of positive predictive value (PPV) (precision) (0.686 vs. 1.000). This study had successfully designed a deep learning model for pneumothorax detection on chest radiographs and set up an ARAS with improved efficiency and overall diagnostic performance.<\/jats:p>","DOI":"10.3390\/diagnostics11071182","type":"journal-article","created":{"date-parts":[[2021,6,29]],"date-time":"2021-06-29T10:52:46Z","timestamp":1624963966000},"page":"1182","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Automated Radiology Alert System for Pneumothorax Detection on Chest Radiographs Improves Efficiency and Diagnostic Performance"],"prefix":"10.3390","volume":"11","author":[{"given":"Cheng-Yi","family":"Kao","sequence":"first","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chiao-Yun","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, E-DA Hospital, I-Shou University, No. 1 Yida Road, Jiaosu Village, Yanchao District, Kaohsiung 824, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng-Chen","family":"Chao","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Han-Sheng","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hsing-Yu","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chia-Ming","family":"Chang","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kang","family":"Sung","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ting-Rong","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Po-Chang","family":"Chiang","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Li-Ting","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bow","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yi-Sheng","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jung-Hsien","family":"Chiang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Information Engineering, College of Electrical Engineering and Computer Science, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8887-2935","authenticated-orcid":false,"given":"Chien-Kuo","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0898-9250","authenticated-orcid":false,"given":"Yi-Shan","family":"Tsai","sequence":"additional","affiliation":[{"name":"Department of Medical Imaging, National Cheng Kung University Hospital, College of Medicine, National Cheng Kung University, No. 1 University Road, Tainan 704, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1378\/chest.10-1302","article-title":"Interpretation of Plain Chest Roentgenogram","volume":"141","author":"Raoof","year":"2012","journal-title":"Chest"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1098","DOI":"10.1378\/chest.11-1691","article-title":"Pneumothorax in the Critically Ill Patient","volume":"141","author":"Yarmus","year":"2012","journal-title":"Chest"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"313","DOI":"10.2214\/ajr.166.2.8553937","article-title":"Comparison of upright inspiratory and expiratory chest radiographs for detecting pneumothoraces","volume":"166","author":"Seow","year":"1996","journal-title":"Am. J. Roentgenol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1055\/s-0033-1350566","article-title":"Value of Digital Radiography in Expiration in Detection of Pneumothorax","volume":"186","author":"Thomsen","year":"2013","journal-title":"RoFo Fortschr. Geb. Rontgenstrahlen Bildgeb. Verfahr."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., and Summers, R.M. (2017, January 21\u201326). ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.369"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e191095","DOI":"10.1001\/jamanetworkopen.2019.1095","article-title":"Development and Validation of a Deep Learning\u2013Based Automated Detection Algorithm for Major Thoracic Diseases on Chest Radiographs","volume":"2","author":"Hwang","year":"2019","journal-title":"JAMA Netw. Open"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1148\/radiol.2017162664","article-title":"Automated Critical Test Findings Identification and Online Notification System Using Artificial Intelligence in Imaging","volume":"285","author":"Prevedello","year":"2017","journal-title":"Radiology"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Taylor, A.G., Mielke, C., and Mongan, J. (2018). Automated detection of moderate and large pneumothorax on frontal chest X-rays using deep convolutional neural networks: A retrospective study. PLoS Med., 15.","DOI":"10.1371\/journal.pmed.1002697"},{"key":"ref_9","unstructured":"Wada, K. (2020, February 25). Labelme: Image Polygonal Annotation with Python, GitHub. Available online: https:\/\/github.com\/wkentaro\/labelme."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention\u2013MICCAI 2015, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Pang, J., Chen, K., Shi, J., Feng, H., Ouyang, W., and Lin, D. (2019, January 15\u201320). Libra R-CNN: Towards Balanced Learning for Object Detection. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00091"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5341","DOI":"10.1007\/s00330-019-06130-x","article-title":"Application of deep learning\u2013based computer-aided detection system: Detecting pneumothorax on chest radiograph after biopsy","volume":"29","author":"Park","year":"2019","journal-title":"Eur. Radiol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"3660","DOI":"10.1007\/s00330-020-06771-3","article-title":"Deep learning algorithm for surveillance of pneumothorax after lung biopsy: A multicenter diagnostic cohort study","volume":"30","author":"Hwang","year":"2020","journal-title":"Eur. Radiol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1359","DOI":"10.1007\/s00330-019-06532-x","article-title":"Deep learning-based detection system for multiclass lesions on chest radiographs: Comparison with observer readings","volume":"30","author":"Park","year":"2019","journal-title":"Eur. Radiol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1148\/radiol.2019191293","article-title":"Chest Radiograph Interpretation with Deep Learning Models: Assessment with Radiologist-adjudicated Reference Standards and Population-adjusted Evaluation","volume":"294","author":"Majkowska","year":"2020","journal-title":"Radiology"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"653","DOI":"10.1136\/thoraxjnl-2014-206577","article-title":"Epidemiology of spontaneous pneumothorax: Gender-related differences","volume":"70","author":"Bobbio","year":"2015","journal-title":"Thorax"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1093\/ejcts\/ezy081","article-title":"The three peaks in age distribution of females with pneumothorax: A nationwide database study in Japan","volume":"54","author":"Hiyama","year":"2018","journal-title":"Eur. J. Cardio Thorac. Surg."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kim, D., Jung, B., Jang, B.-H., Chung, S.-H., Lee, Y.J., and Ha, I.-H. (2019). Epidemiology and medical service use for spontaneous pneumo-thorax: A 12-year study using nationwide cohort data in Korea. BMJ Open, 9.","DOI":"10.1136\/bmjopen-2018-028624"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1660","DOI":"10.1109\/JBHI.2020.3023476","article-title":"Deep Learning for Diagnosis and Segmentation of Pneumothorax: The Results on the Kaggle Competition and Validation against Radiologists","volume":"25","author":"Tolkachev","year":"2021","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/11\/7\/1182\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:26:56Z","timestamp":1760164016000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/11\/7\/1182"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,29]]},"references-count":21,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["diagnostics11071182"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics11071182","relation":{},"ISSN":["2075-4418"],"issn-type":[{"type":"electronic","value":"2075-4418"}],"subject":[],"published":{"date-parts":[[2021,6,29]]}}}