{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T12:56:19Z","timestamp":1790600179634,"version":"4.1.0"},"reference-count":36,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2026,9,27]],"date-time":"2026-09-27T00:00:00Z","timestamp":1790467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Diagnostics"],"abstract":"<jats:p>Background\/Objectives: Artificial intelligence (AI) increasingly supports chest radiograph interpretation, but per-abnormality comparisons of commercial tools using CT-anchored reference standards remain limited. We compared two commercial AI tools using a CT-anchored, CXR-targeted reference framework. Methods: We retrospectively reviewed chest radiographs obtained between 30 October 2023 and 10 October 2024. Each radiograph was paired with CT performed within 14 days or within 2 days for rapidly progressive findings. Seven abnormalities across five analysis categories were evaluated: fracture, nodule, pleural effusion, pneumothorax, and airspace disease (edema, atelectasis, opacity\/consolidation). Radiologists first confirmed abnormalities on CT then assessed their visibility on the paired radiograph. Outputs from vendors A and B were recorded. Sensitivity was calculated for CT-confirmed, radiographically visible abnormalities; specificity, precision, and accuracy were calculated within the same detectability framework. Vendors were compared using McNemar\u2019s test. Results: The cohort included 1707 radiographs from 1680 patients (mean age, 60.3 \u00b1 16.5 years; 50.5% male). Of 3573 CT-confirmed abnormalities, 1981 (55.4%) were radiographically visible and formed the primary reference-positive set. Vendor A had higher sensitivity for fractures, nodules, and pleural effusions (all p &lt; 0.001), whereas vendor B had higher specificity for these findings (all p &lt; 0.05). For pneumothorax, vendor B showed numerically higher sensitivity but lower specificity and accuracy; case numbers were limited, and precision was low for both tools. No significant differences were observed for harmonized airspace disease. Overall specificity was high, while sensitivity and precision varied across abnormalities. Conclusions: Both tools showed abnormality-specific strengths and limitations, supporting tailored implementation and real-world clinical validation.<\/jats:p>","DOI":"10.3390\/diagnostics16193139","type":"journal-article","created":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T11:35:59Z","timestamp":1790595359000},"page":"3139","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Diagnostic Performance of Different AI Tools for Chest Radiography: A CT-Anchored Per-Abnormality Analysis in a Tertiary Referral Center"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2623-2542","authenticated-orcid":false,"given":"Selin","family":"Ardal\u0131 D\u00fczg\u00fcn","sequence":"first","affiliation":[{"name":"Department of Radiology, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-8143-6583","authenticated-orcid":false,"given":"\u0130lke","family":"Ta\u015f\u00e7\u0131","sequence":"additional","affiliation":[{"name":"Department of Radiology, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"}]},{"given":"Atahan","family":"Tamt\u00fcrk","sequence":"additional","affiliation":[{"name":"Department of Radiology, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1463-7286","authenticated-orcid":false,"given":"Nuri","family":"Sara\u00e7","sequence":"additional","affiliation":[{"name":"Department of Radiology, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-3023-0015","authenticated-orcid":false,"given":"Melih","family":"Karada\u011f","sequence":"additional","affiliation":[{"name":"Department of Radiology, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7664-5786","authenticated-orcid":false,"given":"Mustafa Ege","family":"\u015eeker","sequence":"additional","affiliation":[{"name":"Department of Radiology, School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI 53705, USA"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"methodology","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8374-3691","authenticated-orcid":false,"given":"Deniz","family":"K\u00f6ksal","sequence":"additional","affiliation":[{"name":"Department of Chest Diseases, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"}]},{"given":"Sevin\u00e7","family":"Sar\u0131n\u00e7","sequence":"additional","affiliation":[{"name":"Department of Chest Diseases, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"}]},{"given":"Meltem","family":"G\u00fcls\u00fcn Akp\u0131nar","sequence":"additional","affiliation":[{"name":"Department of Radiology, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"}]},{"given":"Figen","family":"Ba\u015faran Demirkaz\u0131k","sequence":"additional","affiliation":[{"name":"Department of Radiology, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"}]},{"given":"Gamze","family":"Durhan","sequence":"additional","affiliation":[{"name":"Department of Radiology, Faculty of Medicine, Hacettepe University, Ankara 06100, Turkey"}],"role":[{"vocabulary":"crossref","role":"author"},{"role":"conceptualization","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1053\/j.ro.2015.01.008","article-title":"Pitfalls in Chest Radiographic Interpretation: Blind Spots","volume":"50","author":"Carter","year":"2015","journal-title":"Semin. Roentgenol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1111\/j.1754-9485.2012.02348.x","article-title":"Common Patterns in 558 Diagnostic Radiology Errors","volume":"56","author":"Donald","year":"2012","journal-title":"J. Med. Imaging Radiat. Oncol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"102125","DOI":"10.1016\/j.media.2021.102125","article-title":"Deep Learning for Chest X-Ray Analysis: A Survey","volume":"72","author":"Sogancioglu","year":"2021","journal-title":"Med. Image Anal."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Li, D., Pehrson, L.M., Lauridsen, C.A., T\u00f8ttrup, L., Fraccaro, M., Elliott, D., Zaj\u0105c, H.D., Darkner, S., Carlsen, J.F., and Nielsen, M.B. (2021). The Added Effect of Artificial Intelligence on Physicians\u2019 Performance in Detecting Thoracic Pathologies on CT and Chest X-Ray: A Systematic Review. Diagnostics, 11.","DOI":"10.3390\/diagnostics11122206"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Blake, S.R., Das, N., Tadepalli, M., Reddy, B., Singh, A., Agrawal, R., Chattoraj, S., Shah, D., and Putha, P. (2023). Using Artificial Intelligence to Stratify Normal versus Abnormal Chest X-Rays: External Validation of a Deep Learning Algorithm at East Kent Hospitals University NHS Foundation Trust. Diagnostics, 13.","DOI":"10.3390\/diagnostics13223408"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e2229289","DOI":"10.1001\/jamanetworkopen.2022.29289","article-title":"Association of Artificial Intelligence\u2013Aided Chest Radiograph Interpretation With Reader Performance and Efficiency","volume":"5","author":"Ahn","year":"2022","journal-title":"JAMA Netw. Open"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1097\/RTI.0000000000000746","article-title":"Deep Learning for Detection of Pneumothorax and Pleural Effusion on Chest Radiographs: Validation Against Computed Tomography, Impact on Resident Reading Time, and Interreader Concordance","volume":"39","author":"Tejani","year":"2024","journal-title":"J. Thorac. Imaging"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1097\/RLI.0000000000000813","article-title":"Artificial Intelligence in Chest Radiography Reporting Accuracy: Added Clinical Value in the Emergency Unit Setting Without 24\/7 Radiology Coverage","volume":"57","author":"Rudolph","year":"2022","journal-title":"Invest. Radiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"e230860","DOI":"10.1148\/radiol.230860","article-title":"Using AI to Improve Radiologist Performance in Detection of Abnormalities on Chest Radiographs","volume":"309","author":"Bennani","year":"2023","journal-title":"Radiology"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1513\/AnnalsATS.202206-481OC","article-title":"Artificial Intelligence Solution for Chest Radiographs in Respiratory Outpatient Clinics: Multicenter Prospective Randomized Clinical Trial","volume":"20","author":"Lee","year":"2023","journal-title":"Ann. Am. Thorac. Soc."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e25663","DOI":"10.1097\/MD.0000000000025663","article-title":"Evaluation of a Deep Learning-Based Computer-Aided Detection Algorithm on Chest Radiographs: Case-Control Study","volume":"100","author":"Choi","year":"2021","journal-title":"Medicine"},{"key":"ref_12","first-page":"1","article-title":"Validation Study of Machine-Learning Chest Radiograph Software in Primary and Emergency Medicine","volume":"78","author":"Ahn","year":"2023","journal-title":"Clin. Radiol."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"L\u00f3pez Alcolea, J., Fern\u00e1ndez Alfonso, A., Cano Alonso, R., \u00c1lvarez V\u00e1zquez, A., D\u00edaz Moreno, A., Garc\u00eda Castellanos, D., Sanabria Greciano, L., Hayoun, C., Recio Rodr\u00edguez, M., and Andreu V\u00e1zquez, C. (2024). Diagnostic Performance of Artificial Intelligence in Chest Radiographs Referred from the Emergency Department. Diagnostics, 14.","DOI":"10.3390\/diagnostics14222592"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1007\/s10140-005-0413-4","article-title":"Agreement between Emergency Physician Diagnosis and Radiologist Reports in Patients Discharged from an Emergency Department with Community-Acquired Pneumonia","volume":"11","author":"Campbell","year":"2005","journal-title":"Emerg. Radiol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1007\/s10140-009-0854-2","article-title":"Intraobserver and Interobserver Agreement of the Interpretation of Pediatric Chest Radiographs","volume":"17","author":"Johnson","year":"2010","journal-title":"Emerg. Radiol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kim, E.Y., Kim, Y.J., Choi, W.-J., Jeon, J.S., Kim, M.Y., Oh, D.H., Jin, K.N., and Cho, Y.J. (2022). Concordance Rate of Radiologists and a Commercialized Deep-Learning Solution for Chest X-Ray: Real-World Experience with a Multicenter Health Screening Cohort. PLoS ONE, 17.","DOI":"10.1371\/journal.pone.0264383"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kim, E.Y., Kim, Y.J., Choi, W.-J., Lee, G.P., Choi, Y.R., Jin, K.N., and Cho, Y.J. (2021). Performance of a Deep-Learning Algorithm for Referable Thoracic Abnormalities on Chest Radiographs: A Multicenter Study of a Health Screening Cohort. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0251045"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1148\/radiol.2021202818","article-title":"Added Value of Deep Learning\u2013Based Detection System for Multiple Major Findings on Chest Radiographs: A Randomized Crossover Study","volume":"299","author":"Sung","year":"2021","journal-title":"Radiology"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5288","DOI":"10.21037\/qims-24-160","article-title":"Independent Evaluation of the Accuracy of 5 Artificial Intelligence Software for Detecting Lung Nodules on Chest X-Rays","volume":"14","author":"Arzamasov","year":"2024","journal-title":"Quant. Imaging Med. Surg."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2728","DOI":"10.21037\/jtd-20-3522","article-title":"Performance of an AI Based CAD System in Solid Lung Nodule Detection on Chest Phantom Radiographs Compared to Radiology Residents and Fellow Radiologists","volume":"13","author":"Peters","year":"2021","journal-title":"J. Thorac. Dis."},{"key":"ref_21","unstructured":"(2026, April 06). ACR Lung CT Screening Reporting & Data System (Lung-RADS\u00ae). Available online: https:\/\/www.acr.org\/Clinical-Resources\/Clinical-Tools-and-Reference\/Reporting-and-Data-Systems\/Lung-RADS."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1148\/radiol.2017161659","article-title":"Guidelines for Management of Incidental Pulmonary Nodules Detected on CT Images: From the Fleischner Society 2017","volume":"284","author":"MacMahon","year":"2017","journal-title":"Radiology"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3680","DOI":"10.1038\/s41598-023-30521-2","article-title":"Evaluation of the Clinical Performance of an AI-Based Application for the Automated Analysis of Chest X-Rays","volume":"13","author":"Niehoff","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.diii.2024.11.003","article-title":"An Introductory Guide to Statistics for the Radiologist","volume":"106","author":"Detrinidad","year":"2025","journal-title":"Diagn. Interv. Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1111\/j.0006-341X.2000.00345.x","article-title":"Comparisons of Predictive Values of Binary Medical Diagnostic Tests for Paired Designs","volume":"56","author":"Leisenring","year":"2000","journal-title":"Biometrics"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/S0895-4356(00)00314-0","article-title":"Adjusting for Multiple Testing\u2014When and How?","volume":"54","author":"Bender","year":"2001","journal-title":"J. Clin. Epidemiol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3283","DOI":"10.1038\/s41591-025-03953-8","article-title":"The STARD-AI Reporting Guideline for Diagnostic Accuracy Studies Using Artificial Intelligence","volume":"31","author":"Sounderajah","year":"2025","journal-title":"Nat. Med."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kaviani, P., Kalra, M.K., Digumarthy, S.R., Gupta, R.V., Dasegowda, G., Jagirdar, A., Gupta, S., Putha, P., Mahajan, V., and Reddy, B. (2022). Frequency of Missed Findings on Chest Radiographs (CXRs) in an International, Multicenter Study: Application of AI to Reduce Missed Findings. Diagnostics, 12.","DOI":"10.3390\/diagnostics12102382"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"4468","DOI":"10.1007\/s00330-022-08593-x","article-title":"Artificial Intelligence System for Identification of False-Negative Interpretations in Chest Radiographs","volume":"32","author":"Hwang","year":"2022","journal-title":"Eur. Radiol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"e231236","DOI":"10.1148\/radiol.231236","article-title":"Commercially Available Chest Radiograph AI Tools for Detecting Airspace Disease, Pneumothorax, and Pleural Effusion","volume":"308","author":"Laustrup","year":"2023","journal-title":"Radiology"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"e190222","DOI":"10.1148\/ryct.2020190222","article-title":"Undetected Lung Cancer at Posteroanterior Chest Radiography: Potential Role of a Deep Learning\u2013Based Detection Algorithm","volume":"2","author":"Nam","year":"2020","journal-title":"Radiol. Cardiothorac. Imaging"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"111002","DOI":"10.1016\/j.ejrad.2023.111002","article-title":"Deep Learning-Based Automatic Detection for Pulmonary Nodules on Chest Radiographs: The Relationship with Background Lung Condition, Nodule Characteristics, and Location","volume":"166","author":"Ueno","year":"2023","journal-title":"Eur. J. Radiol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2003061","DOI":"10.1183\/13993003.03061-2020","article-title":"Development and Validation of a Deep Learning Algorithm Detecting 10 Common Abnormalities on Chest Radiographs","volume":"57","author":"Nam","year":"2021","journal-title":"Eur. Respir. J."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kaviani, P., Digumarthy, S.R., Bizzo, B.C., Reddy, B., Tadepalli, M., Putha, P., Jagirdar, A., Ebrahimian, S., Kalra, M.K., and Dreyer, K.J. (2022). Performance of a Chest Radiography AI Algorithm for Detection of Missed or Mislabeled Findings: A Multicenter Study. Diagnostics, 12.","DOI":"10.20944\/preprints202208.0189.v1"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1016\/j.acra.2016.01.006","article-title":"Outcomes Knowledge May Bias Radiological Decision-Making","volume":"23","author":"Littlefair","year":"2016","journal-title":"Acad. Radiol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"890","DOI":"10.3348\/kjr.2023.0255","article-title":"Effects of Implementing Artificial Intelligence-Based Computer-Aided Detection for Chest Radiographs in Daily Practice on the Rate of Referral to Chest Computed Tomography in Pulmonology Outpatient Clinic","volume":"24","author":"Hong","year":"2023","journal-title":"Korean J. Radiol."}],"container-title":["Diagnostics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/19\/3139\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T11:56:40Z","timestamp":1790596600000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2075-4418\/16\/19\/3139"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,27]]},"references-count":36,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2026,10]]}},"alternative-id":["diagnostics16193139"],"URL":"https:\/\/doi.org\/10.3390\/diagnostics16193139","relation":{},"ISSN":["2075-4418"],"issn-type":[{"value":"2075-4418","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,27]]}}}