{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T22:58:50Z","timestamp":1790895530697,"version":"4.1.0"},"reference-count":21,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2023,5,1]],"date-time":"2023-05-01T00:00:00Z","timestamp":1682899200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/501100003710","name":"Korea Health Industry Development Institute","doi-asserted-by":"publisher","award":["HI19C0847"],"award-info":[{"award-number":["HI19C0847"]}],"id":[{"id":"10.13039\/501100003710","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003710","name":"Korea Health Industry Development Institute","doi-asserted-by":"crossref","award":["HI19C0847"],"award-info":[{"award-number":["HI19C0847"]}],"id":[{"id":"10.13039\/501100003710","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["www.atsjournals.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,5,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Rationale<\/jats:title>\n                    <jats:p>Artificial intelligence (AI)\u2013assisted diagnosis imparts high accuracy to chest radiography (CXR) interpretation; however, its benefit for nonradiologist physicians in detecting lung lesions on CXR remains unclear.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>To investigate whether AI assistance improves the diagnostic performance of physicians for CXR interpretation and affects their clinical decisions in clinical practice.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We randomly allocated eligible patients who visited an outpatient clinic to the intervention (with AI-assisted interpretation) and control (without AI-assisted interpretation) groups. Lung lesions on CXR were recorded by seven nonradiologists with or without AI assistance. The reference standard for lung lesions was established by three radiologists. The primary and secondary endpoints were the physicians\u2019 diagnostic accuracy and clinical decision, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Between October 2020 and May 2021, 162 and 161 patients were assigned to the intervention and control groups, respectively. The area under the receiver operating characteristic curve was significantly larger in the intervention group than in the control group for the CXR level (0.840 [95% confidence interval (CI), 0.778\u20130.903] vs. 0.718 [95% CI, 0.640\u20130.796]; P\u2009=\u20090.017) and lung lesion level (0.800 [95% CI, 0.740\u20130.861] vs. 0.677 [95% CI, 0.605\u20130.750]; P\u2009=\u20090.011). The intervention group had higher sensitivity in terms of both CXR and lung lesion level and a lower false referral rate for the lung lesion level. AI-assisted CXR interpretation did not affect the physicians\u2019 clinical decisions.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>AI-assisted CXR interpretation improves the diagnostic performance of nonradiologist physicians in detecting abnormal lung findings.<\/jats:p>\n                    <jats:p>Clinical trial registered with Clinical Research Information Service of the Republic of Korea (KCT 0005466).<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1513\/annalsats.202206-481oc","type":"journal-article","created":{"date-parts":[[2022,12,12]],"date-time":"2022-12-12T12:46:06Z","timestamp":1670849166000},"page":"660-667","update-policy":"https:\/\/doi.org\/10.1164\/crossmarkpolicies","source":"Crossref","is-referenced-by-count":19,"title":["Artificial Intelligence Solution for Chest Radiographs in Respiratory Outpatient Clinics: Multicenter Prospective Randomized Clinical Trial"],"prefix":"10.1093","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4379-0260","authenticated-orcid":false,"given":"Hyun Woo","family":"Lee","sequence":"first","affiliation":[{"name":"Division of Respiratory and Critical Care, Department of Internal Medicine"},{"name":"College of Medicine, Seoul National University, Seoul, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kwang Nam","family":"Jin","sequence":"additional","affiliation":[{"name":"College of Medicine, Seoul National University, Seoul, Korea"},{"name":"Department of Radiology, and"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sohee","family":"Oh","sequence":"additional","affiliation":[{"name":"Medical Research Collaborating Center, Seoul Metropolitan Government\u2013Seoul National University Boramae Medical Center, Seoul, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sung-Yoon","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9568-2096","authenticated-orcid":false,"given":"Sang Min","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"In Beom","family":"Jeong","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, College of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ji Woong","family":"Son","sequence":"additional","affiliation":[{"name":"Department of Internal Medicine, College of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ju Hyuck","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Medical Engineering, and"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eun Young","family":"Heo","sequence":"additional","affiliation":[{"name":"Division of Respiratory and Critical Care, Department of Internal Medicine"},{"name":"College of Medicine, Seoul National University, Seoul, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5060-7255","authenticated-orcid":false,"given":"Jung Gyu","family":"Lee","sequence":"additional","affiliation":[{"name":"Division of Respiratory and Critical Care, Department of Internal Medicine"},{"name":"College of Medicine, Seoul National University, Seoul, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Young Jae","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Biomedical Engineering, Gachon University, Incheon, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eun Young","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Radiology, Gil Medical Center, College of Medicine, and"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Young Jun","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Radiology, Konyang University Hospital, Daejeon, Korea"},{"name":"School of Medicine, Konyang University, Daejeon, Korea; and"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,5,1]]},"reference":[{"key":"2026012203265701300_bib1","doi-asserted-by":"crossref","first-page":"1700364","DOI":"10.1183\/13993003.00364-2017","article-title":"The long and winding road of chest radiography for tuberculosis detection","volume":"49","author":"Miller","year":"2017","journal-title":"Eur Respir J"},{"key":"2026012203265701300_bib2","doi-asserted-by":"crossref","first-page":"703","DOI":"10.1016\/j.jacr.2006.02.007","article-title":"Clinical indicators of radiographic findings in patients with suspected community-acquired pneumonia: who needs a chest x-ray?","volume":"3","author":"O\u2019Brien","year":"2006","journal-title":"J Am Coll Radiol"},{"key":"2026012203265701300_bib3","doi-asserted-by":"crossref","first-page":"522","DOI":"10.21037\/tlcr.2020.04.02","article-title":"Role of chest radiographs in early lung cancer detection","volume":"9","author":"Kim","year":"2020","journal-title":"Transl Lung Cancer Res"},{"key":"2026012203265701300_bib4","doi-asserted-by":"crossref","first-page":"252","DOI":"10.1148\/radiol.2016150409","article-title":"The development of expertise in radiology: in chest radiograph interpretation, \u201cexpert\u201d search pattern may predate \u201cexpert\u201d levels of diagnostic accuracy for pneumothorax identification","volume":"280","author":"Kelly","year":"2016","journal-title":"Radiology"},{"key":"2026012203265701300_bib5","doi-asserted-by":"crossref","first-page":"349","DOI":"10.7861\/clinmedicine.13-4-349","article-title":"Assessing the accuracy and certainty in interpreting chest X-rays in the medical division","volume":"13","author":"Satia","year":"2013","journal-title":"Clin Med (Lond)"},{"key":"2026012203265701300_bib6","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1186\/s12875-021-01390-3","article-title":"Family medicine residents\u2019 skill levels in emergency chest X-ray interpretation","volume":"22","author":"Al Shammari","year":"2021","journal-title":"BMC Fam Pract"},{"key":"2026012203265701300_bib7","first-page":"A4875","article-title":"Poor interpretation of chest X-rays by junior doctors","volume":"61","author":"Christiansen","year":"2014","journal-title":"Dan Med J"},{"key":"2026012203265701300_bib8","doi-asserted-by":"crossref","first-page":"e827","DOI":"10.3399\/bjgp19X706853","article-title":"Sensitivity of chest X-ray for detecting lung cancer in people presenting with symptoms: a systematic review","volume":"69","author":"Bradley","year":"2019","journal-title":"Br J Gen Pract"},{"key":"2026012203265701300_bib9","doi-asserted-by":"crossref","first-page":"118","DOI":"10.5152\/dir.2016.16187","article-title":"Missed lung cancer: when, where, and why?","volume":"23","author":"Del Ciello","year":"2017","journal-title":"Diagn Interv Radiol"},{"key":"2026012203265701300_bib10","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1148\/radiol.2019191293","article-title":"Chest radiograph interpretation with deep learning models: assessment with radiologist-adjudicated reference standards and population-adjusted evaluation","volume":"294","author":"Majkowska","year":"2020","journal-title":"Radiology"},{"key":"2026012203265701300_bib11","doi-asserted-by":"crossref","first-page":"e496","DOI":"10.1016\/S2589-7500(21)00106-0","article-title":"Effect of a comprehensive deep-learning model on the accuracy of chest X-ray interpretation by radiologists: a retrospective, multireader multicase study","volume":"3","author":"Seah","year":"2021","journal-title":"Lancet Digit Health"},{"key":"2026012203265701300_bib12","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1148\/radiol.2018180237","article-title":"Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs","volume":"290","author":"Nam","year":"2019","journal-title":"Radiology"},{"key":"2026012203265701300_bib13","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1038\/s41746-020-00322-2","article-title":"CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV","volume":"3","author":"Rajpurkar","year":"2020","journal-title":"NPJ Digit Med"},{"key":"2026012203265701300_bib14","doi-asserted-by":"crossref","first-page":"e1000251","DOI":"10.1371\/journal.pmed.1000251","article-title":"CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials","volume":"7","author":"Schulz","year":"2010","journal-title":"PLoS Med"},{"key":"2026012203265701300_bib15","doi-asserted-by":"crossref","first-page":"e191095","DOI":"10.1001\/jamanetworkopen.2019.1095","article-title":"Development and validation of a deep learning-based automated detection algorithm for major thoracic diseases on chest radiographs","volume":"2","author":"Hwang","year":"2019","journal-title":"JAMA Netw Open"},{"key":"2026012203265701300_bib16","doi-asserted-by":"crossref","first-page":"3469","DOI":"10.1007\/s00330-021-08397-5","article-title":"Diagnostic effect of artificial intelligence solution for referable thoracic abnormalities on chest radiography: a multicenter respiratory outpatient diagnostic cohort study","volume":"32","author":"Jin","year":"2022","journal-title":"Eur Radiol"},{"key":"2026012203265701300_bib17","doi-asserted-by":"crossref","first-page":"100039","DOI":"10.1016\/j.ibmed.2021.100039","article-title":"Integration of a deep learning system for automated chest x-ray interpretation in the emergency department: a proof-of-concept","volume":"5","author":"Mosquera","year":"2021","journal-title":"Intell Based Med"},{"key":"2026012203265701300_bib18","doi-asserted-by":"crossref","first-page":"450","DOI":"10.1148\/radiol.2021202818","article-title":"Added value of deep learning-based detection system for multiple major findings on chest radiographs: a randomized crossover study","volume":"299","author":"Sung","year":"2021","journal-title":"Radiology"},{"key":"2026012203265701300_bib19","doi-asserted-by":"crossref","first-page":"103898","DOI":"10.1016\/j.compbiomed.2020.103898","article-title":"Accuracy of deep learning for automated detection of pneumonia using chest X-ray images: a systematic review and meta-analysis","volume":"123","author":"Li","year":"2020","journal-title":"Comput Biol Med"},{"key":"2026012203265701300_bib20","doi-asserted-by":"crossref","first-page":"689","DOI":"10.1183\/09031936.00136609","article-title":"Diagnostic accuracy of digital chest radiography for pulmonary tuberculosis in a UK urban population","volume":"35","author":"Abubakar","year":"2010","journal-title":"Eur Respir J"},{"key":"2026012203265701300_bib21","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1378\/chest.06-1261","article-title":"A clinical model to estimate the pretest probability of lung cancer in patients with solitary pulmonary nodules","volume":"131","author":"Gould","year":"2007","journal-title":"Chest"}],"container-title":["Annals of the American Thoracic Society"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/annalsats\/article-pdf\/20\/5\/660\/66278690\/annalsats_20_5_660.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/annalsats\/article-pdf\/20\/5\/660\/66278690\/annalsats_20_5_660.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T08:27:49Z","timestamp":1769070469000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/annalsats\/article\/20\/5\/660\/8415257"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,1]]},"references-count":21,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2023,5,1]]},"published-print":{"date-parts":[[2023,5,1]]}},"URL":"https:\/\/doi.org\/10.1513\/annalsats.202206-481oc","relation":{},"ISSN":["2329-6933","2325-6621"],"issn-type":[{"value":"2329-6933","type":"print"},{"value":"2325-6621","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,5]]},"published":{"date-parts":[[2023,5,1]]},"assertion":[{"value":"2022-06-03","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-12","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}