{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T18:20:06Z","timestamp":1775672406711,"version":"3.50.1"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,4,29]],"date-time":"2023-04-29T00:00:00Z","timestamp":1682726400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,29]],"date-time":"2023-04-29T00:00:00Z","timestamp":1682726400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Whether the utilization of artificial intelligence (AI) during the interpretation of chest radiographs (CXRs) would affect the radiologists\u2019 workload is of particular interest. Therefore, this prospective observational study aimed to observe how AI affected the reading times of radiologists in the daily interpretation of CXRs. Radiologists who agreed to have the reading times of their CXR interpretations collected from September to December 2021 were recruited. Reading time was defined as the duration in seconds from opening CXRs to transcribing the image by the same radiologist. As commercial AI software was integrated for all CXRs, the radiologists could refer to AI results for 2 months (AI-aided period). During the other 2 months, the radiologists were automatically blinded to the AI results (AI-unaided period). A total of 11 radiologists participated, and 18,680 CXRs were included. Total reading times were significantly shortened with AI use, compared to no use (13.3\u2009s vs. 14.8\u2009s, <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.001). When there was no abnormality detected by AI, reading times were shorter with AI use (mean 10.8\u2009s vs. 13.1\u2009s, <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.001). However, if any abnormality was detected by AI, reading times did not differ according to AI use (mean 18.6\u2009s vs. 18.4\u2009s, <jats:italic>p<\/jats:italic>\u2009=\u20090.452). Reading times increased as abnormality scores increased, and a more significant increase was observed with AI use (coefficient 0.09 vs. 0.06, <jats:italic>p<\/jats:italic>\u2009&lt;\u20090.001). Therefore, the reading times of CXRs among radiologists were influenced by the availability of AI. Overall reading times shortened when radiologists referred to AI; however, abnormalities detected by AI could lengthen reading times.<\/jats:p>","DOI":"10.1038\/s41746-023-00829-4","type":"journal-article","created":{"date-parts":[[2023,4,29]],"date-time":"2023-04-29T11:01:44Z","timestamp":1682766104000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":70,"title":["The impact of artificial intelligence on the reading times of radiologists for chest radiographs"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7462-2609","authenticated-orcid":false,"given":"Hyun Joo","family":"Shin","sequence":"first","affiliation":[]},{"given":"Kyunghwa","family":"Han","sequence":"additional","affiliation":[]},{"given":"Leeha","family":"Ryu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3368-5013","authenticated-orcid":false,"given":"Eun-Kyung","family":"Kim","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,4,29]]},"reference":[{"key":"829_CR1","doi-asserted-by":"publisher","first-page":"1743","DOI":"10.3348\/kjr.2021.0544","volume":"22","author":"EJ Hwang","year":"2021","unstructured":"Hwang, E. J. et al. Use of artificial intelligence-based software as medical devices for chest radiography: a position paper from the Korean Society of Thoracic Radiology. Korean J. Radiol. 22, 1743\u20131748 (2021).","journal-title":"Korean J. Radiol."},{"key":"829_CR2","doi-asserted-by":"publisher","unstructured":"van Leeuwen, K. G. et al. How does artificial intelligence in radiology improve efficiency and health outcomes? Pediatr. Radiol. https:\/\/doi.org\/10.1007\/s00247-021-05114-8 (2021).","DOI":"10.1007\/s00247-021-05114-8"},{"key":"829_CR3","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-00324-0","volume":"3","author":"S Benjamens","year":"2020","unstructured":"Benjamens, S., Dhunnoo, P. & Mesk\u00f3, B. The state of artificial intelligence-based FDA-approved medical devices and algorithms: an online database. NPJ Digit. Med. 3, 118 (2020).","journal-title":"NPJ Digit. Med."},{"key":"829_CR4","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1148\/radiol.212631","volume":"304","author":"R Alexander","year":"2022","unstructured":"Alexander, R. et al. Mandating limits on workload, duty, and speed in radiology. Radiology 304, 274\u2013282 (2022).","journal-title":"Radiology"},{"key":"829_CR5","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1148\/radiol.2018171820","volume":"288","author":"G Choy","year":"2018","unstructured":"Choy, G. et al. Current applications and future impact of machine learning in radiology. Radiology 288, 318\u2013328 (2018).","journal-title":"Radiology"},{"key":"829_CR6","doi-asserted-by":"publisher","first-page":"e200024","DOI":"10.1148\/ryai.2020200024","volume":"3","author":"TJ O\u2019Neill","year":"2021","unstructured":"O\u2019Neill, T. J. et al. Active reprioritization of the reading worklist using artificial intelligence has a beneficial effect on the turnaround time for interpretation of head CT with intracranial hemorrhage. Radio. Artif. Intell. 3, e200024 (2021).","journal-title":"Radio. Artif. Intell."},{"key":"829_CR7","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1007\/s00234-020-02566-x","volume":"63","author":"Y Watanabe","year":"2021","unstructured":"Watanabe, Y. et al. Improvement of the diagnostic accuracy for intracranial haemorrhage using deep learning-based computer-assisted detection. Neuroradiology 63, 713\u2013720 (2021).","journal-title":"Neuroradiology"},{"key":"829_CR8","doi-asserted-by":"publisher","first-page":"505","DOI":"10.3348\/kjr.2021.0476","volume":"23","author":"JH Lee","year":"2022","unstructured":"Lee, J. H. et al. Improving the performance of radiologists using artificial intelligence-based detection support software for mammography: a multi-reader study. Korean J. Radiol. 23, 505\u2013516 (2022).","journal-title":"Korean J. Radiol."},{"key":"829_CR9","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1148\/radiol.210937","volume":"302","author":"A Guermazi","year":"2022","unstructured":"Guermazi, A. et al. Improving radiographic fracture recognition performance and efficiency using artificial intelligence. Radiology 302, 627\u2013636 (2022).","journal-title":"Radiology"},{"key":"829_CR10","doi-asserted-by":"publisher","first-page":"20200870","DOI":"10.1259\/bjr.20200870","volume":"94","author":"B Zhang","year":"2021","unstructured":"Zhang, B. et al. Improving rib fracture detection accuracy and reading efficiency with deep learning-based detection software: a clinical evaluation. Br. J. Radiol. 94, 20200870 (2021).","journal-title":"Br. J. Radiol."},{"key":"829_CR11","doi-asserted-by":"publisher","first-page":"450","DOI":"10.1148\/radiol.2021202818","volume":"299","author":"J Sung","year":"2021","unstructured":"Sung, J. et al. Added value of deep learning-based detection system for multiple major findings on chest radiographs: a randomized crossover study. Radiology 299, 450\u2013459 (2021).","journal-title":"Radiology"},{"key":"829_CR12","doi-asserted-by":"publisher","first-page":"e0264383","DOI":"10.1371\/journal.pone.0264383","volume":"17","author":"EY Kim","year":"2022","unstructured":"Kim, E. Y. et al. Concordance rate of radiologists and a commercialized deep-learning solution for chest X-ray: Real-world experience with a multicenter health screening cohort. PloS ONE 17, e0264383 (2022).","journal-title":"PloS ONE"},{"key":"829_CR13","doi-asserted-by":"publisher","first-page":"1085","DOI":"10.1016\/j.acra.2021.10.008","volume":"29","author":"FC M\u00fcller","year":"2022","unstructured":"M\u00fcller, F. C. et al. Impact of concurrent use of artificial intelligence tools on radiologists reading time: a prospective feasibility study. Acad. Radiol. 29, 1085\u20131090 (2022).","journal-title":"Acad. Radiol."},{"key":"829_CR14","doi-asserted-by":"publisher","first-page":"511","DOI":"10.3348\/kjr.2019.0821","volume":"21","author":"EJ Hwang","year":"2020","unstructured":"Hwang, E. J. & Park, C. M. Clinical implementation of deep learning in thoracic radiology: potential applications and challenges. Korean J. Radiol. 21, 511\u2013525 (2020).","journal-title":"Korean J. Radiol."},{"key":"829_CR15","doi-asserted-by":"publisher","unstructured":"Canoni-Meynet, L. et al. Added value of an artificial intelligence solution for fracture detection in the radiologist\u2019s daily trauma emergencies workflow. Diagn. Interv. Imaging https:\/\/doi.org\/10.1016\/j.diii.2022.06.004 (2022).","DOI":"10.1016\/j.diii.2022.06.004"},{"key":"829_CR16","doi-asserted-by":"publisher","unstructured":"Dang, L. A. et al. Impact of artificial intelligence in breast cancer screening with mammography. Breast Cancer https:\/\/doi.org\/10.1007\/s12282-022-01375-9 (2022).","DOI":"10.1007\/s12282-022-01375-9"},{"key":"829_CR17","doi-asserted-by":"publisher","first-page":"682","DOI":"10.21147\/j.issn.1000-9604.2021.06.05","volume":"33","author":"Y Sun","year":"2021","unstructured":"Sun, Y. et al. Deep learning model improves radiologists\u2019 performance in detection and classification of breast lesions. Chin. J. Cancer Res. 33, 682\u2013693 (2021).","journal-title":"Chin. J. Cancer Res."},{"key":"829_CR18","first-page":"e190208","volume":"2","author":"S Pacil\u00e8","year":"2020","unstructured":"Pacil\u00e8, S. et al. Improving breast cancer detection accuracy of mammography with the concurrent use of an artificial intelligence tool. Radiology 2, e190208 (2020).","journal-title":"Radiology"},{"key":"829_CR19","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-14519-w","volume":"12","author":"HJ Shin","year":"2022","unstructured":"Shin, H. J., Son, N. H., Kim, M. J. & Kim, E. K. Diagnostic performance of artificial intelligence approved for adults for the interpretation of pediatric chest radiographs. Sci. Rep. 12, 10215 (2022).","journal-title":"Sci. Rep."},{"key":"829_CR20","doi-asserted-by":"publisher","unstructured":"Lee, S., Shin, H. J., Kim, S. & Kim, E. K. Successful implementation of an artificial intelligence-based computer-aided detection system for chest radiography in daily clinical practice. Korean J. Radiol. https:\/\/doi.org\/10.3348\/kjr.2022.0193 (2022).","DOI":"10.3348\/kjr.2022.0193"},{"key":"829_CR21","doi-asserted-by":"publisher","first-page":"e0282123","DOI":"10.1371\/journal.pone.0282123","volume":"18","author":"HJ Shin","year":"2023","unstructured":"Shin, H. J. et al. Hospital-wide survey of clinical experience with artificial intelligence applied to daily chest radiographs. PloS ONE 18, e0282123 (2023).","journal-title":"PloS ONE"},{"key":"829_CR22","doi-asserted-by":"publisher","first-page":"2003061","DOI":"10.1183\/13993003.03061-2020","volume":"57","author":"JG Nam","year":"2021","unstructured":"Nam, J. G. et al. Development and validation of a deep learning algorithm detecting 10 common abnormalities on chest radiographs. Eur. Respir. J. 57, 2003061 (2021).","journal-title":"Eur. Respir. J."},{"key":"829_CR23","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1148\/radiol.2018180237","volume":"290","author":"JG Nam","year":"2019","unstructured":"Nam, J. G. et al. Development and validation of deep learning-based automatic detection algorithm for malignant pulmonary nodules on chest radiographs. Radiology 290, 218\u2013228 (2019).","journal-title":"Radiology"},{"key":"829_CR24","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1148\/radiol.2020201240","volume":"297","author":"JH Lee","year":"2020","unstructured":"Lee, J. H. et al. Performance of a deep learning algorithm compared with radiologic interpretation for lung cancer detection on chest radiographs in a health screening population. Radiology 297, 687\u2013696 (2020).","journal-title":"Radiology"},{"key":"829_CR25","doi-asserted-by":"publisher","unstructured":"Jin, K. N. et al. Diagnostic effect of artificial intelligence solution for referable thoracic abnormalities on chest radiography: a multicenter respiratory outpatient diagnostic cohort study. Eur. Radiol. https:\/\/doi.org\/10.1007\/s00330-021-08397-5 (2022).","DOI":"10.1007\/s00330-021-08397-5"},{"key":"829_CR26","doi-asserted-by":"publisher","first-page":"e0281690","DOI":"10.1371\/journal.pone.0281690","volume":"18","author":"SH Kwak","year":"2023","unstructured":"Kwak, S. H. et al. Incidentally found resectable lung cancer with the usage of artificial intelligence on chest radiographs. PloS ONE 18, e0281690 (2023).","journal-title":"PloS ONE"},{"key":"829_CR27","doi-asserted-by":"publisher","first-page":"647","DOI":"10.3349\/ymj.2020.61.8.647","volume":"61","author":"SJ Kim","year":"2020","unstructured":"Kim, S. J. et al. Current state and strategy for establishing a digitally innovative hospital: memorial review article for opening of Yongin Severance Hospital. Yonsei Med. J. 61, 647\u2013651 (2020).","journal-title":"Yonsei Med. J."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00829-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00829-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00829-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,29]],"date-time":"2023-04-29T11:04:31Z","timestamp":1682766271000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00829-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,29]]},"references-count":27,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["829"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00829-4","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,29]]},"assertion":[{"value":"25 January 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"82"}}