{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T09:01:51Z","timestamp":1781686911772,"version":"3.54.5"},"reference-count":30,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T00:00:00Z","timestamp":1781654400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"JSPS KAKENHI","award":["22K07665, 23KK0148"],"award-info":[{"award-number":["22K07665, 23KK0148"]}]},{"name":"Cross-ministerial Strategic Innovation Promotion Program and Construction of an Integrated Health Care System","award":["JPJ01242"],"award-info":[{"award-number":["JPJ01242"]}]},{"DOI":"10.13039\/100009619","name":"AMED","doi-asserted-by":"crossref","award":["JP256f0137011"],"award-info":[{"award-number":["JP256f0137011"]}],"id":[{"id":"10.13039\/100009619","id-type":"DOI","asserted-by":"crossref"}]},{"name":"GE Healthcare (Japan), Hino, Japan"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Intracranial hemorrhage is life-threatening and requires prompt and accurate diagnosis. Non-contrast head computed tomography is the standard first-line examination, but detecting small hemorrhages and classifying multiple subtypes require substantial expertise. Workforce shortages and increasing diagnostic workloads, especially in emergency settings, further challenge timely decision-making. Artificial intelligence (AI)-assisted interpretation has shown promise for improving accuracy and efficiency. This retrospective study evaluated the effect of AI assistance on the diagnostic performance of radiologic technologists (RTs).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We analyzed the data for 100 non-contrast head computed tomography examinations (50 positive and 50 negative for hemorrhage) obtained from the Japan Medical Image Database. The interpretations of the five RTs (5\u201312 years of experience) with and without AI assistance were compared with those of two radiologists. The detection targets were intraparenchymal, intraventricular, subarachnoid, subdural, epidural, and any hemorrhages. We calculated the Area Under the Receiver Operating Characteristic Curve (AUC), accuracy, sensitivity, and specificity. The differences in the AUC for the AI-assisted and unassisted readings were tested using the DeLong method with Bonferroni correction.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Significant AUC improvements were observed for five of the 30 reader\u2013task comparisons (17%) after Bonferroni correction. These improvements were all related to intraventricular (\n                      <jats:italic>p<\/jats:italic>\n                      = 0.0001 to 0.0071) and subdural (\n                      <jats:italic>p<\/jats:italic>\n                      = 0.0022 to 0.0071) hemorrhages.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>\n                      AI assistance significantly improved RT detection of challenging subtypes such as intraventricular and subdural hemorrhages. However, it did not improve the diagnostic accuracy for detecting any hemorrhage overall (\n                      <jats:italic>p<\/jats:italic>\n                      = 0.0689 to 0.9669). AI can strengthen the role of RTs within task-sharing models and help stabilize preliminary assessments, especially in emergency care and resource-constrained environments.\n                    <\/jats:p>\n                  <\/jats:sec>","DOI":"10.7717\/peerj.21414","type":"journal-article","created":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T08:46:22Z","timestamp":1781685982000},"page":"e21414","source":"Crossref","is-referenced-by-count":0,"title":["Development and evaluation of a deep learning-assisted diagnostic support system for radiographer preliminary clinical evaluation of intracranial hemorrhage"],"prefix":"10.7717","volume":"14","author":[{"given":"Kazuma","family":"Tsukamoto","sequence":"first","affiliation":[{"name":"Department of Medical Device Engineering, Kobe University Graduate School of Medicine, Kusunoki-cho, Chuo-ku, Kobe, Japan"},{"name":"Center for Radiology and Radiation Oncology, Kobe University Hospital, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mizuho","family":"Nishio","sequence":"additional","affiliation":[{"name":"Department of Radiology, Kobe University Graduate School of Medicine, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryo","family":"Kurosaki","sequence":"additional","affiliation":[{"name":"Department of Medical Device Engineering, Kobe University Graduate School of Medicine, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yasuyuki","family":"Kojita","sequence":"additional","affiliation":[{"name":"Department of Radiology, Kobe University Graduate School of Medicine, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9684-4632","authenticated-orcid":true,"given":"Hidetoshi","family":"Matsuo","sequence":"additional","affiliation":[{"name":"Department of Radiology, Kobe University Graduate School of Medicine, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4846-5662","authenticated-orcid":true,"given":"Munenobu","family":"Nogami","sequence":"additional","affiliation":[{"name":"Department of Radiology, Kobe University Graduate School of Medicine, Chuo-ku, Kobe, Japan"},{"name":"Division of Medical Imaging, Biomedical Imaging Research Center, University of Fukui, Yoshida, Fukui, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kazuki","family":"Ishikawa","sequence":"additional","affiliation":[{"name":"Center for Radiology and Radiation Oncology, Kobe University Hospital, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryosuke","family":"Hatano","sequence":"additional","affiliation":[{"name":"Center for Radiology and Radiation Oncology, Kobe University Hospital, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuka","family":"Shimo","sequence":"additional","affiliation":[{"name":"Center for Radiology and Radiation Oncology, Kobe University Hospital, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuki","family":"Komon","sequence":"additional","affiliation":[{"name":"Center for Radiology and Radiation Oncology, Kobe University Hospital, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuya","family":"Ueki","sequence":"additional","affiliation":[{"name":"Center for Radiology and Radiation Oncology, Kobe University Hospital, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Izumi","family":"Imaoka","sequence":"additional","affiliation":[{"name":"Department of Radiology, Kobe University Graduate School of Medicine, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kazuyuki","family":"Ohmura","sequence":"additional","affiliation":[{"name":"GE HealthCare (Japan) Research Division, Hino-shi, Tokyo, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kazuya","family":"Matsuo","sequence":"additional","affiliation":[{"name":"Department of Medical Device Engineering, Kobe University Graduate School of Medicine, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3056-0792","authenticated-orcid":true,"given":"Toshiaki","family":"Akashi","sequence":"additional","affiliation":[{"name":"Department of Radiology, Juntendo University Graduate School of Medicine, Bunkyo-ku, Tokyo, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shigeki","family":"Aoki","sequence":"additional","affiliation":[{"name":"Department of Radiology, Juntendo University Graduate School of Medicine, Bunkyo-ku, Tokyo, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Akiko","family":"Kusaka","sequence":"additional","affiliation":[{"name":"Center for Radiology and Radiation Oncology, Kobe University Hospital, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7782-548X","authenticated-orcid":true,"given":"Takamichi","family":"Murakami","sequence":"additional","affiliation":[{"name":"Department of Radiology, Kobe University Graduate School of Medicine, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yoshihiro","family":"Muragaki","sequence":"additional","affiliation":[{"name":"Department of Medical Device Engineering, Kobe University Graduate School of Medicine, Kusunoki-cho, Chuo-ku, Kobe, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4443","published-online":{"date-parts":[[2026,6,17]]},"reference":[{"issue":"3","key":"10.7717\/peerj.21414\/ref-1","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1002\/jmrs.466","article-title":"An analysis of radiographer preliminary image evaluation\u2014a focus on common false negatives","volume":"68","author":"Alexander-Bates","year":"2021","journal-title":"Journal of Medical Radiation Sciences"},{"issue":"1","key":"10.7717\/peerj.21414\/ref-2","doi-asserted-by":"publisher","first-page":"9975","DOI":"10.1038\/s41598-023-37114-z","article-title":"A comparison of performance between a deep learning model with residents for localization and classification of intracranial hemorrhage","volume":"13","author":"Angkurawaranon","year":"2023","journal-title":"Scientific Reports"},{"issue":"2","key":"10.7717\/peerj.21414\/ref-3","doi-asserted-by":"publisher","first-page":"101815","DOI":"10.1016\/j.jmir.2024.101815","article-title":"Preliminary clinical evaluation (PCE): a transnational scoping review of current radiography practice","volume":"56","author":"Anudjo","year":"2025","journal-title":"Journal of Medical Imaging and Radiation Sciences"},{"issue":"1","key":"10.7717\/peerj.21414\/ref-4","doi-asserted-by":"publisher","first-page":"1009","DOI":"10.1089\/neur.2024.0017","article-title":"Clinical impact of an AI decision support system for detection of intracranial hemorrhage in CT scans","volume":"5","author":"Bark","year":"2024","journal-title":"Neurotrauma Reports"},{"issue":"19","key":"10.7717\/peerj.21414\/ref-5","doi-asserted-by":"publisher","first-page":"5611","DOI":"10.3390\/s20195611","article-title":"Accurate and efficient intracranial hemorrhage detection and subtype classification in 3D CT scans with CNN and LSTM","volume":"20","author":"Burduja","year":"2020","journal-title":"Sensors"},{"issue":"3","key":"10.7717\/peerj.21414\/ref-6","doi-asserted-by":"publisher","first-page":"771","DOI":"10.1016\/j.emc.2012.06.003","article-title":"Intracranial hemorrhage","volume":"30","author":"Caceres","year":"2012","journal-title":"Emergency Medicine Clinics of North America"},{"issue":"4\u20135","key":"10.7717\/peerj.21414\/ref-7","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1016\/j.compmedimag.2007.02.010","article-title":"Computer aided detection of small acute intracranial hemorrhage on computer tomography of brain","volume":"31","author":"Chan","year":"2007","journal-title":"Computerized Medical Imaging and Graphics"},{"issue":"9","key":"10.7717\/peerj.21414\/ref-8","doi-asserted-by":"publisher","first-page":"1609","DOI":"10.3174\/ajnr.A5742","article-title":"Hybrid 3D\/2D convolutional neural network for hemorrhage evaluation on head CT","volume":"39","author":"Chang","year":"2018","journal-title":"American Journal of Neuroradiology"},{"issue":"10162","key":"10.7717\/peerj.21414\/ref-9","doi-asserted-by":"publisher","first-page":"2388","DOI":"10.1016\/S0140-6736(18)31645-3","article-title":"Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study","volume":"392","author":"Chilamkurthy","year":"2018","journal-title":"The Lancet"},{"issue":"9675","key":"10.7717\/peerj.21414\/ref-10","doi-asserted-by":"publisher","first-page":"110073","DOI":"10.1016\/j.ejrad.2021.110073","article-title":"Convolutional neural network performance compared to radiologists in detecting intracranial hemorrhage from brain computed tomography: a systematic review and meta-analysis","volume":"146","author":"Daugaard J\u00f8rgensen","year":"2022","journal-title":"European Journal of Radiology"},{"issue":"3","key":"10.7717\/peerj.21414\/ref-11","doi-asserted-by":"publisher","first-page":"837","DOI":"10.2307\/2531595","article-title":"Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach","volume":"44","author":"DeLong","year":"1988","journal-title":"Biometrics"},{"key":"10.7717\/peerj.21414\/ref-12","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1109\/CVPR.2009.5206848","article-title":"ImageNet: a large-scale hierarchical image database","author":"Deng","year":"2009"},{"issue":"2","key":"10.7717\/peerj.21414\/ref-13","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/j.radi.2014.10.001","article-title":"Radiographer reporting in the UK: a longitudinal analysis","volume":"21","author":"Hardy","year":"2015","journal-title":"Radiography"},{"key":"10.7717\/peerj.21414\/ref-14","doi-asserted-by":"publisher","first-page":"770","DOI":"10.1109\/CVPR.2016.90","article-title":"Deep residual learning for image recognition","author":"He","year":"2016"},{"key":"10.7717\/peerj.21414\/ref-15","doi-asserted-by":"publisher","first-page":"7132","DOI":"10.1109\/CVPR.2018.00745","article-title":"Squeeze-and-excitation networks","author":"Hu","year":"2018"},{"key":"10.7717\/peerj.21414\/ref-16","doi-asserted-by":"publisher","first-page":"101850","DOI":"10.1016\/j.artmed.2020.101850","article-title":"CT window trainable neural network for improving intracranial hemorrhage detection by combining multiple settings","volume":"106","author":"Karki","year":"2020","journal-title":"Artificial Intelligence in Medicine"},{"key":"10.7717\/peerj.21414\/ref-17","doi-asserted-by":"publisher","DOI":"10.4274\/dir.2025.253301","article-title":"Impact of a computed tomography-based artificial intelligence software on radiologists\u2019 workflow for detecting acute intracranial hemorrhage","author":"Kim","year":"2025","journal-title":"Diagnostic and Interventional Radiology"},{"issue":"45","key":"10.7717\/peerj.21414\/ref-18","doi-asserted-by":"publisher","first-page":"22737","DOI":"10.1073\/pnas.1908021116","article-title":"Expert-level detection of acute intracranial hemorrhage on head computed tomography using deep learning","volume":"116","author":"Kuo","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"10.7717\/peerj.21414\/ref-19","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1608.03983","article-title":"SGDR: stochastic gradient descent with warm restarts. International Conference on Learning Representations (ICLR)","author":"Loshchilov","year":"2017"},{"issue":"7788","key":"10.7717\/peerj.21414\/ref-20","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1038\/s41586-019-1799-6","article-title":"International evaluation of an AI system for breast cancer screening","volume":"577","author":"McKinney","year":"2020","journal-title":"Nature"},{"key":"10.7717\/peerj.21414\/ref-21","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2005.10992","article-title":"A CNN-LSTM architecture for detection of intracranial hemorrhage on CT scans","author":"Nguyen","year":"2020"},{"key":"10.7717\/peerj.21414\/ref-22","article-title":"RSNA Intercranial Hemorrhage Detection","author":"Radiological Society of North America","year":"2019"},{"issue":"3","key":"10.7717\/peerj.21414\/ref-23","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.ejrad.2019.02.038","article-title":"The present and future of deep learning in radiology","volume":"114","author":"Saba","year":"2019","journal-title":"European Journal of Radiology"},{"key":"10.7717\/peerj.21414\/ref-24","article-title":"1st-RSNA-intracranial-hemorrhage-detection","author":"Scu-sen","year":"2020"},{"issue":"1","key":"10.7717\/peerj.21414\/ref-25","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","article-title":"A survey on image data augmentation for deep learning","volume":"6","author":"Shorten","year":"2019","journal-title":"Journal of Big Data"},{"key":"10.7717\/peerj.21414\/ref-26","volume-title":"Radiographer preliminary clinical evaluation","author":"Society and College of Radiographers","year":"2024","edition":"2"},{"issue":"1","key":"10.7717\/peerj.21414\/ref-27","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","article-title":"High-performance medicine: the convergence of human and artificial intelligence","volume":"25","author":"Topol","year":"2019","journal-title":"Nature Medicine"},{"issue":"2","key":"10.7717\/peerj.21414\/ref-28","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1016\/S1474-4422(09)70340-0","article-title":"Incidence, case fatality, and functional outcome of intracerebral haemorrhage over time, according to age, sex, and ethnic origin: a systematic review and meta-analysis","volume":"9","author":"van Asch","year":"2010","journal-title":"The Lancet Neurology"},{"key":"10.7717\/peerj.21414\/ref-29","doi-asserted-by":"publisher","first-page":"102785","DOI":"10.1016\/j.nicl.2021.102785","article-title":"A deep learning algorithm for automatic detection and classification of acute intracranial hemorrhages in head CT scans","volume":"32","author":"Wang","year":"2021","journal-title":"NeuroImage: Clinical"},{"issue":"1","key":"10.7717\/peerj.21414\/ref-30","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1038\/s41746-023-00798-8","article-title":"Deep learning based automatic detection algorithm for acute intracranial haemorrhage: a pivotal randomized clinical trial","volume":"6","author":"Yun","year":"2023","journal-title":"NPJ Digital Medicine"}],"container-title":["PeerJ"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/21414.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/21414.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/21414.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/21414.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T08:46:26Z","timestamp":1781685986000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/21414"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,17]]},"references-count":30,"alternative-id":["10.7717\/peerj.21414"],"URL":"https:\/\/doi.org\/10.7717\/peerj.21414","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{},"ISSN":["2167-8359"],"issn-type":[{"value":"2167-8359","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,17]]},"article-number":"e21414"}}