{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T22:49:18Z","timestamp":1775602158783,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,2,7]],"date-time":"2023-02-07T00:00:00Z","timestamp":1675728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministerio de Ciencia e Innovaci\u00f3n of Spain","award":["PID2019-107339GB-I00"],"award-info":[{"award-number":["PID2019-107339GB-I00"]}]},{"name":"Ministerio de Ciencia e Innovaci\u00f3n of Spain","award":["TED2021-129438B-I00"],"award-info":[{"award-number":["TED2021-129438B-I00"]}]},{"name":"Ministerio de Ciencia e Innovaci\u00f3n of Spain","award":["101070028"],"award-info":[{"award-number":["101070028"]}]},{"name":"Ministerio de Ciencia e Innovaci\u00f3n of Spain","award":["100010434"],"award-info":[{"award-number":["100010434"]}]},{"name":"Ministerio de Ciencia e Innovaci\u00f3n of Spain","award":["CI19-0068"],"award-info":[{"award-number":["CI19-0068"]}]},{"name":"Ministerio de Ciencia e Innovaci\u00f3n of Spain","award":["PI-0136-2012"],"award-info":[{"award-number":["PI-0136-2012"]}]},{"name":"European Commission","award":["PID2019-107339GB-I00"],"award-info":[{"award-number":["PID2019-107339GB-I00"]}]},{"name":"European Commission","award":["TED2021-129438B-I00"],"award-info":[{"award-number":["TED2021-129438B-I00"]}]},{"name":"European Commission","award":["101070028"],"award-info":[{"award-number":["101070028"]}]},{"name":"European Commission","award":["100010434"],"award-info":[{"award-number":["100010434"]}]},{"name":"European Commission","award":["CI19-0068"],"award-info":[{"award-number":["CI19-0068"]}]},{"name":"European Commission","award":["PI-0136-2012"],"award-info":[{"award-number":["PI-0136-2012"]}]},{"name":"\u201cla Caixa\u201d Foundation","award":["PID2019-107339GB-I00"],"award-info":[{"award-number":["PID2019-107339GB-I00"]}]},{"name":"\u201cla Caixa\u201d Foundation","award":["TED2021-129438B-I00"],"award-info":[{"award-number":["TED2021-129438B-I00"]}]},{"name":"\u201cla Caixa\u201d Foundation","award":["101070028"],"award-info":[{"award-number":["101070028"]}]},{"name":"\u201cla Caixa\u201d Foundation","award":["100010434"],"award-info":[{"award-number":["100010434"]}]},{"name":"\u201cla Caixa\u201d Foundation","award":["CI19-0068"],"award-info":[{"award-number":["CI19-0068"]}]},{"name":"\u201cla Caixa\u201d Foundation","award":["PI-0136-2012"],"award-info":[{"award-number":["PI-0136-2012"]}]},{"name":"Consejer\u00eda de Igualdad, Salud y Pol\u00edticas Sociales de Andaluc\u00eda, Spain","award":["PID2019-107339GB-I00"],"award-info":[{"award-number":["PID2019-107339GB-I00"]}]},{"name":"Consejer\u00eda de Igualdad, Salud y Pol\u00edticas Sociales de Andaluc\u00eda, Spain","award":["TED2021-129438B-I00"],"award-info":[{"award-number":["TED2021-129438B-I00"]}]},{"name":"Consejer\u00eda de Igualdad, Salud y Pol\u00edticas Sociales de Andaluc\u00eda, Spain","award":["101070028"],"award-info":[{"award-number":["101070028"]}]},{"name":"Consejer\u00eda de Igualdad, Salud y Pol\u00edticas Sociales de Andaluc\u00eda, Spain","award":["100010434"],"award-info":[{"award-number":["100010434"]}]},{"name":"Consejer\u00eda de Igualdad, Salud y Pol\u00edticas Sociales de Andaluc\u00eda, Spain","award":["CI19-0068"],"award-info":[{"award-number":["CI19-0068"]}]},{"name":"Consejer\u00eda de Igualdad, Salud y Pol\u00edticas Sociales de Andaluc\u00eda, Spain","award":["PI-0136-2012"],"award-info":[{"award-number":["PI-0136-2012"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Intracranial hemorrhage is a serious medical problem that requires rapid and often intensive medical care. Identifying the location and type of any hemorrhage present is a critical step in the treatment of the patient. Detection of, and diagnosis of, a hemorrhage that requires an urgent procedure is a difficult and time-consuming process for human experts. In this paper, we propose methods based on EfficientDet\u2019s deep-learning technology that can be applied to the diagnosis of hemorrhages at a patient level and which could, thus, become a decision-support system. Our proposal is two-fold. On the one hand, the proposed technique classifies slices of computed tomography scans for the presence of hemorrhage or its lack of, and evaluates whether the patient is positive in terms of hemorrhage, and achieving, in this regard, 92.7% accuracy and 0.978 ROC AUC. On the other hand, our methodology provides visual explanations of the chosen classification using the Grad-CAM methodology.<\/jats:p>","DOI":"10.3390\/jimaging9020037","type":"journal-article","created":{"date-parts":[[2023,2,8]],"date-time":"2023-02-08T03:01:45Z","timestamp":1675825305000},"page":"37","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":40,"title":["Deep Learning Applied to Intracranial Hemorrhage Detection"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1586-5042","authenticated-orcid":false,"given":"Luis","family":"Cort\u00e9s-Ferre","sequence":"first","affiliation":[{"name":"Department of Computer Sciences and Artificial Intelligence, University of Seville, Avda. Reina Mercedes s\/n, 41012 Sevilla, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3624-6139","authenticated-orcid":false,"given":"Miguel Angel","family":"Guti\u00e9rrez-Naranjo","sequence":"additional","affiliation":[{"name":"Department of Computer Sciences and Artificial Intelligence, University of Seville, Avda. Reina Mercedes s\/n, 41012 Sevilla, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4166-313X","authenticated-orcid":false,"given":"Juan Jos\u00e9","family":"Egea-Guerrero","sequence":"additional","affiliation":[{"name":"Hospital Universitario Virgen del Rocio, Avda. Manuel Siurot, 41013 Sevilla, Spain"},{"name":"Instituto de Biomedicina de Sevilla (Universidad de Sevilla\u2014CSIC\u2014Junta de Andaluc\u00eda), 41013 Sevilla, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8940-9763","authenticated-orcid":false,"given":"Soledad","family":"P\u00e9rez-S\u00e1nchez","sequence":"additional","affiliation":[{"name":"Stroke Unit, Neurology Department, Hospital Universitario Virgen Macarena, 41009 Sevilla, Spain"},{"name":"Neurovascular Research Laboratory, Instituto de Biomedicina de Sevilla-IBiS, 41013 Seville, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6030-7416","authenticated-orcid":false,"given":"Marcin","family":"Balcerzyk","sequence":"additional","affiliation":[{"name":"Department of Medical Physiology and Biophysics, University of Seville, 41009 Sevilla, Spain"},{"name":"Centro Nacional Aceleradores (Universidad de Sevilla\u2014CSIC\u2014Junta de Andaluc\u00eda), 41092 Sevilla, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1016\/S1474-4422(17)30299-5","article-title":"Global, regional, and national burden of neurological disorders during 1990\u20132015: A systematic analysis for the Global Burden of Disease Study 2015","volume":"16","author":"Feigin","year":"2017","journal-title":"Lancet Neurol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1016\/j.emc.2012.06.003","article-title":"Intracranial hemorrhage","volume":"30","author":"Caceres","year":"2012","journal-title":"Emerg. Med. Clin. N. Am."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1534","DOI":"10.1136\/jnnp.2004.055145","article-title":"Long term survival after primary intracerebral haemorrhage: A retrospective population based study","volume":"76","author":"Fogelholm","year":"2005","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/s12028-012-9792-z","article-title":"Clinical prediction models for aneurysmal subarachnoid hemorrhage: A systematic review","volume":"18","author":"Jaja","year":"2013","journal-title":"Neurocrit. Care"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1001\/jamaneurol.2019.0006","article-title":"Worldwide Incidence of Aneurysmal Subarachnoid Hemorrhage According to Region, Time Period, Blood Pressure, and Smoking Prevalence in the Population: A Systematic Review and Meta-analysis","volume":"76","author":"Etminan","year":"2019","journal-title":"JAMA Neurol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1757","DOI":"10.1007\/s13311-020-00902-w","article-title":"Advances in Therapeutic Approaches for Spontaneous Intracerebral Hemorrhage","volume":"17","author":"Hanley","year":"2020","journal-title":"Neurotherapeutics"},{"key":"ref_7","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"99112","DOI":"10.1109\/ACCESS.2021.3096136","article-title":"Recent Advances in Deep Learning Techniques for Face Recognition","volume":"9","author":"Fuad","year":"2021","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Hernandez-Olivan, C., and Beltran, J.R. (2021). Music Composition with Deep Learning: A Review. arXiv.","DOI":"10.1007\/978-3-031-18444-4_2"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Pan, X., Wang, M., Wu, L., and Li, L. (2021). Contrastive Learning for Many-to-many Multilingual Neural Machine Translation. arXiv.","DOI":"10.18653\/v1\/2021.acl-long.21"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"107700","DOI":"10.1016\/j.patcog.2020.107700","article-title":"MetaCOVID: A Siamese neural network framework with contrastive loss for n-shot diagnosis of COVID-19 patients","volume":"113","author":"Shorfuzzaman","year":"2021","journal-title":"Pattern Recognit."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2626","DOI":"10.1109\/TMI.2020.2996645","article-title":"Inf-Net: Automatic COVID-19 Lung Infection Segmentation from CT Images","volume":"39","author":"Fan","year":"2020","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1557","DOI":"10.1016\/j.media.2019.101557","article-title":"Exploring uncertainty measures in deep networks for Multiple sclerosis lesion detection and segmentation","volume":"59","author":"Nair","year":"2020","journal-title":"Med. Image Anal."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1007\/s11263-019-01228-7","article-title":"Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization","volume":"128","author":"Selvaraju","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Tan, M., Pang, R., and Le, Q.V. (2020, January 13\u201319). EfficientDet: Scalable and Efficient Object Detection. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"ref_17","unstructured":"Schwartz, R., Dodge, J., Smith, N.A., and Etzioni, O. (2019). Green AI. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Burduja, M., Ionescu, R.T., and Verga, N. (2020). Accurate and Efficient Intracranial Hemorrhage Detection and Subtype Classification in 3D CT Scans with Convolutional and Long Short-Term Memory Neural Networks. Sensors, 20.","DOI":"10.3390\/s20195611"},{"key":"ref_19","unstructured":"Gildenblat, J. (2022, November 16). Contributors. PyTorch Library for CAM Methods. Available online: https:\/\/github.com\/jacobgil\/pytorchgrad-cam."},{"key":"ref_20","unstructured":"(2021, January 25). Kaggle Competition: RSNA intracranial Hemorrhage Detection. Available online: https:\/\/www.kaggle.com\/c\/rsna-intracranialhemorrhage-detection."},{"key":"ref_21","unstructured":"(2014). Diagnostic Radiology Physics, International Atomic Energy Agency. Non-serial Publications."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.1016\/j.jacr.2021.03.005","article-title":"Diagnostic Accuracy and Failure Mode Analysis of a Deep Learning Algorithm for the Detection of Intracranial Hemorrhage","volume":"18","author":"Voter","year":"2021","journal-title":"J. Am. Coll. Radiol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"22737","DOI":"10.1073\/pnas.1908021116","article-title":"Expert-level detection of acute intracranial hemorrhage on head computed tomography using deep learning","volume":"116","author":"Kuo","year":"2019","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_24","first-page":"3706","article-title":"Intracranial hemorrhage detection","volume":"Volume 43","author":"Janardhan","year":"2021","journal-title":"Materials Today: Proceedings, Proceedings of the International Conference on Nanoelectronics, Nanophotonics, Nanomaterials, Nanobioscience & Nanotechnology, Kottayam, India, 29\u201330 April 2021"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sage, A., and Badura, P. (2020). Intracranial Hemorrhage Detection in Head CT Using Double-Branch Convolutional Neural Network, Support Vector Machine, and Random Forest. Appl. Sci., 10.","DOI":"10.3390\/app10217577"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"100005","DOI":"10.1016\/j.neuri.2021.100005","article-title":"Performance testing of a novel deep learning algorithm for the detection of intracranial hemorrhage and first trial under clinical conditions","volume":"1","author":"Gruschwitz","year":"2021","journal-title":"Neurosci. Inform."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"20546","DOI":"10.1038\/s41598-020-77441-z","article-title":"Detection and classification of intracranial haemorrhage on CT images using a novel deep-learning algorithm","volume":"10","author":"Lee","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"79545","DOI":"10.1109\/ACCESS.2019.2923002","article-title":"Prediction of the Location of the Glottis in Laryngeal Images by Using a Novel Deep-Learning Algorithm","volume":"7","author":"Kim","year":"2019","journal-title":"IEEE Access"},{"key":"ref_29","unstructured":"AIDoc Medical Ltd. (2021, January 25). Available online: https:\/\/www.aidoc.com\/."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2785","DOI":"10.1016\/j.nicl.2021.102785","article-title":"A deep learning algorithm for automatic detection and classification of acute intracranial hemorrhages in head CT scans","volume":"32","author":"Wang","year":"2021","journal-title":"NeuroImage Clin."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1861","DOI":"10.1177\/15910199211011861","article-title":"e-ASPECTS software improves interobserver agreement and accuracy of interpretation of aspects score","volume":"27","author":"Brinjikji","year":"2021","journal-title":"Intervent. Neuroradiol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1038\/s41746-017-0015-z","article-title":"Advanced machine learning in action: Identification of intracranial hemorrhage on computed tomography scans of the head with clinical workflow integration","volume":"1","author":"Arbabshirani","year":"2018","journal-title":"NPJ Digit. Med."},{"key":"ref_33","unstructured":"(2021, January 25). Brainscan.ai. Available online: https:\/\/brainscan.ai\/."},{"key":"ref_34","unstructured":"Brzeski, A. Personal communication."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Michalowski, M., and Moskovitch, R. (2020). Proceedings of the Artificial Intelligence in Medicine, Springer International Publishing.","DOI":"10.1007\/978-3-030-59137-3"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"110190","DOI":"10.1016\/j.chaos.2020.110190","article-title":"A deep learning and grad-CAM based color visualization approach for fast detection of COVID-19 cases using chest X-ray and CT-Scan images","volume":"140","author":"Panwar","year":"2020","journal-title":"Chaos Solit. Fractt."},{"key":"ref_37","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_38","unstructured":"Wightman, R. (2022, November 16). PyTorch Image Models. Available online: https:\/\/github.com\/rwightman\/pytorch-image-models."},{"key":"ref_39","unstructured":"Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., and Garnett, R. (2019). Advances in Neural Information Processing Systems 32, Curran Associates, Inc."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/9\/2\/37\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:27:05Z","timestamp":1760120825000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/9\/2\/37"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,7]]},"references-count":39,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["jimaging9020037"],"URL":"https:\/\/doi.org\/10.3390\/jimaging9020037","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,7]]}}}