{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T09:53:02Z","timestamp":1773654782430,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T00:00:00Z","timestamp":1773619200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Radiological departments face challenges in efficiency and diagnostic consistency. The interpretation of radiographs remains highly variable between practitioners, which creates potential disparities in patient care. This study explores how artificial intelligence (AI), specifically transfer learning techniques, can automate parts of the radiological workflow to improve service quality and efficiency. Transfer learning methods were applied to various convolutional neural network (CNN) architectures and compared to classify medical images across different modalities, i.e., X-rays, ultrasound, magnetic resonance imaging (MRI), and angiography, through a two-component model: medical image modality prediction and anatomical region prediction. Several publicly available datasets were combined to create a representative dataset to evaluate residual networks (ResNet), dense networks (DenseNet), efficient networks (EfficientNet), and the Swin Transformer (Swin-T). The models were evaluated through accuracy, precision, recall, and F1-score metrics with macro-averaging to account for class imbalance. The results demonstrate that lightweight transfer learning methods effectively classify medical imagery, with an accuracy of 97.21% on test data for the combined transfer learning pipeline. EfficientNet-B4 demonstrated the best performance on both components of the proposed pipeline and achieved a 99.6% accuracy for modality prediction and 99.21% accuracy for anatomical region prediction on unseen test data. This approach offers the potential for streamlined radiological workflows while maintaining diagnostic quality. The strong model performance across diverse modalities and anatomical regions indicates robust generalisability for practical implementation in clinical settings.<\/jats:p>","DOI":"10.3390\/a19030222","type":"journal-article","created":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T08:41:26Z","timestamp":1773650486000},"page":"222","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Automated Classification of Medical Image Modality and Anatomy"],"prefix":"10.3390","volume":"19","author":[{"given":"Jean","family":"de Smidt","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, Stellenbosch University, Stellenbosch 7600, Western Cape, South Africa"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5443-6801","authenticated-orcid":false,"given":"Kian","family":"Anderson","sequence":"additional","affiliation":[{"name":"Computer Science Division, Stellenbosch University, Stellenbosch 7600, Western Cape, South Africa"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0242-3539","authenticated-orcid":false,"given":"Andries","family":"Engelbrecht","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, Stellenbosch University, Stellenbosch 7600, Western Cape, South Africa"},{"name":"Computer Science Division, Stellenbosch University, Stellenbosch 7600, Western Cape, South Africa"},{"name":"GUST Engineering and Applied Innovation Research Centre, Gulf University of Science and Technology, Kuwait City 32093, Kuwait"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,16]]},"reference":[{"key":"ref_1","first-page":"41","article-title":"Workflow management-integration technology for efficient radiology","volume":"45","author":"Wendler","year":"2001","journal-title":"Medicamundi"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1109\/RBME.2012.2232289","article-title":"Computer-aided breast cancer detection using mammograms: A review","volume":"6","author":"Ganesan","year":"2012","journal-title":"IEEE Rev. Biomed. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A Survey on Transfer Learning","volume":"22","author":"Pan","year":"2010","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Yu, Y., Lin, H., Meng, J., Wei, X., Guo, H., and Zhao, Z. (2017). Deep transfer learning for modality classification of medical images. Information, 8.","DOI":"10.3390\/info8030091"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Chiang, C.H., Weng, C.L., and Chiu, H.W. (2021). Automatic classification of medical image modality and anatomical location using convolutional neural network. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0253205"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"5164970","DOI":"10.1155\/2022\/5164970","article-title":"Modern diagnostic imaging technique applications and risk factors in the medical field: A review","volume":"2022","author":"Hussain","year":"2022","journal-title":"BioMed Res. Int."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1080\/17453674.2020.1837420","article-title":"Ankle fracture classification using deep learning: Automating detailed AO Foundation\/Orthopedic Trauma Association (AO\/OTA) 2018 malleolar fracture identification reaches a high degree of correct classification","volume":"92","author":"Olczak","year":"2020","journal-title":"Acta Orthop."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"101869","DOI":"10.1016\/j.inffus.2023.101869","article-title":"A review of deep learning techniques for speech processing","volume":"99","author":"Mehrish","year":"2023","journal-title":"Inf. Fusion"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, Y. (2022). Research and application of deep learning in image recognition. Proceedings of the 2022 IEEE 2nd International Conference on Power, Electronics and Computer Applications, IEEE.","DOI":"10.1109\/ICPECA53709.2022.9718847"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1016\/j.neucom.2021.05.103","article-title":"An introduction to deep learning in natural language processing: Models, techniques, and tools","volume":"470","author":"Lauriola","year":"2022","journal-title":"Neurocomputing"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3713","DOI":"10.1007\/s11042-022-13428-4","article-title":"Natural language processing: State of the art, current trends and challenges","volume":"82","author":"Khurana","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"27497","DOI":"10.1038\/s41598-024-78015-z","article-title":"Predictive analytics of complex healthcare systems using deep learning based disease diagnosis model","volume":"14","author":"Saeed","year":"2024","journal-title":"Sci. Rep."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s13244-018-0639-9","article-title":"Convolutional neural networks: An overview and application in radiology","volume":"9","author":"Yamashita","year":"2018","journal-title":"Insights Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1142\/S0218488598000094","article-title":"The vanishing gradient problem during learning recurrent neural nets and problem solutions","volume":"6","author":"Hochreiter","year":"1998","journal-title":"Int. J. Uncertainty Fuzziness Knowl.-Based Syst."},{"key":"ref_19","unstructured":"Tan, M., and Le, Q. (2019, January 9\u201315). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning PMLR, Long Beach, CA USA."},{"key":"ref_20","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021, January 3\u20137). An image is worth 16x16 words: Transformers for image recognition at scale. Proceedings of the International Conference on Learning Representations, Virtual Event."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_22","unstructured":"Yosinski, J., Clune, J., Bengio, Y., and Lipson, H. (2014). How transferable are features in deep neural networks?. Advances in Neural Information Processing Systems 27, NIPS Foundation."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s40537-016-0043-6","article-title":"A survey of transfer learning","volume":"3","author":"Weiss","year":"2016","journal-title":"J. Big Data"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/JPROC.2020.3004555","article-title":"A comprehensive survey on transfer learning","volume":"109","author":"Zhuang","year":"2020","journal-title":"Proc. IEEE"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M., and Summers, R.M. (2017, January 21\u201326). Chestx-ray8: Hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.369"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"170177","DOI":"10.1038\/sdata.2017.177","article-title":"A curated mammography data set for use in computer-aided detection and diagnosis research","volume":"4","author":"Lee","year":"2017","journal-title":"Sci. Data"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"106716","DOI":"10.1016\/j.cmpb.2022.106716","article-title":"Crossover based technique for data augmentation","volume":"218","author":"Raj","year":"2022","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2159","DOI":"10.1007\/s12530-024-09608-2","article-title":"An explainable approach to deep learning from CT-scans for COVID identification","volume":"15","author":"Soares","year":"2024","journal-title":"Evol. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Khoruzhaya, A.N., Bobrovskaya, T.M., Kozlov, D.V., Kuligovskiy, D., Novik, V.P., Arzamasov, K.M., and Kremneva, E.I. (2024). Expanded Brain CT Dataset for the Development of AI Systems for Intracranial Hemorrhage Detection and Classification. Data, 9.","DOI":"10.3390\/data9020030"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"11440","DOI":"10.1038\/s41598-022-15634-4","article-title":"Vision transformer and explainable transfer learning models for auto detection of kidney cyst, stone and tumor from CT-radiography","volume":"12","author":"Islam","year":"2022","journal-title":"Sci. Rep."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"10200","DOI":"10.1038\/s41598-020-67076-5","article-title":"Evaluation of deep convolutional neural networks for automatic classification of common maternal fetal ultrasound planes","volume":"10","author":"Eixarch","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_33","unstructured":"Montoya, A., kaggle446, Cukierski, W., and yffud (2025, February 15). Ultrasound Nerve Segmentation. Kaggle. Available online: https:\/\/kaggle.com\/competitions\/ultrasound-nerve-segmentation."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Born, J., Wiedemann, N., Cossio, M., Buhre, C., Br\u00e4ndle, G., Leidermann, K., Goulet, J., Aujayeb, A., Moor, M., and Rieck, B. (2021). Accelerating detection of lung pathologies with explainable ultrasound image analysis. Appl. Sci., 11.","DOI":"10.3390\/app11020672"},{"key":"ref_35","unstructured":"Danilov, V., Klyshnikov, K., Kutikhin, A., Gerget, O., Frangi, A., and Ovcharenko, E. (2021). Angiographic dataset for stenosis detection. Mendeley Data, 2."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"e190007","DOI":"10.1148\/ryai.2020190007","article-title":"fastMRI: A publicly available raw k-space and DICOM dataset of knee images for accelerated MR image reconstruction using machine learning","volume":"2","author":"Knoll","year":"2020","journal-title":"Radiol. Artif. Intell."},{"key":"ref_37","unstructured":"Zbontar, J., Knoll, F., Sriram, A., Murrell, T., Huang, Z., Muckley, M., Defazio, A., Stern, R., Johnson, P., and Bruno, M. (2018). fastMRI: An open dataset and benchmarks for accelerated MRI. arXiv."},{"key":"ref_38","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-CAM: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/19\/3\/222\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T08:51:38Z","timestamp":1773651098000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/19\/3\/222"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,16]]},"references-count":39,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["a19030222"],"URL":"https:\/\/doi.org\/10.3390\/a19030222","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,16]]}}}