{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T02:49:16Z","timestamp":1783133356813,"version":"3.54.6"},"reference-count":50,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,3,7]],"date-time":"2022-03-07T00:00:00Z","timestamp":1646611200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Malaria is a globally widespread disease caused by parasitic protozoa transmitted to humans by infected female mosquitoes of Anopheles. It is caused in humans only by the parasite Plasmodium, further classified into four different species. Identifying malaria parasites is possible by analysing digital microscopic blood smears, which is tedious, time-consuming and error prone. So, automation of the process has assumed great importance as it helps the laborious manual process of review and diagnosis. This work focuses on deep learning-based models, by comparing off-the-shelf architectures for classifying healthy and parasite-affected cells, by investigating the four-class classification on the Plasmodium falciparum stages of life and, finally, by evaluating the robustness of the models with cross-dataset experiments on two different datasets. The main contributions to the research in this field can be resumed as follows: (i) comparing off-the-shelf architectures in the task of classifying healthy and parasite-affected cells, (ii) investigating the four-class classification on the P. falciparum stages of life and (iii) evaluating the robustness of the models with cross-dataset experiments. Eleven well-known convolutional neural networks on two public datasets have been exploited. The results show that the networks have great accuracy in binary classification, even though they lack few samples per class. Moreover, the cross-dataset experiments exhibit the need for some further regulations. In particular, ResNet-18 achieved up to 97.68% accuracy in the binary classification, while DenseNet-201 reached 99.40% accuracy on the multiclass classification. The cross-dataset experiments exhibit the limitations of deep learning approaches in such a scenario, even though combining the two datasets permitted DenseNet-201 to reach 97.45% accuracy. Naturally, this needs further investigation to improve the robustness. In general, DenseNet-201 seems to offer the most stable and robust performance, offering as a crucial candidate to further developments and modifications. Moreover, the mobile-oriented architectures showed promising and satisfactory performance in the classification of malaria parasites. The obtained results enable extensive improvements, specifically oriented to the application of object detectors for type and stage of life recognition, even in mobile environments.<\/jats:p>","DOI":"10.3390\/jimaging8030066","type":"journal-article","created":{"date-parts":[[2022,3,7]],"date-time":"2022-03-07T10:21:16Z","timestamp":1646648476000},"page":"66","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["An Empirical Evaluation of Convolutional Networks for Malaria Diagnosis"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6571-3816","authenticated-orcid":false,"given":"Andrea","family":"Loddo","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, University of Cagliari, Via Ospedale 72, 09124 Cagliari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7816-5943","authenticated-orcid":false,"given":"Corrado","family":"Fadda","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, University of Cagliari, Via Ospedale 72, 09124 Cagliari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4641-0307","authenticated-orcid":false,"given":"Cecilia","family":"Di Ruberto","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Computer Science, University of Cagliari, Via Ospedale 72, 09124 Cagliari, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,7]]},"reference":[{"key":"ref_1","unstructured":"(2021, September 13). WHO. Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/malaria."},{"key":"ref_2","unstructured":"(2021, September 13). Stanford Healthcare. Available online: https:\/\/stanfordhealthcare.org\/medical-conditions\/primary-care\/malaria\/types.html."},{"key":"ref_3","unstructured":"(2021, September 10). ScienceDirect. Available online: https:\/\/www.sciencedirect.com\/topics\/neuroscience\/malaria."},{"key":"ref_4","unstructured":"(2021, September 10). WHO. Available online: https:\/\/www.who.int\/health-topics\/malaria#tab=tab_1."},{"key":"ref_5","unstructured":"(2021, September 10). Centers for Disease Control Prevention, Available online: https:\/\/www.cdc.gov\/malaria\/about\/biology\/index.html."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1016\/j.engappai.2018.04.024","article-title":"Leukemia diagnosis in blood slides using transfer learning in CNNs and SVM for classification","volume":"72","author":"Vogado","year":"2018","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"106810","DOI":"10.1016\/j.asoc.2020.106810","article-title":"Classification of white blood cells using deep features obtained from Convolutional Neural Network models based on the combination of feature selection methods","volume":"97","author":"Ergen","year":"2020","journal-title":"Appl. Soft Comp. J."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Mondal, C., Hasan, M.K., Jawad, M.T., Dutta, A., Islam, M.R., Awal, M.A., and Ahmad, M. (2021). Acute Lymphoblastic Leukemia Detection from Microscopic Images Using Weighted Ensemble of Convolutional Neural Networks. arXiv.","DOI":"10.20944\/preprints202105.0429.v1"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1109\/JBHI.2019.2905623","article-title":"Blood Cell Classification Based on Hyperspectral Imaging with Modulated Gabor and CNN","volume":"24","author":"Huang","year":"2020","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Di Ruberto, C., Loddo, A., and Puglisi, G. (2020). Blob Detection and Deep Learning for Leukemic Blood Image Analysis. Appl. Sci., 10.","DOI":"10.3390\/app10031176"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Di Ruberto, C., Loddo, A., and Putzu, L. (2015, January 7\u201311). Learning by Sampling for White Blood Cells Segmentation. Proceedings of the 18th International Conference Image Analysis and Processing (ICIAP 2015), Genoa, Italy.","DOI":"10.1007\/978-3-319-23231-7_50"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1151","DOI":"10.1007\/s00138-016-0812-4","article-title":"A leucocytes count system from blood smear images Segmentation and counting of white blood cells based on learning by sampling","volume":"27","author":"Loddo","year":"2016","journal-title":"Mach. Vis. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103530","DOI":"10.1016\/j.compbiomed.2019.103530","article-title":"Detection of red and white blood cells from microscopic blood images using a region proposal approach","volume":"116","author":"Loddo","year":"2020","journal-title":"Comput. Biol. Med."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1080\/21681163.2016.1149104","article-title":"Microscopy cell counting and detection with fully convolutional regression networks","volume":"6","author":"Xie","year":"2018","journal-title":"Comput. Methods Biomech. Biomed. Eng. Imaging Vis."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Loddo, A., Di Ruberto, C., and Kocher, M. (2018). Recent Advances of Malaria Parasites Detection Systems Based on Mathematical Morphology. Sensors, 18.","DOI":"10.3390\/s18020513"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.patrec.2020.07.002","article-title":"Quantification of malaria parasitaemia using trainable semantic segmentation and capsnet","volume":"138","author":"Maity","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"15297","DOI":"10.1007\/s11042-019-7162-y","article-title":"Deep learning approach to detect malaria from microscopic images","volume":"79","author":"Vijayalakshmi","year":"2020","journal-title":"Multim. Tools Appl."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Chan, Y.K., Tsai, M.H., Huang, D.C., Zheng, Z.H., and Hung, K.D. (2010). Leukocyte nucleus segmentation and nucleus lobe counting. BMC Bioinform., 11.","DOI":"10.1186\/1471-2105-11-558"},{"key":"ref_19","unstructured":"De Carneri, L. (1972). Parassitologia Generale e Umana, Casa Editrice Ambrosiana CEA."},{"key":"ref_20","unstructured":"Faust, E.C., Beaver, P.C., and Jung, R.C. (1975). Animal Agents and Vectors of Human Disease, Henry Kimpton Publishers Ltd."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"9801","DOI":"10.1007\/s11042-017-4495-2","article-title":"A review on automated diagnosis of malaria parasite in microscopic blood smears images","volume":"77","author":"Jan","year":"2018","journal-title":"Multim. Tools Appl."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1016\/j.trsl.2017.12.004","article-title":"Image analysis and machine learning for detecting malaria","volume":"194","author":"Poostchi","year":"2018","journal-title":"Transl. Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1016\/j.compeleceng.2015.04.009","article-title":"Segmentation of erythrocytes infected with malaria parasites for the diagnosis using microscopy imaging","volume":"45","author":"Somasekar","year":"2015","journal-title":"Comput. Electr. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.procs.2018.10.187","article-title":"Mobile Hardware Based Implementation of a Novel, Efficient, Fuzzy Logic Inspired Edge Detection Technique for Analysis of Malaria Infected Microscopic Thin Blood Images","volume":"141","author":"Bias","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_25","unstructured":"Rode, K.B., and Bharkad, S.D. (2018). Automatic segmentation of malaria affected erythrocyte in thin blood films. International Conference on ISMAC in Computational Vision and Bio-Engineering, Springer."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Liang, Z., Powell, A., Ersoy, I., Poostchi, M., Silamut, K., Palaniappan, K., Guo, P., Hossain, M.A., Antani, S.K., and Maude, R.J. (2016, January 15\u201318). CNN-based image analysis for malaria diagnosis. Proceedings of the International Conference on Bioinformatics and Biomedicine (BIBM 2016), Shenzhen, China.","DOI":"10.1109\/BIBM.2016.7822567"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"e4568","DOI":"10.7717\/peerj.4568","article-title":"Pre-trained convolutional neural networks as feature extractors toward improved malaria parasite detection in thin blood smear images","volume":"6","author":"Rajaraman","year":"2018","journal-title":"PeerJ"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"e6977","DOI":"10.7717\/peerj.6977","article-title":"Perf. eval. of deep neural ensembles toward malaria parasite detection in thin-blood smear images","volume":"7","author":"Rajaraman","year":"2019","journal-title":"PeerJ"},{"key":"ref_29","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet Classification with Deep Convolutional Neural Networks. Proceedings of the 25th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"101473","DOI":"10.1016\/j.tice.2020.101473","article-title":"A comparative analysis of deep learning architectures on high variation malaria parasite classification dataset","volume":"69","author":"Rahman","year":"2021","journal-title":"Tissue Cell"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.patcog.2017.05.025","article-title":"Handcrafted vs. non-handcrafted features for computer vision classification","volume":"71","author":"Nanni","year":"2017","journal-title":"Pattern Recognit."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Loddo, A., and Di Ruberto, C. (2021). On the Efficacy of Handcrafted and Deep Features for Seed Image Classification. J. Imaging, 7.","DOI":"10.3390\/jimaging7090171"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"78663","DOI":"10.1109\/ACCESS.2020.2990497","article-title":"Counting and Classification of Malarial Parasite From Giemsa-Stained Thin Film Images","volume":"8","author":"Kudisthalert","year":"2020","journal-title":"IEEE Access"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Abdurahman, F., Fante, K.A., and Aliy, M. (2021). Malaria parasite detection in thick blood smear microscopic images using modified YOLOV3 and YOLOV4 models. BMC Bioinform., 22.","DOI":"10.1186\/s12859-021-04036-4"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Loddo, A., Di Ruberto, C., Kocher, M., and Prod\u2019Hom, G. (2019). MP-IDB: The Malaria Parasite Image Database for Image Processing and Analysis. Processing and Analysis of Biomedical Information, Springer.","DOI":"10.1007\/978-3-030-13835-6_7"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TMI.2016.2528162","article-title":"Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning","volume":"35","author":"Shin","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_38","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations (ICLR 2015), San Diego, CA, USA."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27\u201330). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.308"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., and Weinberger, K.Q. (2016, January 27\u201330). Densely Connected Convolutional Networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18\u201322). ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_44","unstructured":"Iandola, F.N., Moskewicz, M.W., Ashraf, K., Han, S., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50\u00d7 fewer parameters and <1 MB model size. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Sandler, M., Howard, A.G., Zhu, M., Zhmoginov, A., and Chen, L. (2018, January 18\u201322). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00474"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wong, S.C., Gatt, A., Stamatescu, V., and McDonnell, M.D. (December, January 30). Understanding Data Augmentation for Classification: When to Warp?. Proceedings of the 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA 2016), Gold Coast, Australia.","DOI":"10.1109\/DICTA.2016.7797091"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Shijie, J., Ping, W., Peiyi, J., and Siping, H. (2017, January 20\u201322). Research on data augmentation for image classification based on convolution neural networks. Proceedings of the 2017 Chinese Automation Congress (CAC), Jinan, China.","DOI":"10.1109\/CAC.2017.8243510"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Miko\u0142ajczyk, A., and Grochowski, M. (2018, January 9\u201312). Data augmentation for improving deep learning in image classification problem. Proceedings of the 2018 International Interdisciplinary PhD Workshop (IIPhDW), Swinoujscie, Poland.","DOI":"10.1109\/IIPHDW.2018.8388338"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"3055","DOI":"10.3233\/BME-141127","article-title":"Texture based feature extraction methods for content based medical image retrieval systems","volume":"24","author":"Ergen","year":"2014","journal-title":"Bio-Med. Mater. Eng."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Ba\u015faran, E., \u015eeng\u00fcr, A., C\u00f6mert, Z., Budak, \u00dc., \u00c7el\u0131k, Y., and Velappan, S. (2019, January 21\u201322). Normal and Acute Tympanic Membrane Diagnosis based on Gray Level Co-Occurrence Matrix and Artificial Neural Networks. Proceedings of the 2019 International Artificial Intelligence and Data Processing Symposium (IDAP), Malatya, Turkey.","DOI":"10.1109\/IDAP.2019.8875973"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/3\/66\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:33:09Z","timestamp":1760135589000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/3\/66"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,7]]},"references-count":50,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["jimaging8030066"],"URL":"https:\/\/doi.org\/10.3390\/jimaging8030066","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,7]]}}}