{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T15:54:08Z","timestamp":1780502048523,"version":"3.54.1"},"reference-count":56,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T00:00:00Z","timestamp":1645747200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"publisher","award":["KK.01.2.1.02.0310"],"award-info":[{"award-number":["KK.01.2.1.02.0310"]}],"id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>In the field of face biometrics, finding the identity of a person in an image is most researched, but there are other, soft biometric information that are equally as important, such as age, gender, ethnicity or emotion. Nowadays, ethnicity classification has a wide application area and is a prolific area of research. This paper gives an overview of recent advances in ethnicity classification with focus on convolutional neural networks (CNNs) and proposes a new ethnicity classification method using only the middle part of the face and CNN. The paper also compares the differences in results of CNN with and without plotted landmarks. The proposed model was tested using holdout testing method on UTKFace dataset and FairFace dataset. The accuracy of the model was 80.34% for classification into five classes and 61.74% for classification into seven classes, which is slightly better than state-of-the-art, but it is also important to note that results in this paper are obtained by using only the middle part of the face which reduces the time and resources necessary.<\/jats:p>","DOI":"10.3390\/informatics9010018","type":"journal-article","created":{"date-parts":[[2022,2,25]],"date-time":"2022-02-25T10:00:40Z","timestamp":1645783240000},"page":"18","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Automatic Ethnicity Classification from Middle Part of the Face Using Convolutional Neural Networks"],"prefix":"10.3390","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6939-1116","authenticated-orcid":false,"given":"David","family":"Belcar","sequence":"first","affiliation":[{"name":"Evolva d.o.o., 42000 Vara\u017edin, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3530-5851","authenticated-orcid":false,"given":"Petra","family":"Grd","sequence":"additional","affiliation":[{"name":"Faculty of Organization and Informatics, University of Zagreb, 10000 Zagreb, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Igor","family":"Tomi\u010di\u0107","sequence":"additional","affiliation":[{"name":"Faculty of Organization and Informatics, University of Zagreb, 10000 Zagreb, Croatia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tomi\u010di\u0107, I., Grd, P., and Ba\u010da, M. (2018, January 21\u201325). A review of soft biometrics for IoT. Proceedings of the 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.","DOI":"10.23919\/MIPRO.2018.8400203"},{"key":"ref_2","first-page":"441","article-title":"What Else Does Your Biometric Data Reveal? A Survey on Soft Biometrics","volume":"11","author":"Mezzoudj","year":"2016","journal-title":"Multimed. Tools Appl."},{"key":"ref_3","first-page":"26729","article-title":"Towards large-scale face-based race classification on spark framework","volume":"78","author":"Reid","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_4","unstructured":"(2021, September 14). \u0160kolski Rje\u010dnik Hrvatskoga Jezika. Available online: https:\/\/rjecnik.hr\/search\/?strict=yes&q=rasa."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Darabant, A.S., Borza, D., and Danescu, R. (2021). Recognizing Human Races through Machine Learning\u2014A Multi-Network, Multi-Features Study. Mathematics, 9.","DOI":"10.3390\/math9020195"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Becerra-Riera, F., Llanes, N.M., Morales-Gonz\u00e1lez, A., M\u00e9ndez-V\u00e1zquez, H., and Tistarelli, M. (2019). On Combining Face Local Appearance and Geometrical Features for Race Classification. Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, Springer International Publishing.","DOI":"10.1007\/978-3-030-13469-3_66"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2483","DOI":"10.1109\/TPAMI.2014.2321570","article-title":"Learning Race from Face: A Survey","volume":"36","author":"Fu","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Heng, Z., Dipu, M., and Yap, K.H. (2018, January 27\u201330). Hybrid Supervised Deep Learning for Ethnicity Classification using Face Images. Proceedings of the 2018 IEEE International Symposium on Circuits and Systems (ISCAS), Florence, Italy.","DOI":"10.1109\/ISCAS.2018.8351370"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1117\/12.542847","article-title":"Ethnicity Identification from Face Images","volume":"Volume 5404","author":"Lu","year":"2004","journal-title":"Biometric Technology for Human Identification; International Society for Optics and Photonics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1084","DOI":"10.1111\/j.1467-9280.2007.02029.x","article-title":"The Other-Race Effect Develops During Infancy","volume":"18","author":"Kelly","year":"2007","journal-title":"Psychol. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s00138-020-01123-z","article-title":"Benchmarking deep network architectures for ethnicity recognition using a new large face dataset","volume":"31","author":"Greco","year":"2020","journal-title":"Mach. Vis. Appl."},{"key":"ref_12","first-page":"152","article-title":"Learned Features are Better for Ethnicity Classification","volume":"17","author":"Anwar","year":"2017","journal-title":"Cybern. Inf. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mohammad, A.S., and Al-Ani, J.A. (2018, January 19\u201321). Convolutional Neural Network for Ethnicity Classification using Ocular Region in Mobile Environment. Proceedings of the 2018 10th Computer Science and Electronic Engineering (CEEC), Colchester, UK.","DOI":"10.1109\/CEEC.2018.8674194"},{"key":"ref_14","unstructured":"Grd, P. (2021, January 13\u201315). A Survey on Neural Networks for Face Age Estimation. Proceedings of the 32nd Central European Conference on Information and Intelligent Systems, Varazdin, Croatia."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1016\/j.neucom.2017.08.062","article-title":"A hybrid deep learning CNN\u2013ELM for age and gender classification","volume":"275","author":"Duan","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, W., He, F., and Zhao, Q. (2016). Facial Ethnicity Classification with Deep Convolutional Neural Networks. Biometric Recognition, Springer International Publishing.","DOI":"10.1007\/978-3-319-46654-5_20"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Srinivas, N., Atwal, H., Rose, D.C., Mahalingam, G., Ricanek, K., and Bolme, D.S. (June, January 30). Age, Gender, and Fine-Grained Ethnicity Prediction Using Convolutional Neural Networks for the East Asian Face Dataset. Proceedings of the 2017 12th IEEE International Conference on Automatic Face Gesture Recognition (FG 2017), Washington, DC, USA.","DOI":"10.1109\/FG.2017.118"},{"key":"ref_18","first-page":"3483","article-title":"Race Classification Using Deep Learning","volume":"68","author":"Khan","year":"2021","journal-title":"Comput. Mater. Contin."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hamdi, S., and Moussaoui, A. (2020, January 15\u201316). Comparative study between machine and deep learning methods for age, gender and ethnicity identification. Proceedings of the 2020 4th International Symposium on Informatics and its Applications (ISIA), M\u2019sila, Algeria.","DOI":"10.1109\/ISIA51297.2020.9416549"},{"key":"ref_20","unstructured":"Ahmed, M.A., Choudhury, R.D., and Kashyap, K. (2020). Race estimation with deep networks. J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Baig, T.I., Alam, T.M., Anjum, T., Naseer, S., Wahab, A., Imtiaz, M., and Raza, M.M. (2019, January 26\u201329). Classification of Human Face: Asian and Non-Asian People. Proceedings of the 2019 International Conference on Innovative Computing (ICIC), Seoul, Korea.","DOI":"10.1109\/ICIC48496.2019.8966721"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Khan, A., and Mahmoud, M. (2019, January 7\u201311). Considering Race a Problem of Transfer Learning. Proceedings of the 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW), Village, HI, USA.","DOI":"10.1109\/WACVW.2019.00022"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Talo, M., Ay, B., Makinist, S., and Aydin, G. (2018, January 28\u201330). Bigailab-4race-50K: Race Classification with a New Benchmark Dataset. Proceedings of the 2018 International Conference on Artificial Intelligence and Data Processing (IDAP), Malatya, Turkey.","DOI":"10.1109\/IDAP.2018.8620759"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Das, A., Dantcheva, A., and Br\u00e9mond, F. (2018, January 8\u201314). Mitigating Bias in Gender, Age and Ethnicity Classification: A Multi-task Convolution Neural Network Approach. Proceedings of the ECCV Workshops, Munich, Germany.","DOI":"10.1007\/978-3-030-11009-3_35"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2597","DOI":"10.1109\/TPAMI.2017.2738004","article-title":"Heterogeneous Face Attribute Estimation: A Deep Multi-Task Learning Approach","volume":"40","author":"Han","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Masood, S., Gupta, S., Wajid, A., Gupta, S., and Ahmed, M. (2018). Prediction of Human Ethnicity from Facial Images Using Neural Networks. Data Engineering and Intelligent Computing, Springer.","DOI":"10.1007\/978-981-10-3223-3_20"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wu, X., Yuan, P., Wang, T., Gao, D., and Cai, Y. (2018, January 18\u201320). Race Classification from Face using Deep Convolutional Neural Networks. Proceedings of the 2018 3rd International Conference on Advanced Robotics and Mechatronics (ICARM), Sigapore.","DOI":"10.1109\/ICARM.2018.8610704"},{"key":"ref_28","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201326). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_29","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very Deep Convolutional Networks for Large-Scale Image Recognition. Proceedings of the 3rd International Conference on Learning Representations, ICLR, San Diego, CA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, X., Chen, S., Hu, X., and Yang, J. (2019, January 15\u201320). Understanding the Disharmony Between Dropout and Batch Normalization by Variance Shift. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00279"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"12777","DOI":"10.1007\/s11042-019-08453-9","article-title":"Dropout vs. Batch Normalization: An Empirical Study of Their Impact to Deep Learning","volume":"79","author":"Garbin","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_32","unstructured":"Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Fu, S.Y., Yang, G.S., and Hou, Z.G. (August, January 31). Spiking neural networks based cortex like mechanism: A case study for facial expression recognition. Proceedings of the 2011 International Joint Conference on Neural Networks, San Jose, CA, USA.","DOI":"10.1109\/IJCNN.2011.6033421"},{"key":"ref_34","unstructured":"Hwang, B.W., Roh, M.C., and Lee, S.W. (2004, January 17\u201319). Performance evaluation of face recognition algorithms on Asian face database. Proceedings of the Sixth IEEE International Conference on Automatic Face and Gesture Recognition, Seoul, Korea."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1109\/TSMCA.2007.909557","article-title":"The CAS-PEAL Large-Scale Chinese Face Database and Baseline Evaluations","volume":"38","author":"Gao","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybern.-Part Syst. Hum."},{"key":"ref_36","unstructured":"Bastanfard, A., Nik, M.A., and Dehshibi, M.M. (2007, January 28\u201329). Iranian Face Database with age, pose and expression. Proceedings of the 2007 International Conference on Machine Vision, Isalambad, Pakistan."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"902","DOI":"10.1016\/j.imavis.2009.11.005","article-title":"A new ranking method for principal components analysis and its application to face image analysis","volume":"28","author":"Thomaz","year":"2010","journal-title":"Image Vis. Comput."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1109\/34.817413","article-title":"Automatic classification of single facial images","volume":"21","author":"Lyons","year":"1999","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"K\u00e4rkk\u00e4inen, K., and Joo, J. (2021, January 3\u20138). FairFace: Face Attribute Dataset for Balanced Race, Gender, and Age for Bias Measurement and Mitigation. Proceedings of the 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.","DOI":"10.1109\/WACV48630.2021.00159"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Song, Y., and Qi, H. (2017, January 21\u201326). Age Progression\/Regression by Conditional Adversarial Autoencoder. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.463"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1109\/TPAMI.2003.1251154","article-title":"The CMU pose, illumination, and expression database","volume":"25","author":"Sim","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Riccio, D., Tortora, G., Marsico, M.D., and Wechsler, H. (2012, January 14). EGA\u2014Ethnicity, gender and age, a pre-annotated face database. Proceedings of the 2012 IEEE Workshop on Biometric Measurements and Systems for Security and Medical Applications (BIOMS), Salerno, Italy.","DOI":"10.1109\/BIOMS.2012.6345776"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1962","DOI":"10.1109\/TPAMI.2011.48","article-title":"Describable Visual Attributes for Face Verification and Image Search","volume":"33","author":"Kumar","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_44","unstructured":"Ricanek, K., and Tesafaye, T. (2006, January 10\u201312). MORPH: A longitudinal image database of normal adult age-progression. Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition (FGR06), Southampton, UK."},{"key":"ref_45","unstructured":"Phillips, P.J., Rauss, P.J., and Der, S.Z. (1996). FERET (Face Recognition Technology) Recognition Algorithm Development and Test Results, Army Research Laboratory."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Liu, Z., Luo, P., Wang, X., and Tang, X. (2015, January 7\u201313). Deep Learning Face Attributes in the Wild. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.425"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1122","DOI":"10.3758\/s13428-014-0532-5","article-title":"The Chicago face database: A free stimulus set of faces and norming data","volume":"47","author":"Ma","year":"2015","journal-title":"Behav. Res. Methods"},{"key":"ref_48","unstructured":"Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Jaesik, M., and Worek, W. (2005, January 20\u201325). Overview of the face recognition grand challenge. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.3389\/fpsyg.2014.01532","article-title":"The Child Affective Facial Expression (CAFE) set: Validity and reliability from untrained adults","volume":"5","author":"Lobue","year":"2015","journal-title":"Front. Psychol."},{"key":"ref_50","unstructured":"(2021, October 10). dlib C++ Library. Available online: http:\/\/dlib.net\/."},{"key":"ref_51","unstructured":"(2021, October 10). Opencv-Python: Wrapper Package for OpenCV Python Bindings. Available online: https:\/\/github.com\/skvark\/opencv-python."},{"key":"ref_52","unstructured":"(2021, October 10). Keras Documentation: Keras API Reference. Available online: https:\/\/keras.io\/api\/."},{"key":"ref_53","first-page":"2825","article-title":"Scikit-Learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_54","unstructured":"(2021, October 12). Categorical Crossentropy. Available online: https:\/\/peltarion.com\/knowledge-center\/documentation\/modeling-view\/build-an-ai-model\/loss-functions\/categorical-crossentropy."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Vo, T., Nguyen, T., and Le, C.T. (2018). Race Recognition Using Deep Convolutional Neural Networks. Symmetry, 10.","DOI":"10.3390\/sym10110564"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1146\/annurev.publhealth.24.100901.140927","article-title":"Classification of Race and Ethnicity: Implications for Public Health","volume":"24","author":"Mays","year":"2003","journal-title":"Annu. Rev. Public Health"}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/1\/18\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:27:15Z","timestamp":1760135235000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/9\/1\/18"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,25]]},"references-count":56,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["informatics9010018"],"URL":"https:\/\/doi.org\/10.3390\/informatics9010018","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,25]]}}}