{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,5]],"date-time":"2026-08-05T18:34:52Z","timestamp":1785954892731,"version":"3.56.0"},"reference-count":49,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,10,5]],"date-time":"2021-10-05T00:00:00Z","timestamp":1633392000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2025234"],"award-info":[{"award-number":["2025234"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Face recognition with wearable items has been a challenging task in computer vision and involves the problem of identifying humans wearing a face mask. Masked face analysis via multi-task learning could effectively improve performance in many fields of face analysis. In this paper, we propose a unified framework for predicting the age, gender, and emotions of people wearing face masks. We first construct FGNET-MASK, a masked face dataset for the problem. Then, we propose a multi-task deep learning model to tackle the problem. In particular, the multi-task deep learning model takes the data as inputs and shares their weight to yield predictions of age, expression, and gender for the masked face. Through extensive experiments, the proposed framework has been found to provide a better performance than other existing methods.<\/jats:p>","DOI":"10.3390\/jimaging7100204","type":"journal-article","created":{"date-parts":[[2021,10,7]],"date-time":"2021-10-07T16:23:58Z","timestamp":1633623838000},"page":"204","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Masked Face Analysis via Multi-Task Deep Learning"],"prefix":"10.3390","volume":"7","author":[{"given":"Vatsa S.","family":"Patel","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Dayton, Dayton, OH 45469, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhongliang","family":"Nie","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Dayton, Dayton, OH 45469, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7363-2610","authenticated-orcid":false,"given":"Trung-Nghia","family":"Le","sequence":"additional","affiliation":[{"name":"National Institute of Informatics, Tokyo 101-8430, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0236-7992","authenticated-orcid":false,"given":"Tam V.","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Dayton, Dayton, OH 45469, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Guo, G., Guowang, M., Fu, Y., and Huang, T.S. (2009, January 20\u201325). Human age estimation using bio-inspired features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206681"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Cao, D., He, R., Zhang, M., Sun, Z., and Tan, T. (2015, January 23\u201325). Real-world gender recognition using multi-order LBP and localized multi-boost learning. Proceedings of the IEEE International Conference on Identity, Security and Behavior Analysis (ISBA 2015), Hong Kong, China.","DOI":"10.1109\/ISBA.2015.7126350"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wang, K., Nguyen, T.V., Feng, J., and Sepulveda, J. (2015, January 26\u201330). Sense Beyond Expressions: Cuteness. Proceedings of the 23rd ACM international conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2806283"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Nguyen, T.V., and Liu, L. (2017, January 23\u201327). Smart Mirror: Intelligent Makeup Recommendation and Synthesis. Proceedings of the 25th ACM international conference on Multimedia, Mountain View, CA USA.","DOI":"10.1145\/3123266.3127926"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Adjabi, I., Ouahabi, A., Benzaoui, A., and Taleb-Ahmed, A. (2020). Past, Present, and Future of Face Recognition: A Review. Electronics, 9.","DOI":"10.20944\/preprints202007.0479.v1"},{"key":"ref_6","unstructured":"Wang, Z., Wang, G., Huang, B., Xiong, Z., Hong, Q., Wu, H., Yi, P., Jiang, K., Wang, N., and Pei, Y. (2020). Masked face recognition dataset and application. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Chaudhuri, B., Vesdapunt, N., and Wang, B. (2019, January 15\u201320). Joint face detection and facial motion retargeting for multiple faces. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00995"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kortli, Y., Jridi, M., Falou, A.A., and Atri, M. (2020). Face Recognition Systems: A Survey. Sensors, 20.","DOI":"10.3390\/s20020342"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ge, S., Li, J., Ye, Q., and Luo, Z. (2017, January 21\u201326). Detecting masked faces in the wild with lle-cnns. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.53"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Cao, J., Li, Y., and Zhang, Z. (2018, January 18\u201323). Partially shared multi-task convolutional neural network with local constraint for face attribute learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake, UT, USA.","DOI":"10.1109\/CVPR.2018.00451"},{"key":"ref_11","unstructured":"Dmitry, Y., Tamir, B., and Roman, V. (2020). MaskFace: Multi-task face and landmark detector. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Vandenhende, S., Georgoulis, S., Gansbeke, V., Proesmans, W., Dai, M.D., and Van, G.L. (2021). Multi-task learning for dense prediction tasks: A survey. IEEE Trans. Pattern Anal. Mach. Intell., 1\u201320. Early Access.","DOI":"10.1109\/TPAMI.2021.3054719"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Najibi, M., Samangouei, P., Chellappa, R., and Davis, L.S. (2017, January 22\u201329). Ssh: Single stage headless face detector. Proceedings of the IEEE international conference on computer vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.522"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Mundial, I.Q., Ul Hassan, M.S., Tiwana, M.I., Qureshi, W.S., and Alanazi, E. (2020, January 3\u20134). Towards Facial Recognition Problem in COVID-19 Pandemic. Proceedings of the 4rd International Conference on Electrical, Telecommunication and Computer Engineering (ELTICOM), Medan, Indonesia.","DOI":"10.1109\/ELTICOM50775.2020.9230504"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Yang, H., Huang, D., Wang, Y., and Jain, A.K. (2018, January 18\u201323). Learning face age progression: A pyramid architecture of gans. Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake, UT, USA.","DOI":"10.1109\/CVPR.2018.00011"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Nithyashri, J., and Kulanthaivel, G. (2012, January 13\u201315). Classification of human age based on Neural Network using FG-NET Aging database and Wavelets. Proceedings of the Fourth International Conference on Advanced Computing (ICoAC), Chennai, India.","DOI":"10.1109\/ICoAC.2012.6416855"},{"key":"ref_17","unstructured":"Santarcangelo, V., Farinella, G.M., and Battiato, S. (July, January 29). Gender recognition: Methods, datasets and results. Proceedings of the IEEE International Conference on Multimedia & Expo Workshops (ICMEW), Turin, Italy."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Levi, G., and Hassncer, T. (2015, January 7\u201312). Age and gender classification using convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Boston, MA, USA.","DOI":"10.1109\/CVPRW.2015.7301352"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Tivatansakul, S., Ohkura, M., Puangpontip, S., and Achalakul, T. (2014, January 25\u201326). Emotional healthcare system: Emotion detection by facial expressions using Japanese database. Proceedings of the 6th Computer Science and Electronic Engineering Conference (CEEC), Colchester, UK.","DOI":"10.1109\/CEEC.2014.6958552"},{"key":"ref_20","unstructured":"Arriaga, O., Valdenegro-Toro, M., and Ploger, P. (2017). Real-time convolutional neural networks for emotion and gender classification. arXiv."},{"key":"ref_21","first-page":"1","article-title":"Deep representation for partially occluded face verification","volume":"1","author":"Yang","year":"2018","journal-title":"EURASIP J. Image Video Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/TPAMI.2019.2929257","article-title":"OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields","volume":"43","author":"Cao","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Napol\u00e9on, T., and Alfalou, A. (2014). Local binary patterns preprocessing for face identification\/verification using the VanderLugt correlator. Optical Pattern Recognition XXV, International Society for Optics and Photonics, SPIE.","DOI":"10.1117\/12.2051267"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Oravec, M. (2011). Understanding Correlation Techniques for Face Recognition: From Basics to Applications. Face Recognition, IntechOpen.","DOI":"10.5772\/207"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Chen, K., Gong, S., Xiang, T., and Chang Loy, C. (2013, January 23\u201328). Cumulative attribute space for age and crowd density estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.319"},{"key":"ref_27","unstructured":"Huang, G.B., Mattar, M., Berg, T., and Learned-Miller, E. (2007). Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments, Technical Report for University of Massachusetts."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1109\/TMM.2008.921847","article-title":"Human Age Estimation With Regression on Discriminative Aging Manifold","volume":"10","author":"Fu","year":"2008","journal-title":"IEEE Trans. Multimedia"},{"key":"ref_29","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR\u201905), San Diego, CA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/s10586-017-1585-x","article-title":"A hybrid technique for gender classification with SLBP and HOG features","volume":"22","author":"Annalakshmi","year":"2019","journal-title":"Clust. Comput."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1177\/1748301816649073","article-title":"Cascade classifier for face detection","volume":"10","author":"Yang","year":"2016","journal-title":"J. Algorithms Comput. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1016\/j.optlaseng.2016.06.019","article-title":"Pose invariant face recognition: 3D model from single photo","volume":"89","author":"Alfalou","year":"2017","journal-title":"Opt. Lasers Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"HajiRassouliha, A., Gamage, T.P.B., Parker, M.D., Nash, M.P., Taberner, A.J., and Nielsen, P.M. (2013, January 27\u201329). FPGA implementation of 2D cross-correlation for real-time 3D tracking of deformable surfaces. Proceedings of the IVCNZ, Wellington, New Zealand.","DOI":"10.1109\/IVCNZ.2013.6727067"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1109\/TIFS.2011.2159205","article-title":"Face verification using the lark representation","volume":"6","author":"Seo","year":"2011","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_35","first-page":"536","article-title":"A Survey: Linear and Nonlinear PCA Based Face Recognition Techniques","volume":"10","author":"Shah","year":"2013","journal-title":"Int. Arab J. Inf. Technol."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, S.Q., Lan, X., and Yuen, P.C. (2018, January 8\u201314). Remote photoplethysmography correspondence feature for 3D mask face presentation attack detection. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01270-0_34"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11042-020-09479-0","article-title":"Analysis of RGB-D camera technologies for supporting different facial usage scenarios","volume":"79","author":"Ulrich","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Bock, R.D. (2018). Low-cost 3D security camera. Autonomous Systems: Sensors, Vehicles, Security, and the Internet of Everything, International Society for Optics and Photonics.","DOI":"10.1117\/12.2305455"},{"key":"ref_39","first-page":"012156","article-title":"Design of Face Recognition Access Entrance Guard System with Mask Based on Embedded Development","volume":"1883","author":"Ruiqin","year":"2021","journal-title":"Journal of Physics: Conference Serie"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1617","DOI":"10.1007\/s12008-019-00582-7","article-title":"3D geometry-based face recognition in presence of eye and mouth occlusions","volume":"13","author":"Dagnes","year":"2019","journal-title":"Int. J. Interact. Des. Manuf. (IJIDeM)"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Shi, Y., Yu, X., Sohn, K.M., and Jain, A.K. (2020, January 16\u201318). Towards universal representation learning for deep face recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00685"},{"key":"ref_42","unstructured":"Chen, Z., Xu, T., and Han, Z. (2011, January 21\u201323). Occluded face recognition based on the improved SVM and block weighted LBP. Proceedings of the International Conference on Image Analysis and Signal Processing, Wuhan, China."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Nie, Z., Mattey, A., Huang, Z., and Nguyen, T.V. (2018, January 7\u201310). Revisit of Region-Feature Combinations in Facial Analysis. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.","DOI":"10.1109\/SMC.2018.00403"},{"key":"ref_44","unstructured":"(2021, May 18). COVID-19 Face Mask Detector with Open CV, Keras, Tensorflow, and Deep Learning. Available online: https:\/\/www.pyimagesearch.com\/2020\/05\/04\/covid-19-face-mask-detector-with-opencv-keras-tensorflow-and-deep-learning\/."},{"key":"ref_45","unstructured":"(2021, May 18). Pillow Package. Available online: https:\/\/pillow.readthedocs.io\/en\/stable\/."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1958","DOI":"10.1109\/TPAMI.2008.128","article-title":"80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition","volume":"30","author":"Torralba","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Parkhi, O.M., Vedaldi, A., and Zisserman, A. (2015, January 7\u201310). Deep face recognition. Proceedings of the British Machine Vision Conference (BMVC), Swansea, UK.","DOI":"10.5244\/C.29.41"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Adjabi, I., Ouahabi, A., Benzaoui, A., and Jaques, S. (2021). Multi-Block Color-Binarized Statistical Images for Single-Sample Face Recognition. Sensors, 21.","DOI":"10.3390\/s21030728"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/10\/204\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:09:40Z","timestamp":1760166580000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/10\/204"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,5]]},"references-count":49,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["jimaging7100204"],"URL":"https:\/\/doi.org\/10.3390\/jimaging7100204","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,5]]}}}