{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:23:32Z","timestamp":1760232212378,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2022,10,17]],"date-time":"2022-10-17T00:00:00Z","timestamp":1665964800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Research on face recognition with masked faces has been increasingly important due to the prolonged COVID-19 pandemic. To make face recognition practical and robust, a large amount of face image data should be acquired for training purposes. However, it is difficult to obtain masked face images for each human subject. To cope with this difficulty, this paper proposes a simple yet practical method to synthesize a realistic masked face for an unseen face image. For this, a cascade of two convolutional auto-encoders (CAEs) has been designed. The former CAE generates a pose-alike face wearing a mask pattern, which is expected to fit the input face in terms of pose view. The output of the former CAE is readily fed into the secondary CAE for extracting a segmentation map that localizes the mask region on the face. Using the segmentation map, the mask pattern can be successfully fused with the input face by means of simple image processing techniques. The proposed method relies on face appearance reconstruction without any facial landmark detection or localization techniques. Extensive experiments with the GTAV Face database and Labeled Faces in the Wild (LFW) database show that the two complementary generators could rapidly and accurately produce synthetic faces even for challenging input faces (e.g., low-resolution face of 25 \u00d7 25 pixels with out-of-plane rotations).<\/jats:p>","DOI":"10.3390\/s22207903","type":"journal-article","created":{"date-parts":[[2022,10,18]],"date-time":"2022-10-18T00:31:01Z","timestamp":1666053061000},"page":"7903","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Two-Stage Deep Generative Model for Masked Face Synthesis"],"prefix":"10.3390","volume":"22","author":[{"given":"Seungho","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Future Technology, Korea University of Technology and Education, Cheonan-si 31253, Chungcheongnam-do, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Alzu\u2019bi, A., Albalas, F., L-Hadhrami, T.A., Younis, L.B., and Bashayreh, A. (2021). Masked face recognition using deep learning: A review. Electronics, 10.","DOI":"10.3390\/electronics10212666"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5497","DOI":"10.1007\/s10489-021-02728-1","article-title":"Masked face recognition with convolutional neural networks and local binary patterns","volume":"52","author":"Vu","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3012","DOI":"10.1007\/s10489-020-02100-9","article-title":"Cropping and attention based approach for masked face recognition","volume":"51","author":"Li","year":"2021","journal-title":"Appl. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hariri, W. (2022, October 08). Efficient Masked Face Recognition Method during the COVID-19 Pandemic. Available online: https:\/\/www.researchsquare.com\/article\/rs-39289\/v3.","DOI":"10.21203\/rs.3.rs-39289\/v4"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"44276","DOI":"10.1109\/ACCESS.2020.2977386","article-title":"A novel GAN-based network for unmasking of masked face","volume":"8","author":"Din","year":"2020","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s12046-013-0216-3","article-title":"Occlusion invariant face recognition using a mean based weight matrix and support vector machine","volume":"39","author":"Priya","year":"2014","journal-title":"Sadhana"},{"key":"ref_7","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G. (2012, January 3\u20136). ImageNet classification with deep convolutional neural networks. Proceedings of the Neural Information and Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_9","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_11","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative adversarial nets. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_12","unstructured":"Wang, Z., Wang, G., Huang, B., Xiong, Z., Hong, Q., Wu, H., Yi, P., Jiang, K., Wang, N., and Pei, Y. (2022, October 08). Masked Face Recognition Dataset and Application. Available online: http:\/\/arxiv.org\/abs\/2003.09093."},{"key":"ref_13","unstructured":"Huang, G.B., Ramesh, M., Berg, T., and Learned-Miller, E. (2008, January 17). Labeled faces in the wild: A database for studying face recognition in unconstrained environments. Proceedings of the Workshop on Faces in \u2018Real-Life\u2019 Images: Detection, Alignment, and Recognition, Marseille, France."},{"key":"ref_14","unstructured":"Yi, D., Lei, Z., Liao, S., and Li, S.Z. (2014). Learning face representation from scratch. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Boyko, N., Basystiuk, O., and Shakhovska, N. (2018, January 21). Performance evaluation and comparison of software for face recognition, based on dlib and opencv library. Proceedings of the IEEE Second Conference on Data Stream Mining and Processing, Lviv, Ukraine.","DOI":"10.1109\/DSMP.2018.8478556"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ngan, M., Grother, P., and Hanaoka, K. (2020). Ongoing Face Recognition Vendor Test (FRVT) Part 6A: Face Recognition Accuracy with Masks Using Pre- COVID-19 Algorithms, NLST.","DOI":"10.6028\/NIST.IR.8311"},{"key":"ref_17","unstructured":"Anwar, A., and Raychowdhury, A. (2020). Masked face recognition for secure authentication. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Masci, J., Meier, U., Cire\u00b8san, D., and Schmidhuber, J. (2011, January 14). Stacked convolutional auto-encoders for hierarchical feature extraction. Proceedings of the International Conference on Artificial Neural Networks, Berlin, Germany.","DOI":"10.1007\/978-3-642-21735-7_7"},{"key":"ref_19","unstructured":"(2022, October 08). Available online: https:\/\/en.wikipedia.org\/wiki\/Snow_(app)."},{"key":"ref_20","unstructured":"Tarr\u00e9s, F., and Rama, A. (2022, October 08). GTAV Face Database. Available online: http:\/\/gps-tsc.upc.es\/GTAV\/ResearchAreas\/UPCFaceDatabase\/GTAVFaceDatabase.htm."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/MSP.2008.930649","article-title":"Mean Squared Error: Love it or leave it? A new look at signal fidelty measures","volume":"26","author":"Wang","year":"2009","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_22","unstructured":"Kingma, D.P., and Ba, J.L. (2015). Adam: A method for stochastic optimization. Proc. Int. Conf. Learn. Represent., 1\u201341."},{"key":"ref_23","unstructured":"(2022, October 08). Available online: https:\/\/www.kaggle.com\/datasets\/akashguna\/lfw-dataset-with-masks?resource=download."},{"key":"ref_24","unstructured":"(2022, October 08). Available online: https:\/\/github.com\/leesh903\/masked-face-dataset-LFW-."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ullah, N., Javed, A., Ghazanfar, M.A., Alsufyani, A., and Bourouis, S. (2022). A novel DeepMaskNet model for face mask detection and masked facial recognition. J. King Saud Univ.-Comput. Inf. Sci.","DOI":"10.1016\/j.jksuci.2021.12.017"},{"key":"ref_26","first-page":"293","article-title":"Video-based face recognition: A survey","volume":"60","author":"Wang","year":"2009","journal-title":"World Acad. Sci. Eng. Technol."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Stallkamp, J., Ekenel, H.K., and Stiefelhagen, R. (2007, January 14\u201321). Video-based face recognition on real-world dataset. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4408868"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bashbaghi, S., Granger, E., Sabourin, R., and Parchami, M. (2019). Deep Learning Architectures for Face Recognition in Video Surveillance, Springer.","DOI":"10.1007\/978-981-10-5152-4_6"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7903\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:56:02Z","timestamp":1760144162000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/20\/7903"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,17]]},"references-count":28,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["s22207903"],"URL":"https:\/\/doi.org\/10.3390\/s22207903","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,10,17]]}}}