{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T16:48:13Z","timestamp":1781974093607,"version":"3.54.5"},"reference-count":31,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2022,8,14]],"date-time":"2022-08-14T00:00:00Z","timestamp":1660435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Face recognition is an important application of pattern recognition and image analysis in biometric security systems. The COVID-19 outbreak has introduced several issues that can negatively affect the reliability of the facial recognition systems currently available: on the one hand, wearing a face mask\/covering has led to growth in failure cases, while on the other, the restrictions on direct contact between people can prevent any biometric data being acquired in controlled environments. To effectively address these issues, we designed a hybrid methodology that improves the reliability of facial recognition systems. A well-known Source Camera Identification (SCI) technique, based on Pixel Non-Uniformity (PNU), was applied to analyze the integrity of the input video stream as well as to detect any tampered\/fake frames. To examine the behavior of this methodology in real-life use cases, we implemented a prototype that showed two novel properties compared to the current state-of-the-art of biometric systems: (a) high accuracy even when subjects are wearing a face mask; (b) whenever the input video is produced by deep fake techniques (replacing the face of the main subject) the system can recognize that it has been altered providing more than one alert message. This methodology proved not only to be simultaneously more robust to mask induced occlusions but also even more reliable in preventing forgery attacks on the input video stream.<\/jats:p>","DOI":"10.3390\/s22166074","type":"journal-article","created":{"date-parts":[[2022,8,15]],"date-time":"2022-08-15T23:44:03Z","timestamp":1660607043000},"page":"6074","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["A PNU-Based Methodology to Improve the Reliability of Biometric Systems"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5236-0492","authenticated-orcid":false,"given":"Paola","family":"Capasso","sequence":"first","affiliation":[{"name":"Department of Computer Science, University of Salerno, 84084 Fisciano, Salerno, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4880-4975","authenticated-orcid":false,"given":"Lucia","family":"Cimmino","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Salerno, 84084 Fisciano, Salerno, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0472-0318","authenticated-orcid":false,"given":"Andrea F.","family":"Abate","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Salerno, 84084 Fisciano, Salerno, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1821-7908","authenticated-orcid":false,"given":"Andrea","family":"Bruno","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Salerno, 84084 Fisciano, Salerno, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6983-4818","authenticated-orcid":false,"given":"Giuseppe","family":"Cattaneo","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Salerno, 84084 Fisciano, Salerno, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1145\/954339.954342","article-title":"Face Recognition: A Literature Survey","volume":"35","author":"Zhao","year":"2003","journal-title":"ACM Comput. Surv."},{"key":"ref_2","unstructured":"Damer, N., Grebe, J.H., Chen, C., Boutros, F., Kirchbuchner, F., and Kuijper, A. (2020, January 16\u201318). The Effect of Wearing a Mask on Face Recognition Performance: An Exploratory Study. Proceedings of the 2020 International Conference of the Biometrics Special Interest Group (BIOSIG), Darmstadt, Germany."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"548","DOI":"10.1049\/bme2.12044","article-title":"Extended evaluation of the effect of real and simulated masks on face recognition performance","volume":"10","author":"Damer","year":"2021","journal-title":"IET Biom."},{"key":"ref_4","first-page":"1741","article-title":"Deep Learning Model for Face Mask Based Attendance System in the Era of the COVID-19 Pandemic","volume":"Volume 1","author":"Kumar","year":"2021","journal-title":"Proceedings of the 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS)"},{"key":"ref_5","first-page":"1702","article-title":"A reminiscence of \u201cMastermind\u201d: Iris\/periocular biometrics by \u201cIn-Set\u201d CNN Iterative analysis","volume":"14","author":"Neves","year":"2018","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ullah, N., Javed, A., Ghazanfar, M.A., Alsufyani, A., and Bourouis, S. (2022). A novel DeepMaskNet model for face mask detection and masked facial recognition. J. King Saud Univ. Comput. Inf. Sci.","DOI":"10.1016\/j.jksuci.2021.12.017"},{"key":"ref_7","first-page":"38","article-title":"A survey on soft biometrics for human identification","volume":"37","author":"Abdelwhab","year":"2018","journal-title":"Mach. Learn. Biom."},{"key":"ref_8","unstructured":"Zewail, R., Elsafi, A., Saeb, M., and Hamdy, N. (2004, January 25\u201328). Soft and hard biometrics fusion for improved identity verification. Proceedings of the The 2004 47th Midwest Symposium on Circuits and Systems, 2004, MWSCAS\u201904, Hiroshima, Japan."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"9037","DOI":"10.1109\/ACCESS.2019.2962010","article-title":"Clustering facial attributes: Narrowing the path from soft to hard biometrics","volume":"8","author":"Abate","year":"2019","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_11","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Levada, A.L.M., Correa, D.C., Salvadeo, D.H.P., Saito, J.H., and Mascarenhas, N.D.A. (2008, January 12\u201315). Novel approaches for face recognition: Template-matching using Dynamic Time Warping and LSTM neural network supervised classification. Proceedings of the 2008 15th International Conference on Systems, Signals and Image Processing, San Diego, CA, USA.","DOI":"10.1109\/IWSSIP.2008.4604412"},{"key":"ref_13","unstructured":"Tsai, M., and Wu, G. (2006, January 14\u201319). USING Image Features to Identify Camera Sources. Proceedings of the 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings, Toulouse, France."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1109\/TIFS.2006.873602","article-title":"Digital camera identification from sensor pattern noise","volume":"1","author":"Lukas","year":"2006","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"393","DOI":"10.1109\/TIFS.2011.2168214","article-title":"Enhancing Source Camera Identification Performance With a Camera Reference Phase Sensor Pattern Noise","volume":"7","author":"Kang","year":"2012","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Goljan, M. (2008, January 3\u20135). Digital camera identification from images\u2013estimating false acceptance probability. Proceedings of the International Workshop on Digital Watermarking, Guangzhou, China.","DOI":"10.1007\/978-3-642-04438-0_38"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1109\/34.598227","article-title":"Probabilistic visual learning for object representation","volume":"19","author":"Moghaddam","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1109\/34.598235","article-title":"Face recognition by elastic bunch graph matching","volume":"19","author":"Wiskott","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1162\/jocn.1991.3.1.71","article-title":"Eigenfaces for recognition","volume":"3","author":"Turk","year":"1991","journal-title":"J. Cogn. Neurosci."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Abate, A., Cimmino, L., Nappi, M., and Narducci, F. (2022, January 23\u201327). Fusion of Periocular Deep Features in a Dual-Input CNN for Biometric Recognition. Proceedings of the Image Analysis and Processing\u2014ICIAP 2022, Lecce, Italy.","DOI":"10.1007\/978-3-031-06427-2_31"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2969","DOI":"10.1364\/JOSAA.18.002969","article-title":"Face verification through tracking facial features","volume":"18","author":"Li","year":"2001","journal-title":"JOSA A"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Baccouche, M., Mamalet, F., Wolf, C., Garcia, C., and Baskurt, A. (2010, January 15\u201318). Action classification in soccer videos with long short-term memory recurrent neural networks. Proceedings of the International Conference on Artificial Neural Networks, Thessaloniki, Greece.","DOI":"10.1007\/978-3-642-15822-3_20"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Iengo, D., Nappi, M., Ricciardi, S., and Vanore, D. (2019, January 22\u201325). Dynamic Facial Features for Inherently Safer Face Recognition. Proceedings of the 2019 IEEE International Conference on Image Processing (ICIP), Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803304"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Abate, A.F., Cimmino, L., Narducci, F., and Pero, C. (2020, January 17\u201322). Biometric Face Recognition Based on Landmark Dynamics. Proceedings of the 2020 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC\/PiCom\/CBDCom\/CyberSciTech), Calgary, AB, Canada.","DOI":"10.1109\/DASC-PICom-CBDCom-CyberSciTech49142.2020.00105"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Blanc-Talon, J., Distante, C., Philips, W., Popescu, D., and Scheunders, P. (2016, January 24\u201327). Using PNU-Based Techniques to Detect Alien Frames in Videos. Proceedings of the Advanced Concepts for Intelligent Vision Systems, Lecce, Italy.","DOI":"10.1007\/978-3-319-48680-2"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1109\/TIFS.2007.916285","article-title":"Determining Image Origin and Integrity Using Sensor Noise","volume":"3","author":"Chen","year":"2008","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2021.07.008","article-title":"PNU Spoofing: A menace for biometrics authentication systems?","volume":"151","author":"Bruno","year":"2021","journal-title":"Pattern Recognit. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Bayram, S., Sencar, H.T., and Memon, N. (2010, January 18\u201320). Efficient techniques for sensor fingerprint matching in large image and video databases. Proceedings of the Media Forensics and Security II, International Society for Optics and Photonics, San Jose, CA, USA.","DOI":"10.1117\/12.845737"},{"key":"ref_29","unstructured":"Chen, M., Fridrich, J., Goljan, M., and Luk\u00e1\u0161, J. (February, January 29). Source digital camcorder identification using sensor photo response non-uniformity. Proceedings of the Security, Steganography, and Watermarking of Multimedia Contents IX, International Society for Optics and Photonics, San Jose, CA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"108308","DOI":"10.1016\/j.patcog.2021.108308","article-title":"An empirical study of the impact of masks on face recognition","volume":"122","author":"Jeevan","year":"2022","journal-title":"Pattern Recognit."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1504\/IJES.2020.107641","article-title":"An experimental estimate of the impact produced on PNU by new generation video codecs","volume":"12","author":"Bruno","year":"2020","journal-title":"Int. J. Embed. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6074\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:08:37Z","timestamp":1760141317000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6074"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,14]]},"references-count":31,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22166074"],"URL":"https:\/\/doi.org\/10.3390\/s22166074","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,14]]}}}