{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:38:04Z","timestamp":1760150284335,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T00:00:00Z","timestamp":1698883200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ford Motor Company"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We present a synthetic augmentation approach towards improving monocular face presentation\u2013attack\u2013detection (PAD) robustness to real-world noise additions. Face PAD algorithms secure authentication systems against spoofing attacks, such as pictures, videos, and 2D-inspired masks. Best-in-class PAD methods typically use 3D imagery, but these can be expensive. To reduce application cost, there is a growing field investigating monocular algorithms that detect facial artifacts. These approaches work well in laboratory conditions, but can be sensitive to the imaging environment (e.g., sensor noise, dynamic lighting, etc.). The ideal solution for noise robustness is training under all expected conditions; however, this is time consuming and expensive. Instead, we propose that physics-informed noise-augmentations can pragmatically achieve robustness. Our toolbox contains twelve sensor and lighting effect generators. We demonstrate that our toolbox generates more robust PAD features than popular augmentation methods in noisy test-evaluations. We also observe that the toolbox improves accuracy on clean test data, suggesting that it inherently helps discern spoof artifacts from imaging artifacts. We validate this hypothesis through an ablation study, where we remove liveliness pairs (e.g., live or spoof imagery only for participants) to identify how much real data can be replaced with synthetic augmentations. We demonstrate that using these noise augmentations allows us to achieve better test accuracy while only requiring 30% of participants to be fully imaged under all conditions. These findings indicate that synthetic noise augmentations are a great way to improve PAD, addressing noise robustness while simplifying data collection.<\/jats:p>","DOI":"10.3390\/s23218914","type":"journal-article","created":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T02:05:07Z","timestamp":1698890707000},"page":"8914","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Improving Monocular Facial Presentation\u2013Attack\u2013Detection Robustness with Synthetic Noise Augmentations"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0097-6807","authenticated-orcid":false,"given":"Ali","family":"Hassani","sequence":"first","affiliation":[{"name":"Information Systems, Security and Forensics Lab, University of Michigan-Dearborn, Dearborn, MI 48128, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jon","family":"Diedrich","sequence":"additional","affiliation":[{"name":"Research and Advanced Engineering, Ford Motor Company, Dearborn, MI 48124, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6006-3888","authenticated-orcid":false,"given":"Hafiz","family":"Malik","sequence":"additional","affiliation":[{"name":"Research and Advanced Engineering, Ford Motor Company, Dearborn, MI 48124, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,11,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","article-title":"Joint face detection and alignment using multitask cascaded convolutional networks","volume":"23","author":"Zhang","year":"2016","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Ververas, E., Kotsia, I., and Zafeiriou, S. (2020, January 13\u201319). Retinaface: Single-shot multi-level face localisation in the wild. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00525"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7\u201312). Facenet: A unified embedding for face recognition and clustering. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Deng, J., Guo, J., Xue, N., and Zafeiriou, S. (2019, January 15\u201320). Arcface: Additive angular margin loss for deep face recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00482"},{"key":"ref_5","unstructured":"Newton, E., and Schuckers, S. (2021, May 01). Recommendations for Presentation Attack Detection (PAD): Mitigation of Threats Due to Spoof Attacks, Available online: https:\/\/www.nist.gov\/system\/files\/documents\/2020\/09\/03\/10_ibpc-prez-fido-ssanden-v5.pdf."},{"key":"ref_6","unstructured":"Zhang, Y., Yin, Z., Shao, J., Liu, Z., Yang, S., Xiong, Y., Xia, W., Xu, Y., Luo, M., and Liu, J. (2021). Celeba-spoof challenge 2020 on face anti-spoofing: Methods and results. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Purnapatra, S., Smalt, N., Bahmani, K., Das, P., Yambay, D., Mohammadi, A., George, A., Bourlai, T., Marcel, S., and Schuckers, S. (2021, January 4\u20137). Face liveness detection competition (livdet-face)-2021. Proceedings of the 2021 IEEE International Joint Conference on Biometrics (IJCB), Shenzhen, China.","DOI":"10.1109\/IJCB52358.2021.9484359"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2268","DOI":"10.1109\/TIFS.2016.2578288","article-title":"Secure face unlock: Spoof detection on smartphones","volume":"11","author":"Patel","year":"2016","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_9","unstructured":"Li, A. (2023, October 01). Pixel 8 and 8 Pro Face Unlock Works for Payments, More. Available online: https:\/\/9to5google.com\/2023\/10\/04\/pixel-8-face-unlock\/."},{"key":"ref_10","unstructured":"(2022, October 01). Reservations.com. Facial Recognition Statistics in Airports: Survey Shows 43% Approve, 33% Disapprove. Available online: https:\/\/www.reservations.com\/blog\/resources\/facial-recognition-airports-survey\/."},{"key":"ref_11","unstructured":"Thabet, A.B., and Amor, N.B. (2015, January 21\u201323). Enhanced smart doorbell system based on face recognition. Proceedings of the 2015 16th International Conference on Sciences and Techniques of Automatic Control and Computer Engineering (STA), Monastir, Tunisia."},{"key":"ref_12","unstructured":"Oliva, J. (2022, October 01). Genesis GV60 Will Recognize Your Face to Unlock the Car. Available online: https:\/\/www.motor1.com\/news\/533678\/genesis-gv60-facial-recognition\/."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, A., Wan, J., Escalera, S., Jair Escalante, H., Tan, Z., Yuan, Q., Wang, K., Lin, C., Guo, G., and Guyon, I. (2019, January 16\u201317). Multi-modal face anti-spoofing attack detection challenge at cvpr2019. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00202"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Yu, Z., Zhao, C., Wang, Z., Qin, Y., Su, Z., Li, X., Zhou, F., and Zhao, G. (2020, January 14\u201319). Searching Central Difference Convolutional Networks for Face Anti-Spoofing. Proceedings of the CVPR, Virtual.","DOI":"10.1109\/CVPR42600.2020.00534"},{"key":"ref_15","unstructured":"R\u00f6ssler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., and Nie\u00dfner, M. (2018). Faceforensics: A large-scale video dataset for forgery detection in human faces. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Hassani, A., Diedrich, J., and Malik, H. (2023). Monocular Facial Presentation-Attack-Detection: Classifying Near-Infrared Reflectance Patterns. Appl. Sci., 13.","DOI":"10.3390\/app13031987"},{"key":"ref_17","unstructured":"Huang, G.B., Mattar, M., Berg, T., and Learned-Miller, E. (2008, January 17\u201320). Labeled faces in the wild: A database forstudying face recognition in unconstrained environments. Proceedings of the Workshop on faces in\u2019Real-Life\u2019Images: Detection, Alignment, and Recognition, Marseille, France."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Guo, Y., Zhang, L., Hu, Y., He, X., and Gao, J. (2016, January 11\u201314). Ms-celeb-1m: A dataset and benchmark for large-scale face recognition. Proceedings of the Computer Vision\u2014ECCV 2016: 14th European Conference, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_6"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhu, Z., Huang, G., Deng, J., Ye, Y., Huang, J., Chen, X., Zhu, J., Yang, T., Lu, J., and Du, D. (2021, January 20\u201325). Webface260m: A benchmark unveiling the power of million-scale deep face recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01035"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.neucom.2016.12.025","article-title":"Data augmentation for face recognition","volume":"230","author":"Lv","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_21","unstructured":"Shan, S., Gao, W., Cao, B., and Zhao, D. (October, January 29). Illumination normalization for robust face recognition against varying lighting conditions. Proceedings of the 2003 IEEE International SOI Conference, Newport Beach, CA, USA."},{"key":"ref_22","unstructured":"Crispell, D., Biris, O., Crosswhite, N., Byrne, J., and Mundy, J.L. (2017). Dataset augmentation for pose and lighting invariant face recognition. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3507901","article-title":"Face image quality assessment: A literature survey","volume":"54","author":"Schlett","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Uchida, N., Shibahara, T., Aoki, T., Nakajima, H., and Kobayashi, K. (2005, January 11\u201314). 3D face recognition using passive stereo vision. Proceedings of the IEEE International Conference on Image Processing, Genoa, Italy.","DOI":"10.1109\/ICIP.2005.1530214"},{"key":"ref_25","unstructured":"Plank, H., Almer, M., Lobnik, R., Steger, C., Ruprechter, T., Bock, H., Haid, J., Holweg, G., and Druml, N. (2016, January 15\u201317). OptiSec3D-A new Paradigm in Secure Communication and Authentication featuring Time-of-Flight. Proceedings of the EWSN, Graz, Austria."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/j.rti.2005.06.006","article-title":"Real-time acquisition of depth and color images using structured light and its application to 3D face recognition","volume":"11","author":"Tsalakanidou","year":"2005","journal-title":"Real-Time Imaging"},{"key":"ref_27","unstructured":"Bao, W., Li, H., Li, N., and Jiang, W. (2009, January 11\u201312). A liveness detection method for face recognition based on optical flow field. Proceedings of the 2009 International Conference on Image Analysis and Signal Processing, Linhai, China."},{"key":"ref_28","unstructured":"Soukupova, T., and Cech, J. (2016, January 3\u20135). Eye blink detection using facial landmarks. Proceedings of the 21st Computer Vision Winter Workshop, Rimske Toplice, Slovenia."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Balakrishnan, G., Durand, F., and Guttag, J. (2013, January 23\u201328). Detecting pulse from head motions in video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.440"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, X., Chen, J., Zhao, G., and Pietikainen, M. (2014, January 23\u201328). Remote heart rate measurement from face videos under realistic situations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.543"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, S.Y., Yang, S.H., Chen, Y.P., and Huang, J.W. (2017). Face liveness detection based on skin blood flow analysis. Symmetry, 9.","DOI":"10.3390\/sym9120305"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Boulkenafet, Z., Komulainen, J., and Hadid, A. (2015, January 27\u201330). Face anti-spoofing based on color texture analysis. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada.","DOI":"10.1109\/ICIP.2015.7351280"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1109\/TIFS.2015.2400395","article-title":"Face spoof detection with image distortion analysis","volume":"10","author":"Wen","year":"2015","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_34","unstructured":"Zhang, W., Shan, S., Gao, W., Chen, X., and Zhang, H. (2005, January 17\u201321). Local gabor binary pattern histogram sequence (lgbphs): A novel non-statistical model for face representation and recognition. Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV\u201905), Beijing, China."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1109\/TIFS.2021.3134869","article-title":"Dual-Branch Meta-Learning Network with Distribution Alignment for Face Anti-Spoofing","volume":"17","author":"Jia","year":"2021","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1109\/TIFS.2018.2868230","article-title":"Joint discriminative learning of deep dynamic textures for 3D mask face anti-spoofing","volume":"14","author":"Shao","year":"2018","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1289","DOI":"10.1007\/s11042-020-09520-2","article-title":"Image surface texture analysis and classification using deep learning","volume":"80","author":"Aggarwal","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, Z., Yu, Z., Zhao, C., Zhu, X., Qin, Y., Zhou, Q., Zhou, F., and Lei, Z. (2020, January 13\u201319). Deep spatial gradient and temporal depth learning for face anti-spoofing. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00509"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1007\/s11263-019-01178-0","article-title":"Face-specific data augmentation for unconstrained face recognition","volume":"127","author":"Masi","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Bae, G., de La Gorce, M., Baltru\u0161aitis, T., Hewitt, C., Chen, D., Valentin, J., Cipolla, R., and Shen, J. (2023, January 3\u20137). DigiFace-1M: 1 Million Digital Face Images for Face Recognition. Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, USA.","DOI":"10.1109\/WACV56688.2023.00352"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Uch\u00f4a, V., Aires, K., Veras, R., Paiva, A., and Britto, L. (2020, January 1\u20133). Data augmentation for face recognition with CNN transfer learning. Proceedings of the 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), Niter\u00f3i, Brazil.","DOI":"10.1109\/IWSSIP48289.2020.9145453"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Moreno-Barea, F.J., Strazzera, F., Jerez, J.M., Urda, D., and Franco, L. (2018, January 18\u201321). Forward noise adjustment scheme for data augmentation. Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence (SSCI), Bengaluru, India.","DOI":"10.1109\/SSCI.2018.8628917"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Pervaiz, A., Hussain, F., Israr, H., Tahir, M.A., Raja, F.R., Baloch, N.K., Ishmanov, F., and Zikria, Y.B. (2020). Incorporating noise robustness in speech command recognition by noise augmentation of training data. Sensors, 20.","DOI":"10.3390\/s20082326"},{"key":"ref_44","first-page":"120","article-title":"The OpenCV Library","volume":"25","author":"Bradski","year":"2000","journal-title":"Dr. Dobb\u2019S J. Softw. Tools"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"e453","DOI":"10.7717\/peerj.453","article-title":"Scikit-image: Image processing in Python","volume":"2","author":"Boulogne","year":"2014","journal-title":"PeerJ"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Efrat, N., Glasner, D., Apartsin, A., Nadler, B., and Levin, A. (2013, January 1\u20138). Accurate blur models vs. image priors in single image super-resolution. Proceedings of the IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.352"},{"key":"ref_47","unstructured":"Widenhorn, R., Blouke, M.M., Weber, A., Rest, A., and Bodegom, E. (2002, January 21\u201323). Temperature dependence of dark current in a CCD. Proceedings of the Sensors and Camera Systems for Scientific, Industrial, and Digital Photography Applications III, San Jose, CA, USA."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1109\/34.141557","article-title":"An analysis of camera noise","volume":"14","author":"Boie","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","first-page":"252","article-title":"Salt and pepper noise: Effects and removal","volume":"2","author":"Azzeh","year":"2018","journal-title":"Int. J. Inform. Vis."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Shin, U., Park, J., Shim, G., Rameau, F., and Kweon, I.S. (2019, January 4\u20138). Camera exposure control for robust robot vision with noise-aware image quality assessment. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8968590"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"168","DOI":"10.5897\/IJPS2015.4274","article-title":"Light source estimation using feature points from specular highlights and cast shadows","volume":"11","author":"Anusorn","year":"2016","journal-title":"Int. J. Phys. Sci."},{"key":"ref_52","unstructured":"FLIR (2022, October 01). Blackfly S USB3. Available online: https:\/\/www.flir.com\/products\/blackfly-s-usb3\/?model=BFS-U3-51S5P-C&vertical=machine%2Bvision&segment=iis."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Man, K., and Ashdown, I. (2006, January 14\u201317). Accurate colorimetric feedback for RGB LED clusters. Proceedings of the Sixth International Conference on Solid State Lighting. International Society for Optics and Photonics, San Diego, CA, USA.","DOI":"10.1117\/12.683239"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Hassani, A., El Shair, Z., Refat, R.U.D., and Malik, H. (2022, January 16\u201319). Distilling Facial Knowledge with Teacher-Tasks: Semantic-Segmentation-Features For Pose-Invariant Face-Recognition. Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France.","DOI":"10.1109\/ICIP46576.2022.9897793"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/21\/8914\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:15:52Z","timestamp":1760130952000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/21\/8914"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,2]]},"references-count":54,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["s23218914"],"URL":"https:\/\/doi.org\/10.3390\/s23218914","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,11,2]]}}}