{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T12:41:23Z","timestamp":1763037683544,"version":"build-2065373602"},"reference-count":57,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2021,11,4]],"date-time":"2021-11-04T00:00:00Z","timestamp":1635984000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Human Activity Recognition (HAR) has become increasingly crucial in several applications, ranging from motion-driven virtual games to automated video surveillance systems. In these applications, sensors such as smart phone cameras, web cameras or CCTV cameras are used for detecting and tracking physical activities of users. Inevitably, spoof detection in HAR is essential to prevent anomalies and false alarms. To this end, we propose a deep learning based approach that can be used to detect spoofing in various fields such as border control, institutional security and public safety by surveillance cameras. Specifically, in this work, we address the problem of detecting spoofing occurring from video replay attacks, which is more common in such applications. We present a new database containing several videos of users juggling a football, captured under different lighting conditions and using different display and capture devices. We train our models using this database and the proposed system is capable of running in parallel with the HAR algorithms in real-time. Our experimental results show that our approach precisely detects video replay spoofing attacks and generalizes well, even to other applications such as spoof detection in face biometric authentication. Results show that our approach is effective even under resizing and compression artifacts that are common in HAR applications using remote server connections.<\/jats:p>","DOI":"10.3390\/s21217339","type":"journal-article","created":{"date-parts":[[2021,11,4]],"date-time":"2021-11-04T22:25:54Z","timestamp":1636064754000},"page":"7339","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["Live Spoofing Detection for Automatic Human Activity Recognition Applications"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5402-0208","authenticated-orcid":false,"given":"Viktor D\u00e9nes","family":"Husz\u00e1r","sequence":"first","affiliation":[{"name":"Teqball Kft., Expo t\u00e9r 5-7, 1101 Budapest, Hungary"},{"name":"Doctoral School of Military Engineering, National University of Public Service, Ludovika t\u00e9r 2, 1083 Budapest, Hungary"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vamsi Kiran","family":"Adhikarla","sequence":"additional","affiliation":[{"name":"Teqball Kft., Expo t\u00e9r 5-7, 1101 Budapest, Hungary"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"14997","DOI":"10.1038\/ncomms14997","article-title":"Wearable smart sensor systems integrated on soft contact lenses for wireless ocular diagnostics","volume":"8","author":"Jones","year":"2017","journal-title":"Nat. Commun."},{"key":"ref_2","unstructured":"Kim, J.E. (2018). Genetic studies of accelerometer-based sleep measures in 85,670 individuals yield new insights into human sleep behaviour. bioRxiv."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1038\/s41587-019-0045-y","article-title":"Wearable biosensors for healthcare monitoring","volume":"37","author":"Kim","year":"2019","journal-title":"Nat. Biotechnol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1109\/TCE.2012.6311329","article-title":"Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home","volume":"58","author":"Jalal","year":"2012","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"5379","DOI":"10.1109\/TVT.2019.2908425","article-title":"Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach","volume":"68","author":"Xing","year":"2019","journal-title":"IEEE Trans. Veh. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"983","DOI":"10.1007\/s00371-012-0752-6","article-title":"A Survey of Activity Recognition And Understanding The Behavior In Video Survelliance","volume":"29","author":"Revathi","year":"2013","journal-title":"Vis Comput."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mukherjee, A., Misra, S., Mangrulkar, P., Rajarajan, M., and Rahulamathavan, Y. (2017, January 17\u201320). SmartARM: A smartphone-based group activity recognition and monitoring scheme for military applications. Proceedings of the 2017 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS), Bhubaneswar, India.","DOI":"10.1109\/ANTS.2017.8384149"},{"key":"ref_8","unstructured":"SQILLER App (2021, July 19). The Digital Football Game. Available online: https:\/\/sqillerapp.com\/."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1109\/SURV.2012.110112.00192","article-title":"A Survey on Human Activity Recognition using Wearable Sensors","volume":"15","author":"Lara","year":"2013","journal-title":"IEEE Commun. Surv. Tutor."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/j.eswa.2018.03.056","article-title":"Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges","volume":"105","author":"Nweke","year":"2018","journal-title":"Expert Syst. Appl."},{"key":"ref_11","unstructured":"Bresan, R., Pinto, A., Rocha, A., Beluzo, C., and Carvalho, T. (2019). FaceSpoof Buster: A Presentation Attack Detector Based on Intrinsic Image Properties and Deep Learning. arXiv."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bharadwaj, S., Dhamecha, T.I., Vatsa, M., and Singh, R. (2013, January 23\u201328). Computationally Efficient Face Spoofing Detection with Motion Magnification. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Portland, OR, USA.","DOI":"10.1109\/CVPRW.2013.23"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Pan, G., Sun, L., Wu, Z., and Lao, S. (2007, January 14\u201321). Eyeblink-based Anti-Spoofing in Face Recognition from a Generic Webcamera. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4409068"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Uzun, E., Chung, S.P., Essa, I., and Lee, W. (2018, January 18\u201321). rtCaptcha: A Real-Time CAPTCHA Based Liveness Detection System. Proceedings of the NDSS Symposium, San Diego, CA, USA.","DOI":"10.14722\/ndss.2018.23253"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Yi, D., Lei, Z., and Li, S.Z. (2011, January 21\u201325). Face liveness detection by learning multispectral reflectance distributions. Proceedings of the 2011 IEEE International Conference on Automatic Face Gesture Recognition (FG), Santa Barbara, CA, USA.","DOI":"10.1109\/FG.2011.5771438"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Erdogmus, N., and Marcel, S. (2, January 29). Spoofing in 2D face recognition with 3D masks and anti-spoofing with Kinect. Proceedings of the 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS), Arlington, VA, USA.","DOI":"10.1109\/BTAS.2013.6712688"},{"key":"ref_17","unstructured":"Bao, W., Li, H., Li, N., and Jiang, W. (2009, January 11\u201312). A liveness detection method for face recognition based on optical flow field. Proceedings of the 2009 International Conference on Image Analysis and Signal Processing, Linhai, China."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"De Marsico, M., Nappi, M., Riccio, D., and Dugelay, J.L. (April, January 29). Moving face spoofing detection via 3D projective invariants. Proceedings of the 2012 5th IAPR International Conference on Biometrics (ICB), New Delhi, India.","DOI":"10.1109\/ICB.2012.6199761"},{"key":"ref_19","unstructured":"Chingovska, I., Anjos, A., and Marcel, S. (2012, January 6\u20137). On the effectiveness of local binary patterns in face anti-spoofing. Proceedings of the 2012 BIOSIG\u2014Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG), Darmstadt, Germany."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"M\u00e4\u00e4tt\u00e4, J., Hadid, A., and Pietik\u00e4inen, M. (2011, January 11\u201313). Face spoofing detection from single images using micro-texture analysis. Proceedings of the 2011 International Joint Conference on Biometrics (IJCB), Washington, DC, USA.","DOI":"10.1109\/IJCB.2011.6117510"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Bai, J., Ng, T.T., Gao, X., and Shi, Y.Q. (June, January 30). Is physics-based liveness detection truly possible with a single image?. Proceedings of the 2010 IEEE International Symposium on Circuits and Systems, Paris, France.","DOI":"10.1109\/ISCAS.2010.5537866"},{"key":"ref_22","unstructured":"Daniilidis, K., Maragos, P., and Paragios, N. (2010). Face Liveness Detection from a Single Image with Sparse Low Rank Bilinear Discriminative Model. Computer Vision\u2014ECCV 2010, Springer."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1818","DOI":"10.1109\/TIFS.2016.2555286","article-title":"Face Spoofing Detection Using Colour Texture Analysis","volume":"11","author":"Boulkenafet","year":"2016","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Komulainen, J., Hadid, A., Pietik\u00e4inen, M., Anjos, A., and Marcel, S. (2013, January 4\u20137). Complementary countermeasures for detecting scenic face spoofing attacks. Proceedings of the 2013 International Conference on Biometrics (ICB), Madrid, Spain.","DOI":"10.1109\/ICB.2013.6612968"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"710","DOI":"10.1109\/TIP.2013.2292332","article-title":"Image Quality Assessment for Fake Biometric Detection: Application to Iris, Fingerprint, and Face Recognition","volume":"23","author":"Galbally","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Unnikrishnan, S., and Eshack, A. (2016, January 21\u201322). Face spoof detection using image distortion analysis and image quality assessment. Proceedings of the 2016 International Conference on Emerging Technological Trends (ICETT), Kollam, India.","DOI":"10.1109\/ICETT.2016.7873742"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"778","DOI":"10.1109\/TIFS.2015.2411394","article-title":"Face-Spoofing 2D-Detection Based on Moir\u00e9-Pattern Analysis","volume":"10","author":"Garcia","year":"2015","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"13868","DOI":"10.1109\/ACCESS.2017.2729161","article-title":"An Anomaly Detection Approach to Face Spoofing Detection: A New Formulation and Evaluation Protocol","volume":"5","author":"Arashloo","year":"2017","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1117\/12.541955","article-title":"Live face detection based on the analysis of Fourier spectra","volume":"Volume 5404","author":"Jain","year":"2004","journal-title":"Biometric Technology for Human Identification"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Kim, G., Eum, S., Suhr, J.K., Kim, D.I., Park, K.R., and Kim, J. (April, January 29). Face liveness detection based on texture and frequency analyses. Proceedings of the 2012 5th IAPR International Conference on Biometrics (ICB), New Delhi, India.","DOI":"10.1109\/ICB.2012.6199760"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1109\/TIFS.2015.2395139","article-title":"Using Visual Rhythms for Detecting Video-Based Facial Spoof Attacks","volume":"10","author":"Pinto","year":"2015","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4726","DOI":"10.1109\/TIP.2015.2466088","article-title":"Face Spoofing Detection Through Visual Codebooks of Spectral Temporal Cubes","volume":"24","author":"Pinto","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Liu, Y., Jourabloo, A., and Liu, X. (2018). Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision. arXiv.","DOI":"10.1109\/CVPR.2018.00048"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Atoum, Y., Liu, Y., Jourabloo, A., and Liu, X. (2017, January 1\u20134). Face anti-spoofing using patch and depth-based CNNs. Proceedings of the 2017 IEEE International Joint Conference on Biometrics (IJCB), Denver, CO, USA.","DOI":"10.1109\/BTAS.2017.8272713"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"de Freitas Pereira, T., Anjos, A., De Martino, J.M., and Marcel, S. (2013, January 4\u20137). Can face anti-spoofing countermeasures work in a real world scenario?. Proceedings of the 2013 International Conference on Biometrics (ICB), Madrid, Spain.","DOI":"10.1109\/ICB.2013.6612981"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Yan, J., Liu, S., Lei, Z., Yi, D., and Li, S.Z. (April, January 29). A face antispoofing database with diverse attacks. Proceedings of the 2012 5th IAPR International Conference on Biometrics (ICB), New Delhi, India.","DOI":"10.1109\/ICB.2012.6199754"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"762","DOI":"10.1109\/TIFS.2015.2406533","article-title":"Detection of Face Spoofing Using Visual Dynamics","volume":"10","author":"Tirunagari","year":"2015","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2456","DOI":"10.1109\/TIP.2015.2422574","article-title":"Face liveness detection from a single image via diffusion speed model","volume":"24","author":"Kim","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1109\/TIFS.2015.2398817","article-title":"Deep Representations for Iris, Face, and Fingerprint Spoofing Detection","volume":"10","author":"Menotti","year":"2015","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Boulkenafet, Z., Komulainen, J., and Hadid, A. (2015). face anti-spoofing based on color texture analysis. arXiv.","DOI":"10.1109\/ICIP.2015.7351280"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2396","DOI":"10.1109\/TIFS.2015.2458700","article-title":"Face Spoofing Detection Based on Multiple Descriptor Fusion Using Multiscale Dynamic Binarized Statistical ImageFeatures","volume":"10","author":"Arashloo","year":"2015","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1109\/TIFS.2015.2400395","article-title":"Face Spoof Detection With Image Distortion Analysis","volume":"10","author":"Wen","year":"2015","journal-title":"IEEE Trans. Inf. Forensics Secur."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bok, J.Y., Suh, K.H., and Lee, E.C. (2020). Verifying the Effectiveness of New Face Spoofing DB with Capture Angle and Distance. Electronics, 9.","DOI":"10.3390\/electronics9040661"},{"key":"ref_45","unstructured":"Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., and Sheikh, Y. (2019). OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. arXiv."},{"key":"ref_46","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An Incremental Improvement. arXiv."},{"key":"ref_47","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Feichtenhofer, C. (2020). X3D: Expanding Architectures for Efficient Video Recognition. arXiv.","DOI":"10.1109\/CVPR42600.2020.00028"},{"key":"ref_49","unstructured":"Chollet, F. (2021, June 01). Keras. Available online: https:\/\/github.com\/fchollet\/keras."},{"key":"ref_50","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_51","unstructured":"ISO (2017). ISO\/IEC JTC 1 \/SC 37 Biometrics Information Technology\u2014Biometric Presentation Attack Detection\u2014Part 3: Testing and Reporting, International Organization for Standardization."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Park, J.I., and Kim, J. (2013). LBP TOP Based Countermeasure against Face Spoofing Attacks. Computer Vision\u2014ACCV 2012 Workshops, Springer.","DOI":"10.1007\/978-3-642-37484-5"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1565","DOI":"10.1016\/j.neucom.2015.09.029","article-title":"Statistical binary patterns for rotational invariant texture classification","volume":"173","author":"Nguyen","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Dubey, R.K., Hua, G., and Thing, V.L. (2018, January 28\u201331). Face Spoofing Video Detection Using Spatio-Temporal Statistical Binary Pattern. Proceedings of the TENCON 2018\u20142018 IEEE Region 10 Conference, Jeju, Korea.","DOI":"10.1109\/TENCON.2018.8650515"},{"key":"ref_55","unstructured":"FFmpeg Developers (2021, July 19). Ffmpeg Tool (Version be1d324). Available online: http:\/\/ffmpeg.org\/."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Costa-Pazo, A., Bhattacharjee, S., Vazquez-Fernandez, E., and Marcel, S. (2016, January 21\u201323). The Replay-Mobile Face Presentation-Attack Database. Proceedings of the 2016 International Conference of the Biometrics Special Interest Group (BIOSIG), Darmstadt, Germany.","DOI":"10.1109\/BIOSIG.2016.7736936"},{"key":"ref_57","unstructured":"Swift Developers (2021, July 19). Swift Programming Language. Available online: https:\/\/developer.apple.com\/swift\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/21\/7339\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:25:51Z","timestamp":1760167551000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/21\/7339"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,4]]},"references-count":57,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21217339"],"URL":"https:\/\/doi.org\/10.3390\/s21217339","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,11,4]]}}}