{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T16:14:33Z","timestamp":1784823273823,"version":"3.55.0"},"publisher-location":"Cham","reference-count":48,"publisher":"Springer International Publishing","isbn-type":[{"value":"9783030876630","type":"print"},{"value":"9783030876647","type":"electronic"}],"license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T00:00:00Z","timestamp":1643587200000},"content-version":"vor","delay-in-days":30,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This chapter describes a DeepFake detection\u00a0framework based on physiological measurement. In particular, we consider information related to the heart rate\u00a0using remote photoplethysmography (rPPG). rPPG methods analyze video sequences looking for subtle color changes in the human skin, revealing the presence of human blood under the tissues. This chapter explores to what extent rPPG\u00a0is useful for the detection of DeepFake\u00a0videos. We analyze the recent fake detector named DeepFakesON-Phys that is based on a Convolutional Attention Network (CAN), which extracts spatial and temporal information from video frames, analyzing and combining both sources to better detect fake videos. DeepFakesON-Phys has been experimentally evaluated using the latest public databases in the field: Celeb-DF\u00a0v2 and DFDC. The results achieved for DeepFake detection\u00a0based on a single frame are over 98% AUC (Area Under the Curve) on both databases, proving the success of fake detectors based on physiological measurement to detect the latest DeepFake\u00a0videos. In this chapter, we also propose and study heuristical and statistical approaches for performing continuous DeepFake detection\u00a0by combining scores from consecutive frames with low latency and high accuracy (100% on the Celeb-DF\u00a0v2 evaluation dataset). We show that combining scores extracted from short-time video sequences can improve the discrimination power of DeepFakesON-Phys.<\/jats:p>","DOI":"10.1007\/978-3-030-87664-7_12","type":"book-chapter","created":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T09:03:06Z","timestamp":1643619786000},"page":"255-273","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["DeepFakes Detection Based on Heart Rate Estimation: Single- and Multi-frame"],"prefix":"10.1007","author":[{"given":"Javier","family":"Hernandez-Ortega","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ruben","family":"Tolosana","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julian","family":"Fierrez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aythami","family":"Morales","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,1,31]]},"reference":[{"key":"12_CR1","unstructured":"Information Technology-Biometric Presentation Attack Detection-Part 3: Testing and Reporting. Tech. rep., ISO\/IEC JTC1 SC37 Biometrics (2017)"},{"key":"12_CR2","doi-asserted-by":"crossref","unstructured":"Afchar D, Nozick V, Yamagishi J, Echizen I (2018) MesoNet: a compact facial video forgery detection network. In: Proceedings of IEEE international workshop on information forensics and security (2018)","DOI":"10.1109\/WIFS.2018.8630761"},{"key":"12_CR3","unstructured":"Agarwal S, Farid H (2019) Protecting world leaders against deep fakes. In: Proceedings of IEEE\/CVF conference on computer vision and pattern recognition workshops (2019)"},{"key":"12_CR4","doi-asserted-by":"crossref","unstructured":"Bharadwaj S, Dhamecha TI, Vatsa M, Singh R (2013) Computationally efficient face spoofing detection with motion magnification. In: Proceedings IEEE\/CVF conference on computer vision and pattern recognition workshops (2013)","DOI":"10.1109\/CVPRW.2013.23"},{"key":"12_CR5","unstructured":"Cellan-Jones R (2019) Deepfake videos double in nine months (2019). https:\/\/www.bbc.com\/news\/technology-49961089"},{"key":"12_CR6","doi-asserted-by":"crossref","unstructured":"Chen W, McDuff D (2018) DeepPhys: video-based physiological measurement using convolutional attention networks. In: Proceedings of European Conference on Computer Vision, pp 349\u2013365","DOI":"10.1007\/978-3-030-01216-8_22"},{"key":"12_CR7","doi-asserted-by":"crossref","unstructured":"Ciftci UA, Demir I, Yin L (2020) FakeCatcher: detection of synthetic portrait videos using biological signals. IEEE Trans Pattern Anal Mach Intell","DOI":"10.1109\/TPAMI.2020.3009287"},{"key":"12_CR8","unstructured":"Citron D (2019) How deepfake undermine truth and threaten democracy. https:\/\/www.ted.com"},{"key":"12_CR9","doi-asserted-by":"crossref","unstructured":"Conotter V, Bodnari E, Boato G, Farid H (2014) Physiologically-based detection of computer generated faces in video. In: Proceedings IEEE international conference on image processing","DOI":"10.1109\/ICIP.2014.7025049"},{"key":"12_CR10","doi-asserted-by":"crossref","unstructured":"Dang H, Liu F, Stehouwer J, Liu X, Jain A (2020) On the detection of digital face manipulation. In: Proceedings IEEE\/CVF conference on computer vision and pattern recognition","DOI":"10.1109\/CVPR42600.2020.00582"},{"key":"12_CR11","unstructured":"Dolhansky B, Howes R, Pflaum B, Baram N, Ferrer CC (2019) The deepfake detection challenge (DFDC) preview dataset. arXiv:1910.08854"},{"issue":"7","key":"12_CR12","doi-asserted-by":"publisher","first-page":"1084","DOI":"10.1109\/TIFS.2014.2322255","volume":"9","author":"N Erdogmus","year":"2014","unstructured":"Erdogmus N, Marcel S (2014) Spoofing face recognition with 3D masks. IEEE Trans Inf Forensics Secur 9(7):1084\u20131097","journal-title":"IEEE Trans Inf Forensics Secur"},{"key":"12_CR13","unstructured":"Galbally J, Fierrez J, Ortega-Garcia J (2007) Vulnerabilities in biometric systems: attacks and recent advances in liveness detection. In: Proceedings Spanish workshop on biometrics, SWB"},{"key":"12_CR14","doi-asserted-by":"publisher","first-page":"1530","DOI":"10.1109\/ACCESS.2014.2381273","volume":"2","author":"J Galbally","year":"2014","unstructured":"Galbally J, Marcel S, Fierrez J (2014) Biometric anti-spoofing methods: a survey in face recognition. IEEE Access 2:1530\u20131552","journal-title":"IEEE Access"},{"key":"12_CR15","unstructured":"Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. In: Proceedings advances in neural information processing systems"},{"key":"12_CR16","doi-asserted-by":"crossref","unstructured":"G\u00fcera D, Delp E (2018) Deepfake video detection using recurrent neural networks. In: Proceedings international conference on advanced video and signal based surveillance","DOI":"10.1109\/AVSS.2018.8639163"},{"key":"12_CR17","doi-asserted-by":"crossref","unstructured":"Hernandez-Ortega J, Daza R, Morales A, Fierrez J, Tolosana R (2020) Heart rate estimation from face videos for student assessment: experiments on edBB. In: Proceedings IEEE computer software and applications conference","DOI":"10.1109\/COMPSAC48688.2020.00031"},{"key":"12_CR18","doi-asserted-by":"crossref","unstructured":"Hernandez-Ortega J, Fierrez J, Morales A, Diaz D (2020) A comparative evaluation of heart rate estimation methods using face videos. In: Proceedings IEEE international workshop on medical computing","DOI":"10.1109\/COMPSAC48688.2020.00-53"},{"key":"12_CR19","doi-asserted-by":"crossref","unstructured":"Hernandez-Ortega J, Fierrez J, Morales A, Galbally J (2019) Introduction to face presentation attack detection. In: Handbook of biometric anti-spoofing. Springer, pp 187\u2013206","DOI":"10.1007\/978-3-319-92627-8_9"},{"key":"12_CR20","doi-asserted-by":"crossref","unstructured":"Hernandez-Ortega J, Fierrez J, Morales A, Tome P (2018) Time analysis of pulse-based face anti-spoofing in visible and NIR. In: Proceedings IEEE conference on computer vision and pattern recognition workshops","DOI":"10.1109\/CVPRW.2018.00096"},{"key":"12_CR21","doi-asserted-by":"crossref","unstructured":"Hernandez-Ortega J, Tolosana R, Fierrez J, Morales A (2021) DeepFakesON-Phys: deepfakes detection based on heart rate estimation. AAAI\u2019s workshop on artificial intelligence safety (SafeAI) (2021)","DOI":"10.1007\/978-3-030-87664-7_12"},{"key":"12_CR22","unstructured":"Heusch G, Anjos A, Marcel S (2017) A reproducible study on remote heart rate measurement. arXiv:1709.00962"},{"key":"12_CR23","doi-asserted-by":"publisher","first-page":"83144","DOI":"10.1109\/ACCESS.2020.2988660","volume":"8","author":"T Jung","year":"2020","unstructured":"Jung T, Kim S, Kim K (2020) DeepVision: deepfakes detection using human eye blinking pattern. IEEE Access 8:83144\u201383154","journal-title":"IEEE Access"},{"key":"12_CR24","doi-asserted-by":"crossref","unstructured":"Karras T et\u00a0al (2020) Analyzing and improving the image quality of StyleGAN. In: Proceedings IEEE\/CVF conference on computer vision and patter recognition","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"12_CR25","unstructured":"Kingma DP, Welling M (2013) Auto-encoding Variational Bayes. In: Proceedings international conference on learning represent"},{"key":"12_CR26","doi-asserted-by":"crossref","unstructured":"Li Y, Chang M, Lyu S (2018) In Ictu Oculi: exposing AI generated fake face videos by detecting eye blinking. In: Proceedings IEEE international workshop information forensics and security","DOI":"10.1109\/WIFS.2018.8630787"},{"key":"12_CR27","unstructured":"Li Y, Lyu S (2019) Exposing deepfake videos by detecting face warping artifacts. In: Proceedings IEEE\/CVF conference on computer vision and pattern recognition workshops"},{"key":"12_CR28","doi-asserted-by":"crossref","unstructured":"Li Y, Yang X, Sun P, Qi H, Lyu S (2020) Celeb-DF: a large-scale challenging dataset for deepfake forensics. In: Proceedings IEEE\/CVF conference on computer vision and pattern recognition","DOI":"10.1109\/CVPR42600.2020.00327"},{"key":"12_CR29","doi-asserted-by":"crossref","unstructured":"Marcel S, Nixon M, Fierrez J, Evans N (2019) Handbook of biometric anti-spoofing, 2nd edn","DOI":"10.1007\/978-3-319-92627-8"},{"key":"12_CR30","doi-asserted-by":"crossref","unstructured":"Matern F, Riess C, Stamminger M (2019) Exploiting visual artifacts to expose deepfakes and face manipulations. In: Proceedings IEEE winter applications of computer vision workshops","DOI":"10.1109\/WACVW.2019.00020"},{"key":"12_CR31","doi-asserted-by":"crossref","unstructured":"McDuff DJ, Estepp JR, Piasecki AM, Blackford EB (2015) A survey of remote optical photoplethysmographic imaging methods. In: Proceedings annual international conference of the IEEE engineering in medicine and biology society","DOI":"10.1109\/EMBC.2015.7319857"},{"issue":"5","key":"12_CR32","doi-asserted-by":"publisher","first-page":"1038","DOI":"10.1109\/JSTSP.2020.3007250","volume":"14","author":"JC Neves","year":"2020","unstructured":"Neves JC, Tolosana R, Vera-Rodriguez R, Lopes V, Proen\u00e7a H, Fierrez J (2020) GANprintR: improved fakes and evaluation of the state of the art in face manipulation detection. IEEE J Select Top Signal Process 14(5):1038\u20131048","journal-title":"IEEE J Select Top Signal Process"},{"key":"12_CR33","doi-asserted-by":"crossref","unstructured":"Nguyen HH, Yamagishi J, Echizen I (2019) Use of a capsule network to detect fake images and videos. arXiv:1910.12467","DOI":"10.1109\/ICASSP.2019.8682602"},{"key":"12_CR34","doi-asserted-by":"crossref","unstructured":"Perera P, Fierrez J, Patel V (2020) Quickest intruder detection for multiple user active authentication. In: IEEE international conference on image processing (ICIP)","DOI":"10.1109\/ICIP40778.2020.9191244"},{"key":"12_CR35","doi-asserted-by":"crossref","unstructured":"Qi H, Guo Q, Juefei-Xu F, Xie X, Ma L, Feng W, Liu Y, Zhao J (2020) DeepRhythm: exposing deepfakes with attentional visual heartbeat rhythms. In: Proceedings ACM multimedia conference","DOI":"10.1145\/3394171.3413707"},{"key":"12_CR36","doi-asserted-by":"crossref","unstructured":"Raja K, Ferrara M, Franco A, Spreeuwers L, Batskos I, de Wit F, Gomez-Barrero M, Scherhag U, Fischer D, Venkatesh S, Singh JM, Li G, Bergeron L, Isadskiy S, Ramachandra R, Rathgeb C, Frings D, Seidel U, Knopjes F, Veldhuis R, Maltoni D, Busch C (2020) Morphing attack detection-database. Evaluation platform and benchmarking. IEEE Trans Inf Forensics Secur","DOI":"10.1109\/TIFS.2020.3035252"},{"key":"12_CR37","doi-asserted-by":"crossref","unstructured":"Ranjan R, Patel VM, Chellappa R (2017) Hyperface: a deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition. IEEE Trans Pattern Anal Mach Intell 41(1):121\u2013135","DOI":"10.1109\/TPAMI.2017.2781233"},{"key":"12_CR38","doi-asserted-by":"publisher","first-page":"224958","DOI":"10.1109\/ACCESS.2020.3044723","volume":"8","author":"C Rathgeb","year":"2020","unstructured":"Rathgeb C, Drozdowski P, Busch C (2020) Makeup presentation attacks: review and detection performance benchmark. IEEE Access 8:224958\u2013224973","journal-title":"IEEE Access"},{"key":"12_CR39","doi-asserted-by":"crossref","unstructured":"Rathgeb C, Drozdowski P, Busch C (2021) Detection of makeup presentation attacks based on deep face representations. In: Proceedings international conference on pattern recognition","DOI":"10.1109\/ICPR48806.2021.9413347"},{"key":"12_CR40","doi-asserted-by":"crossref","unstructured":"R\u00f6ssler A, Cozzolino D, Verdoliva L, Riess C, Thies J, Nie\u00dfner M (2019) FaceForensics++: learning to detect manipulated facial images. In: Proceedings IEEE\/CVF international conference on computer vision","DOI":"10.1109\/ICCV.2019.00009"},{"key":"12_CR41","unstructured":"Sabir E, Cheng J, Jaiswal A, AbdAlmageed W, Masi I, Natarajan P (2019) Recurrent convolutional strategies for face manipulation detection in videos. In: Proceedings IEEE\/CVF conference on computer vision and pattern recognition workshops"},{"key":"12_CR42","unstructured":"Soukupova T, Cech J (2016) Real-time eye blink detection using facial landmarks. In: Proceedings computer vision winter workshop"},{"key":"12_CR43","doi-asserted-by":"crossref","unstructured":"Sun K, Liu H, Ye Q, Liu J, Gao Y, Shao L, Ji R (2021) Domain general face forgery detection by learning to weight. In: Proceedings AAAI conference on artificial intelligence","DOI":"10.1609\/aaai.v35i3.16367"},{"key":"12_CR44","doi-asserted-by":"crossref","unstructured":"Tan D, Nijholt A (2010) Brain-computer interfaces and human-computer interaction. In: Brain-computer interfaces. Springer, pp 3\u201319","DOI":"10.1007\/978-1-84996-272-8_1"},{"key":"12_CR45","doi-asserted-by":"crossref","unstructured":"Tolosana R, Romero-Tapiador S, Fierrez J, Vera-Rodriguez R (2020) DeepFakes evolution: analysis of facial regions and fake detection performance. In: Proceedings international conference on pattern recognition workshops","DOI":"10.1007\/978-3-030-68821-9_38"},{"key":"12_CR46","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1016\/j.inffus.2020.06.014","volume":"64","author":"R Tolosana","year":"2020","unstructured":"Tolosana R, Vera-Rodriguez R, Fierrez J, Morales A, Ortega-Garcia J (2020) DeepFakes and beyond: a survey of face manipulation and fake detection. Inf Fusion 64:131\u2013148","journal-title":"Inf Fusion"},{"key":"12_CR47","doi-asserted-by":"crossref","unstructured":"Trinh L, Tsang M, Rambhatla S, Liu Y (2021) Interpretable and trustworthy deepfake detection via dynamic prototypes. In: Proceedings IEEE\/CVF winter conference on applications of computer vision (WACV), pp 1973\u20131983","DOI":"10.1109\/WACV48630.2021.00202"},{"key":"12_CR48","doi-asserted-by":"crossref","unstructured":"Yang X, Li Y, Lyu S (2019) Exposing deep fakes using inconsistent head poses. In: Proceedings IEEE international conference on acoustics, speech and signal processing","DOI":"10.1109\/ICASSP.2019.8683164"}],"container-title":["Advances in Computer Vision and Pattern Recognition","Handbook of Digital Face Manipulation and Detection"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-87664-7_12","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,27]],"date-time":"2024-01-27T16:05:59Z","timestamp":1706371559000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-87664-7_12"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"ISBN":["9783030876630","9783030876647"],"references-count":48,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-87664-7_12","relation":{},"ISSN":["2191-6586","2191-6594"],"issn-type":[{"value":"2191-6586","type":"print"},{"value":"2191-6594","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022]]},"assertion":[{"value":"31 January 2022","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}}]}}