{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,4,9]],"date-time":"2025-04-09T16:13:55Z","timestamp":1744215235156,"version":"3.40.3"},"publisher-location":"Cham","reference-count":65,"publisher":"Springer International Publishing","isbn-type":[{"type":"print","value":"9783030876630"},{"type":"electronic","value":"9783030876647"}],"license":[{"start":{"date-parts":[[2022,1,1]],"date-time":"2022-01-01T00:00:00Z","timestamp":1640995200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T00:00:00Z","timestamp":1643587200000},"content-version":"vor","delay-in-days":30,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>AI-synthesized face-swapping videos, commonly known as <jats:italic>DeepFakes<\/jats:italic>, is an emerging problem threatening the trustworthiness of online information. The need to develop and evaluate DeepFake detection\u00a0algorithms calls for large-scale datasets. However, current DeepFake datasets suffer from low visual quality and do not resemble DeepFake\u00a0videos circulated on the Internet. We present a new large-scale challenging DeepFake video dataset, <jats:italic>Celeb-DF<\/jats:italic>, which contains 5,\u00a0639 high-quality DeepFake\u00a0videos of celebrities generated using an improved synthesis process. We conduct a comprehensive evaluation of DeepFake detection\u00a0methods and datasets to demonstrate the escalated level of challenges posed by Celeb-DF. Then we introduce <jats:italic>Landmark Breaker<\/jats:italic>, the first dedicated method to disrupt facial landmark\u00a0extraction, and apply it to the obstruction of the generation of DeepFake\u00a0videos. The experiments are conducted on three state-of-the-art facial landmark\u00a0extractors using our Celeb-DF\u00a0dataset.<\/jats:p>","DOI":"10.1007\/978-3-030-87664-7_4","type":"book-chapter","created":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T09:03:06Z","timestamp":1643619786000},"page":"71-96","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Toward the\u00a0Creation and\u00a0Obstruction of\u00a0DeepFakes"],"prefix":"10.1007","author":[{"given":"Yuezun","family":"Li","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pu","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Honggang","family":"Qi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siwei","family":"Lyu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,1,31]]},"reference":[{"key":"4_CR1","doi-asserted-by":"crossref","unstructured":"Afchar D, Nozick V, Yamagishi J, Echizen I (2018) Mesonet: a compact facial video forgery detection network. In: WIFS","DOI":"10.1109\/WIFS.2018.8630761"},{"key":"4_CR2","unstructured":"Agarwal S, Farid H, Gu Y, He M, Nagano K, Li H (2019) Protecting world leaders against deep fakes. In: IEEE conference on computer vision and pattern recognition workshops (CVPRW)"},{"key":"4_CR3","doi-asserted-by":"crossref","unstructured":"Arnab A, Miksik O, Torr PH (2018) On the robustness of semantic segmentation models to adversarial attacks. In: CVPR","DOI":"10.1109\/CVPR.2018.00099"},{"key":"4_CR4","doi-asserted-by":"crossref","unstructured":"Baluja S, Fischer I (2018) Learning to attack: Adversarial transformation networks. In: AAAI","DOI":"10.1609\/aaai.v32i1.11672"},{"key":"4_CR5","doi-asserted-by":"crossref","unstructured":"Bappy JH, Simons C, Nataraj L, Manjunath B, Roy-Chowdhury AK (2019) Hybrid lstm and encoder-decoder architecture for detection of image forgeries. IEEE Trans Image Process (TIP)","DOI":"10.1109\/TIP.2019.2895466"},{"key":"4_CR6","doi-asserted-by":"crossref","unstructured":"Bitouk D, Kumar N, Dhillon S, Belhumeur P, Nayar SK (2008) Face swapping: automatically replacing faces in photographs. ACM Trans Graph (TOG)","DOI":"10.1145\/1399504.1360638"},{"key":"4_CR7","doi-asserted-by":"crossref","unstructured":"Bulat A, Tzimiropoulos G (2017) How far are we from solving the 2d & 3d face alignment problem? (and a dataset of 230,000 3d facial landmarks). In: ICCV","DOI":"10.1109\/ICCV.2017.116"},{"key":"4_CR8","doi-asserted-by":"crossref","unstructured":"Chan C, Ginosar S, Zhou T, Efros AA (2019) Everybody dance now. In: ICCV","DOI":"10.1109\/ICCV.2019.00603"},{"key":"4_CR9","doi-asserted-by":"crossref","unstructured":"Chen ST, Cornelius C, Martin J, Chau DH (2018) Robust physical adversarial attack on faster r-cnn object detector. arXiv:180405810","DOI":"10.1007\/978-3-030-10925-7_4"},{"key":"4_CR10","doi-asserted-by":"crossref","unstructured":"Chesney R, Citron DK (2018) Deep fakes: a looming challenge for privacy, democracy, and national security. 107 California Law Review (2019, Forthcoming); U of Texas Law, Public Law Research Paper No 692; U of Maryland Legal Studies Research Paper No 2018-21","DOI":"10.2139\/ssrn.3213954"},{"key":"4_CR11","doi-asserted-by":"crossref","unstructured":"Dale K, Sunkavalli K, Johnson MK, Vlasic D, Matusik W, Pfister H (2011) Video face replacement. ACM Trans Graph (TOG)","DOI":"10.1145\/2024156.2024164"},{"key":"4_CR12","unstructured":"Dolhansky B, Howes R, Pflaum B, Baram N, Ferrer CC (2019) The deepfake detection challenge (DFDC) preview dataset. arXiv:191008854"},{"key":"4_CR13","doi-asserted-by":"crossref","unstructured":"Dong Y, Liao F, Pang T, Su H, Zhu J, Hu X, Li J (2018) Boosting adversarial attacks with momentum. In: CVPR","DOI":"10.1109\/CVPR.2018.00957"},{"key":"4_CR14","unstructured":"Dufour N, Gully A, Karlsson P, Vorbyov AV, Leung T, Childs J, Bregler C (2019-09) Deepfakes detection dataset by google & jigsaw"},{"key":"4_CR15","unstructured":"Farid H (2012) Digital image forensics. MIT Press"},{"key":"4_CR16","unstructured":"Fischer V, Kumar MC, Metzen JH, Brox T (2017) Adversarial examples for semantic image segmentation. arXiv:170301101"},{"key":"4_CR17","unstructured":"Goodfellow IJ, Shlens J, Szegedy C (2015) Explaining and harnessing adversarial examples. In: ICLR"},{"key":"4_CR18","doi-asserted-by":"crossref","unstructured":"G\u00fcera D, Delp EJ (2018) Deepfake video detection using recurrent neural networks. In: AVSS","DOI":"10.1109\/AVSS.2018.8639163"},{"key":"4_CR19","doi-asserted-by":"crossref","unstructured":"Hu T, Qi H, Xu J, Huang Q (2018) Facial landmarks detection by self-iterative regression based landmarks-attention network. In: AAAI","DOI":"10.1609\/aaai.v32i1.12275"},{"key":"4_CR20","unstructured":"Karras T, Aila T, Laine S, Lehtinen J (2018) Progressive growing of GANs for improved quality, stability, and variation. In: ICLR"},{"key":"4_CR21","doi-asserted-by":"crossref","unstructured":"Karras T, Laine S, Aila T (2019) A style-based generator architecture for generative adversarial networks. In: CVPR","DOI":"10.1109\/CVPR.2019.00453"},{"key":"4_CR22","doi-asserted-by":"crossref","unstructured":"Kazemi V, Sullivan J (2014) One millisecond face alignment with an ensemble of regression trees. In: CVPR","DOI":"10.1109\/CVPR.2014.241"},{"key":"4_CR23","doi-asserted-by":"crossref","unstructured":"Kim H, Garrido P, Tewari A, Xu W, Thies J, Nie\u00dfner N, P\u00e9rez P, Richardt C, Zollh\u00f6fer M, Theobalt C (2018) Deep video portraits. ACM Trans Graph 2018 (TOG)","DOI":"10.1145\/3197517.3201283"},{"key":"4_CR24","unstructured":"King DE (2009) Dlib-ml: A machine learning toolkit. JMLR"},{"key":"4_CR25","unstructured":"Kingma DP, Welling M (2014) Auto-encoding variational bayes. In: ICLR"},{"key":"4_CR26","unstructured":"Korshunov P, Marcel S (2018) Deepfakes: a new threat to face recognition? assessment and detection. arXiv:181208685"},{"key":"4_CR27","doi-asserted-by":"crossref","unstructured":"Korshunova I, Shi W, Dambre J, Theis L (2017) Fast face-swap using convolutional neural networks. In: ICCV","DOI":"10.1109\/ICCV.2017.397"},{"key":"4_CR28","unstructured":"Kurakin A, Goodfellow I, Bengio S (2017) Adversarial machine learning at scale. In: ICLR"},{"key":"4_CR29","unstructured":"Li Y, Lyu S (2019) Exposing deepfake videos by detecting face warping artifacts. In: CVPR Workshops"},{"key":"4_CR30","doi-asserted-by":"crossref","unstructured":"Li Y, Chang MC, Lyu S (2018) In ictu oculi: exposing AI generated fake face videos by detecting eye blinking. In: WIFS","DOI":"10.1109\/WIFS.2018.8630787"},{"key":"4_CR31","doi-asserted-by":"crossref","unstructured":"Li Y, Yang X, Sun P, Qi H, Lyu S (2020) Celeb-df: a large-scale challenging dataset for deepfake forensics. In: CVPR","DOI":"10.1109\/CVPR42600.2020.00327"},{"key":"4_CR32","unstructured":"Liu MY, Breuel T, Kautz J (2017) Unsupervised image-to-image translation networks. In: NeurIPS"},{"key":"4_CR33","doi-asserted-by":"crossref","unstructured":"Liu Y, Guan Q, Zhao X, Cao Y (2018) Image forgery localization based on multi-scale convolutional neural networks. In: ACM workshop on information hiding and multimedia security (IHMMSec)","DOI":"10.1145\/3206004.3206010"},{"key":"4_CR34","doi-asserted-by":"crossref","unstructured":"Luo B, Liu Y, Wei L, Xu Q (2018) Towards imperceptible and robust adversarial example attacks against neural networks. In: AAAI","DOI":"10.1609\/aaai.v32i1.11499"},{"key":"4_CR35","unstructured":"Luo Y, Boix X, Roig G, Poggio T, Zhao Q (2015) Foveation-based mechanisms alleviate adversarial examples. arXiv:151106292"},{"key":"4_CR36","doi-asserted-by":"crossref","unstructured":"Ma L, Jia X, Sun Q, Schiele B, Tuytelaars T, Van\u00a0Gool L (2017) Pose guided person image generation. In: NeurIPS","DOI":"10.1109\/CVPR.2018.00018"},{"key":"4_CR37","doi-asserted-by":"crossref","unstructured":"Matern F, Riess C, Stamminger M (2019) Exploiting visual artifacts to expose deepfakes and face manipulations. In: WACV Workshops","DOI":"10.1109\/WACVW.2019.00020"},{"key":"4_CR38","doi-asserted-by":"crossref","unstructured":"Moosavi-Dezfooli SM, Fawzi A, Frossard P (2016) Deepfool: a simple and accurate method to fool deep neural networks. In: CVPR","DOI":"10.1109\/CVPR.2016.282"},{"key":"4_CR39","doi-asserted-by":"crossref","unstructured":"Moosavi-Dezfooli SM, Fawzi A, Fawzi O, Frossard P (2017) Universal adversarial perturbations. In: CVPR","DOI":"10.1109\/CVPR.2017.17"},{"key":"4_CR40","doi-asserted-by":"crossref","unstructured":"Nguyen HH, Fang F, Yamagishi J, Echizen I (2019) Multi-task learning for detecting and segmenting manipulated facial images and videos. In: IEEE international conference on biometrics: theory, applications and systems (BTAS)","DOI":"10.1109\/BTAS46853.2019.9185974"},{"key":"4_CR41","doi-asserted-by":"crossref","unstructured":"Nguyen HH, Yamagishi J, Echizen I (2019) Capsule-forensics: using capsule networks to detect forged images and videos. In: IEEE international conference on acoustics, speech and signal processing (ICASSP)","DOI":"10.1109\/ICASSP.2019.8682602"},{"key":"4_CR42","doi-asserted-by":"crossref","unstructured":"Nguyen HH, Yamagishi J, Echizen I (2019) Use of a capsule network to detect fake images and videos. arXiv:191012467","DOI":"10.1109\/ICASSP.2019.8682602"},{"key":"4_CR43","doi-asserted-by":"crossref","unstructured":"Papernot N, McDaniel P, Jha S, Fredrikson M, Celik ZB, Swami A (2016) The limitations of deep learning in adversarial settings. In: EuroS&P","DOI":"10.1109\/EuroSP.2016.36"},{"key":"4_CR44","unstructured":"Pham HX, Wang Y, Pavlovic V (2018) Generative adversarial talking head: bringing portraits to life with a weakly supervised neural network. arXiv:180307716"},{"key":"4_CR45","doi-asserted-by":"crossref","unstructured":"Qian S, Sun K, Wu W, Qian C, Jia J (2019) Aggregation via separation: boosting facial landmark detector with semi-supervised style translation. In: ICCV","DOI":"10.1109\/ICCV.2019.01025"},{"key":"4_CR46","doi-asserted-by":"crossref","unstructured":"Reinhard E, Adhikhmin M, Gooch B, Shirley P (2001) Color transfer between images. IEEE Comput Graph Appl","DOI":"10.1109\/38.946629"},{"key":"4_CR47","doi-asserted-by":"crossref","unstructured":"R\u00f6ssler A, Cozzolino D, Verdoliva L, Riess C, Thies J, Nie\u00dfner M (2019) FaceForensics++: learning to detect manipulated facial images. In: ICCV","DOI":"10.1109\/ICCV.2019.00009"},{"key":"4_CR48","unstructured":"Sabir E, Cheng J, Jaiswal A, AbdAlmageed W, Masi I, Natarajan P (2019) Recurrent-convolution approach to deepfake detection-state-of-art results on faceforensics++. arXiv:190500582"},{"key":"4_CR49","doi-asserted-by":"crossref","unstructured":"Sanderson C, Lovell BC (2009) Multi-region probabilistic histograms for robust and scalable identity inference. In: International conference on biometrics","DOI":"10.1007\/978-3-642-01793-3_21"},{"key":"4_CR50","doi-asserted-by":"crossref","unstructured":"Sun K, Xiao B, Liu D, Wang J (2019) Deep high-resolution representation learning for human pose estimation. In: CVPR","DOI":"10.1109\/CVPR.2019.00584"},{"key":"4_CR51","doi-asserted-by":"crossref","unstructured":"Sun Q, Ma L, Joon\u00a0Oh S, Van\u00a0Gool L, Schiele B, Fritz M (2018) Natural and effective obfuscation by head inpainting. In: CVPR","DOI":"10.1109\/CVPR.2018.00530"},{"key":"4_CR52","doi-asserted-by":"crossref","unstructured":"Suwajanakorn S, Seitz SM, Kemelmacher-Shlizerman I (2015) What makes tom hanks look like tom hanks. In: ICCV","DOI":"10.1109\/ICCV.2015.450"},{"key":"4_CR53","doi-asserted-by":"crossref","unstructured":"Suwajanakorn S, Seitz SM, Kemelmacher-Shlizerman I (2017) Synthesizing obama: learning lip sync from audio. ACM Trans Graph (TOG)","DOI":"10.1145\/3072959.3073640"},{"key":"4_CR54","unstructured":"Szegedy C, Zaremba W, Sutskever I, Bruna J, Erhan D, Goodfellow I, Fergus R (2014) Intriguing properties of neural networks. In: ICLR"},{"key":"4_CR55","doi-asserted-by":"crossref","unstructured":"Thies J, Zollhofer M, Stamminger M, Theobalt C, Niessner M (2016) Face2face: real-time face capture and reenactment of rgb videos. In: CVPR","DOI":"10.1109\/CVPR.2016.262"},{"key":"4_CR56","doi-asserted-by":"crossref","unstructured":"Thies J, Zollh\u00f6fer M, Nie\u00dfner M (2019) Deferred neural rendering: image synthesis using neural textures. In: SIGGRAPH","DOI":"10.1145\/3306346.3323035"},{"key":"4_CR57","doi-asserted-by":"crossref","unstructured":"Wang Z, Bovik AC, Sheikh HR, Simoncelli EP, et\u00a0al. (2004) Image quality assessment: from error visibility to structural similarity. TIP","DOI":"10.1109\/TIP.2003.819861"},{"key":"4_CR58","doi-asserted-by":"crossref","unstructured":"Wu W, Qian C, Yang S, Wang Q, Cai Y, Zhou Q (2018) Look at boundary: a boundary-aware face alignment algorithm. In: CVPR","DOI":"10.1109\/CVPR.2018.00227"},{"key":"4_CR59","doi-asserted-by":"crossref","unstructured":"Xie C, Wang J, Zhang Z, Zhou Y, Xie L, Yuille A (2017) Adversarial examples for semantic segmentation and object detection. In: ICCV","DOI":"10.1109\/ICCV.2017.153"},{"key":"4_CR60","doi-asserted-by":"crossref","unstructured":"Xie C, Zhang Z, Zhou Y, Bai S, Wang J, Ren Z, Yuille AL (2019) Improving transferability of adversarial examples with input diversity. In: CVPR","DOI":"10.1109\/CVPR.2019.00284"},{"key":"4_CR61","doi-asserted-by":"crossref","unstructured":"Yang X, Li Y, Lyu S (2019) Exposing deep fakes using inconsistent head poses. In: ICASSP","DOI":"10.1109\/ICASSP.2019.8683164"},{"key":"4_CR62","doi-asserted-by":"crossref","unstructured":"Zeng X, Liu C, Wang YS, Qiu W, Xie L, Tai YW, Tang CK, Yuille AL (2019) Adversarial attacks beyond the image space. In: CVPR","DOI":"10.1109\/CVPR.2019.00443"},{"key":"4_CR63","doi-asserted-by":"crossref","unstructured":"Zhou P, Han X, Morariu VI, Davis LS (2017) Two-stream neural networks for tampered face detection. In: IEEE conference on computer vision and pattern recognition workshops (CVPRW)","DOI":"10.1109\/CVPRW.2017.229"},{"key":"4_CR64","doi-asserted-by":"crossref","unstructured":"Zhou P, Han X, Morariu VI, Davis LS (2018) Learning rich features for image manipulation detection. In: CVPR","DOI":"10.1109\/CVPR.2018.00116"},{"key":"4_CR65","doi-asserted-by":"crossref","unstructured":"Zou X, Zhong S, Yan L, Zhao X, Zhou J, Wu Y (2019) Learning robust facial landmark detection via hierarchical structured ensemble. In: ICCV","DOI":"10.1109\/ICCV.2019.00023"}],"container-title":["Advances in Computer Vision and Pattern Recognition","Handbook of Digital Face Manipulation and Detection"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-87664-7_4","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,27]],"date-time":"2024-01-27T16:03:09Z","timestamp":1706371389000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/978-3-030-87664-7_4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022]]},"ISBN":["9783030876630","9783030876647"],"references-count":65,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-87664-7_4","relation":{},"ISSN":["2191-6586","2191-6594"],"issn-type":[{"type":"print","value":"2191-6586"},{"type":"electronic","value":"2191-6594"}],"subject":[],"published":{"date-parts":[[2022]]},"assertion":[{"value":"31 January 2022","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}}]}}