{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,11]],"date-time":"2026-07-11T17:28:41Z","timestamp":1783790921972,"version":"3.55.0"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,2,5]],"date-time":"2024-02-05T00:00:00Z","timestamp":1707091200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62072390, 62102334, 92270123"],"award-info":[{"award-number":["62072390, 62102334, 92270123"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Research Grants Council, Hong Kong SAR, China","award":["15218919, 15203120, 15226221, 15225921, 15209922, C2004-21GF"],"award-info":[{"award-number":["15218919, 15203120, 15226221, 15225921, 15209922, C2004-21GF"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Priv. Secur."],"published-print":{"date-parts":[[2024,2,29]]},"abstract":"<jats:p>With the rapid growth of DeepFake video techniques, it becomes increasingly challenging to identify them visually, posing a huge threat to our society. Unfortunately, existing detection schemes are limited to exploiting the artifacts left by DeepFake manipulations, so they struggle to keep pace with the ever-improving DeepFake models. In this work, we propose DeepMark, a scalable and robust framework for detecting DeepFakes. It imprints essential visual features of a video into DeepMark Meta (DMM) and uses it to detect DeepFake manipulations by comparing the extracted visual features with the ground truth in DMM. Therefore, DeepMark is future-proof, because a DeepFake video must aim to alter some visual feature, no matter how \u201cnatural\u201d it looks. Furthermore, DMM also contains a signature for verifying the integrity of the above features. And an essential link to the features as well as their signature is attached with error correction codes and embedded in the video watermark. To improve the efficiency of DMM creation, we also present a threshold-based feature selection scheme and a deduced face detection scheme. Experimental results demonstrate the effectiveness and efficiency of DeepMark on DeepFake video detection under various datasets and parameter settings.<\/jats:p>\n          <jats:p\/>","DOI":"10.1145\/3629976","type":"journal-article","created":{"date-parts":[[2023,11,2]],"date-time":"2023-11-02T04:40:52Z","timestamp":1698900052000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["DeepMark: A Scalable and Robust Framework for DeepFake Video Detection"],"prefix":"10.1145","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0123-1364","authenticated-orcid":false,"given":"Li","family":"Tang","sequence":"first","affiliation":[{"name":"Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1547-2847","authenticated-orcid":false,"given":"Qingqing","family":"Ye","sequence":"additional","affiliation":[{"name":"Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9008-2112","authenticated-orcid":false,"given":"Haibo","family":"Hu","sequence":"additional","affiliation":[{"name":"Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5523-3918","authenticated-orcid":false,"given":"Qiao","family":"Xue","sequence":"additional","affiliation":[{"name":"Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4205-677X","authenticated-orcid":false,"given":"Yaxin","family":"Xiao","sequence":"additional","affiliation":[{"name":"Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0385-8793","authenticated-orcid":false,"given":"Jin","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Artificial Intelligence and Blockchain, Guangzhou University, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,2,5]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00152"},{"key":"e_1_3_3_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01495"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0019-9958(60)90287-4"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(96)00142-2"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/2723372.2747649"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413630"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2008.918801"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01483"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00582"},{"key":"e_1_3_3_11_2","article-title":"ffmpeg tool (Version be1d324)[Software]","author":"Developers FFmpeg","year":"2016","unstructured":"FFmpeg Developers. 2016. ffmpeg tool (Version be1d324)[Software]. Retrieved from http:\/\/ffmpeg.org","journal-title":"R"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2021.3098422"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2904018"},{"key":"e_1_3_3_14_2","unstructured":"FaceApp. [n.d.]. Retrieved from https:\/\/www.faceapp.com"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3536426"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475508"},{"key":"e_1_3_3_17_2","unstructured":"Zhihao Gu Yang Chen Taiping Yao Shouhong Ding Jilin Li and Lizhuang Ma. 2022. Delving into the local: Dynamic inconsistency learning for DeepFake video detection. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_3_18_2","article-title":"Building an invisible shield for your portrait against DeepFakes","author":"Guan Jiazhi","year":"2023","unstructured":"Jiazhi Guan, Tianshu Hu, Hang Zhou, Zhizhi Guo, Lirui Deng, Chengbin Quan, Errui Ding, and Youjian Zhao. 2023. Building an invisible shield for your portrait against DeepFakes. Retrieved from https:\/\/arXiv:2305.12881","journal-title":"R"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW50498.2020.00341"},{"key":"e_1_3_3_20_2","first-page":"147","article-title":"Codes correcteurs d\u2019erreurs","volume":"2","author":"Hocquenghem Alexis","year":"1959","unstructured":"Alexis Hocquenghem. 1959. Codes correcteurs d\u2019erreurs. Chiffers 2 (1959), 147\u2013156.","journal-title":"Chiffers"},{"key":"e_1_3_3_21_2","first-page":"1312","volume-title":"Proceedings of the IEEE 29th International Conference on Data Engineering (ICDE)","author":"Hu Haibo","year":"2013","unstructured":"Haibo Hu, Qian Chen, and Jianliang Xu. 2013. VERDICT: Privacy-preserving authentication of range queries in location-based services. In Proceedings of the IEEE 29th International Conference on Data Engineering (ICDE). IEEE, 1312\u20131315."},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICDE.2014.6816687"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i1.19982"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3531225"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475324"},{"key":"e_1_3_3_26_2","first-page":"1695","volume-title":"Proceedings of the International Conference on Image Processing (ICIP\u201904)","volume":"3","author":"Joo In-Hak","year":"2004","unstructured":"In-Hak Joo, Tae-Hyun Hwang, and Kyung-Ho Choi. 2004. Generation of video metadata supporting video-GIS integration. In Proceedings of the International Conference on Image Processing (ICIP\u201904), Vol. 3. IEEE, 1695\u20131698."},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.5555\/1577069.1755843"},{"key":"e_1_3_3_28_2","first-page":"1428","volume-title":"Proceedings of the 27th ACM International Conference on Multimedia","author":"Prajwal K. R.","year":"2019","unstructured":"K. R. Prajwal, Rudrabha Mukhopadhyay, Jerin Philip, Abhishek Jha, Vinay Namboodiri, and C. V. Jawahar. 2019. Toward automatic face-to-face translation. In Proceedings of the 27th ACM International Conference on Multimedia. 1428\u20131436."},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01586"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00505"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3414034"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/WIFS.2018.8630787"},{"key":"e_1_3_3_33_2","article-title":"Exposing DeepFake videos by detecting face warping artifacts","author":"Li Yuezun","year":"2018","unstructured":"Yuezun Li and Siwei Lyu. 2018. Exposing DeepFake videos by detecting face warping artifacts. Retrieved from https:\/\/arXiv:1811.00656","journal-title":"R"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00327"},{"key":"e_1_3_3_35_2","first-page":"140","volume-title":"Security and Watermarking of Multimedia Contents II","author":"Lin Ching-Yung","year":"2000","unstructured":"Ching-Yung Lin and Shih-Fu Chang. 2000. Semifragile watermarking for authenticating JPEG visual content. In Security and Watermarking of Multimedia Contents II, Vol. 3971. SPIE, 140\u2013151."},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2013.137"},{"key":"e_1_3_3_37_2","article-title":"TCSD: Triple complementary streams detector for comprehensive DeepFake detection","author":"Liu Xiaolong","year":"2022","unstructured":"Xiaolong Liu, Yang Yu, Xiaolong Li, Yao Zhao, and Guodong Guo. 2022. TCSD: Triple complementary streams detector for comprehensive DeepFake detection. ACM Trans. Multimedia Comput., Commun. Appl. (2022).","journal-title":"ACM Trans. Multimedia Comput., Commun. Appl."},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.425"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/1201730.1201736"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2005.861293"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3064645"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58571-6_39"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3425780"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-019-09926-y"},{"key":"e_1_3_3_45_2","article-title":"DeepFaceLab: Integrated, flexible and extensible face-swapping framework","author":"Perov Ivan","year":"2020","unstructured":"Ivan Perov, Daiheng Gao, Nikolay Chervoniy, Kunlin Liu, Sugasa Marangonda, Chris Um\u00e9, Mr. Dpfks, Carl Shift Facenheim, Luis RP, Jian Jiang et\u00a0al. 2020. DeepFaceLab: Integrated, flexible and extensible face-swapping framework. Retrieved from https:\/\/arXiv:2005.05535","journal-title":"R"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413532"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491199"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1137\/0108018"},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00009"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-66823-5_14"},{"issue":"1","key":"e_1_3_3_51_2","first-page":"1","article-title":"Analysis of reflexive eye movements for fast replay-resistant biometric authentication","volume":"22","author":"Sluganovic Ivo","year":"2018","unstructured":"Ivo Sluganovic, Marc Roeschlin, Kasper B. Rasmussen, and Ivan Martinovic. 2018. Analysis of reflexive eye movements for fast replay-resistant biometric authentication. ACM Trans. Privacy Secur. 22, 1 (2018), 1\u201330.","journal-title":"ACM Trans. Privacy Secur."},{"key":"e_1_3_3_52_2","article-title":"A convolutional LSTM based residual network for DeepFake video detection","author":"Tariq Shahroz","year":"2020","unstructured":"Shahroz Tariq, Sangyup Lee, and Simon S. Woo. 2020. A convolutional LSTM based residual network for DeepFake video detection. Retrieved from https:\/\/arXiv:2009.07480","journal-title":"Retrieved from https:\/\/arXiv:2009.07480"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/2929464.2929475"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475518"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00872"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01450"},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/3408299"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2016.2520091"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2017.2773541"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1145\/3183713.3183741"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2019.8683164"},{"key":"e_1_3_3_62_2","article-title":"FaceGuard: Proactive DeepFake detection","author":"Yang Yuankun","year":"2021","unstructured":"Yuankun Yang, Chenyue Liang, Hongyu He, Xiaoyu Cao, and Neil Zhenqiang Gong. 2021. FaceGuard: Proactive DeepFake detection. Retrieved from https:\/\/arXiv:2109.05673","journal-title":"R"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3499026"},{"key":"e_1_3_3_64_2","article-title":"Robust invisible video watermarking with attention","author":"Zhang Kevin Alex","year":"2019","unstructured":"Kevin Alex Zhang, Lei Xu, Alfredo Cuesta-Infante, and Kalyan Veeramachaneni. 2019. Robust invisible video watermarking with attention. Retrieved from https:\/\/arXiv:1909.01285","journal-title":"R"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01475"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01267-0_40"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1145\/3394171.3413769"}],"container-title":["ACM Transactions on Privacy and Security"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3629976","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3629976","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T23:57:00Z","timestamp":1750291020000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3629976"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,5]]},"references-count":66,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,2,29]]}},"alternative-id":["10.1145\/3629976"],"URL":"https:\/\/doi.org\/10.1145\/3629976","relation":{},"ISSN":["2471-2566","2471-2574"],"issn-type":[{"value":"2471-2566","type":"print"},{"value":"2471-2574","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,5]]},"assertion":[{"value":"2023-03-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-10-19","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}