{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T07:17:46Z","timestamp":1782890266320,"version":"3.54.5"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2025,1,10]],"date-time":"2025-01-10T00:00:00Z","timestamp":1736467200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004541","name":"Ministry of Education, Government of India","doi-asserted-by":"crossref","award":["2102743"],"award-info":[{"award-number":["2102743"]}],"id":[{"id":"10.13039\/501100004541","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2025,2,28]]},"abstract":"<jats:p>\n            In Deep Learning (DL), an adversary creates Deepfakes by manipulating facial features to fool someone. The Deepfakes pose a security threat to anyone\u2019s privacy and a primary concern for our society. It can be detected by utilizing the texture and physiological properties of the face, like eye and lip movements; however, such methods are incompetent when Deepfakes are created using recent Generative Adversarial Networks (GAN). Alternatively, Remote Photoplethysmography (rPPG) information can be used for Deepfake detection because GANs neglect human physiological information for Deepfake generation. Such detection can be inaccurate when rPPG signals are affected by the noises induced by facial deformation and illumination variations. Furthermore, the exiting Deepfake detections are usually performed using sequential models, and such models fail to process the long sequence of temporal information. These issues are mitigated by our proposed method\n            <jats:italic>AVENUE<\/jats:italic>\n            , that is,\n            <jats:inline-formula content-type=\"math\/tex\">\n              <jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\(A\\)<\/jats:tex-math>\n            <\/jats:inline-formula>\n            no\n            <jats:inline-formula content-type=\"math\/tex\">\n              <jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\(V\\)<\/jats:tex-math>\n            <\/jats:inline-formula>\n            el d\n            <jats:inline-formula content-type=\"math\/tex\">\n              <jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\(E\\)<\/jats:tex-math>\n            <\/jats:inline-formula>\n            epfake detectio\n            <jats:inline-formula content-type=\"math\/tex\">\n              <jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\(N\\)<\/jats:tex-math>\n            <\/jats:inline-formula>\n            method based on temporal convol\n            <jats:inline-formula content-type=\"math\/tex\">\n              <jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\(U\\)<\/jats:tex-math>\n            <\/jats:inline-formula>\n            tion n\n            <jats:inline-formula content-type=\"math\/tex\">\n              <jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\(E\\)<\/jats:tex-math>\n            <\/jats:inline-formula>\n            twork and rPPG information. For mitigating the noise issues in the rPPG signals, the proposed method detects and employs relatively stable clips of the input video for Deepfake detection. The stable clips are those clips that are least affected by facial deformations. Also, we use a modified Temporal convolutional network to model the long sequence of Deepfake information rather than the sequential architectures. We performed the experimental result on publicly available datasets of Deepfake videos. It demonstrates that our proposed method performs better than the existing rPPG-based Deepfake detection methods.\n          <\/jats:p>","DOI":"10.1145\/3702232","type":"journal-article","created":{"date-parts":[[2024,10,28]],"date-time":"2024-10-28T16:55:51Z","timestamp":1730134551000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["AVENUE: A Novel Deepfake Detection Method Based on Temporal Convolutional Network and rPPG Information"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1403-3359","authenticated-orcid":false,"given":"Lokendra","family":"Birla","sequence":"first","affiliation":[{"name":"Indian Institute of Technology Indore, Indore, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3052-1689","authenticated-orcid":false,"given":"Trishna","family":"Saikia","sequence":"additional","affiliation":[{"name":"Indian Institute of Technology Indore, Indore, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3586-9315","authenticated-orcid":false,"given":"Puneet","family":"Gupta","sequence":"additional","affiliation":[{"name":"Indian Institute of Technology Indore, Indore, India"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,1,10]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00152"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2021.3129714"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","unstructured":"Shaojie Bai J. Zico Kolter and Vladlen Koltun. 2018. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv:1803.01271. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.1803.01271","DOI":"10.48550\/arXiv.1803.01271"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2017.09.003"},{"key":"e_1_3_2_6_2","first-page":"137","article-title":"Efficient algorithms for k maximum sums","author":"Bengtsson Fredrik","year":"2004","unstructured":"Fredrik Bengtsson and Jingsen Chen. 2004. Efficient algorithms for k maximum sums. In International Symposium on Algorithms and Computation, 137\u2013148.","journal-title":"International Symposium on Algorithms and Computation"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.105146"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2021.115883"},{"key":"e_1_3_2_9_2","first-page":"5029","volume-title":"IEEE Winter Conference on Applications of Computer Vision","author":"Birla Lokendra","year":"2023","unstructured":"Lokendra Birla, Sneha Shukla, Anup Kumar Gupta, and Puneet Gupta. 2023. ALPINE: Improving remote heart rate estimation using contrastive learning. In IEEE Winter Conference on Applications of Computer Vision, 5029\u20135038."},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","unstructured":"Polychronis Charitidis Giorgos Kordopatis-Zilos Symeon Papadopoulos and Ioannis Kompatsiaris. 2020. Investigating the impact of pre-processing and prediction aggregation on the deepfake detection task. arXiv:2006.07084. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2006.07084","DOI":"10.48550\/arXiv.2006.07084"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.195"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2020.3009287"},{"key":"e_1_3_2_13_2","first-page":"1","article-title":"Video face replacement","author":"Dale Kevin","year":"2011","unstructured":"Kevin Dale, Kalyan Sunkavalli, Micah K. Johnson, Daniel Vlasic, Wojciech Matusik, and Hanspeter Pfister. 2011. Video face replacement. In SIGGRAPH Asia Conference, 1\u201310.","journal-title":"SIGGRAPH Asia Conference"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","unstructured":"Oscar de Lima Sean Franklin Shreshtha Basu Blake Karwoski and Annet George. 2020. Deepfake detection using spatiotemporal convolutional networks. arXiv:2006.14749. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2006.14749","DOI":"10.48550\/arXiv.2006.14749"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","unstructured":"Brian Dolhansky Joanna Bitton Ben Pflaum Jikuo Lu Russ Howes Menglin Wang and Cristian Canton Ferrer. 2020. The deepfake detection challenge (DFDC) dataset. arXiv:2006.07397. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2006.07397","DOI":"10.48550\/arXiv.2006.07397"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2019.00213"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.2352\/ISSN.2470-1173.2021.4.MWSF-271"},{"key":"e_1_3_2_18_2","first-page":"1","article-title":"Deepfake video detection using recurrent neural networks","author":"Guera David","year":"2018","unstructured":"David Guera and Edward J. Delp. 2018. Deepfake video detection using recurrent neural networks. In International Conference on Advanced Video and Signal Based Surveillance, 1\u20136.","journal-title":"International Conference on Advanced Video and Signal Based Surveillance"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2017.8297060"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2017.8037447"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2018.00179"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2020.103813"},{"key":"e_1_3_2_23_2","first-page":"530","volume-title":"IEEE Winter Conference on Applications of Computer Vision","author":"Gupta Puneet","year":"2018","unstructured":"Puneet Gupta, Brojeshwar Bhowmik, and Arpan Pal. 2018. Robust adaptive heart-rate monitoring using face videos. In IEEE Winter Conference on Applications of Computer Vision, 530\u2013538."},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","unstructured":"Javier Hernandez-Ortega Ruben Tolosana Julian Fierrez and Aythami Morales. 2020. DeepFakesON-Phys: Deepfakes detection based on heart rate estimation. arXiv:2010.00400. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2010.00400","DOI":"10.48550\/arXiv.2010.00400"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i1.19978"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2021.3074259"},{"issue":"4","key":"e_1_3_2_27_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3501814","article-title":"Dynamic-aware federated learning for face forgery video detection","volume":"13","author":"Hu Ziheng","year":"2022","unstructured":"Ziheng Hu, Hongtao Xie, Lingyun Yu, Xingyu Gao, Zhihua Shang, and Yongdong Zhang. 2022. Dynamic-aware federated learning for face forgery video detection. ACM Transactions on Intelligent Systems and Technology 13, 4 (2022), 1\u201325.","journal-title":"ACM Transactions on Intelligent Systems and Technology"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","unstructured":"Tero Karras Timo Aila Samuli Laine and Jaakko Lehtinen. 2017. Progressive growing of GANs for improved quality stability and variation. arXiv:1710.10196. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.1710.10196","DOI":"10.48550\/arXiv.1710.10196"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00453"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00327"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.324"},{"key":"e_1_3_2_32_2","first-page":"2608","volume-title":"IEEE Winter Conference on Applications of Computer Vision","author":"Liu Siqi","year":"2020","unstructured":"Siqi Liu, Xiangyuan Lan, and PongChi Yuen. 2020. Temporal similarity analysis of remote-photoplethysmography for fast 3D mask face presentation attack detection. In IEEE Winter Conference on Applications of Computer Vision, 2608\u20132616."},{"key":"e_1_3_2_33_2","unstructured":"Xin Liu Josh Fromm Shwetak Patel and Daniel McDuff. 2020. Multi-task temporal shift attention networks for on-device contactless vitals measurement. arXiv:2006.03790. Retrieved from https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2020\/hash\/e1228be46de6a0234ac22ded31417bc7-Abstract.html"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP42928.2021.9506381"},{"key":"e_1_3_2_35_2","first-page":"2857","volume-title":"IEEE Winter Conference on Applications of Computer Vision","author":"Ma Pingchuan","year":"2021","unstructured":"Pingchuan Ma, Yujiang Wang, Jie Shen, Stavros Petridis, and Maja Pantic. 2021. Lip-reading with densely connected temporal convolutional networks. In IEEE Winter Conference on Applications of Computer Vision, 2857\u20132866."},{"key":"e_1_3_2_36_2","first-page":"83","article-title":"Exploiting visual artifacts to expose Deepfakes and face manipulations","author":"Matern Falko","year":"2019","unstructured":"Falko Matern, Christian Riess, and Marc Stamminger. 2019. Exploiting visual artifacts to expose Deepfakes and face manipulations. In IEEE Winter Applications of Computer Vision Workshops, 83\u201392.","journal-title":"IEEE Winter Applications of Computer Vision Workshops"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","unstructured":"Huy H. Nguyen Junichi Yamagishi and Isao Echizen. 2019. Use of a capsule network to detect fake images and videos. arXiv:1910.12467. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.1910.12467","DOI":"10.48550\/arXiv.1910.12467"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","unstructured":"Andreas Rossler Davide Cozzolino Luisa Verdoliva Christian Riess Justus Thies and Matthias Niessner. 2018. FaceForensics: A large-scale video dataset for forgery detection in human faces. arXiv:1803.09179. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.1803.09179","DOI":"10.48550\/arXiv.1803.09179"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00009"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/2929464.2929475"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3402446"},{"key":"e_1_3_2_42_2","first-page":"130","volume-title":"IEEE International Conference on Computer Vision Workshops","author":"Cozzolino Davide","year":"2019","unstructured":"Davide Cozzolino, Giovanni Poggi, and Luisa Verdoliva. 2019. Extracting camera-based fingerprints for video forensics. In IEEE International Conference on Computer Vision Workshops, 130\u2013137."},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","unstructured":"Deressa Wodajo and Solomon Atnafu. 2021. Deepfake video detection using convolutional vision transformer. arXiv:2102.11126. Retrieved from https:\/\/doi.org\/10.48550\/arXiv.2102.11126","DOI":"10.48550\/arXiv.2102.11126"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-023-02833-x"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP40776.2020.9053969"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-023-14744-z"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/TDSC.2024.3352049"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2023.3239223"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3702232","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3702232","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:10:31Z","timestamp":1750295431000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3702232"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,10]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,2,28]]}},"alternative-id":["10.1145\/3702232"],"URL":"https:\/\/doi.org\/10.1145\/3702232","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,10]]},"assertion":[{"value":"2023-11-27","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-21","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}