{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T15:19:48Z","timestamp":1792163988904,"version":"4.4.0"},"reference-count":54,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T00:00:00Z","timestamp":1625097600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["13N15736"],"award-info":[{"award-number":["13N15736"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>DeepFake detection is a novel task for media forensics and is currently receiving a lot of research attention due to the threat these targeted video manipulations propose to the trust placed in video footage. The current trend in DeepFake detection is the application of neural networks to learn feature spaces that allow them to be distinguished from unmanipulated videos. In this paper, we discuss, with features hand-crafted by domain experts, an alternative to this trend. The main advantage that hand-crafted features have over learned features is their interpretability and the consequences this might have for plausibility validation for decisions made. Here, we discuss three sets of hand-crafted features and three different fusion strategies to implement DeepFake detection. Our tests on three pre-existing reference databases show detection performances that are under comparable test conditions (peak AUC &gt; 0.95) to those of state-of-the-art methods using learned features. Furthermore, our approach shows a similar, if not better, generalization behavior than neural network-based methods in tests performed with different training and test sets. In addition to these pattern recognition considerations, first steps of a projection onto a data-centric examination approach for forensics process modeling are taken to increase the maturity of the present investigation.<\/jats:p>","DOI":"10.3390\/jimaging7070108","type":"journal-article","created":{"date-parts":[[2021,7,1]],"date-time":"2021-07-01T12:03:27Z","timestamp":1625141007000},"page":"108","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":40,"title":["Media Forensics Considerations on DeepFake Detection with Hand-Crafted Features"],"prefix":"10.3390","volume":"7","author":[{"given":"Dennis","family":"Siegel","sequence":"first","affiliation":[{"name":"Department of Computer Science, Otto-von-Guericke University, 39106 Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0138-4638","authenticated-orcid":false,"given":"Christian","family":"Kraetzer","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Otto-von-Guericke University, 39106 Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stefan","family":"Seidlitz","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Otto-von-Guericke University, 39106 Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jana","family":"Dittmann","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Otto-von-Guericke University, 39106 Magdeburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,1]]},"reference":[{"key":"ref_1","first-page":"147","article-title":"Deepfakes and the new disinformation war: The coming age of post-truth geopolitics","volume":"98","author":"Chesney","year":"2019","journal-title":"Foreign Aff."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Vaccari, C., and Chadwick, A. (2020). Deepfakes and disinformation: Exploring the impact of synthetic political video on deception, uncertainty, and trust in news. Soc. Media Soc., 6.","DOI":"10.1177\/2056305120903408"},{"key":"ref_3","unstructured":"Palmer, G.L. (2001). A Road Map for Digital Forensics Research\u2014Report from the First Digital Forensics Research Workshop (DFRWS) (Technical Report DTR-T001-01 Final), Air Force Research Laboratory, Rome Research Site. Technical Report."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Champod, C., and Vuille, J. (2011). Scientific Evidence in Europe\u2014Admissibility, Evaluation and Equality of Arms. Int. Comment. Evid., 9.","DOI":"10.2202\/1554-4567.1123"},{"key":"ref_5","unstructured":"Kr\u00e4tzer, C. (2013). Statistical Pattern Recognition for Audio-forensics\u2014Empirical Investigations on the Application Scenarios Audio Steganalysis and Microphone Forensics. [Ph.D. Thesis, Otto-von-Guericke-University]."},{"key":"ref_6","unstructured":"U.S. Congress (2021). Federal Rules of Evidence, Amended by the United States Supreme Court in 2021."},{"key":"ref_7","unstructured":"Kiltz, S. (2020). Data-Centric Examination Approach (DCEA) for a Qualitative Determination of Error, Loss and Uncertainty in Digital and Digitised Forensics. [Ph.D. Thesis, Otto-von-Guericke-University]."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Geradts, Z.J.M.H., Franke, K.Y., and Veenman, C.J. (2009). Multimedia forensics is not computer forensics. Computational Forensics, Springer.","DOI":"10.1007\/978-3-642-03521-0"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Bondi, L., Cannas, E.D., Bestagini, P., and Tubaro, S. (2020). Training Strategies and Data Augmentations in CNN-based DeepFake Video Detection. arXiv.","DOI":"10.1109\/WIFS49906.2020.9360901"},{"key":"ref_10","unstructured":"(2021, June 30). FakeApp 2.2.0. Available online: https:\/\/www.malavida.com\/en\/soft\/fakeapp."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Nguyen, T.T., Nguyen, C.M., Nguyen, D.T., Nguyen, D.T., and Nahavandi, S. (2021). Deep Learning for Deepfakes Creation and Detection. arXiv.","DOI":"10.2139\/ssrn.4030341"},{"key":"ref_12","unstructured":"R\u00f6ssler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., and Nie\u00dfner, M. (November, January 27). FaceForensics++: Learning to Detect Manipulated Facial Images. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Li, Y., Yang, X., Sun, P., Qi, H., and Lyu, S. (2020, January 14\u201319). Celeb-DF: A Large-Scale Challenging Dataset for DeepFake Forensics. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00327"},{"key":"ref_14","unstructured":"Sabir, E., Cheng, J., Jaiswal, A., AbdAlmageed, W., Masi, I., and Natarajan, P. (2019). Recurrent Convolutional Strategies for Face Manipulation Detection in Videos. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, Y., Chang, M., and Lyu, S. (2018). In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking. arXiv.","DOI":"10.1109\/WIFS.2018.8630787"},{"key":"ref_16","unstructured":"Korshunov, P., and Marcel, S. (2018). DeepFakes: A New Threat to Face Recognition? Assessment and Detection. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Tolosana, R., Vera-Rodr\u00edguez, R., Fi\u00e9rrez, J., Morales, A., and Ortega-Garcia, J. (2020). DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection. arXiv.","DOI":"10.1016\/j.inffus.2020.06.014"},{"key":"ref_18","unstructured":"Li, Y., and Lyu, S. (2018). Exposing DeepFake Videos By Detecting Face Warping Artifacts. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Matern, F., Riess, C., and Stamminger, M. (2019, January 7\u201311). Exploiting Visual Artifacts to Expose Deepfakes and Face Manipulations. Proceedings of the 2019 IEEE Winter Applications of Computer Vision Workshops (WACVW), Waikoloa Village, HI, USA.","DOI":"10.1109\/WACVW.2019.00020"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yu, P., Xia, Z., Fei, J., and Lu, Y. (2021). A Survey on Deepfake Video Detection. IET Biom.","DOI":"10.1049\/bme2.12031"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yang, X., Li, Y., and Lyu, S. (2018). Exposing Deep Fakes Using Inconsistent Head Poses. arXiv.","DOI":"10.1109\/ICASSP.2019.8683164"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"McCloskey, S., and Albright, M. (2018). Detecting GAN-generated Imagery using Color Cues. arXiv.","DOI":"10.1109\/ICIP.2019.8803661"},{"key":"ref_23","unstructured":"Agarwal, S., Farid, H., Gu, Y., He, M., Nagano, K., and Li, H. (2019, January 16\u201320). Protecting World Leaders Against Deep Fakes. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Long Beach, CA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"83144","DOI":"10.1109\/ACCESS.2020.2988660","article-title":"DeepVision: Deepfakes Detection Using Human Eye Blinking Pattern","volume":"8","author":"Jung","year":"2020","journal-title":"IEEE Access"},{"key":"ref_25","unstructured":"Ciftci, U.A., and Demir, I. (2019). FakeCatcher: Detection of Synthetic Portrait Videos using Biological Signals. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Verdoliva, L. (2020). Media Forensics and DeepFakes: An overview. arXiv.","DOI":"10.1109\/JSTSP.2020.3002101"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Bach, S., Binder, A., Montavon, G., Klauschen, F., M\u00fcller, K.R., and Samek, W. (2015). On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0130140"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2660","DOI":"10.1109\/TNNLS.2016.2599820","article-title":"Evaluating the Visualization of What a Deep Neural Network Has Learned","volume":"28","author":"Samek","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"20336","DOI":"10.1038\/s41598-020-77264-y","article-title":"Comparison of handcrafted features and convolutional neural networks for liver MR image adequacy assessment","volume":"10","author":"Lin","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yin, H., Tino, P., Corchado, E., Byrne, W., and Yao, X. (2007). Filter Methods for Feature Selection\u2014A Comparative Study. Intelligent Data Engineering and Automated Learning\u2014IDEAL 2007, Springer.","DOI":"10.1007\/978-3-540-77226-2"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.1109\/TPAMI.2004.71","article-title":"Simultaneous feature selection and clustering using mixture models","volume":"26","author":"Law","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kiltz, S., Dittmann, J., and Vielhauer, C. (2015, January 18\u201320). Supporting Forensic Design\u2014A Course Profile to Teach Forensics. Proceedings of the 2015 Ninth International Conference on IT Security Incident Management and IT Forensics, Magdeburg, Germany.","DOI":"10.1109\/IMF.2015.16"},{"key":"ref_33","unstructured":"Altschaffel, R. (2020). Computer Forensics in Cyber-Physical Systems: Applying Existing Forensic Knowledge and Procedures from Classical IT to Automation and Automotive. [Ph.D. Thesis, Otto-von-Guericke-University]."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kiltz, S., Hoppe, T., and Dittmann, J. (2009, January 5\u20137). A New Forensic Model and Its Application to the Collection, Extraction and Long Term Storage of Screen Content off a Memory Dump. Proceedings of the 16th International Conference on Digital Signal Processing, DSP\u201909, Santorini, Greece.","DOI":"10.1109\/ICDSP.2009.5201189"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.imavis.2016.01.002","article-title":"300 Faces In-The-Wild Challenge","volume":"47","author":"Sagonas","year":"2016","journal-title":"Image Vis. Comput."},{"key":"ref_36","first-page":"1755","article-title":"Dlib-ml: A Machine Learning Toolkit","volume":"10","author":"King","year":"2009","journal-title":"J. Mach. Learn. Res."},{"key":"ref_37","unstructured":"(2021, May 19). 2d Face Sets\u2014Utrecht ECVP. Available online: http:\/\/pics.stir.ac.uk\/2D_face_sets.htm."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Makrushin, A., Neubert, T., and Dittmann, J. (March, January 27). Automatic generation and detection of visually faultless facial morphs. Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications\u2014Volume 6: VISAPP, (VISIGRAPP 2017), INSTICC, Porto, Portugal.","DOI":"10.5220\/0006131100390050"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Kraetzer, C., Makrushin, A., Neubert, T., Hildebrandt, M., and Dittmann, J. (2017, January 20\u201322). Modeling Attacks on Photo-ID Documents and Applying Media Forensics for the Detection of Facial Morphing. Proceedings of the 5th ACM Workshop on Information Hiding and Multimedia Security, IH&MMSec \u201917, Philadelphia, PA, USA.","DOI":"10.1145\/3082031.3083244"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1145\/1656274.1656278","article-title":"The WEKA data mining software: An update","volume":"11","author":"Hall","year":"2009","journal-title":"SIGKDD Explor."},{"key":"ref_41","unstructured":"Quinlan, J.R. (1993). C4.5: Programs for Machine Learning, Morgan Kaufmann Publishers Inc."},{"key":"ref_42","first-page":"199","article-title":"Multi-Region Probabilistic Histograms for Robust and Scalable Identity Inference","volume":"5558","author":"Sanderson","year":"2009","journal-title":"LNCS"},{"key":"ref_43","unstructured":"R\u00f6ssler, A., Cozzolino, D., Verdoliva, L., Riess, C., Thies, J., and Nie\u00dfner, M. (2018). FaceForensics: A Large-scale Video Dataset for Forgery Detection in Human Faces. arXiv."},{"key":"ref_44","unstructured":"Dufour, N., Gully, A., Karlsson, P., Vorbyov, A.V., Leung, T., Childs, J., and Bregler, C. (2021, May 19). DeepFakes Detection Dataset by Google & JigSaw. Available online: https:\/\/ai.googleblog.com\/2019\/09\/contributing-data-to-deepfake-detection.html."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wubet, W.M. (2020). The Deepfake Challenges and Deepfake Video Detection. Int. J. Innov. Technol. Explor. Eng., 9.","DOI":"10.35940\/ijitee.E2779.049620"},{"key":"ref_46","unstructured":"DeBruine, L., and Jones, B. (2021, May 19). Face Research Lab London Set. Available online: https:\/\/figshare.com\/articles\/dataset\/Face_Research_Lab_London_Set\/5047666\/1."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Agarwal, S., Farid, H., Fried, O., and Agrawala, M. (2020, January 14\u201319). Detecting Deep-Fake Videos From Phoneme-Viseme Mismatches. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00338"},{"key":"ref_48","first-page":"122","article-title":"The OpenCV Library","volume":"120","author":"Bradski","year":"2000","journal-title":"Dobb J. Softw. Tools"},{"key":"ref_49","unstructured":"Ross, A.A., Nandakumar, K., and Jain, A.K. (2006). Levels of Fusion in Biometrics. Handbook of Multibiometrics, Springer."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Kuncheva, L.I. (2004). Combining Pattern Classifiers: Methods and Algorithms, Wiley.","DOI":"10.1002\/0471660264"},{"key":"ref_51","unstructured":"Rana, S., and Ridwanul, M. (2021, May 30). DeepFake Audio Detection. GitHub Repos, Available online: https:\/\/github.com\/dessa-oss\/fake-voice-detection."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Zhang, W., Zhao, C., and Li, Y. (2020). A Novel Counterfeit Feature Extraction Technique for Exposing Face-Swap Images Based on Deep Learning and Error Level Analysis. Entropy, 22.","DOI":"10.3390\/e22020249"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Zhang, W., and Zhao, C. (2020). Exposing Face-Swap Images Based on Deep Learning and ELA Detection. Proceedings, 46.","DOI":"10.3390\/ecea-5-06684"},{"key":"ref_54","unstructured":"Krawetz, N. (August, January 28). A Picture \u2019 s Worth\u2026Digital Image Analysis and Forensics. Proceedings of the Black Hat Briefings 2007, Las Vegas, NV, USA."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/7\/108\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:24:51Z","timestamp":1760163891000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/7\/7\/108"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,1]]},"references-count":54,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["jimaging7070108"],"URL":"https:\/\/doi.org\/10.3390\/jimaging7070108","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,1]]}}}