{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T01:44:26Z","timestamp":1784943866476,"version":"3.55.0"},"reference-count":54,"publisher":"Springer Science and Business Media LLC","issue":"39","license":[{"start":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T00:00:00Z","timestamp":1753660800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T00:00:00Z","timestamp":1753660800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004505","name":"Universit\u00e0 degli Studi di Catania","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004505","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    The rapid advancement of generative artificial intelligence, particularly in the domains of Generative Adversarial Networks (GANs) and Diffusion Models (DMs), has led to the creation of increasingly sophisticated deepfakes. These synthetic images pose significant challenges for detection systems and present growing concerns in the realm of Cybersecurity. The potential misuse of deepfakes for disinformation, fraud, and identity theft underscores the critical need for robust detection methods. This paper introduces DeepFeatureX-SN (\u2018Deep Features eXtractors based Siamese Network\u2019), an innovative deep learning model designed to address the complex task of not only distinguishing between real and synthetic images but also identifying the specific employed generative technique (GAN or DM). Our approach makes use of a tripartite structure of specialized base models, each trained using Siamese networks and contrastive learning techniques, to extract discriminative features unique to real, GAN-generated, and DM-generated images. These features are then combined through a CNN-based classifier for final categorization. Extensive experiments demonstrate the model\u2019s superior performance, with a detection accuracy of 97.29%, strong generalization to unseen generative architectures (achieving an average accuracy of 67.40%, which surpasses most existing approaches by over 10%) and robustness against various image manipulations, all of which are crucial for real-world Cybersecurity applications. DeepFeatureX-SN achieves state-of-the-art results across multiple datasets, showing particular strength in detecting images from novel GAN and DM implementations. Furthermore, a comprehensive ablation study validates the effectiveness of each component in our proposed architecture. This research contributes significantly to the field, offering a more nuanced and accurate approach to identifying and categorizing synthetic images. The results obtained in the different configurations in the generalization tests demonstrate the good capabilities of the model, outperforming methods found in the literature. Codes and models are available at\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/iplab.dmi.unict.it\/mfs\/Deepfakes\/DeepFeatureX-SN\/\" ext-link-type=\"uri\">https:\/\/iplab.dmi.unict.it\/mfs\/Deepfakes\/DeepFeatureX-SN\/<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1007\/s11042-025-21060-1","type":"journal-article","created":{"date-parts":[[2025,7,28]],"date-time":"2025-07-28T09:25:35Z","timestamp":1753694735000},"page":"47721-47740","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["DeepFeatureX-SN: Generalization of deepfake detection via contrastive learning"],"prefix":"10.1007","volume":"84","author":[{"given":"Orazio","family":"Pontorno","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8315-351X","authenticated-orcid":false,"given":"Luca","family":"Guarnera","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sebastiano","family":"Battiato","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,28]]},"reference":[{"key":"21060_CR1","unstructured":"Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair, S, Courville A, Bengio Y (2014) Generative Adversarial Nets. In: Advances in neural information processing systems, pp 2672\u20132680"},{"key":"21060_CR2","unstructured":"Sohl-Dickstein J, Weiss E, Maheswaranathan N, Ganguli S (2015) Deep unsupervised learning using nonequilibrium thermodynamics. In: International conference on machine learning, PMLR, pp 2256\u20132265"},{"key":"21060_CR3","first-page":"6840","volume":"33","author":"J Ho","year":"2020","unstructured":"Ho J, Jain A, Abbeel P (2020) Denoising diffusion probabilistic models. Adv Neural Inf Process Syst 33:6840\u20136851","journal-title":"Adv Neural Inf Process Syst"},{"key":"21060_CR4","doi-asserted-by":"crossref","unstructured":"Masood M, Nawaz M, Malik KM, Javed A, Irtaza A, Malik H (2022) Deepfakes generation and detection: State-of-the-art open challenges, countermeasures and way forward. Appl Intell 1\u201353","DOI":"10.1007\/s10489-022-03766-z"},{"key":"21060_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2020.102092","volume":"100","author":"E Nowroozi","year":"2021","unstructured":"Nowroozi E, Dehghantanha A, Parizi RM, Choo KKR (2021) A survey of machine learning techniques in adversarial image forensics. Comput Secur 100:102092","journal-title":"Comput Secur"},{"key":"21060_CR6","doi-asserted-by":"crossref","unstructured":"Rombach R, Blattmann A, Lorenz D, Esser P, Ommer B (2022) High-resolution image synthesis with latent diffusion models. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 10684\u201310695","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"21060_CR7","unstructured":"Ramesh A, Dhariwal P, Nichol A, Chu C, Chen M (2022) Hierarchical text-conditional image generation with CLIP latents. 1(2):3. arXiv preprint arXiv:2204.06125"},{"key":"21060_CR8","first-page":"8780","volume":"34","author":"P Dhariwal","year":"2021","unstructured":"Dhariwal P, Nichol A (2021) Diffusion models beat GANs on image synthesis. Adv Neural Inf Process Syst 34:8780\u20138794","journal-title":"Adv Neural Inf Process Syst"},{"key":"21060_CR9","unstructured":"Europol (2022) Facing reality? law enforcement and the challenge of deepfakes. In: an Observatory report from the europol innovation lab publications office of the european union luxembourg"},{"key":"21060_CR10","unstructured":"Interpol (2024) Beyond illusions. unmasking the threat of synthetic media for law enforcement. In: Interpol report luxembourg"},{"key":"21060_CR11","doi-asserted-by":"crossref","unstructured":"Casu M, Guarnera L, Caponnetto P, Battiato S (2024) GenAI mirage: The impostor bias and the deepfake detection challenge in the era of artificial illusions. Forensic Sci Int Digit Investig 50","DOI":"10.1016\/j.fsidi.2024.301795"},{"key":"21060_CR12","doi-asserted-by":"crossref","unstructured":"Zhang X, Karaman S, Chang SF (2019) Detecting and simulating artifacts in GAN fake images. In: 2019 IEEE international workshop on information forensics and security (WIFS), IEEE, pp 1\u20136","DOI":"10.1109\/WIFS47025.2019.9035107"},{"key":"21060_CR13","doi-asserted-by":"crossref","unstructured":"Wang R, Juefei-Xu F, Ma L, Xie X, Huang Y, Wang J, Liu Y (2021) Fakespotter: A simple yet robust baseline for spotting ai-synthesized fake faces. In: Proceedings of the 29th international conference on international joint conferences on artificial intelligence, pp 3444\u20133451","DOI":"10.24963\/ijcai.2020\/476"},{"key":"21060_CR14","doi-asserted-by":"crossref","unstructured":"Wang SY, Wang O, Zhang R, Owens A, Efros AA (2020) CNN-generated images are surprisingly easy to spot... for Now. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 8695\u20138704","DOI":"10.1109\/CVPR42600.2020.00872"},{"key":"21060_CR15","doi-asserted-by":"publisher","DOI":"10.1145\/3652027","author":"L Guarnera","year":"2024","unstructured":"Guarnera L, Giudice O, Battiato S (2024) Mastering deepfake detection: A cutting-edge approach to distinguish GAN and diffusion-model images. ACM Trans Multimed Comput Commun Appl. https:\/\/doi.org\/10.1145\/3652027","journal-title":"ACM Trans Multimed Comput Commun Appl"},{"key":"21060_CR16","doi-asserted-by":"crossref","unstructured":"Sha Z, Li Z, Yu N, Zhang Y (2022) DE-FAKE: Detection and attribution of fake images generated by text-to-image diffusion models. arXiv preprint arXiv:2210.06998","DOI":"10.1145\/3576915.3616588"},{"key":"21060_CR17","doi-asserted-by":"crossref","unstructured":"Corvi R, Cozzolino D, Zingarini G, Poggi G, Nagano K, Verdoliva L (2023) On the Detection of Synthetic Images Generated by Diffusion Models. In: IEEE international conference on acoustics speech and signal processing (ICASSP), IEEE, pp 1\u20135","DOI":"10.1109\/ICASSP49357.2023.10095167"},{"key":"21060_CR18","doi-asserted-by":"crossref","unstructured":"McCloskey S, Albright M (2019) Detecting GAN-generated imagery using saturation cues. In: 2019 IEEE international conference on image processing (ICIP), IEEE, pp 4584\u20134588","DOI":"10.1109\/ICIP.2019.8803661"},{"key":"21060_CR19","doi-asserted-by":"crossref","unstructured":"Marra F, Gragnaniello D, Verdoliva L, Poggi G (2019) Do GANs leave artificial fingerprints? 2019 IEEE conference on multimedia information processing and retrieval (MIPR), pp 506\u2013511","DOI":"10.1109\/MIPR.2019.00103"},{"key":"21060_CR20","doi-asserted-by":"crossref","unstructured":"Bergmann S, Moussa D, Brand F, Kaup A, Riess C (2024) Forensic analysis of AI-compression traces in spatial and frequency domain. Pattern Recognit Lett","DOI":"10.1016\/j.patrec.2024.02.015"},{"key":"21060_CR21","doi-asserted-by":"crossref","unstructured":"Concas S, Perelli G, Marcialis G.L, Puglisi G (2022) Tensor-based deepfake detection in scaled and compressed images. In: 2022 IEEE international conference on image processing (ICIP), IEEE, pp 3121\u20133125","DOI":"10.1109\/ICIP46576.2022.9897606"},{"key":"21060_CR22","unstructured":"Frank J, Eisenhofer T, Sch\u00f6nherr L, Fischer A, Kolossa D, Holz, T (2020) Leveraging frequency analysis for deep fake image recognition. In: International conference on machine learning, vol 119. PMLR, pp 3247\u20133258"},{"key":"21060_CR23","doi-asserted-by":"crossref","unstructured":"Liu H, Li X, Zhou W, Chen Y, He Y, Xue H, Zhang W, Yu N (2021) Spatial-phase shallow learning: Rethinking face forgery detection in frequency domain. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 772\u2013781","DOI":"10.1109\/CVPR46437.2021.00083"},{"key":"21060_CR24","doi-asserted-by":"crossref","unstructured":"Corvi R, Cozzolino D, Poggi G, Nagano K, Verdoliva L (2023) Intriguing properties of synthetic images: From generative adversarial networks to diffusion models. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 973\u2013982","DOI":"10.1109\/CVPRW59228.2023.00104"},{"key":"21060_CR25","unstructured":"Karras T, Aila T, Laine S, Lehtinen J (2018) Progressive growing of GANs for improved quality stability and variation. In: International conference on learning representations (ICLR) 2018"},{"key":"21060_CR26","doi-asserted-by":"crossref","unstructured":"Zhou T, Wang W, Liang Z, Shen J (2021) Face forensics in the wild. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 5778\u20135788","DOI":"10.1109\/CVPR46437.2021.00572"},{"key":"21060_CR27","doi-asserted-by":"crossref","unstructured":"Sha Z, Li Z, Yu N, Zhang Y (2023) De-fake: Detection and attribution of fake images generated by text-to-image generation models. In: Proceedings of the 2023 ACM SIGSAC conference on computer and communications security, pp 3418\u20133432","DOI":"10.1145\/3576915.3616588"},{"key":"21060_CR28","doi-asserted-by":"crossref","unstructured":"Tan C, Zhao Y, Wei S, Gu G, Liu P, Wei Y (2024) Rethinking the up-sampling operations in cnn-based generative network for generalizable deepfake detection. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 28130\u201328139","DOI":"10.1109\/CVPR52733.2024.02657"},{"key":"21060_CR29","doi-asserted-by":"crossref","unstructured":"Hong CY, Hsu YC, Liu TL (2024) Contrastive learning for deepfake classification and localization via multi-label ranking. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 17627\u201317637","DOI":"10.1109\/CVPR52733.2024.01669"},{"key":"21060_CR30","doi-asserted-by":"publisher","unstructured":"Pontorno O, Guarnera L, Battiato S (2024) On the Exploitation of DCT-traces in the generative-AI domain. In: 2024 IEEE international conference on image processing (ICIP), pp 3806\u20133812. https:\/\/doi.org\/10.1109\/ICIP51287.2024.10648013","DOI":"10.1109\/ICIP51287.2024.10648013"},{"key":"21060_CR31","doi-asserted-by":"publisher","first-page":"5464","DOI":"10.1109\/TIP.2019.2916751","volume":"11","author":"Z He","year":"2019","unstructured":"He Z, Zuo W, Kan M, Shan S, Chen X (2019) AttGAN: Facial attribute editing by only changing what you want. IEEE Trans Image Process 11:5464\u20135478","journal-title":"IEEE Trans Image Process"},{"key":"21060_CR32","unstructured":"Brock A, Donahue J, Simonyan K (2018) Large scale GAN training for high fidelity natural image synthesis. In: International conference on learning representations"},{"key":"21060_CR33","doi-asserted-by":"crossref","unstructured":"Zhu JY, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE international conference on computer vision, pp 2223\u20132232","DOI":"10.1109\/ICCV.2017.244"},{"key":"21060_CR34","doi-asserted-by":"crossref","unstructured":"Park T, Liu MY, Wang TC, Zhu JY (2019) GauGAN: Semantic image synthesis with spatially adaptive normalization. In: ACM SIGGRAPH 2019 Real-Time Live!, pp 1\u20131","DOI":"10.1145\/3306305.3332370"},{"key":"21060_CR35","doi-asserted-by":"crossref","unstructured":"Cho W, Choi S, Park D.K, Shin I, Choo J (2019) Image-to-image translation via group-wise deep whitening-and-coloring transformation. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 10639\u201310647","DOI":"10.1109\/CVPR.2019.01089"},{"key":"21060_CR36","unstructured":"Karras T, Aila T, Laine S, Lehtinen J (2018) Progressive growing of GANs for improved quality stability and variation. In: International conference on learning representations"},{"key":"21060_CR37","doi-asserted-by":"crossref","unstructured":"Choi Y, Choi M, Kim M, Ha JW, Kim S, Choo J (2018) StarGAN: Unified generative adversarial networks for multi-domain image-to-image translation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 8789\u20138797","DOI":"10.1109\/CVPR.2018.00916"},{"key":"21060_CR38","doi-asserted-by":"crossref","unstructured":"Karras T, Laine S, Aila T (2019) A style-based generator architecture for generative adversarial networks. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 4401\u20134410","DOI":"10.1109\/CVPR.2019.00453"},{"key":"21060_CR39","doi-asserted-by":"crossref","unstructured":"Karras T, Laine S, Aittala M, Hellsten J, Lehtinen J, Aila T (2020) Analyzing and improving the image quality of StyleGAN. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 8110\u20138119","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"21060_CR40","first-page":"852","volume":"34","author":"T Karras","year":"2021","unstructured":"Karras T, Aittala M, Laine S, H\u00e4rk\u00f6nen E, Hellsten J, Lehtinen J, Aila T (2021) Alias-free generative adversarial networks. Adv Neural Inf Process Syst 34:852\u2013863","journal-title":"Adv Neural Inf Process Syst"},{"key":"21060_CR41","unstructured":"Nichol A.Q, Dhariwal P, Ramesh A, Shyam P, Mishkin P, Mcgrew B., Sutskever I, Chen M (2022) GLIDE: Towards photorealistic image generation and editing with text-guided diffusion models. In: International conference on machine learning, PMLR, pp 16784\u201316804"},{"key":"21060_CR42","doi-asserted-by":"crossref","unstructured":"Liu Z, Luo P, Wang X, Tang X (2015) Deep learning face attributes in the wild. In: Proceedings of international conference on computer vision (ICCV)","DOI":"10.1109\/ICCV.2015.425"},{"key":"21060_CR43","doi-asserted-by":"crossref","unstructured":"Cocchi F, Baraldi L, Poppi S, Cornia M, Cucchiara R (2023) Unveiling the impact of image transformations on deepfake detection: An experimental analysis. In: International conference on image analysis and processing, Springer, pp 345\u2013356","DOI":"10.1007\/978-3-031-43153-1_29"},{"key":"21060_CR44","unstructured":"Hudson DA, Zitnick L (2021) Generative adversarial transformers. In: International conference on machine learning, PMLR, pp 4487\u20134499"},{"key":"21060_CR45","unstructured":"Xiao Z, Kreis K, Vahdat A (2021) Tackling the generative learning trilemma with denoising diffusion GANs. arXiv preprint arXiv:2112.07804"},{"key":"21060_CR46","unstructured":"Wang Z, Zheng H, He P, Chen W, Zhou M (2022) Diffusion-GAN: Training GANs with diffusion. arXiv preprint arXiv:2206.02262"},{"key":"21060_CR47","first-page":"17480","volume":"34","author":"A Sauer","year":"2021","unstructured":"Sauer A, Chitta K, M\u00fcller J, Geiger A (2021) Projected GANs Converge Faster. Adv Neural Inf Process Syst 34:17480\u201317492","journal-title":"Adv Neural Inf Process Syst"},{"key":"21060_CR48","doi-asserted-by":"crossref","unstructured":"Esser P, Rombach R, Ommer B (2021) Taming transformers for high-resolution image synthesis. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 12873\u201312883","DOI":"10.1109\/CVPR46437.2021.01268"},{"key":"21060_CR49","doi-asserted-by":"crossref","unstructured":"Gu S, Chen D, Bao J, Wen F, Zhang B, Chen D, Yuan L, Guo B (2022) Vector quantized diffusion model for text-to-image synthesis. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 10696\u201310706","DOI":"10.1109\/CVPR52688.2022.01043"},{"key":"21060_CR50","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M et al (2015) ImageNet large scale visual recognition challenge. Int J Comput Vision 115:211\u2013252","journal-title":"Int J Comput Vision"},{"key":"21060_CR51","doi-asserted-by":"crossref","unstructured":"Gandhi A, Jain S (2020) Adversarial perturbations fool deepfake detectors. In: 2020 International joint conference on neural networks (IJCNN), IEEE, pp 1\u20138","DOI":"10.1109\/IJCNN48605.2020.9207034"},{"issue":"1","key":"21060_CR52","doi-asserted-by":"publisher","first-page":"31","DOI":"10.3390\/computers13010031","volume":"13","author":"MA Arshed","year":"2024","unstructured":"Arshed MA, Mumtaz S, Ibrahim M, Dewi C, Tanveer M, Ahmed S (2024) Multiclass AI-generated deepfake face detection using patch-wise deep learning model. Comput 13(1):31","journal-title":"Comput"},{"key":"21060_CR53","doi-asserted-by":"crossref","unstructured":"Pontorno O, Guarnera L, Battiato S (2025) DeepFeatureX net: Deep features extractors based network for discriminating synthetic from real images. In: International conference on pattern recognition, Springer, pp 177\u2013193","DOI":"10.1007\/978-3-031-78305-0_12"},{"key":"21060_CR54","unstructured":"Maaten L, Hinton G (2008) Visualizing data using t-SNE. J Mach Learn Res 9(11)"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-025-21060-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-025-21060-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-025-21060-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,16]],"date-time":"2025-12-16T07:25:32Z","timestamp":1765869932000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-025-21060-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,28]]},"references-count":54,"journal-issue":{"issue":"39","published-online":{"date-parts":[[2025,11]]}},"alternative-id":["21060"],"URL":"https:\/\/doi.org\/10.1007\/s11042-025-21060-1","relation":{},"ISSN":["1573-7721"],"issn-type":[{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,28]]},"assertion":[{"value":"18 November 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 April 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 July 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 July 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"yes","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval and consent to participate"}},{"value":"yes","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Not applicable","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest\/Competing interests"}}]}}