{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,19]],"date-time":"2026-11-19T19:13:59Z","timestamp":1795115639881,"version":"4.10.3"},"reference-count":75,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,12,20]],"date-time":"2024-12-20T00:00:00Z","timestamp":1734652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Horizon Europe project \u201cEuropean Lighthouse on Safe and Secure AI (ELSA)\u201d","award":["HORIZON-CL4-2021-HUMAN-01-03"],"award-info":[{"award-number":["HORIZON-CL4-2021-HUMAN-01-03"]}]},{"name":"European Union, and by the PNRR project \u201cFuture Artificial Intelligence Research (FAIR),\u201d"},{"name":"Italian Ministry of University and Research"},{"name":"CINECA"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2025,1,31]]},"abstract":"<jats:p>Recent advancements in diffusion models have enabled the generation of realistic deepfakes from textual prompts in natural language. While these models have numerous benefits across various sectors, they have also raised concerns about the potential misuse of fake images and cast new pressures on fake image detection. In this work, we pioneer a systematic study on deepfake detection generated by state-of-the-art diffusion models. Firstly, we conduct a comprehensive analysis of the performance of contrastive and classification-based visual features, respectively, extracted from CLIP-based models and ResNet or Vision Transformer (ViT)-based architectures trained on image classification datasets. Our results demonstrate that fake images share common low-level cues, which render them easily recognizable. Further, we devise a multimodal setting wherein fake images are synthesized by different textual captions, which are used as seeds for a generator. Under this setting, we quantify the performance of fake detection strategies and introduce a contrastive-based disentangling method that lets us analyze the role of the semantics of textual descriptions and low-level perceptual cues. Finally, we release a new dataset, called COCOFake, containing about 1.2 million images generated from the original COCO image\u2013caption pairs using two recent text-to-image diffusion models, namely Stable Diffusion v1.4 and v2.0.<\/jats:p>","DOI":"10.1145\/3665497","type":"journal-article","created":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T20:50:32Z","timestamp":1716324632000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":31,"title":["Parents and Children: Distinguishing Multimodal Deepfakes from Natural Images"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1033-2485","authenticated-orcid":false,"given":"Roberto","family":"Amoroso","sequence":"first","affiliation":[{"name":"University of Modena and Reggio Emilia, Modena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7918-6220","authenticated-orcid":false,"given":"Davide","family":"Morelli","sequence":"additional","affiliation":[{"name":"University of Modena and Reggio Emilia, Modena, Italy and University of Pisa, Pisa, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9640-9385","authenticated-orcid":false,"given":"Marcella","family":"Cornia","sequence":"additional","affiliation":[{"name":"University of Modena and Reggio Emilia, Modena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5125-4957","authenticated-orcid":false,"given":"Lorenzo","family":"Baraldi","sequence":"additional","affiliation":[{"name":"University of Modena and Reggio Emilia, Modena, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1052-8322","authenticated-orcid":false,"given":"Alberto","family":"Del Bimbo","sequence":"additional","affiliation":[{"name":"University of Florence, Florence, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2239-283X","authenticated-orcid":false,"given":"Rita","family":"Cucchiara","sequence":"additional","affiliation":[{"name":"University of Modena and Reggio Emilia, Modena, Italy and IIT-CNR, Pisa, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,12,20]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00282"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","unstructured":"Miles Brundage Shahar Avin Jack Clark Helen Toner Peter Eckersley Ben Garfinkel Allan Dafoe Paul Scharre Thomas Zeitzoff Bobby Filar Hyrum Anderson Heather Roff Gregory C. Allen Jacob Steinhardt Carrick Flynn Se\u00e1n \u00d3 h\u00c9igeartaigh Simon Beard Haydn Belfield Sebastian Farquhar Clare Lyle Rebecca Crootof Owain Evans Michael Page Joanna Bryson Roman Yampolskiy and Dario Amodei. 2018. The Malicious Use of Artificial Intelligence: Forecasting Prevention and Mitigation. arXiv:1802.07228. DOI: 10.48550\/arXiv.1802.07228","DOI":"10.48550\/arXiv.1802.07228"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1137\/0916069"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-43148-7_10"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58574-7_7"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00712"},{"issue":"3","key":"e_1_3_2_8_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3625231","article-title":"Voice-Face Homogeneity Tells Deepfake","volume":"20","author":"Cheng Harry","year":"2023","unstructured":"Harry Cheng, Yangyang Guo, Tianyi Wang, Qi Li, Xiaojun Chang, and Liqiang Nie. 2023. Voice-Face Homogeneity Tells Deepfake. ACM Transactions on Multimedia Computing, Communications, and Applications 20, 3 (2023), 1\u201322.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_3_2_9_2","first-page":"147","article-title":"Deepfakes and the New Disinformation War: The Coming Age of Post-Truth Geopolitics","volume":"98","author":"Chesney Robert","year":"2019","unstructured":"Robert Chesney and Danielle Citron. 2019. Deepfakes and the New Disinformation War: The Coming Age of Post-Truth Geopolitics. Foreign Affairs 98 (2019), 147.","journal-title":"Foreign Affairs"},{"key":"e_1_3_2_10_2","volume-title":"Proceedings of the International Conference on Image Analysis and Processing","author":"Cocchi Federico","year":"2023","unstructured":"Federico Cocchi, Lorenzo Baraldi, Samuele Poppi, Marcella Cornia, Lorenzo Baraldi, and Rita Cucchiara. 2023. Unveiling the Impact of Image Transformations on Deepfake Detection: An Experimental Analysis. In Proceedings of the International Conference on Image Analysis and Processing."},{"key":"e_1_3_2_11_2","volume-title":"Proceedings of the International Conference on Acoustics, Speech, and Signal Processing","author":"Corvi Riccardo","year":"2023","unstructured":"Riccardo Corvi, Davide Cozzolino, Giada Zingarini, Giovanni Poggi, Koki Nagano, and Luisa Verdoliva. 2023. On the Detection of Synthetic Images Generated by Diffusion Models. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing."},{"key":"e_1_3_2_12_2","volume-title":"Proceedings of the International Conference on Visual Communications and Image Processing","author":"Cozzolino Davide","year":"2021","unstructured":"Davide Cozzolino, Diego Gragnaniello, Giovanni Poggi, and Luisa Verdoliva. 2021a. Towards Universal GAN Image Detection. In Proceedings of the International Conference on Visual Communications and Image Processing."},{"key":"e_1_3_2_13_2","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Cozzolino Davide","year":"2021","unstructured":"Davide Cozzolino, Andreas R\u00f6ssler, Justus Thies, Matthias Nie\u00dfner, and Luisa Verdoliva. 2021b. ID-Reveal: Identity-Aware DeepFake Video Detection. In Proceedings of the IEEE\/CVF International Conference on Computer Vision."},{"key":"e_1_3_2_14_2","unstructured":"Davide Cozzolino Justus Thies Andreas R\u00f6ssler Christian Riess Matthias Nie\u00dfner and Luisa Verdoliva. 2018. ForensicTransfer: Weakly-Supervised Domain Adaptation for Forgery Detection. arXiv:1812.02510."},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2023.3316696"},{"key":"e_1_3_2_16_2","article-title":"Diffusion Models Beat GANs on Image Synthesis","author":"Dhariwal Prafulla","year":"2021","unstructured":"Prafulla Dhariwal and Alexander Nichol. 2021. Diffusion Models Beat GANs on Image Synthesis. In Advances in Neural Information Processing Systems.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_17_2","article-title":"CogView: Mastering Text-to-Image Generation via Transformers","author":"Ding Ming","year":"2021","unstructured":"Ming Ding, Zhuoyi Yang, Wenyi Hong, Wendi Zheng, Chang Zhou, Da Yin, Junyang Lin, Xu Zou, Zhou Shao, Hongxia Yang, and Jie Tang. 2021. CogView: Mastering Text-to-Image Generation via Transformers. In Advances in Neural Information Processing Systems.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_18_2","unstructured":"Brian Dolhansky Joanna Bitton Ben Pflaum Jikuo Lu Russ Howes Menglin Wang and Cristian Canton Ferrer. 2020. The DeepFake Detection Challenge (DFDC) Dataset. arXiv:2006.07397."},{"key":"e_1_3_2_19_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Dosovitskiy Alexey","year":"2020","unstructured":"Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, Neil Houlsby. 2020. An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00791"},{"key":"e_1_3_2_21_2","volume-title":"Advances in Neural Information Processing Systems","author":"Dzanic Tarik","year":"2020","unstructured":"Tarik Dzanic, Karan Shah, and Freddie Witherden. 2020. Fourier Spectrum Discrepancies in Deep Network Generated Images. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_22_2","volume-title":"Proceedings of the International Conference on Acoustics, Speech, and Signal Processing","author":"Fernandez Pierre","year":"2022","unstructured":"Pierre Fernandez, Alexandre Sablayrolles, Teddy Furon, Herv\u00e9 J\u00e9gou, and Matthijs Douze. 2022. Watermarking Images in Self-Supervised Latent Spaces. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing."},{"key":"e_1_3_2_23_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Frank Joel","year":"2020","unstructured":"Joel Frank, Thorsten Eisenhofer, Lea Sch\u00f6nherr, Asja Fischer, Dorothea Kolossa, and Thorsten Holz. 2020. Leveraging Frequency Analysis for Deep Fake Image Recognition. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_3_2_24_2","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Gafni Oran","year":"2022","unstructured":"Oran Gafni, Adam Polyak, Oron Ashual, Shelly Sheynin, Devi Parikh, and Yaniv Taigman. 2022. Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priors. In Proceedings of the European Conference on Computer Vision."},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01383"},{"key":"e_1_3_2_26_2","article-title":"Generative Adversarial Nets","author":"Goodfellow Ian J.","year":"2014","unstructured":"Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron C. Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_27_2","volume-title":"Proceedings of the IEEE International Conference on Multimedia and Expo","author":"Gragnaniello Diego","year":"2021","unstructured":"Diego Gragnaniello, Davide Cozzolino, Francesco Marra, Giovanni Poggi, and Luisa Verdoliva. 2021. Are GAN Generated Images Easy to Detect? A Critical Analysis of the State-of-the-Art. In Proceedings of the IEEE International Conference on Multimedia and Expo."},{"key":"e_1_3_2_28_2","volume-title":"Proceedings of the ACM International Conference on Multimedia","author":"Gu Zhihao","year":"2021","unstructured":"Zhihao Gu, Yang Chen, Taiping Yao, Shouhong Ding, Jilin Li, Feiyue Huang, and Lizhuang Ma. 2021. Spatiotemporal Inconsistency Learning for DeepFake Video Detection. In Proceedings of the ACM International Conference on Multimedia."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBIOM.2021.3065735"},{"key":"e_1_3_2_30_2","volume-title":"Proceedings of the ACM International Conference on Multimedia Retrieval","author":"Han Bing","year":"2023","unstructured":"Bing Han, Jianshu Li, Wenqi Ren, Man Luo, Jian Liu, and Xiaochun Cao. 2023. SIGMA-DF: Single-Side Guided Meta-Learning for Deepfake Detection. In Proceedings of the ACM International Conference on Multimedia Retrieval."},{"key":"e_1_3_2_31_2","first-page":"99","article-title":"Deepfakes: False Pornography is Here and the Law Cannot Protect You","volume":"17","author":"Harris Douglas","year":"2018","unstructured":"Douglas Harris. 2018. Deepfakes: False Pornography is Here and the Law Cannot Protect You. Duke Law & Technology Review 17 (2018), 99.","journal-title":"Duke Law & Technology Review"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00296"},{"key":"e_1_3_2_34_2","volume-title":"Proceedings of the IEEE Security and Privacy Workshops","author":"Joslin Matthew","year":"2020","unstructured":"Matthew Joslin and Shuang Hao. 2020. Attributing and Detecting Fake Images Generated by Known GANs. In Proceedings of the IEEE Security and Privacy Workshops."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298932"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00453"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00813"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i7.20675"},{"key":"e_1_3_2_39_2","volume-title":"Advances in Neural Information Processing Systems","author":"Khosla Prannay","year":"2020","unstructured":"Prannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna, Yonglong Tian, Phillip Isola, Aaron Maschinot, Ce Liu, and Dilip Krishnan. 2020. Supervised Contrastive Learning. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_40_2","volume-title":"Advances in Neural Information Processing Systems","author":"Kingma Durk P.","year":"2018","unstructured":"Durk P. Kingma and Prafulla Dhariwal. 2018. Glow: Generative Flow with Invertible 1x1 Convolutions. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_41_2","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops","author":"Li Yuezun","year":"2018","unstructured":"Yuezun Li and Siwei Lyu. 2018. Exposing DeepFake Videos By Detecting Face Warping Artifacts. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops."},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00327"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_44_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Loshchilov Ilya","year":"2018","unstructured":"Ilya Loshchilov and Frank Hutter. 2018. Decoupled Weight Decay Regularization. In Proceedings of the International Conference on Learning Representations."},{"issue":"1","key":"e_1_3_2_45_2","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/s13640-024-00621-8","article-title":"Assessment Framework for Deepfake Detection in Real-World Situations","volume":"2024","author":"Lu Yuhang","year":"2024","unstructured":"Yuhang Lu and Touradj Ebrahimi. 2024. Assessment Framework for Deepfake Detection in Real-World Situations. EURASIP Journal on Image and Video Processing 2024, 1 (2024), 6.","journal-title":"EURASIP Journal on Image and Video Processing"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.01605"},{"key":"e_1_3_2_47_2","volume-title":"Proceedings of the International Conference on Image Processing","author":"Mandelli Sara","year":"2022","unstructured":"Sara Mandelli, Nicolo Bonettini, Paolo Bestagini, and Stefano Tubaro. 2022. Detecting GAN-Generated Images by Orthogonal Training of Multiple CNNs. In Proceedings of the International Conference on Image Processing."},{"key":"e_1_3_2_48_2","volume-title":"Proceedings of the IEEE Conference on Multimedia Information Processing and Retrieval","author":"Marra Francesco","year":"2018","unstructured":"Francesco Marra, Diego Gragnaniello, Davide Cozzolino, and Luisa Verdoliva. 2018. Detection of GAN-Generated Fake Images over Social Networks. In Proceedings of the IEEE Conference on Multimedia Information Processing and Retrieval."},{"key":"e_1_3_2_49_2","unstructured":"Mehdi Mirza and Simon Osindero. 2014. Conditional Generative Adversarial Nets. arXiv:1411.1784."},{"key":"e_1_3_2_50_2","unstructured":"Alex Nichol Prafulla Dhariwal Aditya Ramesh Pranav Shyam Pamela Mishkin Bob McGrew Ilya Sutskever and Mark Chen. 2021. GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models. arXiv:2112.10741."},{"key":"e_1_3_2_51_2","doi-asserted-by":"crossref","unstructured":"Samuele Poppi Tobia Poppi Federico Cocchi Marcella Cornia Lorenzo Baraldi and Rita Cucchiara. 2024. Safe-CLIP: Removing NSFW Concepts from Vision-and-Language Models. arXiv:2311.16254.","DOI":"10.1007\/978-3-031-73668-1_20"},{"key":"e_1_3_2_52_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Radford Alec","year":"2021","unstructured":"Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning Transferable Visual Models from Natural Language Supervision. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_3_2_53_2","unstructured":"Aditya Ramesh Prafulla Dhariwal Alex Nichol Casey Chu and Mark Chen. 2022. Hierarchical Text-Conditional Image Generation with CLIP Latents. arXiv:2204.06125."},{"key":"e_1_3_2_54_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Ramesh Aditya","year":"2021","unstructured":"Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2021. Zero-Shot Text-to-Image Generation. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_3_2_55_2","volume-title":"Proceedings of the International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications","author":"Ricker Jonas","year":"2024","unstructured":"Jonas Ricker, Simon Damm, Thorsten Holz, and Asja Fischer. 2024. Towards the Detection of Diffusion Model Deepfakes. In Proceedings of the International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications."},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01042"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00009"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-015-0816-y"},{"key":"e_1_3_2_59_2","doi-asserted-by":"crossref","unstructured":"Chitwan Saharia William Chan Saurabh Saxena Lala Li Jay Whang Emily Denton Seyed Kamyar Seyed Ghasemipour Burcu Karagol Ayan S. Sara Mahdavi Rapha Gontijo Lopes Tim Salimans Jonathan Ho David J. Fleet and Mohammad Norouzi. 2022. Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding. arXiv:2205.11487.","DOI":"10.1145\/3528233.3530757"},{"key":"e_1_3_2_60_2","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Sarto Sara","year":"2023","unstructured":"Sara Sarto, Manuele Barraco, Marcella Cornia, Lorenzo Baraldi, and Rita Cucchiara. 2023. Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluation. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.02157"},{"key":"e_1_3_2_62_2","article-title":"LAION-5B: An Open Large-Scale Dataset for Training Next Generation Image-Text Models","author":"Schuhmann Christoph","year":"2022","unstructured":"Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, Patrick Schramowski, Srivatsa Kundurthy, Katherine Crowson, Ludwig Schmidt, Robert Kaczmarczyk, and Jenia Jitsev. 2022. LAION-5B: An Open Large-Scale Dataset for Training Next Generation Image-Text Models. In Advances in Neural Information Processing Systems.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_63_2","volume-title":"Advances in Neural Information Processing Systems Workshops","author":"Schuhmann Christoph","year":"2021","unstructured":"Christoph Schuhmann, Robert Kaczmarczyk, Aran Komatsuzaki, Aarush Katta, Richard Vencu, Romain Beaumont, Jenia Jitsev, Theo Coombes, and Clayton Mullis. 2021. LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs. In Advances in Neural Information Processing Systems Workshops."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1145\/3576915.3616588"},{"key":"e_1_3_2_65_2","volume-title":"Advances in Neural Information Processing Systems","author":"Vahdat Arash","year":"2020","unstructured":"Arash Vahdat and Jan Kautz. 2020. NVAE: A Deep Hierarchical Variational Autoencoder. In Advances in Neural Information Processing Systems."},{"issue":"11","key":"e_1_3_2_66_2","first-page":"2579","article-title":"Visualizing Data Using t-SNE","volume":"9","author":"Maaten Laurens Van der","year":"2008","unstructured":"Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing Data Using t-SNE. Journal of Machine Learning Research 9, 11 (2008), 2579\u20132605.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_67_2","volume-title":"Advances in Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems."},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2020.3002101"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00872"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10994-022-06225-5"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00780"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2023.3262148"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00765"},{"key":"e_1_3_2_74_2","volume-title":"Proceedings of the International Workshop on Information Forensics and Security","author":"Zhang Xu","year":"2019","unstructured":"Xu Zhang, Svebor Karaman, and Shih-Fu Chang. 2019. Detecting and Simulating Artifacts in GAN Fake Images. In Proceedings of the International Workshop on Information Forensics and Security."},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1145\/279232.279236"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.244"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3665497","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3665497","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T23:57:13Z","timestamp":1750291033000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3665497"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,20]]},"references-count":75,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1,31]]}},"alternative-id":["10.1145\/3665497"],"URL":"https:\/\/doi.org\/10.1145\/3665497","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,20]]},"assertion":[{"value":"2023-03-31","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-14","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-20","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}