{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T05:14:18Z","timestamp":1781586858275,"version":"3.54.5"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,12,30]],"date-time":"2024-12-30T00:00:00Z","timestamp":1735516800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61802111, 61872125"],"award-info":[{"award-number":["61802111, 61872125"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Science and Technology Project of Henan Province","award":["232102210109, 232102210096, 232102211056"],"award-info":[{"award-number":["232102210109, 232102210096, 232102211056"]}]},{"name":"Key Scientific Research Projects of Colleges and Universities of Henan Province","award":["24A520003"],"award-info":[{"award-number":["24A520003"]}]},{"name":"Natural Science Foundation Project of Henan Province","award":["242300421404"],"award-info":[{"award-number":["242300421404"]}]},{"name":"Pre-research Project of Song Shan Laboratory","award":["YYJC012022011"],"award-info":[{"award-number":["YYJC012022011"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2025,2,28]]},"abstract":"<jats:p>In recent years, the Metaverse has garnered significant attention in social and Metahuman realms, showcasing substantial value and immense developmental potential through its integration of virtual and real worlds. However, this integration has also raised security concerns. For instance, in digital image forensics, the malicious dissemination of false images by wrongdoers could result in serious consequences and the propagation of misinformation. This article presented a novel two-branch network (abbreviated as CAFTB-Net) to detect and localize the forged regions of document images in the Metaverse. One branch extracts manipulation trace directly from spatial information, e.g., unnatural smears, anomalies between pixels. The other branch employs an SRM filter to transform the input image from the color domain into the noise domain, effectively extracting anomalies, such as global noise inconsistencies from the noise domain. Compared to spatial domain features, the discontinuity of forgery traces within the noise domain aids the network in authenticating the document image. The two branches extract local and global features in the forged document images. Finally, we propose a cross-attention module to fuse local spatial features and global noise features. Extensive experimental results demonstrate that the proposed network achieves F1 scores of 0.819 and 0.948 on the SACP and ICDAR datasets, respectively, with AUC scores of 0.933 and 0.764, outperforming some of the state-of-the-art algorithms.<\/jats:p>","DOI":"10.1145\/3686158","type":"journal-article","created":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T14:19:14Z","timestamp":1723040354000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Cross-Attention Based Two-Branch Networks for Document Image Forgery Localization in the Metaverse"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-4034-2286","authenticated-orcid":false,"given":"Yalin","family":"Song","sequence":"first","affiliation":[{"name":"School of Software, Intelligent Data Processing Engineering Research Center of Henan Province, Institute of Intelligent Network System, Henan University, Kaifeng, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-7148-5035","authenticated-orcid":false,"given":"Wenbin","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Software, Intelligent Data Processing Engineering Research Center of Henan Province, Institute of Intelligent Network System, Henan University, Kaifeng, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1609-0624","authenticated-orcid":false,"given":"Xiuli","family":"Chai","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Henan Engineering Research Center for Industrial Internet of Things, Henan University, Zhengzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1138-1887","authenticated-orcid":false,"given":"Zhihua","family":"Gan","sequence":"additional","affiliation":[{"name":"School of Software, Intelligent Data Processing Engineering Research Center of Henan Province, Institute of Intelligent Network System, Henan University, Kaifeng, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-2747-4757","authenticated-orcid":false,"given":"Mengyuan","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Software, Henan University, Kaifeng, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7304-0802","authenticated-orcid":false,"given":"Lei","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Software, Henan University, Kaifeng, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,12,30]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.caeai.2022.100052"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scs.2022.103842"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2023.3278329"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/MTS.2018.2826060"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.iot.2023.100884"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2023.3301042"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2022.3228781"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2023.109299"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.26599\/BDMA.2022.9020047"},{"key":"e_1_3_1_11_2","first-page":"1","article-title":"Fake news in virtual community, virtual society, and metaverse: A survey","author":"Wang Jinxia","year":"2023","unstructured":"Jinxia Wang, Makowski Stanislav, Cie\u015alik Alan, Haibin Lv, and Zhihan Lv. 2023. Fake news in virtual community, virtual society, and metaverse: A survey. IEEE Transactions on Computational Social Systems (2023), 1\u201315.","journal-title":"IEEE Transactions on Computational Social Systems"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/OJCS.2023.3245801"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3408299"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/2487268.2487272"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/3176650"},{"issue":"2","key":"e_1_3_1_16_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3548689","article-title":"PRNU-based image forgery localization with deep multi-scale fusion","volume":"19","author":"Zhang Yushu","year":"2023","unstructured":"Yushu Zhang, Qing Tan, Shuren Qi, and Mingfu Xue. 2023. PRNU-based image forgery localization with deep multi-scale fusion. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 19, 2, Article 67 (2023), 1\u201320.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3183518"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV56688.2023.00462"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2022.3172617"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00240"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2022.109026"},{"key":"e_1_3_1_22_2","unstructured":"Security AI challenger program [EB\/OL]. 2021. Retrieved from https:\/\/tianchi.aliyun.com\/competition\/entrance\/531812\/ introduction"},{"key":"e_1_3_1_23_2","unstructured":"ICDAR 2023DTT in images 2: text manipulation detection [EB\/OL]. Retrieved from https:\/\/tianchi.aliyun.com\/competition\/entrance\/532052\/introduction"},{"key":"e_1_3_1_24_2","first-page":"1223","volume-title":"Proceedings of the 14th IAPR International Conference on Document Analysis and Recognition","volume":"1","author":"Francisco Cruz","year":"2017","unstructured":"Cruz Francisco, Nicolas Sidere, Micka\u00ebl Coustaty, Vincent Poulain d\u2019Andecy, and Jean-Marc Ogier. 2017. Local binary patterns for document forgery detection. In Proceedings of the 14th IAPR International Conference on Document Analysis and Recognition, 1, 1223\u20131228."},{"key":"e_1_3_1_25_2","unstructured":"Hailey James Otkrist Gupta and Dan Raviv. 2020. OCR graph features for manipulation detection in documents. arXiv:2009.05158. Retrieved from https:\/\/arxiv.org\/abs\/2009.05158"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2022.107770"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1002\/int.22792"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.3390\/e24010118"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/TrustCom56396.2022.00113"},{"issue":"6","key":"e_1_3_1_30_2","first-page":"207","article-title":"Document image forgery localization and desensitization localization using the attention mechanism","volume":"50","author":"Zheng Kengtao","year":"2023","unstructured":"Kengtao Zheng, Bin Li, and Jinhua Zeng. 2023. Document image forgery localization and desensitization localization using the attention mechanism. Journal of Xidian University 50, 6 (2023), 207\u2013218.","journal-title":"Journal of Xidian University"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.00575"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.57019\/jmv.1286526"},{"key":"e_1_3_1_33_2","first-page":"1","article-title":"A conformable moments-based deep learning system for forged handwriting detection","author":"Nandanwar Lokesh","year":"2022","unstructured":"Lokesh Nandanwar, Palaiahnakote Shivakumara, Hamid A. Jalab, Rabha W. Ibrahim, Ramachandra Raghavendra, Umapada Pal, Tong Lu, and Michael Blumenstein. 2022. A conformable moments-based deep learning system for forged handwriting detection. IEEE Transactions on Neural Networks and Learning Systems (2022), 1\u201314.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2022.3220630"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00378"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00338"},{"key":"e_1_3_1_37_2","first-page":"6000","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in Neural Information Processing Systems 30 (2017), 6000\u20136010.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58452-8_13"},{"issue":"3","key":"e_1_3_1_39_2","first-page":"29","article-title":"Tampered text detection via RGB and frequency relationship modeling","volume":"8","author":"Wang Yuxin","year":"2022","unstructured":"Yuxin Wang, Boqiang Zhang, Hongtao xie, and Yongdong Zhang. 2022. Tampered text detection via RGB and frequency relationship modeling. Chinese Journal of Network and Information Security 8, 3 (2022), 29\u201340.","journal-title":"Chinese Journal of Network and Information Security"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00745"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2023.3279018"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW56347.2022.00018"},{"key":"e_1_3_1_44_2","first-page":"185","article-title":"Rich model for steganalysis of color images","author":"Goljan M.","year":"2014","unstructured":"M. Goljan, J. Fridrich, R. Cogranne. 2014. Rich model for steganalysis of color images. In Proceedings of the 2014 IEEE International Workshop on Information Forensics and Security, 185\u2013190.","journal-title":"Proceedings of the 2014 IEEE International Workshop on Information Forensics and Security"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"e_1_3_1_46_2","first-page":"12077","article-title":"SegFormer: Simple and efficient design for semantic segmentation with transformers","volume":"34","author":"Xie Enze","year":"2021","unstructured":"Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M. Alvarez, and Ping Luo. 2021. SegFormer: Simple and efficient design for semantic segmentation with transformers. Advances In Neural Information Processing Systems 34 (2021), 12077\u201312090.","journal-title":"Advances In Neural Information Processing Systems"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2019.00117"},{"key":"e_1_3_1_48_2","unstructured":"Nist Nimble 2016 Datasets. Retrieved January 23 2022 from https:\/\/www.nist.gov\/itl\/iad\/mig\/nimble-challenge-2017-evaluation\/"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICME.2006.262447"},{"key":"e_1_3_1_50_2","first-page":"422","volume-title":"Proceedings of the 2013 IEEE China Summit and International Conference on Signal and Information Processing","author":"Jiang Dong","year":"2013","unstructured":"Dong Jiang, Wei Wang, and Tieniu Tan. 2013. CASIA image tampering detection evaluation database. In Proceedings of the 2013 IEEE China Summit and International Conference on Signal and Information Processing, 422\u2013426."},{"key":"e_1_3_1_51_2","first-page":"8026","article-title":"PyTorch: An imperative style, high-performance deep learning library","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas K\u00f6pf, Edward Yang, Zach DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems (2019), 8026\u20138037.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_52_2","unstructured":"Diederik P. Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv:1412.6980v9. Retrieved from http:\/\/arxiv.org\/abs\/1412.6980"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2016.79"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2019.00010"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2022.3180556"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686158","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3686158","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:17:50Z","timestamp":1750295870000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3686158"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,30]]},"references-count":54,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,2,28]]}},"alternative-id":["10.1145\/3686158"],"URL":"https:\/\/doi.org\/10.1145\/3686158","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,30]]},"assertion":[{"value":"2023-12-30","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-07-25","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-30","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}