{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,12]],"date-time":"2026-01-12T17:53:29Z","timestamp":1768240409015,"version":"3.49.0"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"name":"Hallym University Research Fund","award":["HRF-202501-013"],"award-info":[{"award-number":["HRF-202501-013"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2026,1,31]]},"abstract":"<jats:p>This study systematically addresses the issues of copyright infringement that have emerged with the introduction of neural radiance fields (NeRFs) by defining scenarios and applying and analyzing existing protective technologies tailored to each case. To formalize these threats, we introduce a threat model consisting of security requirements against modality shifts and an attacker model that classifies misuse based on the modalities held by the creator and attacker. This results in nine representative infringement cases that guide our experimental design. Our novel end-to-end watermarking approach is robust against modality changes caused by neural rendering. Independent decoders that vary according to the domain are proposed to extract messages from watermarked data effectively. In addition, a generalized neural rendering (GNR) module is utilized to optimize the various 3D models. These elements are integrated in an end-to-end manner, enhancing the interaction between different modalities and improving the overall performance. This study systematically examines the effectiveness of both the existing and proposed methods through experiments across different distribution modalities.<\/jats:p>","DOI":"10.1145\/3774650","type":"journal-article","created":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T13:03:08Z","timestamp":1762261388000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Robust 3D Watermarking for NeRF-Induced Modality Shifts"],"prefix":"10.1145","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-1512-4988","authenticated-orcid":false,"given":"Seung-Lee","family":"Lee","sequence":"first","affiliation":[{"name":"Hallym University, Chuncheon-si, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9706-6652","authenticated-orcid":false,"given":"Minjae","family":"Kang","sequence":"additional","affiliation":[{"name":"Hallym University, Chuncheon-si, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8092-585X","authenticated-orcid":false,"given":"Bo Seok","family":"Shim","sequence":"additional","affiliation":[{"name":"Hallym University, Chuncheon-si, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7101-0244","authenticated-orcid":false,"given":"Jong-Uk","family":"Hou","sequence":"additional","affiliation":[{"name":"Hallym University, Chuncheon-si, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2026,1,12]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01972"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00539"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/38.736468"},{"issue":"1","key":"e_1_3_2_5_2","first-page":"142","article-title":"An oblivious watermarking for 3-D polygonal meshes using distribution of vertex norms","volume":"55","author":"Cho Jae-Won","year":"2006","unstructured":"Jae-Won Cho, Rmy Prost, and Ho-Youl Jung. 2006. An oblivious watermarking for 3-D polygonal meshes using distribution of vertex norms. IEEE Transactions on Signal Processing 55, 1 (2006), 142\u2013155.","journal-title":"IEEE Transactions on Signal Processing"},{"key":"e_1_3_2_6_2","first-page":"129","volume-title":"Proceedings of the Eurographics Italian Chapter Conference","volume":"2008","author":"Cignoni Paolo","year":"2008","unstructured":"Paolo Cignoni, Marco Callieri, Massimiliano Corsini, Matteo Dellepiane, Fabio Ganovelli, and Guido Ranzuglia. 2008. Meshlab: An open-source mesh processing tool. In Proceedings of the Eurographics Italian Chapter Conference, Vol. 2008, 129\u2013136."},{"key":"e_1_3_2_7_2","first-page":"1","volume-title":"Proceedings of the International Workshop on Digital Watermarking","author":"Cox Ingemar J.","year":"2006","unstructured":"Ingemar J. Cox, Gwena\u00ebl Do\u00ebrr, and Teddy Furon. 2006. Watermarking is not cryptography. In Proceedings of the International Workshop on Digital Watermarking. Springer, 1\u201315."},{"issue":"11","key":"e_1_3_2_8_2","doi-asserted-by":"crossref","first-page":"2780","DOI":"10.1109\/TMM.2019.2962306","article-title":"Blind watermarking for 3-D printed objects by locally modifying layer thickness","volume":"22","author":"Delmotte Arnaud","year":"2019","unstructured":"Arnaud Delmotte, Kenichiro Tanaka, Hiroyuki Kubo, Takuya Funatomi, and Yasuhiro Mukaigawa. 2019. Blind watermarking for 3-D printed objects by locally modifying layer thickness. IEEE Transactions on Multimedia 22, 11 (2019), 2780\u20132791.","journal-title":"IEEE Transactions on Multimedia"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2024.3419761"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA46639.2022.9811809"},{"issue":"11","key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"4075","DOI":"10.1109\/TCSVT.2019.2953720","article-title":"A camera shooting resilient watermarking scheme for underpainting documents","volume":"30","author":"Fang Han","year":"2019","unstructured":"Han Fang, Weiming Zhang, Zehua Ma, Hang Zhou, Shan Sun, Hao Cui, and Nenghai Yu. 2019. A camera shooting resilient watermarking scheme for underpainting documents. IEEE Transactions on Circuits and Systems for Video Technology 30, 11 (2019), 4075\u20134089.","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2003.815963"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258849"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2014.03.012"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.3390\/electronics10202467"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2864331"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIFS.2017.2718482"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.3390\/app8071040"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2023.3245650"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00583"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3475324"},{"key":"e_1_3_2_22_2","first-page":"18365","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Johari Mohammad Mahdi","year":"2022","unstructured":"Mohammad Mahdi Johari, Yann Lepoittevin, and Fran\u00e7ois Fleuret. 2022. GeoNeRF: Generalizing NeRF with geometry priors. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 18365\u201318375."},{"key":"e_1_3_2_23_2","unstructured":"Hangyeol Kang. 2023. Continuous False Advertising of Chinese Games\u2026 Suspicion of Unauthorized Use of Nexon Characters. Retrieved from https:\/\/zdnet.co.kr\/view\/?no=20230922164010"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.5555\/1771881.1771882"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/3592433"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TBC.2012.2206851"},{"key":"e_1_3_2_27_2","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1117\/12.384991","volume-title":"Proceedings of the Security and Watermarking of Multimedia Contents II","author":"Kutter Martin","year":"2000","unstructured":"Martin Kutter, Sviatoslav V. Voloshynovskiy, and Alexander Herrigel. 2000. Watermark copy attack. In Proceedings of the Security and Watermarking of Multimedia Contents II, Vol. 3971, SPIE, 371\u2013380."},{"key":"e_1_3_2_28_2","first-page":"425","volume-title":"Proceedings of the 2008 15th IEEE International Conference on Image Processing","author":"Lee Min-Jeong","year":"2008","unstructured":"Min-Jeong Lee, Kyung-Su Kim, Hae-Yeoun Lee, Tae-Woo Oh, Young-Ho Suh, and Heung-Kyu Lee. 2008. Robust watermark detection against D-A\/A-D conversion for digital cinema using local auto-correlation function. In Proceedings of the 2008 15th IEEE International Conference on Image Processing. IEEE, 425\u2013428."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00047"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2024.3448351"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1145\/1178766.1178774"},{"key":"e_1_3_2_32_2","first-page":"3205","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Li Yixuan","year":"2023","unstructured":"Yixuan Li, Lihan Jiang, Linning Xu, Yuanbo Xiangli, Zhenzhi Wang, Dahua Lin, and Bo Dai. 2023. MatrixCity: A large-scale city dataset for city-scale neural rendering and beyond. In Proceedings of the IEEE\/CVF International Conference on Computer Vision, 3205\u20133215."},{"key":"e_1_3_2_33_2","unstructured":"Zihao Li Pan Gao Hui Yuan Ran Wei and Manoranjan Paul. 2023. Exploiting inductive bias in transformer for point cloud classification and segmentation. arXiv:2304.14124. Retrieved from https:\/\/arxiv.org\/abs\/2304.14124"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2022.3174582"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.09.013"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00780"},{"key":"e_1_3_2_38_2","first-page":"3689","volume-title":"Proceedings of the 2010 IEEE International Conference on Image Processing","author":"Liu Yang","year":"2010","unstructured":"Yang Liu, Balakrishnan Prabhakaran, and Xiaohu Guo. 2010. Blind invisible watermarking for 3D meshes with textures. In Proceedings of the 2010 IEEE International Conference on Image Processing. IEEE, 3689\u20133692."},{"key":"e_1_3_2_39_2","unstructured":"Ziyuan Luo Qing Guo Ka Chun Cheung Simon See and Renjie Wan. 2023. CopyRNeRF: Protecting the copyright of neural radiance fields. arXiv:2307.11526. Retrieved from https:\/\/arxiv.org\/abs\/2307.11526"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2025.3550166"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00713"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3503250"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-017-4678-x"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-021-00860-z"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.00540"},{"key":"e_1_3_2_46_2","first-page":"373","volume-title":"Computer Graphics Forum","author":"Ohbuchi Ryutarou","year":"2002","unstructured":"Ryutarou Ohbuchi, Akio Mukaiyama, and Shigeo Takahashi. 2002. A frequency-domain approach to watermarking 3D shapes. Computer Graphics Forum 21 (2002), 373\u2013382."},{"key":"e_1_3_2_47_2","first-page":"9","volume-title":"Proceedings of the Graphics Interface","volume":"2001","author":"Ohbuchi Ryutarou","year":"2001","unstructured":"Ryutarou Ohbuchi, Shigeo Takahashi, Takahiko Miyazawa, and Akio Mukaiyama. 2001. Watermarking 3D polygonal meshes in the mesh spectral domain. In Proceedings of the Graphics Interface, Vol. 2001, 9\u201317."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/280811.280980"},{"key":"e_1_3_2_49_2","first-page":"652","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Qi Charles R.","year":"2017","unstructured":"Charles R. Qi, Hao Su, Kaichun Mo, and Leonidas J. Guibas. 2017. Pointnet: Deep learning on point sets for 3D classification and segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 652\u2013660."},{"key":"e_1_3_2_50_2","first-page":"1","article-title":"Pointnet++: Deep hierarchical feature learning on point sets in a metric space","volume":"30","author":"Ruizhongtai Qi Charles","year":"2017","unstructured":"Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J. Guibas. 2017. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. In Advances in Neural Information Processing Systems, Vol. 30, 1\u201310.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_51_2","doi-asserted-by":"crossref","unstructured":"Marie-Julie Rakotosaona Fabian Manhardt DiegoMartin Arroyo Michael Niemeyer Abhijit Kundu and Federico Tombari. 2023. NeRFMeshing: Distilling neural radiance fields into geometrically-accurate 3D meshes. arXiv:2303.09431. Retrieved from https:\/\/arxiv.org\/abs\/2303.09431","DOI":"10.1109\/3DV62453.2024.00093"},{"key":"e_1_3_2_52_2","unstructured":"Nikhila Ravi Jeremy Reizenstein David Novotny Taylor Gordon Wan-Yen Lo Justin Johnson and Georgia Gkioxari. 2020. Accelerating 3D deep learning with PyTorch3D. arXiv:2007.08501. Retrieved from https:\/\/arxiv.org\/abs\/2007.08501"},{"key":"e_1_3_2_53_2","unstructured":"Michael Rubloff. 2023. Google Launches Product NeRFs in Search. Retrieved from https:\/\/neuralradiancefields.io\/google-launches-product-nerfs-in-search\/"},{"key":"e_1_3_2_54_2","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Song Qi","year":"2024","unstructured":"Qi Song, Ziyuan Luo, Ka Chun Cheung, Simon See, and Renjie Wan. 2024. Protecting NeRFs\u2019 copyright via plug-and-play watermarking base model. In Proceedings of the European Conference on Computer Vision."},{"issue":"6","key":"e_1_3_2_55_2","doi-asserted-by":"crossref","first-page":"8008","DOI":"10.1109\/TIA.2022.3195972","article-title":"Invisible and readable checkerboard as watermark with temporally brightness modulation","volume":"58","author":"Unno Hiroshi","year":"2022","unstructured":"Hiroshi Unno and Kazutake Uehira. 2022. Invisible and readable checkerboard as watermark with temporally brightness modulation. IEEE Transactions on Industry Applications 58, 6 (2022), 8008\u20138014.","journal-title":"IEEE Transactions on Industry Applications"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2008.2007350"},{"key":"e_1_3_2_57_2","first-page":"1912","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Wu Zhirong","year":"2015","unstructured":"Zhirong Wu, Shuran Song, Aditya Khosla, Fisher Yu, Linguang Zhang, Xiaoou Tang, and Jianxiong Xiao. 2015. 3D ShapeNets: A deep representation for volumetric shapes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1912\u20131920."},{"key":"e_1_3_2_58_2","first-page":"10031","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Yoo Innfarn","year":"2022","unstructured":"Innfarn Yoo, Huiwen Chang, Xiyang Luo, Ondrej Stava, Ce Liu, Peyman Milanfar, and Feng Yang. 2022. Deep 3D-to-2D watermarking: Embedding messages in 3D meshes and extracting them from 2D renderings. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, 10031\u201310040."},{"key":"e_1_3_2_59_2","unstructured":"Yang Zhou Zhen Zhu Xiang Bai Dani Lischinski Daniel Cohen-Or and Hui Huang. 2018. Non-stationary texture synthesis by adversarial expansion. arXiv:1805.04487. Retrieved from https:\/\/arxiv.org\/abs\/1805.04487"},{"key":"e_1_3_2_60_2","first-page":"657","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV)","author":"Zhu Jiren","year":"2018","unstructured":"Jiren Zhu, Russell Kaplan, Justin Johnson, and Li Fei-Fei. 2018. Hidden: Hiding data with deep networks. In Proceedings of the European Conference on Computer Vision (ECCV), 657\u2013672."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3774650","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,12]],"date-time":"2026-01-12T14:33:06Z","timestamp":1768228386000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3774650"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,12]]},"references-count":59,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1,31]]}},"alternative-id":["10.1145\/3774650"],"URL":"https:\/\/doi.org\/10.1145\/3774650","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,12]]},"assertion":[{"value":"2025-02-06","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-25","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-01-12","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}