{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T15:42:16Z","timestamp":1774539736671,"version":"3.50.1"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001711","name":"Swiss National Science Foundation","doi-asserted-by":"crossref","award":["CRSII5-180359"],"award-info":[{"award-number":["CRSII5-180359"]}],"id":[{"id":"10.13039\/501100001711","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2024,7,19]]},"abstract":"<jats:p>Texture modeling and synthesis are essential for enhancing the realism of virtual environments. Methods that directly synthesize textures in 3D offer distinct advantages to the UV-mapping-based methods as they can create seamless textures and align more closely with the ways textures form in nature. We propose Mesh Neural Cellular Automata (MeshNCA), a method that directly synthesizes dynamic textures on 3D meshes without requiring any UV maps. MeshNCA is a generalized type of cellular automata that can operate on a set of cells arranged on non-grid structures such as the vertices of a 3D mesh. MeshNCA accommodates multi-modal supervision and can be trained using different targets such as images, text prompts, and motion vector fields. Only trained on an Icosphere mesh, MeshNCA shows remarkable test-time generalization and can synthesize textures on unseen meshes in real time. We conduct qualitative and quantitative comparisons to demonstrate that MeshNCA outperforms other 3D texture synthesis methods in terms of generalization and producing high-quality textures. Moreover, we introduce a way of grafting trained MeshNCA instances, enabling interpolation between textures. MeshNCA allows several user interactions including texture density\/orientation controls, grafting\/regenerate brushes, and motion speed\/direction controls. Finally, we implement the forward pass of our MeshNCA model using the WebGL shading language and showcase our trained models in an online interactive demo, which is accessible on personal computers and smartphones and is available at https:\/\/meshnca.github.io\/.<\/jats:p>","DOI":"10.1145\/3658127","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T14:47:57Z","timestamp":1721400477000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Mesh Neural Cellular Automata"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1163-1962","authenticated-orcid":false,"given":"Ehsan","family":"Pajouheshgar","sequence":"first","affiliation":[{"name":"School of Computer and Communication Sciences, EPFL, Lausanne, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9024-6746","authenticated-orcid":false,"given":"Yitao","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Sciences, EPFL, Lausanne, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-4107-0929","authenticated-orcid":false,"given":"Alexander","family":"Mordvintsev","sequence":"additional","affiliation":[{"name":"Google Research, Zurich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1488-9037","authenticated-orcid":false,"given":"Eyvind","family":"Niklasson","sequence":"additional","affiliation":[{"name":"Google Research, Zurich, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5818-4285","authenticated-orcid":false,"given":"Tong","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Sciences, EPFL, Lausanne, Switzerland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0441-6068","authenticated-orcid":false,"given":"Sabine","family":"S\u00fcsstrunk","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Sciences, EPFL, Lausanne, Switzerland"}]}],"member":"320","published-online":{"date-parts":[[2024,7,19]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-010-0390-2"},{"key":"e_1_2_2_2_1","volume-title":"Mesh2Tex: Generating Mesh Textures from Image Queries. arXiv preprint arXiv:2304.05868","author":"Bokhovkin Alexey","year":"2023","unstructured":"Alexey Bokhovkin, Shubham Tulsiani, and Angela Dai. 2023. Mesh2Tex: Generating Mesh Textures from Image Queries. arXiv preprint arXiv:2304.05868 (2023)."},{"key":"e_1_2_2_4_1","volume-title":"Learning to predict 3d objects with an interpolation-based differentiable renderer. Advances in neural information processing systems 32","author":"Chen Wenzheng","year":"2019","unstructured":"Wenzheng Chen, Huan Ling, Jun Gao, Edward Smith, Jaakko Lehtinen, Alec Jacobson, and Sanja Fidler. 2019. Learning to predict 3d objects with an interpolation-based differentiable renderer. Advances in neural information processing systems 32 (2019)."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201378"},{"key":"e_1_2_2_6_1","volume-title":"Image and Vision Computing","author":"Dharma K. C.","unstructured":"K. C. Dharma, Clayton T. Morrison, and Bradley Walls. 2023. Texture Generation Using a Graph Generative Adversarial Network and Differentiable Rendering. In Image and Vision Computing, Wei Qi Yan, Minh Nguyen, and Martin Stommel (Eds.). Springer Nature Switzerland, Cham, 388--401."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.5555\/850924.851569"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218447"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/8579.003.0012"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530164"},{"key":"e_1_2_2_11_1","volume-title":"Texture synthesis using convolutional neural networks. Advances in Neural Information Processing Systems 28","author":"Gatys Leon","year":"2015","unstructured":"Leon Gatys, Alexander S Ecker, and Matthias Bethge. 2015. Texture synthesis using convolutional neural networks. Advances in Neural Information Processing Systems 28 (2015)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1778(199907\/09)10:3<143::AID-VIS204>3.0.CO;2-W"},{"key":"e_1_2_2_13_1","first-page":"20983","article-title":"Learning graph cellular automata","volume":"34","author":"Grattarola Daniele","year":"2021","unstructured":"Daniele Grattarola, Lorenzo Livi, and Cesare Alippi. 2021. Learning graph cellular automata. Advances in Neural Information Processing Systems 34 (2021), 20983--20994.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_14_1","volume-title":"Archives of the game developers conference","author":"Green Robin","unstructured":"Robin Green. 2003. Spherical harmonic lighting: The gritty details. In Archives of the game developers conference, Vol. 56. 4."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530173"},{"key":"e_1_2_2_16_1","volume-title":"Computer Graphics Forum","author":"Gutierrez Jorge","unstructured":"Jorge Gutierrez, Julien Rabin, Bruno Galerne, and Thomas Hurtut. 2020. On demand solid texture synthesis using deep 3d networks. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 511--530."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-006-0078-3"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00838"},{"key":"e_1_2_2_19_1","first-page":"1","article-title":"A novel framework for inverse procedural texture modeling","volume":"38","author":"Hu Yiwei","year":"2019","unstructured":"Yiwei Hu, Julie Dorsey, and Holly Rushmeier. 2019. A novel framework for inverse procedural texture modeling. ACM Transactions on Graphics (ToG) 38, 6 (2019), 1--14.","journal-title":"ACM Transactions on Graphics (ToG)"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588432.3591520"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528233.3530707"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01029"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276380"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141921"},{"key":"e_1_2_2_25_1","first-page":"30923","article-title":"Tango: Text-driven photorealistic and robust 3d stylization via lighting decomposition","volume":"35","author":"Lei Jiabao","year":"2022","unstructured":"Jiabao Lei, Yabin Zhang, Kui Jia, et al. 2022. Tango: Text-driven photorealistic and robust 3d stylization via lighting decomposition. Advances in Neural Information Processing Systems 35 (2022), 30923--30936.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00258"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2008.01.003"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01313"},{"key":"e_1_2_2_29_1","volume-title":"\u03bcNCA: Texture Generation with Ultra-Compact Neural Cellular Automata. arXiv preprint arXiv:2111.13545","author":"Mordvintsev Alexander","year":"2021","unstructured":"Alexander Mordvintsev and Eyvind Niklasson. 2021. \u03bcNCA: Texture Generation with Ultra-Compact Neural Cellular Automata. arXiv preprint arXiv:2111.13545 (2021)."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.23915\/distill.00012"},{"key":"e_1_2_2_31_1","volume-title":"Differentiable Programming of Reaction-Diffusion Patterns. In ALIFE 2022: The 2022 Conference on Artificial Life. MIT Press.","author":"Mordvintsev Alexander","year":"2021","unstructured":"Alexander Mordvintsev, Ettore Randazzo, and Eyvind Niklasson. 2021. Differentiable Programming of Reaction-Diffusion Patterns. In ALIFE 2022: The 2022 Conference on Artificial Life. MIT Press."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.23915\/distill.00023"},{"key":"e_1_2_2_33_1","first-page":"745","article-title":"Theory of self-reproducing automata","volume":"21","author":"von Neumann John","year":"1966","unstructured":"John von Neumann. 1966. Theory of self-reproducing automata. Math. Comp. 21 (1966), 745.","journal-title":"Math. Comp."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.23915\/distill.00027.003"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00463"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52729.2023.01987"},{"key":"e_1_2_2_37_1","unstructured":"Joao Paulo. 2019. Free seamless PBR textures with Diffuse Normal Displacement Occlusion and Roughness Maps. https:\/\/3dtextures.me\/"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/325334.325246"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/325165.325247"},{"key":"e_1_2_2_40_1","first-page":"6994","article-title":"Gramgan: Deep 3d texture synthesis from 2d exemplars","volume":"33","author":"Portenier Tiziano","year":"2020","unstructured":"Tiziano Portenier, Siavash Arjomand Bigdeli, and Orcun Goksel. 2020. Gramgan: Deep 3d texture synthesis from 2d exemplars. Advances in Neural Information Processing Systems 33 (2020), 6994--7004.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_41_1","volume-title":"International conference on machine learning. PMLR, 8748--8763","author":"Radford Alec","year":"2021","unstructured":"Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. 2021. Learning transferable visual models from natural language supervision. In International conference on machine learning. PMLR, 8748--8763."},{"key":"e_1_2_2_42_1","volume-title":"Texture: Text-guided texturing of 3d shapes. arXiv preprint arXiv:2302.01721","author":"Richardson Elad","year":"2023","unstructured":"Elad Richardson, Gal Metzer, Yuval Alaluf, Raja Giryes, and Daniel Cohen-Or. 2023. Texture: Text-guided texturing of 3d shapes. arXiv preprint arXiv:2302.01721 (2023)."},{"key":"e_1_2_2_43_1","first-page":"1","article-title":"Match: Differentiable material graphs for procedural material capture","volume":"39","author":"Shi Liang","year":"2020","unstructured":"Liang Shi, Beichen Li, Milo\u0161 Ha\u0161an, Kalyan Sunkavalli, Tamy Boubekeur, Radomir Mech, and Wojciech Matusik. 2020. Match: Differentiable material graphs for procedural material capture. ACM Transactions on Graphics (TOG) 39, 6 (2020), 1--15.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-20062-5_5"},{"key":"e_1_2_2_45_1","volume-title":"3rd International Conference on Learning Representations, ICLR","author":"Simonyan Karen","year":"2015","unstructured":"Karen Simonyan and Andrew Zisserman. 2015. Very Deep Convolutional Networks for Large-Scale Image Recognition. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7--9, 2015, Conference Track Proceedings, Yoshua Bengio and Yann LeCun (Eds.). http:\/\/arxiv.org\/abs\/1409.1556"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3503161.3548146"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3531232.3531237"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00701"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.1952.0012"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/127719.122749"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383297"},{"key":"e_1_2_2_52_1","volume-title":"Computer Graphics Forum","author":"Vallet Bruno","unstructured":"Bruno Vallet and Bruno L\u00e9vy. 2008. Spectral geometry processing with manifold harmonics. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 251--260."},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383298"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7091-6242-2_28"},{"key":"e_1_2_2_55_1","first-page":"17009","article-title":"Design space for graph neural networks","volume":"33","author":"You Jiaxuan","year":"2020","unstructured":"Jiaxuan You, Zhitao Ying, and Jure Leskovec. 2020. Design space for graph neural networks. Advances in Neural Information Processing Systems 33 (2020), 17009--17021.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_2_56_1","volume-title":"Computer graphics forum","author":"Yuksel Cem","unstructured":"Cem Yuksel, Sylvain Lefebvre, and Marco Tarini. 2019. Rethinking texture mapping. In Computer graphics forum, Vol. 38. Wiley Online Library, 535--551."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/1201775.882266"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658127","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3658127","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:05:54Z","timestamp":1750291554000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,19]]},"references-count":56,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,7,19]]}},"alternative-id":["10.1145\/3658127"],"URL":"https:\/\/doi.org\/10.1145\/3658127","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,19]]},"assertion":[{"value":"2024-07-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}