{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T08:16:49Z","timestamp":1774685809295,"version":"3.50.1"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T00:00:00Z","timestamp":1721347200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2040433"],"award-info":[{"award-number":["2040433"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2024,7,19]]},"abstract":"<jats:p>Procedural noise is a fundamental component of computer graphics pipelines, offering a flexible way to generate textures that exhibit \"natural\" random variation. Many different types of noise exist, each produced by a separate algorithm. In this paper, we present a single generative model which can learn to generate multiple types of noise as well as blend between them. In addition, it is capable of producing spatially-varying noise blends despite not having access to such data for training. These features are enabled by training a denoising diffusion model using a novel combination of data augmentation and network conditioning techniques. Like procedural noise generators, the model's behavior is controllable via interpretable parameters plus a source of randomness. We use our model to produce a variety of visually compelling noise textures. We also present an application of our model to improving inverse procedural material design; using our model in place of fixed-type noise nodes in a procedural material graph results in higher-fidelity material reconstructions without needing to know the type of noise in advance. Open-sourced materials can be found at https:\/\/armanmaesumi.github.io\/onenoise\/<\/jats:p>","DOI":"10.1145\/3658195","type":"journal-article","created":{"date-parts":[[2024,7,19]],"date-time":"2024-07-19T14:47:57Z","timestamp":1721400477000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["One Noise to Rule Them All: Learning a Unified Model of Spatially-Varying Noise Patterns"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7898-8061","authenticated-orcid":false,"given":"Arman","family":"Maesumi","sequence":"first","affiliation":[{"name":"Department of Computer Science, Brown University, Providence, Rhode Island, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-9456-9470","authenticated-orcid":false,"given":"Dylan","family":"Hu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Brown University, Providence, Rhode Island, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-5224-2632","authenticated-orcid":false,"given":"Krishi","family":"Saripalli","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Brown University, Providence, Rhode Island, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3996-6588","authenticated-orcid":false,"given":"Vladimir","family":"Kim","sequence":"additional","affiliation":[{"name":"Adobe Research, Seattle, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8908-3417","authenticated-orcid":false,"given":"Matthew","family":"Fisher","sequence":"additional","affiliation":[{"name":"Adobe Research, San Francisco, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1937-9797","authenticated-orcid":false,"given":"Soeren","family":"Pirk","sequence":"additional","affiliation":[{"name":"Christian-Albrecht University of Kiel, Kiel, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8253-0069","authenticated-orcid":false,"given":"Daniel","family":"Ritchie","sequence":"additional","affiliation":[{"name":"Brown University, Providence, United States of America"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,7,19]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Adobe. 2023a. Adobe Substance 3D Designer. https:\/\/www.adobe.com\/products\/substance3d-designer.html."},{"key":"e_1_2_2_2_1","unstructured":"Adobe. 2023b. Adobe Substance 3D Documentation. https:\/\/helpx.adobe.com\/substance-3d-designer\/substance-compositing-graphs\/nodes-reference-for-substance-compositing-graphs\/node-library.html."},{"key":"e_1_2_2_3_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"223","author":"Arjovsky Martin","year":"2017","unstructured":"Martin Arjovsky, Soumith Chintala, and L\u00e9on Bottou. 2017. Wasserstein Generative Adversarial Networks. In Proceedings of the 34th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 70), Doina Precup and Yee Whye Teh (Eds.). PMLR, 214--223. https:\/\/proceedings.mlr.press\/v70\/arjovsky17a.html"},{"key":"e_1_2_2_4_1","volume-title":"Proceedings of the 34th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"477","author":"Bergmann Urs","year":"2017","unstructured":"Urs Bergmann, Nikolay Jetchev, and Roland Vollgraf. 2017. Learning Texture Manifolds with the Periodic Spatial GAN. In Proceedings of the 34th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 70), Doina Precup and Yee Whye Teh (Eds.). PMLR, 469--477. https:\/\/proceedings.mlr.press\/v70\/bergmann17a.html"},{"key":"e_1_2_2_5_1","unstructured":"Blender. 2023. Blender. https:\/\/www.blender.org."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073264"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185578"},{"key":"e_1_2_2_8_1","volume-title":"Diffusion models beat gans on image synthesis. Advances in neural information processing systems 34","author":"Dhariwal Prafulla","year":"2021","unstructured":"Prafulla Dhariwal and Alexander Nichol. 2021. Diffusion models beat gans on image synthesis. Advances in neural information processing systems 34 (2021), 8780--8794."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1185657.1185722"},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"David Ebert Kenton Musgrave Darwyn Peachey Ken Perlin and Steve Worley. 2002. Texturing And Modeling. A Procedural Approach (3 ed.). Morgan Kaufmann.","DOI":"10.1016\/B978-155860848-1\/50029-2"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/358523.358553"},{"key":"e_1_2_2_12_1","volume-title":"Computer Graphics Forum","author":"Galin Eric","unstructured":"Eric Galin, Eric Gu\u00e9rin, Adrien Peytavie, Guillaume Cordonnier, Marie-Paule Cani, Bedrich Benes, and James Gain. 2019. A review of digital terrain modeling. In Computer Graphics Forum, Vol. 38. Wiley Online Library, 553--577."},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","unstructured":"Leon A. Gatys Alexander S. Ecker and Matthias Bethge. 2015. Texture Synthesis Using Convolutional Neural Networks. In NeurIPS.","DOI":"10.1109\/CVPR.2016.265"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461996"},{"key":"e_1_2_2_15_1","volume-title":"MatFormer: A generative model for procedural materials. arXiv preprint arXiv:2207.01044","author":"Guerrero Paul","year":"2022","unstructured":"Paul Guerrero, Milo\u0161 Ha\u0161an, Kalyan Sunkavalli, Radom\u00edr M\u011bch, Tamy Boubekeur, and Niloy J Mitra. 2022. MatFormer: A generative model for procedural materials. arXiv preprint arXiv:2207.01044 (2022)."},{"key":"e_1_2_2_16_1","volume-title":"Computer Graphics Forum","author":"Guo Yu","unstructured":"Yu Guo, Milo\u0161 Ha\u0161an, Lingqi Yan, and Shuang Zhao. 2020. A bayesian inference framework for procedural material parameter estimation. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 255--266."},{"key":"e_1_2_2_17_1","unstructured":"Nicholas Guttenberg. 2023. Diffusion with Offset Noise. (2023)."},{"key":"e_1_2_2_18_1","volume-title":"Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems 30","author":"Heusel Martin","year":"2017","unstructured":"Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems 30 (2017)."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/545261.545288"},{"key":"e_1_2_2_20_1","unstructured":"Jonathan Ho Ajay Jain and Pieter Abbeel. 2020. Denoising diffusion probabilistic"},{"key":"e_1_2_2_21_1","volume-title":"Advances in neural information processing systems 33","year":"2020","unstructured":"models. Advances in neural information processing systems 33 (2020), 6840--6851."},{"key":"e_1_2_2_22_1","first-page":"1","article-title":"A novel framework for inverse procedural texture modeling","volume":"38","author":"Hu Yiwei","year":"2019","unstructured":"Yiwei Hu, Julie Dorsey, and Holly Rushmeier. 2019. A novel framework for inverse procedural texture modeling. ACM Transactions on Graphics (ToG) 38, 6 (2019), 1--14.","journal-title":"ACM Transactions on Graphics (ToG)"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528233.3530733"},{"key":"e_1_2_2_24_1","first-page":"1","article-title":"DU-GAN: Generative adversarial networks with dual-domain U-Net-based discriminators for low-dose CT denoising","volume":"71","author":"Huang Zhizhong","year":"2021","unstructured":"Zhizhong Huang, Junping Zhang, Yi Zhang, and Hongming Shan. 2021. DU-GAN: Generative adversarial networks with dual-domain U-Net-based discriminators for low-dose CT denoising. IEEE Transactions on Instrumentation and Measurement 71 (2021), 1--12.","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1998.710791"},{"key":"e_1_2_2_26_1","unstructured":"Kacper Kania Maciej Zieba and Tomasz Kajdanowicz. 2020. UCSG-NET- Unsupervised Discovering of Constructive Solid Geometry Tree. In Advances in Neural Information Processing Systems."},{"key":"e_1_2_2_27_1","volume-title":"Computer Graphics Forum","author":"Lagae Ares","unstructured":"Ares Lagae, Sylvain Lefebvre, Rob Cook, Tony DeRose, George Drettakis, David S Ebert, John P Lewis, Ken Perlin, and Matthias Zwicker. 2010. A survey of procedural noise functions. In Computer Graphics Forum, Vol. 29. Wiley Online Library, 2579--2600."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531360"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_43"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV57701.2024.00532"},{"key":"e_1_2_2_31_1","unstructured":"Xingchao Liu Xiwen Zhang Jianzhu Ma Jian Peng and Qiang Liu. 2023. InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generation. arXiv:2309.06380 [cs.LG]"},{"key":"e_1_2_2_32_1","volume-title":"Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101","author":"Loshchilov Ilya","year":"2017","unstructured":"Ilya Loshchilov and Frank Hutter. 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 (2017)."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073262"},{"key":"e_1_2_2_34_1","volume-title":"International Conference on Machine Learning. PMLR, 8162--8171","author":"Nichol Alexander Quinn","year":"2021","unstructured":"Alexander Quinn Nichol and Prafulla Dhariwal. 2021. Improved denoising diffusion probabilistic models. In International Conference on Machine Learning. PMLR, 8162--8171."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00244"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/325334.325247"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/566570.566636"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.4310\/AMSA.2018.v3.n1.a4"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.01225"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2022.3143615"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00823"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3015461"},{"key":"e_1_2_2_43_1","volume-title":"Proceedings of the IEEE\/CVF winter conference on applications of computer vision. 3531--3539","author":"Shen Zhuoran","year":"2021","unstructured":"Zhuoran Shen, Mingyuan Zhang, Haiyu Zhao, Shuai Yi, and Hongsheng Li. 2021. Efficient attention: Attention with linear complexities. In Proceedings of the IEEE\/CVF winter conference on applications of computer vision. 3531--3539."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417781"},{"key":"e_1_2_2_45_1","volume-title":"Denoising Diffusion Implicit Models. arXiv:2010.02502 (October","author":"Song Jiaming","year":"2020","unstructured":"Jiaming Song, Chenlin Meng, and Stefano Ermon. 2020. Denoising Diffusion Implicit Models. arXiv:2010.02502 (October 2020). https:\/\/arxiv.org\/abs\/2010.02502"},{"key":"e_1_2_2_46_1","unstructured":"Yang Song. 2021. Generative Modeling by Estimating Gradients of the Data Distribution. https:\/\/yang-song.net\/blog\/2021\/score\/."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322990"},{"key":"e_1_2_2_48_1","volume-title":"Proceedings of The 33rd International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"1357","author":"Ulyanov Dmitry","year":"2016","unstructured":"Dmitry Ulyanov, Vadim Lebedev, Vedaldi Andrea, and Victor Lempitsky. 2016. Texture Networks: Feed-forward Synthesis of Textures and Stylized Images. In Proceedings of The 33rd International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 48), Maria Florina Balcan and Kilian Q. Weinberger (Eds.). PMLR, New York, New York, USA, 1349--1357."},{"key":"e_1_2_2_49_1","volume-title":"The Twelfth International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=3NmO9lY4Jn","author":"Um Soobin","year":"2024","unstructured":"Soobin Um, Suhyeon Lee, and Jong Chul Ye. 2024. Don't Play Favorites: Minority Guidance for Diffusion Models. In The Twelfth International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=3NmO9lY4Jn"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCIAIG.2013.2290371"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237267"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01261-8_1"},{"key":"e_1_2_2_53_1","unstructured":"Zhisheng Xiao Karsten Kreis and Arash Vahdat. 2022. Tackling the Generative Learning Trilemma with Denoising Diffusion GANs. In ICLR."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00612"},{"key":"e_1_2_2_55_1","doi-asserted-by":"crossref","unstructured":"Richard Zhang Phillip Isola Alexei A Efros Eli Shechtman and Oliver Wang. 2018. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. In CVPR.","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588432.3591535"},{"key":"e_1_2_2_57_1","volume-title":"Neural Texture Synthesis with Guided Correspondence. In Conference on Computer Vision and Pattern Recognition (CVPR). 18095--18104","author":"Zhou Yang","year":"2023","unstructured":"Yang Zhou, Kaijian Chen, Rongjun Xiao, and Hui Huang. 2023a. Neural Texture Synthesis with Guided Correspondence. In Conference on Computer Vision and Pattern Recognition (CVPR). 18095--18104."},{"key":"e_1_2_2_58_1","volume-title":"Non-stationary Texture Synthesis by Adversarial Expansion. ACM Transactions on Graphics (Proc. SIGGRAPH) 37, 4","author":"Zhou Yang","year":"2018","unstructured":"Yang Zhou, Zhen Zhu, Xiang Bai, Dani Lischinski, Daniel Cohen-Or, and Hui Huang. 2018. Non-stationary Texture Synthesis by Adversarial Expansion. ACM Transactions on Graphics (Proc. SIGGRAPH) 37, 4 (2018), 49:1--49:13."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658195","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3658195","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3658195","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:04:16Z","timestamp":1750291456000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3658195"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,19]]},"references-count":58,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,7,19]]}},"alternative-id":["10.1145\/3658195"],"URL":"https:\/\/doi.org\/10.1145\/3658195","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,19]]},"assertion":[{"value":"2024-07-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}