{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T13:25:14Z","timestamp":1762867514576,"version":"3.41.0"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,7,30]],"date-time":"2018-07-30T00:00:00Z","timestamp":1532908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"FWF","award":["P27974"],"award-info":[{"award-number":["P27974"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,8,31]]},"abstract":"<jats:p>We present a learning-based system for rapid mass-scale material synthesis that is useful for novice and expert users alike. The user preferences are learned via Gaussian Process Regression and can be easily sampled for new recommendations. Typically, each recommendation takes 40-60 seconds to render with global illumination, which makes this process impracticable for real-world workflows. Our neural network eliminates this bottleneck by providing high-quality image predictions in real time, after which it is possible to pick the desired materials from a gallery and assign them to a scene in an intuitive manner. Workflow timings against Disney's \"principled\" shader reveal that our system scales well with the number of sought materials, thus empowering even novice users to generate hundreds of high-quality material models without any expertise in material modeling. Similarly, expert users experience a significant decrease in the total modeling time when populating a scene with materials. Furthermore, our proposed solution also offers controllable recommendations and a novel latent space variant generation step to enable the real-time fine-tuning of materials without requiring any domain expertise.<\/jats:p>","DOI":"10.1145\/3197517.3201307","type":"journal-article","created":{"date-parts":[[2018,7,31]],"date-time":"2018-07-31T15:56:23Z","timestamp":1533052583000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["Gaussian material synthesis"],"prefix":"10.1145","volume":"37","author":[{"given":"K\u00e1roly","family":"Zsolnai-Feh\u00e9r","sequence":"first","affiliation":[{"name":"TU Wien, Vienna, Austria"}]},{"given":"Peter","family":"Wonka","sequence":"additional","affiliation":[{"name":"KAUST, Thuwal, Kingdom of Saudi Arabia"}]},{"given":"Michael","family":"Wimmer","sequence":"additional","affiliation":[{"name":"TU Wien, Vienna, Austria"}]}],"member":"320","published-online":{"date-parts":[[2018,7,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925917"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461978"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766967"},{"key":"e_1_2_2_4_1","first-page":"63","article-title":"RBF interpolation and Gaussian process regression through an RKHS formulation","volume":"3","author":"Anjyo Ken","year":"2011","unstructured":"Ken Anjyo and JP Lewis . 2011 . RBF interpolation and Gaussian process regression through an RKHS formulation . Journal of Math-for-Industry 3 , 6 (2011), 63 -- 71 . Ken Anjyo and JP Lewis. 2011. RBF interpolation and Gaussian process regression through an RKHS formulation. Journal of Math-for-Industry 3, 6 (2011), 63--71.","journal-title":"Journal of Math-for-Industry"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12310"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073708"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976603321780317"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462002"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141979"},{"key":"e_1_2_2_10_1","unstructured":"Manuel Blum and Martin A Riedmiller. 2013. Optimization of Gaussian process hyper-parameters using Rprop.. In ESANN. 339--344.  Manuel Blum and Martin A Riedmiller. 2013. Optimization of Gaussian process hyper-parameters using Rprop.. In ESANN. 339--344."},{"key":"e_1_2_2_11_1","volume-title":"Optimizing the Latent Space of Generative Networks. arXiv preprint arXiv:1707.05776","author":"Bojanowski Piotr","year":"2017","unstructured":"Piotr Bojanowski , Armand Joulin , David Lopez-Paz , and Arthur Szlam . 2017. Optimizing the Latent Space of Generative Networks. arXiv preprint arXiv:1707.05776 ( 2017 ). Piotr Bojanowski, Armand Joulin, David Lopez-Paz, and Arthur Szlam. 2017. Optimizing the Latent Space of Generative Networks. arXiv preprint arXiv:1707.05776 (2017)."},{"key":"e_1_2_2_12_1","volume-title":"ACM SIGGRAPH","volume":"2012","author":"Burley Brent","year":"2012","unstructured":"Brent Burley and Walt Disney Animation Studios . 2012 . Physically-based Shading at Disney . In ACM SIGGRAPH , Vol. 2012 . 1--7. Brent Burley and Walt Disney Animation Studios. 2012. Physically-based Shading at Disney. In ACM SIGGRAPH, Vol. 2012. 1--7."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1137\/0916069"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601212"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818096"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1409060.1409081"},{"key":"e_1_2_2_17_1","volume-title":"Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:1511.07289","author":"Clevert Djork-Arn\u00e9","year":"2015","unstructured":"Djork-Arn\u00e9 Clevert , Thomas Unterthiner , and Sepp Hochreiter . 2015. Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:1511.07289 ( 2015 ). Djork-Arn\u00e9 Clevert, Thomas Unterthiner, and Sepp Hochreiter. 2015. Fast and accurate deep network learning by exponential linear units (elus). arXiv preprint arXiv:1511.07289 (2015)."},{"key":"e_1_2_2_18_1","volume-title":"Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. 249--256","author":"Glorot Xavier","year":"2010","unstructured":"Xavier Glorot and Yoshua Bengio . 2010 . Understanding the difficulty of training deep feedforward neural networks . In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. 249--256 . Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics. 249--256."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995713"},{"key":"e_1_2_2_20_1","volume-title":"Reducing the dimensionality of data with neural networks. Science 313, 5786","author":"Hinton Geoffrey E","year":"2006","unstructured":"Geoffrey E Hinton and Ruslan R Salakhutdinov 2006. Reducing the dimensionality of data with neural networks. Science 313, 5786 ( 2006 ), 504--507. Geoffrey E Hinton and Ruslan R Salakhutdinov 2006. Reducing the dimensionality of data with neural networks. Science 313, 5786 (2006), 504--507."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766977"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130880"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4408844"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.223"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778772"},{"key":"e_1_2_2_26_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv.1412.6980","author":"Kingma Diederik","year":"2014","unstructured":"Diederik Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv.1412.6980 (2014). Diederik Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv.1412.6980 (2014)."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647386"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258801"},{"key":"e_1_2_2_29_1","unstructured":"Neil D Lawrence. 2004. Gaussian process latent variable models for visualisation of high dimensional data. In Advances in Neural Information Processing Systems. 329--336.   Neil D Lawrence. 2004. Gaussian process latent variable models for visualisation of high dimensional data. In Advances in Neural Information Processing Systems. 329--336."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.726791"},{"key":"e_1_2_2_31_1","unstructured":"Joel Lehman and Kenneth O Stanley. 2008. Exploiting Open-Endedness to Solve Problems Through the Search for Novelty.. In ALIFE. 329--336.  Joel Lehman and Kenneth O Stanley. 2008. Exploiting Open-Endedness to Solve Problems Through the Search for Novelty.. In ALIFE. 329--336."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001576.2001606"},{"key":"e_1_2_2_33_1","first-page":"2579","article-title":"Visualizing data using t-SNE","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton . 2008 . Visualizing data using t-SNE . Journal of Machine Learning Research 9 , Nov (2008), 2579 -- 2605 . Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, Nov (2008), 2579--2605.","journal-title":"Journal of Machine Learning Research 9"},{"volume-title":"Bayesian methods for backpropagation networks","author":"MacKay David JC","key":"e_1_2_2_34_1","unstructured":"David JC MacKay . 1996. Bayesian methods for backpropagation networks . In Models of Neural Networks III. Springer , 211--254. David JC MacKay. 1996. Bayesian methods for backpropagation networks. In Models of Neural Networks III. Springer, 211--254."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258887"},{"key":"e_1_2_2_36_1","first-page":"52","article-title":"Stacked convolutional auto-encoders for hierarchical feature extraction","volume":"2011","author":"Masci Jonathan","year":"2011","unstructured":"Jonathan Masci , Ueli Meier , Dan Cire\u015fan , and J\u00fcrgen Schmidhuber . 2011 . Stacked convolutional auto-encoders for hierarchical feature extraction . Artificial Neural Networks and Machine Learning-ICANN 2011 (2011), 52 -- 59 . Jonathan Masci, Ueli Meier, Dan Cire\u015fan, and J\u00fcrgen Schmidhuber. 2011. Stacked convolutional auto-encoders for hierarchical feature extraction. Artificial Neural Networks and Machine Learning-ICANN 2011 (2011), 52--59.","journal-title":"Artificial Neural Networks and Machine Learning-ICANN"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2929464.2929465"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(05)80056-5"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13225"},{"volume-title":"Bayesian learning for neural networks","author":"Neal Radford M","key":"e_1_2_2_41_1","unstructured":"Radford M Neal . 2012. Bayesian learning for neural networks . Vol. 118 . Springer Science & Business Media . Radford M Neal. 2012. Bayesian learning for neural networks. Vol. 118. Springer Science & Business Media."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.178"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1992.4.4.473"},{"key":"e_1_2_2_44_1","volume-title":"Deconvolution and Checkerboard Artifacts. Distill","author":"Odena Augustus","year":"2016","unstructured":"Augustus Odena , Vincent Dumoulin , and Chris Olah . 2016. Deconvolution and Checkerboard Artifacts. Distill ( 2016 ). Augustus Odena, Vincent Dumoulin, and Chris Olah. 2016. Deconvolution and Checkerboard Artifacts. Distill (2016)."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2462009"},{"key":"e_1_2_2_46_1","volume-title":"Proc. of ISCIS VII), Universitat. Citeseer.","author":"Riedmiller Martin","year":"1992","unstructured":"Martin Riedmiller and Heinrich Braun . 1992 . RPROP-A fast adaptive learning algorithm . In Proc. of ISCIS VII), Universitat. Citeseer. Martin Riedmiller and Heinrich Braun. 1992. RPROP-A fast adaptive learning algorithm. In Proc. of ISCIS VII), Universitat. Citeseer."},{"key":"e_1_2_2_47_1","volume-title":"Photorealistic Facial Texture Inference Using Deep Neural Networks. arXiv preprint arXiv:1612.00523","author":"Saito Shunsuke","year":"2016","unstructured":"Shunsuke Saito , Lingyu Wei , Liwen Hu , Koki Nagano , and Hao Li. 2016. Photorealistic Facial Texture Inference Using Deep Neural Networks. arXiv preprint arXiv:1612.00523 ( 2016 ). Shunsuke Saito, Lingyu Wei, Liwen Hu, Koki Nagano, and Hao Li. 2016. Photorealistic Facial Texture Inference Using Deep Neural Networks. arXiv preprint arXiv:1612.00523 (2016)."},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2016.67"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2167076.2167083"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980242"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073690"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2670313"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276411"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.290.5500.2319"},{"key":"e_1_2_2_55_1","first-page":"3371","article-title":"Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion","author":"Vincent Pascal","year":"2010","unstructured":"Pascal Vincent , Hugo Larochelle , Isabelle Lajoie , Yoshua Bengio , and Pierre-Antoine Manzagol . 2010 . Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion . Journal of Machine Learning Research 11 , Dec (2010), 3371 -- 3408 . Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of Machine Learning Research 11, Dec (2010), 3371--3408.","journal-title":"Journal of Machine Learning Research 11"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1167"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539957"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2005.00503.x"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201307","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3197517.3201307","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:44Z","timestamp":1750210784000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201307"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,30]]},"references-count":57,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,8,31]]}},"alternative-id":["10.1145\/3197517.3201307"],"URL":"https:\/\/doi.org\/10.1145\/3197517.3201307","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2018,7,30]]},"assertion":[{"value":"2018-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}