{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,3]],"date-time":"2026-08-03T06:01:54Z","timestamp":1785736914754,"version":"3.56.0"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2021,12,1]],"date-time":"2021-12-01T00:00:00Z","timestamp":1638316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"EPSRC Early Career Fellowship","award":["EP\/N006259\/1"],"award-info":[{"award-number":["EP\/N006259\/1"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:p>We learn a latent space for easy capture, consistent interpolation, and efficient reproduction of visual material appearance. When users provide a photo of a stationary natural material captured under flashlight illumination, first it is converted into a latent material code. Then, in the second step, conditioned on the material code, our method produces an infinite and diverse spatial field of BRDF model parameters (diffuse albedo, normals, roughness, specular albedo) that subsequently allows rendering in complex scenes and illuminations, matching the appearance of the input photograph. Technically, we jointly embed all flash images into a latent space using a convolutional encoder, and -conditioned on these latent codes- convert random spatial fields into fields of BRDF parameters using a convolutional neural network (CNN). We condition these BRDF parameters to match the visual characteristics (statistics and spectra of visual features) of the input under matching light. A user study compares our approach favorably to previous work, even those with access to BRDF supervision. Project webpage: https:\/\/henzler.github.io\/publication\/neuralmaterial\/.<\/jats:p>","DOI":"10.1145\/3478513.3480507","type":"journal-article","created":{"date-parts":[[2021,12,10]],"date-time":"2021-12-10T18:29:20Z","timestamp":1639160960000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":57,"title":["Generative modelling of BRDF textures from flash images"],"prefix":"10.1145","volume":"40","author":[{"given":"Philipp","family":"Henzler","sequence":"first","affiliation":[{"name":"University College London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Valentin","family":"Deschaintre","sequence":"additional","affiliation":[{"name":"Adobe Research and Imperial College London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niloy J.","family":"Mitra","sequence":"additional","affiliation":[{"name":"University College London and Adobe Research, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tobias","family":"Ritschel","sequence":"additional","affiliation":[{"name":"University College London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,12,10]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925917"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882311"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1576246.1531330"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.5555\/3305381.3305430"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Mark Boss Varun Jampani Kihwan Kim Hendrik P.A. Lensch and Jan Kautz. 2020. Two-shot Spatially-varying BRDF and Shape Estimation. In CVPR.  Mark Boss Varun Jampani Kihwan Kim Hendrik P.A. Lensch and Jan Kautz. 2020. Two-shot Spatially-varying BRDF and Shape Estimation. In CVPR.","DOI":"10.1109\/CVPR42600.2020.00404"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073264"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/357290.357293"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201378"},{"key":"e_1_2_2_10_1","volume-title":"Flexible SVBRDF Capture with a Multi-Image Deep Network. Comp Graph Forum 38, 4","author":"Deschaintre Valentin","year":"2019","unstructured":"Valentin Deschaintre , Miika Aittala , Fr\u00e9do Durand , George Drettakis , and Adrien Bousseau . 2019. Flexible SVBRDF Capture with a Multi-Image Deep Network. Comp Graph Forum 38, 4 ( 2019 ). Valentin Deschaintre, Miika Aittala, Fr\u00e9do Durand, George Drettakis, and Adrien Bousseau. 2019. Flexible SVBRDF Capture with a Multi-Image Deep Network. Comp Graph Forum 38, 4 (2019)."},{"key":"e_1_2_2_11_1","volume-title":"Guided Fine-Tuning for Large-Scale Material Transfer. Comp Graph Forum (Proc. EGSR) 39, 4","author":"Deschaintre Valentin","year":"2020","unstructured":"Valentin Deschaintre , George Drettakis , and Adrien Bousseau . 2020. Guided Fine-Tuning for Large-Scale Material Transfer. Comp Graph Forum (Proc. EGSR) 39, 4 ( 2020 ). Valentin Deschaintre, George Drettakis, and Adrien Bousseau. 2020. Guided Fine-Tuning for Large-Scale Material Transfer. Comp Graph Forum (Proc. EGSR) 39, 4 (2020)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Valentin Deschaintre Yiming Lin and Abhijeet Ghosh. 2021. Deep polarization imaging for 3D shape and SVBRDF acquisition. In CVPR.  Valentin Deschaintre Yiming Lin and Abhijeet Ghosh. 2021. Deep polarization imaging for 3D shape and SVBRDF acquisition. In CVPR.","DOI":"10.1109\/CVPR46437.2021.01531"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/850924.851569"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323042"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/2969239.2969269"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2742999"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12867"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459854"},{"key":"e_1_2_2_19_1","volume-title":"A Bayesian Inference Framework for Procedural Material Parameter Estimation. Comp Graph Forum 39, 7","author":"Guo Yu","year":"2020","unstructured":"Yu Guo , Milo\u0161 Ha\u0161an , Lingqi Yan , and Shuang Zhao . 2020a. A Bayesian Inference Framework for Procedural Material Parameter Estimation. Comp Graph Forum 39, 7 ( 2020 ). Yu Guo, Milo\u0161 Ha\u0161an, Lingqi Yan, and Shuang Zhao. 2020a. A Bayesian Inference Framework for Procedural Material Parameter Estimation. Comp Graph Forum 39, 7 (2020)."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417779"},{"key":"e_1_2_2_21_1","unstructured":"Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR. 770--8.  Kaiming He Xiangyu Zhang Shaoqing Ren and Jian Sun. 2016. Deep residual learning for image recognition. In CVPR. 770--8."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218446"},{"key":"e_1_2_2_23_1","article-title":"Understanding the Masking-Shadowing Function in Microfacet-Based BRDFs","volume":"3","author":"Heitz Eric","year":"2014","unstructured":"Eric Heitz . 2014 . Understanding the Masking-Shadowing Function in Microfacet-Based BRDFs . Journal of Computer Graphics Techniques (JCGT) 3 , 2 (30 June 2014), 48--107. http:\/\/jcgt.org\/published\/0003\/02\/03\/ Eric Heitz. 2014. Understanding the Masking-Shadowing Function in Microfacet-Based BRDFs. Journal of Computer Graphics Techniques (JCGT) 3, 2 (30 June 2014), 48--107. http:\/\/jcgt.org\/published\/0003\/02\/03\/","journal-title":"Journal of Computer Graphics Techniques (JCGT)"},{"key":"e_1_2_2_24_1","volume-title":"Learning a Neural 3D Texture Space from 2D Exemplars. CVPR","author":"Henzler Philipp","year":"2020","unstructured":"Philipp Henzler , Niloy J Mitra , and Tobias Ritschel . 2020. Learning a Neural 3D Texture Space from 2D Exemplars. CVPR ( 2020 ). Philipp Henzler, Niloy J Mitra, and Tobias Ritschel. 2020. Learning a Neural 3D Texture Space from 2D Exemplars. CVPR (2020)."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356516"},{"key":"e_1_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Xun Huang and Serge Belongie. 2017. Arbitrary style transfer in real-time with adaptive instance normalization. In ICCV. 1501--10.  Xun Huang and Serge Belongie. 2017. Arbitrary style transfer in real-time with adaptive instance normalization. In ICCV. 1501--10.","DOI":"10.1109\/ICCV.2017.167"},{"key":"e_1_2_2_27_1","doi-asserted-by":"crossref","unstructured":"Justin Johnson Alexandre Alahi and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In ECCV.  Justin Johnson Alexandre Alahi and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In ECCV.","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"e_1_2_2_28_1","volume-title":"Texture and visual perception. Scientific American 212, 2","author":"Julesz Bela","year":"1965","unstructured":"Bela Julesz . 1965. Texture and visual perception. Scientific American 212, 2 ( 1965 ). Bela Julesz. 1965. Texture and visual perception. Scientific American 212, 2 (1965)."},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Tero Karras Samuli Laine and Timo Aila. 2019. A style-based generator architecture for generative adversarial networks. In CVPR. 4401--10.  Tero Karras Samuli Laine and Timo Aila. 2019. A style-based generator architecture for generative adversarial networks. In CVPR. 4401--10.","DOI":"10.1109\/CVPR.2019.00453"},{"key":"e_1_2_2_30_1","volume-title":"Auto-encoding variational bayes. arXiv:1312.6114","author":"Kingma Diederik P","year":"2013","unstructured":"Diederik P Kingma and Max Welling . 2013. Auto-encoding variational bayes. arXiv:1312.6114 ( 2013 ). Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv:1312.6114 (2013)."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073263"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073641"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00568"},{"key":"e_1_2_2_34_1","unstructured":"Zhengqin Li Kalyan Sunkavalli and Manmohan Chandraker. 2018a. Materials for masses: SVBRDF acquisition with a single mobile phone image. In ECCV. 72--87.  Zhengqin Li Kalyan Sunkavalli and Manmohan Chandraker. 2018a. Materials for masses: SVBRDF acquisition with a single mobile phone image. In ECCV. 72--87."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275055"},{"key":"e_1_2_2_36_1","unstructured":"Guilin Liu Duygu Ceylan Ersin Yumer Jimei Yang and Jyh-Ming Lien. 2017. Material editing using a physically based rendering network. In ICCV. 2261--9.  Guilin Liu Duygu Ceylan Ersin Yumer Jimei Yang and Jyh-Ming Lien. 2017. Material editing using a physically based rendering network. In ICCV. 2261--9."},{"key":"e_1_2_2_37_1","doi-asserted-by":"crossref","unstructured":"Gang Liu Yann Gousseau and Gui-Song Xia. 2016. Texture synthesis through convolutional neural networks and spectrum constraints. In ICPR. 3234--9.  Gang Liu Yann Gousseau and Gui-Song Xia. 2016. Texture synthesis through convolutional neural networks and spectrum constraints. In ICPR. 3234--9.","DOI":"10.1109\/ICPR.2016.7900133"},{"key":"e_1_2_2_38_1","volume-title":"The fractal geometry of nature","author":"Mandelbrot Benoit B","unstructured":"Benoit B Mandelbrot . 1983. The fractal geometry of nature . Vol. 173 . WH Freeman New York . Benoit B Mandelbrot. 1983. The fractal geometry of nature. Vol. 173. WH Freeman New York."},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882343"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1186822.1073262"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275017"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699645"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356498"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275066"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/325334.325247"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/360825.360839"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1026553619983"},{"key":"e_1_2_2_48_1","doi-asserted-by":"crossref","unstructured":"K. Rematas T. Ritschel M. Fritz E. Gavves and T. Tuytelaars. 2016. Deep Reflectance Maps. In CVPR.  K. Rematas T. Ritschel M. Fritz E. Gavves and T. Tuytelaars. 2016. Deep Reflectance Maps. In CVPR.","DOI":"10.1109\/CVPR.2016.488"},{"key":"e_1_2_2_49_1","volume-title":"U-net: Convolutional networks for biomedical image segmentation. In MICCAI. 234--41.","author":"Ronneberger Olaf","year":"2015","unstructured":"Olaf Ronneberger , Philipp Fischer , and Thomas Brox . 2015 . U-net: Convolutional networks for biomedical image segmentation. In MICCAI. 234--41. Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In MICCAI. 234--41."},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1111\/1467-8659.1330233"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.5555\/2600281.2600288"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3015461"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980242"},{"key":"e_1_2_2_54_1","volume-title":"Singan: Learning a generative model from a single natural image. In ICCV.","author":"Shaham Tamar Rott","year":"2019","unstructured":"Tamar Rott Shaham , Tali Dekel , and Tomer Michaeli . 2019 . Singan: Learning a generative model from a single natural image. In ICCV. Tamar Rott Shaham, Tali Dekel, and Tomer Michaeli. 2019. Singan: Learning a generative model from a single natural image. In ICCV."},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417781"},{"key":"e_1_2_2_56_1","volume-title":"Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman . 2014. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556 ( 2014 ). Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556 (2014)."},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/3045390.3045533"},{"key":"e_1_2_2_58_1","doi-asserted-by":"crossref","unstructured":"Dmitry Ulyanov Andrea Vedaldi and Victor Lempitsky. 2017. Improved texture networks: Maximizing quality and diversity in feed-forward stylization and texture synthesis. In CVPR.  Dmitry Ulyanov Andrea Vedaldi and Victor Lempitsky. 2017. Improved texture networks: Maximizing quality and diversity in feed-forward stylization and texture synthesis. In CVPR.","DOI":"10.1109\/CVPR.2017.437"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383847.2383874"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.345009"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13560"},{"key":"e_1_2_2_62_1","unstructured":"Yezi Zhao Beibei Wang Yanning Xu Zheng Zeng Lu Wang and Nicolas Holzschuch. 2020. Joint SVBRDF Recovery and Synthesis From a Single Image using an Unsupervised Generative Adversarial Network. In EGSR.  Yezi Zhao Beibei Wang Yanning Xu Zheng Zeng Lu Wang and Nicolas Holzschuch. 2020. Joint SVBRDF Recovery and Synthesis From a Single Image using an Unsupervised Generative Adversarial Network. In EGSR."},{"key":"e_1_2_2_63_1","volume-title":"Adversarial Single-Image SVBRDF Estimation with Hybrid Training. Computer Graphics Forum (Proc. Eurographics)","author":"Zhou Xilong","year":"2021","unstructured":"Xilong Zhou and Nima Khademi Kalantari . 2021. Adversarial Single-Image SVBRDF Estimation with Hybrid Training. Computer Graphics Forum (Proc. Eurographics) ( 2021 ). Xilong Zhou and Nima Khademi Kalantari. 2021. Adversarial Single-Image SVBRDF Estimation with Hybrid Training. Computer Graphics Forum (Proc. Eurographics) (2021)."},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201285"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201307"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480507","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478513.3480507","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:11:49Z","timestamp":1750191109000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478513.3480507"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12]]},"references-count":65,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["10.1145\/3478513.3480507"],"URL":"https:\/\/doi.org\/10.1145\/3478513.3480507","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12]]},"assertion":[{"value":"2021-12-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}