{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:09:19Z","timestamp":1784268559998,"version":"3.55.0"},"reference-count":33,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,7,19]],"date-time":"2021-07-19T00:00:00Z","timestamp":1626652800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["1703957"],"award-info":[{"award-number":["1703957"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>We propose NeuMIP, a neural method for representing and rendering a variety of material appearances at different scales. Classical prefiltering (mipmapping) methods work well on simple material properties such as diffuse color, but fail to generalize to normals, self-shadowing, fibers or more complex microstructures and reflectances. In this work, we generalize traditional mipmap pyramids to pyramids of neural textures, combined with a fully connected network. We also introduce neural offsets, a novel method which enables rendering materials with intricate parallax effects without any tessellation. This generalizes classical parallax mapping, but is trained without supervision by any explicit heightfield. Neural materials within our system support a 7-dimensional query, including position, incoming and outgoing direction, and the desired filter kernel size. The materials have small storage (on the order of standard mipmapping except with more texture channels), and can be integrated within common Monte-Carlo path tracing systems. We demonstrate our method on a variety of materials, resulting in complex appearance across levels of detail, with accurate parallax, self-shadowing, and other effects.<\/jats:p>","DOI":"10.1145\/3450626.3459795","type":"journal-article","created":{"date-parts":[[2021,7,20]],"date-time":"2021-07-20T00:04:27Z","timestamp":1626739467000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":66,"title":["NeuMIP"],"prefix":"10.1145","volume":"40","author":[{"given":"Alexandr","family":"Kuznetsov","sequence":"first","affiliation":[{"name":"University of California"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Krishna","family":"Mullia","sequence":"additional","affiliation":[{"name":"Adobe Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zexiang","family":"Xu","sequence":"additional","affiliation":[{"name":"Adobe Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Milo\u0161","family":"Ha\u0161an","sequence":"additional","affiliation":[{"name":"Adobe Research"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ravi","family":"Ramamoorthi","sequence":"additional","affiliation":[{"name":"University of California"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,7,19]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Adobe. 2021. Substance Source library. https:\/\/source.substance3d.com.  Adobe. 2021. Substance Source library. https:\/\/source.substance3d.com."},{"key":"e_1_2_2_2_1","unstructured":"Barry G Becker and Nelson L Max. 1993. Smooth transitions between bump rendering algorithms. In SIGGRAPH 93. 183--190.  Barry G Becker and Nelson L Max. 1993. Smooth transitions between bump rendering algorithms. In SIGGRAPH 93. 183--190."},{"key":"e_1_2_2_3_1","volume-title":"Neural reflectance fields for appearance acquisition. arXiv preprint arXiv:2008.03824","author":"Bi Sai","year":"2020","unstructured":"Sai Bi , Zexiang Xu , Pratul Srinivasan , Ben Mildenhall , Kalyan Sunkavalli , Milo\u0161 Ha\u0161an , Yannick Hold-Geoffroy , David Kriegman , and Ravi Ramamoorthi . 2020. Neural reflectance fields for appearance acquisition. arXiv preprint arXiv:2008.03824 ( 2020 ). Sai Bi, Zexiang Xu, Pratul Srinivasan, Ben Mildenhall, Kalyan Sunkavalli, Milo\u0161 Ha\u0161an, Yannick Hold-Geoffroy, David Kriegman, and Ravi Ramamoorthi. 2020. Neural reflectance fields for appearance acquisition. arXiv preprint arXiv:2008.03824 (2020)."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.81"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12830"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/300776.300778"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508422"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.246"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276412"},{"key":"e_1_2_2_10_1","unstructured":"Wenzel Jakob. 2010. Mitsuba renderer. http:\/\/www.mitsuba-renderer.org.  Wenzel Jakob. 2010. Mitsuba renderer. http:\/\/www.mitsuba-renderer.org."},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2601097.2601186","article-title":"Discrete stochastic microfacet models","volume":"33","author":"Jakob Wenzel","year":"2014","unstructured":"Wenzel Jakob , Milo\u0161 Ha\u0161an , Ling-Qi Yan , Jason Lawrence , Ravi Ramamoorthi , and Steve Marschner . 2014 . Discrete stochastic microfacet models . ACM Transactions on Graphics (TOG) 33 , 4 (2014), 1 -- 10 . Wenzel Jakob, Milo\u0161 Ha\u0161an, Ling-Qi Yan, Jason Lawrence, Ravi Ramamoorthi, and Steve Marschner. 2014. Discrete stochastic microfacet models. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1--10.","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"e_1_2_2_12_1","volume-title":"Proceedings of the ICAT 2001 (01","author":"Kaneko Tomomichi","year":"2001","unstructured":"Tomomichi Kaneko , Toshiyuki Takahei , Masahiko Inami , Naoki Kawakami , Yasuyuki Yanagida , Taro Maeda , and Susumu Tachi . 2001 . Detailed shape representation with parallax mapping . In Proceedings of the ICAT 2001 (01 2001). Tomomichi Kaneko, Toshiyuki Takahei, Masahiko Inami, Naoki Kawakami, Yasuyuki Yanagida, Taro Maeda, and Susumu Tachi. 2001. Detailed shape representation with parallax mapping. In Proceedings of the ICAT 2001 (01 2001)."},{"key":"e_1_2_2_13_1","unstructured":"Anton S Kaplanyan Stephan Hill Anjul Patney and Aaron E Lefohn. 2016. Filtering distributions of normals for shading antialiasing.. In High Performance Graphics. 151--162.  Anton S Kaplanyan Stephan Hill Anjul Patney and Aaron E Lefohn. 2016. Filtering distributions of normals for shading antialiasing.. In High Performance Graphics. 151--162."},{"key":"e_1_2_2_14_1","volume-title":"3rd International Workshop on Texture Analysis and Synthesis (Texture","author":"Koudelka Melissa L","year":"2003","unstructured":"Melissa L Koudelka , Sebastian Magda , Peter N Belhumeur , and David J Kriegman . 2003 . Acquisition, compression, and synthesis of bidirectional texture functions . In 3rd International Workshop on Texture Analysis and Synthesis (Texture 2003). 59--64. Melissa L Koudelka, Sebastian Magda, Peter N Belhumeur, and David J Kriegman. 2003. Acquisition, compression, and synthesis of bidirectional texture functions. In 3rd International Workshop on Texture Analysis and Synthesis (Texture 2003). 59--64."},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356525"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00882"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58452-8_24"},{"key":"e_1_2_2_18_1","unstructured":"Gero M\u00fcller Jan Meseth and Reinhard Klein. 2003. Compression and Real-Time Rendering of Measured BTFs Using Local PCA.. In VMV. 271--279.  Gero M\u00fcller Jan Meseth and Reinhard Klein. 2003. Compression and Real-Time Rendering of Measured BTFs Using Local PCA.. In VMV. 271--279."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3341156"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417804"},{"key":"e_1_2_2_21_1","volume-title":"Deep Shading: Convolutional Neural Networks for Screen-Space Shading. Computer Graphics Forum (Proc. EGSR 2017)","author":"Nalbach Oliver","year":"2017","unstructured":"Oliver Nalbach , Elena Arabadzhiyska , Dushyant Mehta , Hans-Peter Seidel , and Tobias Ritschel . 2017 . Deep Shading: Convolutional Neural Networks for Screen-Space Shading. Computer Graphics Forum (Proc. EGSR 2017) 36, 4 (2017), 65--78. Oliver Nalbach, Elena Arabadzhiyska, Dushyant Mehta, Hans-Peter Seidel, and Tobias Ritschel. 2017. Deep Shading: Convolutional Neural Networks for Screen-Space Shading. Computer Graphics Forum (Proc. EGSR 2017) 36, 4 (2017), 65--78."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1730804.1730834"},{"key":"e_1_2_2_24_1","unstructured":"Matt Pharr Wenzel Jakob and Greg Humphreys. 2018. PBRT v3. https:\/\/github.com\/mmp\/pbrt-v3\/.  Matt Pharr Wenzel Jakob and Greg Humphreys. 2018. PBRT v3. https:\/\/github.com\/mmp\/pbrt-v3\/."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13921"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.13633"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.488"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323035"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-005-0318-y"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10578-9_11"},{"key":"e_1_2_2_31_1","doi-asserted-by":"crossref","unstructured":"Lance Williams. 1983. Pyramidal parametrics. In SIGGRAPH 83. 1--11.  Lance Williams. 1983. Pyramidal parametrics. In SIGGRAPH 83. 1--11.","DOI":"10.1145\/964967.801126"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322936"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3130800.3130802"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980228"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459795","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3450626.3459795","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3450626.3459795","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:20Z","timestamp":1750191440000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3450626.3459795"}},"subtitle":["multi-resolution neural materials"],"short-title":[],"issued":{"date-parts":[[2021,7,19]]},"references-count":33,"aliases":["10.1145\/3476576.3476763"],"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3450626.3459795"],"URL":"https:\/\/doi.org\/10.1145\/3450626.3459795","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,19]]},"assertion":[{"value":"2021-07-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}