{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T19:40:32Z","timestamp":1783107632436,"version":"3.54.6"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2023,12,5]],"date-time":"2023-12-05T00:00:00Z","timestamp":1701734400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NSF","award":["1900927"],"award-info":[{"award-number":["1900927"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2023,12,5]]},"abstract":"<jats:p>\n            Recently, great progress has been made in physics-based differentiable rendering. Existing differentiable rendering techniques typically focus on\n            <jats:italic toggle=\"yes\">static<\/jats:italic>\n            scenes, but during inverse rendering---a key application for differentiable rendering---the scene is updated\n            <jats:italic toggle=\"yes\">dynamically<\/jats:italic>\n            by each gradient step. In this paper, we take a first step to leverage temporal data in the context of inverse direct illumination. By adopting reservoir-based spatiotemporal resampled importance resampling (ReSTIR), we introduce new Monte Carlo estimators for both interior and boundary components of differential direct illumination integrals. We also integrate ReSTIR with antithetic sampling to further improve its effectiveness. At equal frame time, our methods produce gradient estimates with up to 100\u00d7 lower relative error than baseline methods. Additionally, we propose an inverse-rendering pipeline that incorporates these estimators and provides reconstructions with up to 20\u00d7 lower error.\n          <\/jats:p>","DOI":"10.1145\/3618331","type":"journal-article","created":{"date-parts":[[2023,12,5]],"date-time":"2023-12-05T10:20:48Z","timestamp":1701771648000},"page":"1-17","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":47,"title":["Amortizing Samples in Physics-Based Inverse Rendering Using ReSTIR"],"prefix":"10.1145","volume":"42","author":[{"given":"Yu-Chen","family":"Wang","sequence":"first","affiliation":[{"name":"University of California, Irvine, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chris","family":"Wyman","sequence":"additional","affiliation":[{"name":"NVIDIA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lifan","family":"Wu","sequence":"additional","affiliation":[{"name":"NVIDIA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuang","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of California, Irvine, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,12,5]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Real-Time Rendering","author":"Akenine-Moller Tomas","unstructured":"Tomas Akenine-Moller, Eric Haines, and Naty Hoffman. 2018. Real-Time Rendering, Fourth Edition (4th ed.). A. K. Peters, Ltd., USA.","edition":"4"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417833"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/1597990.1598035"},{"key":"e_1_2_2_4_1","volume-title":"Spatiotemporal Reservoir Resampling for Real-Time Ray Tracing with Dynamic Direct Lighting. 39, 4","author":"Bitterli Benedikt","year":"2020","unstructured":"Benedikt Bitterli, Chris Wyman, Matt Pharr, Peter Shirley, Aaron Lefohn, and Wojciech Jarosz. 2020. Spatiotemporal Reservoir Resampling for Real-Time Ray Tracing with Dynamic Direct Lighting. 39, 4 (2020), 148:1--148:17."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/MM.2020.2971677"},{"key":"e_1_2_2_6_1","volume-title":"Parameter-space ReSTIR for Differentiable and Inverse Rendering. In ACM SIGGRAPH 2023 Conference Proceedings (SIGGRAPH '23)","author":"Chang Wesley","year":"2023","unstructured":"Wesley Chang, Venkataram Sivaram, Derek Nowrouzezahrai, Toshiya Hachisuka, Ravi Ramamoorthi, and Tzu-Mao Li. 2023. Parameter-space ReSTIR for Differentiable and Inverse Rendering. In ACM SIGGRAPH 2023 Conference Proceedings (SIGGRAPH '23). 10 pages."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/69.3.653"},{"key":"e_1_2_2_8_1","volume-title":"Game Developers Conference. https:\/\/www.gdcvault.com\/play\/1026282\/It-Just-Works-Ray-Traced","author":"Deligiannis Johannes","year":"2019","unstructured":"Johannes Deligiannis and Jan Schmid. 2019. 'It Just Works': Ray-traced Reflections in 'Battlefield V'. Game Developers Conference. https:\/\/www.gdcvault.com\/play\/1026282\/It-Just-Works-Ray-Traced"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566574"},{"key":"e_1_2_2_10_1","volume-title":"Evaluating Derivatives","author":"Griewank Andreas","unstructured":"Andreas Griewank and Andrea Walther. 2008. Evaluating Derivatives (second ed.). Society for Industrial and Applied Mathematics."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3190834.3190852"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530099"},{"key":"e_1_2_2_13_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417861"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275109"},{"key":"e_1_2_2_16_1","article-title":"Generalized Resampled Importance Sampling","volume":"41","author":"Lin Daqi","year":"2022","unstructured":"Daqi Lin, Markus Kettunen, Benedikt Bitterli, Jacopo Pantaleoni, Cem Yuksel, and Chris Wyman. 2022. Generalized Resampled Importance Sampling: Foundations of ReSTIR. ACM Trans. Graph. 41, 4 (2022), 75:1--75:23.","journal-title":"Foundations of ReSTIR. ACM Trans. Graph."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478513.3480499"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00780"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356510"},{"key":"e_1_2_2_20_1","article-title":"Dynamic Diffuse Global Illumination with Ray-Traced Irradiance Fields","volume":"8","author":"Majercik Zander","year":"2019","unstructured":"Zander Majercik, Jean-Philippe Guertin, Derek Nowrouzezahrai, and Morgan McGuire. 2019. Dynamic Diffuse Global Illumination with Ray-Traced Irradiance Fields. Journal of Computer Graphics Techniques (JCGT) 8, 2 (5 June 2019), 1--30. http:\/\/jcgt.org\/published\/0008\/02\/01\/","journal-title":"Journal of Computer Graphics Techniques (JCGT)"},{"key":"e_1_2_2_21_1","article-title":"Efficient GPU Screen-Space Ray Tracing","volume":"3","author":"McGuire Morgan","year":"2014","unstructured":"Morgan McGuire and Michael Mara. 2014. Efficient GPU Screen-Space Ray Tracing. Journal of Computer Graphics Techniques (JCGT) 3, 4 (9 December 2014), 73--85. http:\/\/jcgt.org\/published\/0003\/04\/04\/","journal-title":"Journal of Computer Graphics Techniques (JCGT)"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3023368.3023378"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3592139"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392406"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.14378"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7091-6303-0_2"},{"key":"e_1_2_2_27_1","volume-title":"Physically Based Rendering: From Theory to Implementation","author":"Pharr Matt","unstructured":"Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2016. Physically Based Rendering: From Theory to Implementation (3rd ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA. 1266 pages.","edition":"3"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3105762.3105770"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392394"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.5555\/2383654.2383674"},{"key":"e_1_2_2_31_1","volume-title":"Robust Monte Carlo methods for light transport simulation","author":"Veach Eric","unstructured":"Eric Veach. 1997. Robust Monte Carlo methods for light transport simulation. Vol. 1610. Stanford University PhD thesis."},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459804"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","unstructured":"Ingo Wald. 2022. A Stack-Free Traversal Algorithm for Left-Balanced k-d Trees. 10.48550\/ARXIV.2210.12859","DOI":"10.48550\/ARXIV.2210.12859"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530080"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550454.3555500"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459807"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459783"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392383"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356522"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459782"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3618331","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3618331","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T10:53:30Z","timestamp":1755773610000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3618331"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,5]]},"references-count":40,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,12,5]]}},"alternative-id":["10.1145\/3618331"],"URL":"https:\/\/doi.org\/10.1145\/3618331","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,5]]},"assertion":[{"value":"2023-12-05","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}