{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:09:24Z","timestamp":1784268564163,"version":"3.55.0"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T00:00:00Z","timestamp":1573171200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2019,12,31]]},"abstract":"<jats:p>Physics-based differentiable rendering is the task of estimating the derivatives of radiometric measures with respect to scene parameters. The ability to compute these derivatives is necessary for enabling gradient-based optimization in a diverse array of applications: from solving analysis-by-synthesis problems to training machine learning pipelines incorporating forward rendering processes. Unfortunately, physics-based differentiable rendering remains challenging, due to the complex and typically nonlinear relation between pixel intensities and scene parameters.<\/jats:p>\n          <jats:p>We introduce a differential theory of radiative transfer, which shows how individual components of the radiative transfer equation (RTE) can be differentiated with respect to arbitrary differentiable changes of a scene. Our theory encompasses the same generality as the standard RTE, allowing differentiation while accurately handling a large range of light transport phenomena such as volumetric absorption and scattering, anisotropic phase functions, and heterogeneity. To numerically estimate the derivatives given by our theory, we introduce an unbiased Monte Carlo estimator supporting arbitrary surface and volumetric configurations. Our technique differentiates path contributions symbolically and uses additional boundary integrals to capture geometric discontinuities such as visibility changes.<\/jats:p>\n          <jats:p>We validate our method by comparing our derivative estimations to those generated using the finite-difference method. Furthermore, we use a few synthetic examples inspired by real-world applications in inverse rendering, non-line-of-sight (NLOS) and biomedical imaging, and design, to demonstrate the practical usefulness of our technique.<\/jats:p>","DOI":"10.1145\/3355089.3356522","type":"journal-article","created":{"date-parts":[[2019,11,8]],"date-time":"2019-11-08T20:27:58Z","timestamp":1573244878000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":105,"title":["A differential theory of radiative transfer"],"prefix":"10.1145","volume":"38","author":[{"given":"Cheng","family":"Zhang","sequence":"first","affiliation":[{"name":"University of California, Irvine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lifan","family":"Wu","sequence":"additional","affiliation":[{"name":"University of California, San Diego"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Changxi","family":"Zheng","sequence":"additional","affiliation":[{"name":"Columbia University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ioannis","family":"Gkioulekas","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ravi","family":"Ramamoorthi","sequence":"additional","affiliation":[{"name":"University of California, San Diego"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuang","family":"Zhao","sequence":"additional","affiliation":[{"name":"University of California, Irvine"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2019,11,8]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/192161.192250"},{"key":"e_1_2_2_2_1","volume-title":"Inverse Path Tracing for Joint Material and Lighting Estimation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Azinovic Dejan","year":"2019","unstructured":"Dejan Azinovic, Tzu-Mao Li, Anton Kaplanyan, and Matthias Niessner. 2019. Inverse Path Tracing for Joint Material and Lighting Estimation. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275103"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/800064.801255"},{"key":"e_1_2_2_5_1","unstructured":"Kenneth M Case and Paul Frederick Zweifel. 1967. Linear transport theory. (1967)."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-005-0287-1"},{"key":"e_1_2_2_7_1","volume-title":"Radiative Transfer","author":"Chandrasekhar Subrahmanyan","unstructured":"Subrahmanyan Chandrasekhar. 1960. Radiative Transfer. Courier Corporation."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1593\/neo.81386"},{"key":"e_1_2_2_9_1","volume-title":"Inverse transport networks. arXiv preprint arXiv:1809.10820","author":"Che Chengqian","year":"2018","unstructured":"Chengqian Che, Fujun Luan, Shuang Zhao, Kavita Bala, and Ioannis Gkioulekas. 2018. Inverse transport networks. arXiv preprint arXiv:1809.10820 (2018)."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/380666.380670"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTQE.2003.814413"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/00029890.1973.11993339"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46487-9_42"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508377"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2451236.2451237"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311555"},{"key":"e_1_2_2_17_1","volume-title":"Wave propagation and scattering in random media","author":"Ishimaru Akira","unstructured":"Akira Ishimaru. 1978. Wave propagation and scattering in random media. Academic press New York."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778790"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185554"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/964965.808594"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00411"},{"key":"e_1_2_2_22_1","volume-title":"Computer Graphics Forum","author":"Kelemen Csaba","unstructured":"Csaba Kelemen, L\u00e1szl\u00f3 Szirmay-Kalos, Gy\u00f6rgy Antal, and Ferenc Csonka. 2002. A simple and robust mutation strategy for the metropolis light transport algorithm. In Computer Graphics Forum, Vol. 21. Wiley Online Library, 531--540."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818648"},{"key":"e_1_2_2_24_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_25_1","volume-title":"Picture: A Probabilistic Programming Language for Scene Perception. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Kulkarni Tejas D.","year":"2015","unstructured":"Tejas D. Kulkarni, Pushmeet Kohli, Joshua B. Tenenbaum, and Vikash Mansinghka. 2015. Picture: A Probabilistic Programming Language for Scene Perception. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073665"},{"key":"e_1_2_2_27_1","volume-title":"Rendering techniques' 96","author":"Lafortune Eric P","unstructured":"Eric P Lafortune and Yves D Willems. 1996. Rendering participating media with bidirectional path tracing. In Rendering techniques' 96. Springer, 91--100."},{"key":"e_1_2_2_28_1","volume-title":"Advanced Transport Phenomena: fluid mechanics and convective transport processes","author":"Leal L. Gary","unstructured":"L. Gary Leal. 2007. Advanced Transport Phenomena: fluid mechanics and convective transport processes. Vol. 7. Cambridge University Press."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275109"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818084"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275055"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10584-0_11"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00661"},{"key":"e_1_2_2_35_1","volume-title":"Multiple scattering of light by particles: radiative transfer and coherent backscattering","author":"Mishchenko Michael I","unstructured":"Michael I Mishchenko, Larry D Travis, and Andrew A Lacis. 2006. Multiple scattering of light by particles: radiative transfer and coherent backscattering. Cambridge University Press."},{"key":"e_1_2_2_36_1","volume-title":"Computer Graphics Forum","author":"Nov\u00e1k Jan","unstructured":"Jan Nov\u00e1k, Iliyan Georgiev, Johannes Hanika, and Wojciech Jarosz. 2018. Monte Carlo methods for volumetric light transport simulation. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 551--576."},{"key":"e_1_2_2_37_1","volume-title":"Confocal non-line-of-sight imaging based on the light-cone transform. Nature 555, 7696","author":"O'Toole Matthew","year":"2018","unstructured":"Matthew O'Toole, David B Lindell, and Gordon Wetzstein. 2018. Confocal non-line-of-sight imaging based on the light-cone transform. Nature 555, 7696 (2018), 338."},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-7091-6303-0_2"},{"key":"e_1_2_2_39_1","series-title":"International Series of Monographs in Natural Philosophy","volume-title":"The equations of radiation hydrodynamics","author":"Pomraning GC","year":"1973","unstructured":"GC Pomraning. 1973. The equations of radiation hydrodynamics. International Series of Monographs in Natural Philosophy, Oxford: Pergamon Press, 1973 (1973)."},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1189762.1189764"},{"key":"e_1_2_2_41_1","volume-title":"SIGGRAPH '87","author":"Holly","unstructured":"Holly E. Rushmeier and Kenneth E. Torrance. 1987. The zonal method for calculating light intensities in the presence of a participating medium. In SIGGRAPH '87. 293--302."},{"key":"e_1_2_2_42_1","volume-title":"Computational periscopy with an ordinary digital camera. Nature 565, 7740","author":"Saunders Charles","year":"2019","unstructured":"Charles Saunders, John Murray-Bruce, and Vivek K Goyal. 2019. Computational periscopy with an ordinary digital camera. Nature 565, 7740 (2019), 472."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00659"},{"key":"e_1_2_2_44_1","volume-title":"Monte Carlo principles and neutron transport problems","author":"Spanier Jerome","unstructured":"Jerome Spanier and Ely M Gelbard. 1969. Monte Carlo principles and neutron transport problems. The Addison-Wesley Publishing Company."},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322992"},{"key":"e_1_2_2_46_1","volume-title":"Beyond Volumetric Albedo - A Surface Optimization Framework for Non-Line-Of-Sight Imaging. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Tsai Chia-Yin","year":"2019","unstructured":"Chia-Yin Tsai, Aswin C. Sankaranarayanan, and Ioannis Gkioulekas. 2019. Beyond Volumetric Albedo - A Surface Optimization Framework for Non-Line-Of-Sight Imaging. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_2_47_1","doi-asserted-by":"crossref","unstructured":"Hendrik Christoffel van de Hulst et al. 1957. Light scattering by small particles. (1957).","DOI":"10.1063\/1.3060205"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3272127.3275098"},{"key":"e_1_2_2_49_1","volume-title":"Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature communications 3","author":"Velten Andreas","year":"2012","unstructured":"Andreas Velten, Thomas Willwacher, Otkrist Gupta, Ashok Veeraraghavan, Moungi G Bawendi, and Ramesh Raskar. 2012. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nature communications 3 (2012), 745."},{"key":"e_1_2_2_50_1","first-page":"3371","article-title":"Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion","author":"Vincent Pascal","year":"2010","unstructured":"Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of machine learning research 11, Dec (2010), 3371--3408.","journal-title":"Journal of machine learning research 11"},{"key":"e_1_2_2_51_1","volume-title":"A study of the morphological parameters of cervical squamous epithelium. Physiological measurement 24, 1","author":"Walker DC","year":"2003","unstructured":"DC Walker, BH Brown, AD Blackett, J Tidy, and RH Smallwood. 2003. A study of the morphological parameters of cervical squamous epithelium. Physiological measurement 24, 1 (2003), 121."},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.744"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00696"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980228"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356522","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3355089.3356522","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:41Z","timestamp":1750203881000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3355089.3356522"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,8]]},"references-count":53,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,12,31]]}},"alternative-id":["10.1145\/3355089.3356522"],"URL":"https:\/\/doi.org\/10.1145\/3355089.3356522","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,8]]},"assertion":[{"value":"2019-11-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}