{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T06:42:49Z","timestamp":1781592169641,"version":"3.54.5"},"reference-count":35,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T00:00:00Z","timestamp":1606435200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2020,12,31]]},"abstract":"<jats:p>We present a modular differentiable renderer design that yields performance superior to previous methods by leveraging existing, highly optimized hardware graphics pipelines. Our design supports all crucial operations in a modern graphics pipeline: rasterizing large numbers of triangles, attribute interpolation, filtered texture lookups, as well as user-programmable shading and geometry processing, all in high resolutions. Our modular primitives allow custom, high-performance graphics pipelines to be built directly within automatic differentiation frameworks such as PyTorch or TensorFlow. As a motivating application, we formulate facial performance capture as an inverse rendering problem and show that it can be solved efficiently using our tools. Our results indicate that this simple and straightforward approach achieves excellent geometric correspondence between rendered results and reference imagery.<\/jats:p>","DOI":"10.1145\/3414685.3417861","type":"journal-article","created":{"date-parts":[[2020,11,27]],"date-time":"2020-11-27T21:51:05Z","timestamp":1606513865000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":382,"title":["Modular primitives for high-performance differentiable rendering"],"prefix":"10.1145","volume":"39","author":[{"given":"Samuli","family":"Laine","sequence":"first","affiliation":[{"name":"NVIDIA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Janne","family":"Hellsten","sequence":"additional","affiliation":[{"name":"NVIDIA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tero","family":"Karras","sequence":"additional","affiliation":[{"name":"NVIDIA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yeongho","family":"Seol","sequence":"additional","affiliation":[{"name":"NVIDIA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jaakko","family":"Lehtinen","sequence":"additional","affiliation":[{"name":"NVIDIA and Aalto University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timo","family":"Aila","sequence":"additional","affiliation":[{"name":"NVIDIA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,11,27]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Agisoft. 2020. Agisoft Metashape. https:\/\/www.agisoft.com\/  Agisoft. 2020. Agisoft Metashape. https:\/\/www.agisoft.com\/"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1667239.1667251"},{"key":"e_1_2_2_3_1","volume-title":"ICML (Proceedings of Machine Learning Research","volume":"253","author":"Arora Sanjeev","year":"2018","unstructured":"Sanjeev Arora , Nadav Cohen , and Elad Hazan . 2018 . On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization . In ICML (Proceedings of Machine Learning Research , Vol. 80). 244-- 253 . Sanjeev Arora, Nadav Cohen, and Elad Hazan. 2018. On the Optimization of Deep Networks: Implicit Acceleration by Overparameterization. In ICML (Proceedings of Machine Learning Research, Vol. 80). 244--253."},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778777"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964970"},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Volker Blanz and Thomas Vetter. 1999. A Morphable Model for the Synthesis of 3D Faces (SIGGRAPH '99). 187--194.  Volker Blanz and Thomas Vetter. 1999. A Morphable Model for the Synthesis of 3D Faces (SIGGRAPH '99) . 187--194.","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778778"},{"key":"e_1_2_2_9_1","unstructured":"Wenzheng Chen Jun Gao Huan Ling Edward Smith Jaakko Lehtinen Alec Jacobson and Sanja Fidler. 2019. Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer. In Advances In Neural Information Processing Systems.  Wenzheng Chen Jun Gao Huan Ling Edward Smith Jaakko Lehtinen Alec Jacobson and Sanja Fidler. 2019. Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer. In Advances In Neural Information Processing Systems."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/357290.357293"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.33"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/54852.378468"},{"key":"e_1_2_2_13_1","unstructured":"DI4D. 2020. DI4D PRO System. https:\/\/www.di4d.com\/di4d-pro\/  DI4D. 2020. DI4D PRO System. https:\/\/www.di4d.com\/di4d-pro\/"},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/MCG.1986.276658","article-title":"Environment Mapping and Other Applications of World Projections","volume":"6","author":"Greene Ned","year":"1986","unstructured":"Ned Greene . 1986 . Environment Mapping and Other Applications of World Projections . IEEE Computer Graphics and Applications 6 , 11 (1986), 21 -- 29 . Ned Greene. 1986. Environment Mapping and Other Applications of World Projections. IEEE Computer Graphics and Applications 6, 11 (1986), 21--29.","journal-title":"IEEE Computer Graphics and Applications"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/3071773.3071781"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2004.398"},{"key":"e_1_2_2_17_1","doi-asserted-by":"crossref","unstructured":"Jorge Jimenez Diego Gutierrez Jason Yang Alexander Reshetov Pete Demoreuille Tobias Berghoff Cedric Perthuis Henry Yu Morgan McGuire Timothy Lottes Hugh Malan Emil Persson Dmitry Andreev and Tiago Sousa. 2011. Filtering Approaches for Real-Time Anti-Aliasing. In ACM SIGGRAPH Courses.  Jorge Jimenez Diego Gutierrez Jason Yang Alexander Reshetov Pete Demoreuille Tobias Berghoff Cedric Perthuis Henry Yu Morgan McGuire Timothy Lottes Hugh Malan Emil Persson Dmitry Andreev and Tiago Sousa. 2011. Filtering Approaches for Real-Time Anti-Aliasing. In ACM SIGGRAPH Courses.","DOI":"10.1145\/2037636.2037642"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00411"},{"key":"e_1_2_2_19_1","volume-title":"Kingma and Jimmy Ba","author":"Diederik","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba . 2015 . Adam : A Method for Stochastic Optimization. In ICLR. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR."},{"key":"e_1_2_2_20_1","article-title":"Differentiable Monte Carlo Ray Tracing through Edge Sampling","volume":"37","author":"Li Tzu-Mao","year":"2018","unstructured":"Tzu-Mao Li , Miika Aittala , Fr\u00e9do Durand , and Jaakko Lehtinen . 2018 . Differentiable Monte Carlo Ray Tracing through Edge Sampling . ACM Trans. Graph. (Proc. SIGGRAPH Asia) 37 , 6 (2018), 222:1--222:11. Tzu-Mao Li, Miika Aittala, Fr\u00e9do Durand, and Jaakko Lehtinen. 2018. Differentiable Monte Carlo Ray Tracing through Edge Sampling. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 37, 6 (2018), 222:1--222:11.","journal-title":"ACM Trans. Graph. (Proc. SIGGRAPH Asia)"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073217"},{"key":"e_1_2_2_22_1","volume-title":"Material Editing Using a Physically Based Rendering Network. ICCV","author":"Liu Guilin","year":"2017","unstructured":"Guilin Liu , Duygu Ceylan , Ersin Yumer , Jimei Yang , and Jyh-Ming Lien . 2017. Material Editing Using a Physically Based Rendering Network. ICCV ( 2017 ), 2280--2288. Guilin Liu, Duygu Ceylan, Ersin Yumer, Jimei Yang, and Jyh-Ming Lien. 2017. Material Editing Using a Physically Based Rendering Network. ICCV (2017), 2280--2288."},{"key":"e_1_2_2_23_1","volume-title":"Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning. In ICCV.","author":"Liu Shichen","year":"2019","unstructured":"Shichen Liu , Tianye Li , Weikai Chen , and Hao Li . 2019 . Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning. In ICCV. Shichen Liu, Tianye Li, Weikai Chen, and Hao Li. 2019. Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning. In ICCV."},{"key":"e_1_2_2_24_1","volume-title":"Black","author":"Loper Matthew M.","year":"2014","unstructured":"Matthew M. Loper and Michael J . Black . 2014 . OpenDR: An Approximate Differentiable Renderer. In ECCV 2014, Vol. 8695 . 154--169. Matthew M. Loper and Michael J. Black. 2014. OpenDR: An Approximate Differentiable Renderer. In ECCV 2014, Vol. 8695. 154--169."},{"key":"e_1_2_2_25_1","article-title":"Reparameterizing Discontinuous Integrands for Differentiable Rendering","volume":"38","author":"Loubet Guillaume","year":"2019","unstructured":"Guillaume Loubet , Nicolas Holzschuch , and Wenzel Jakob . 2019 . Reparameterizing Discontinuous Integrands for Differentiable Rendering . ACM Trans. Graph. (Proc. SIGGRAPH Asia) 38 , 6 (2019). Guillaume Loubet, Nicolas Holzschuch, and Wenzel Jakob. 2019. Reparameterizing Discontinuous Integrands for Differentiable Rendering. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 38, 6 (2019).","journal-title":"ACM Trans. Graph. (Proc. SIGGRAPH Asia)"},{"key":"e_1_2_2_26_1","volume-title":"Edge Anti-aliasing by Post-Processing","author":"Malan Hugh","unstructured":"Hugh Malan . 2010. Edge Anti-aliasing by Post-Processing . In GPU Pro, Wolfgang Engel (Ed.). A K Peters , 265--289. Hugh Malan. 2010. Edge Anti-aliasing by Post-Processing. In GPU Pro, Wolfgang Engel (Ed.). A K Peters, 265--289."},{"key":"e_1_2_2_27_1","volume-title":"Greenberg","author":"Marschner Steve","year":"1999","unstructured":"Steve Marschner , Stephen H. Westin , Eric P. Lafortune , Kenneth E. Torrance , and Donald P . Greenberg . 1999 . Image-Based BRDF Measurement Including Human Skin. In Rendering Techniques . Steve Marschner, Stephen H. Westin, Eric P. Lafortune, Kenneth E. Torrance, and Donald P. Greenberg. 1999. Image-Based BRDF Measurement Including Human Skin. In Rendering Techniques."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356498"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2003.00716.x"},{"key":"e_1_2_2_31_1","unstructured":"Emil Persson. 2011. Geometric Post-Process Anti-Aliasing. http:\/\/www.humus.name\/index.php?page=3D&ID=86  Emil Persson. 2011. Geometric Post-Process Anti-Aliasing. http:\/\/www.humus.name\/index.php?page=3D&ID=86"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/360825.360839"},{"key":"e_1_2_2_33_1","unstructured":"R3DS. 2020. R3DS Wrap. https:\/\/www.russian3dscanner.com\/  R3DS. 2020. R3DS Wrap. https:\/\/www.russian3dscanner.com\/"},{"key":"e_1_2_2_34_1","unstructured":"Nikhila Ravi Jeremy Reizenstein David Novotny Taylor Gordon Wan-Yen Lo Justin Johnson and Georgia Gkioxari. 2020. PyTorch3D. https:\/\/github.com\/facebookresearch\/pytorch3d  Nikhila Ravi Jeremy Reizenstein David Novotny Taylor Gordon Wan-Yen Lo Justin Johnson and Georgia Gkioxari. 2020. PyTorch3D. https:\/\/github.com\/facebookresearch\/pytorch3d"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.491183"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/325165.325242"},{"key":"e_1_2_2_37_1","unstructured":"Olga Sorkine. 2005. Laplacian Mesh Processing. In Eurographics 2005 - State of the Art Reports.  Olga Sorkine. 2005. Laplacian Mesh Processing. In Eurographics 2005 - State of the Art Reports."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417861","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3414685.3417861","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:03:15Z","timestamp":1750197795000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3414685.3417861"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,27]]},"references-count":35,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2020,12,31]]}},"alternative-id":["10.1145\/3414685.3417861"],"URL":"https:\/\/doi.org\/10.1145\/3414685.3417861","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,27]]},"assertion":[{"value":"2020-11-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}