{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T15:15:25Z","timestamp":1778080525663,"version":"3.51.4"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T00:00:00Z","timestamp":1669766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:p>\n            Cameras with a finite aperture diameter exhibit defocus for scene elements that are not at the focus distance, and have only a limited\n            <jats:italic>depth of field<\/jats:italic>\n            within which objects appear acceptably sharp. In this work we address the problem of applying inverse rendering techniques to input data that exhibits such defocus blurring. We present differentiable depth-of-field rendering techniques that are applicable to both rasterization-based methods using mesh representations, as well as ray-marching-based methods using either explicit [Yu et al. 2021] or implicit volumetric radiance fields [Mildenhall et al. 2020]. Our approach learns significantly sharper scene reconstructions on data containing blur due to depth of field, and recovers aperture and focus distance parameters that result in plausible forward-rendered images. We show applications to macro photography, where typical lens configurations result in a very narrow depth of field, and to multi-camera video capture, where maintaining sharp focus across a large capture volume for a moving subject is difficult.\n          <\/jats:p>","DOI":"10.1145\/3550454.3555521","type":"journal-article","created":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T21:19:07Z","timestamp":1669843147000},"page":"1-18","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Depth of Field Aware Differentiable Rendering"],"prefix":"10.1145","volume":"41","author":[{"given":"Stanislav","family":"Pidhorskyi","sequence":"first","affiliation":[{"name":"Meta"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Timur","family":"Bagautdinov","sequence":"additional","affiliation":[{"name":"Meta"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shugao","family":"Ma","sequence":"additional","affiliation":[{"name":"Meta"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jason","family":"Saragih","sequence":"additional","affiliation":[{"name":"Meta"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriel","family":"Schwartz","sequence":"additional","affiliation":[{"name":"Meta"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaser","family":"Sheikh","sequence":"additional","affiliation":[{"name":"Meta"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tomas","family":"Simon","sequence":"additional","affiliation":[{"name":"Meta"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,11,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58452-8_26"},{"key":"e_1_2_2_2_1","volume-title":"Iterative blind deconvolution method and its applications. Optics letters 13, 7","author":"Ayers GR","year":"1988","unstructured":"GR Ayers and J Christopher Dainty. 1988. Iterative blind deconvolution method and its applications. Optics letters 13, 7 (1988), 547--549."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00255"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459850"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417833"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/25\/12\/123006"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/5.53403"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392485"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/83.661187"},{"key":"e_1_2_2_10_1","volume-title":"Blender - a 3D modelling and rendering package","author":"Community Blender Online","unstructured":"Blender Online Community. 2018. Blender - a 3D modelling and rendering package. Blender Foundation, Stichting Blender Foundation, Amsterdam. http:\/\/www.blender.org"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/800031.808590"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401132.1401174"},{"key":"e_1_2_2_13_1","volume-title":"Image Processing for Broadcast and Video Production","author":"Dudkiewicz Krzysztof","unstructured":"Krzysztof Dudkiewicz. 1995. Real-time depth of field algorithm. In Image Processing for Broadcast and Video Production. Springer, 257--268."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458305.3478443"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/97879.97913"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12301"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00582"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2008.113"},{"key":"e_1_2_2_19_1","unstructured":"Michael Kass Aaron Lefohn and John D Owens. 2006. Interactive depth of field using simulated diffusion on a GPU. (2006)."},{"key":"e_1_2_2_20_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218463"},{"key":"e_1_2_2_22_1","volume-title":"Computer graphics forum","author":"Kraus Martin","unstructured":"Martin Kraus and Magnus Strengert. 2007. Depth-of-field rendering by pyramidal image processing. In Computer graphics forum, Vol. 26. Wiley Online Library, 645--654."},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/CGI.2003.1214466"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3414685.3417861"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3197517.3201379"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206815"},{"key":"e_1_2_2_27_1","article-title":"Differentiable Monte Carlo Ray Tracing through Edge Sampling","volume":"37","author":"Li Tzu-Mao","year":"2018","unstructured":"Tzu-Mao Li, Miika Aittala, Fr\u00e9do Durand, and Jaakko Lehtinen. 2018. Differentiable Monte Carlo Ray Tracing through Edge Sampling. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 37, 6 (2018), 222:1--222:11.","journal-title":"ACM Trans. Graph. (Proc. SIGGRAPH Asia)"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00780"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356510"},{"key":"e_1_2_2_30_1","volume-title":"Sander","author":"Ma Li","year":"2021","unstructured":"Li Ma, Xiaoyu Li, Jing Liao, Qi Zhang, Xuan Wang, Jue Wang, and Pedro V. Sander. 2021a. Deblur-NeRF: Neural Radiance Fields from Blurry Images. CoRR abs\/2111.14292 (2021). arXiv:2111.14292 https:\/\/arxiv.org\/abs\/2111.14292"},{"key":"e_1_2_2_31_1","volume-title":"Pixel Codec Avatars. 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Ma Shugao","year":"2021","unstructured":"Shugao Ma, Tomas Simon, Jason M. Saragih, Dawei Wang, Yuecheng Li, Fernando De la Torre, and Yaser Sheikh. 2021b. Pixel Codec Avatars. 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2021), 64--73."},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","unstructured":"Ben Mildenhall Pratul P. Srinivasan Matthew Tancik Jonathan T. Barron Ravi Ramamoorthi and Ren Ng. 2020. NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis. In ECCV.","DOI":"10.1007\/978-3-030-58452-8_24"},{"key":"e_1_2_2_33_1","unstructured":"Yuji Moroto Toshiya Hachisuka and Nobuyuki Umetani. 2021. Fast Polygonal Splatting using Directional Kernel Difference. (2021)."},{"key":"e_1_2_2_34_1","volume-title":"Instant Neural Graphics Primitives with a Multiresolution Hash Encoding. arXiv preprint arXiv:2201.05989","author":"M\u00fcller Thomas","year":"2022","unstructured":"Thomas M\u00fcller, Alex Evans, Christoph Schied, and Alexander Keller. 2022. Instant Neural Graphics Primitives with a Multiresolution Hash Encoding. arXiv preprint arXiv:2201.05989 (2022)."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478513.3480501"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392406"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392406"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356498"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/965161.806818"},{"key":"e_1_2_2_40_1","volume-title":"NeurIPS 2020 Workshop for Differentiable Computer Vision, Graphics and Physics","author":"Quinn Peter","year":"2020","unstructured":"Peter Quinn, Jerome Parent-Levesque, Cengiz Oztireli, and Derek Nowrouzezahrai. 2020. Differentiable Path Tracing by Regularizing Discontinuities. NeurIPS 2020 Workshop for Differentiable Computer Vision, Graphics and Physics (2020)."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/0097-8493(93)90010-7"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.486676"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.01851.x"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459674"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00853"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3323035"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/3450626.3459804"},{"key":"e_1_2_2_48_1","volume-title":"Recent progress in image deblurring. arXiv preprint arXiv:1409.6838","author":"Wang Ruxin","year":"2014","unstructured":"Ruxin Wang and Dacheng Tao. 2014. Recent progress in image deblurring. arXiv preprint arXiv:1409.6838 (2014)."},{"key":"e_1_2_2_49_1","volume-title":"NeRFocus: Neural Radiance Field for 3D Synthetic Defocus. arXiv preprint arXiv:2203.05189","author":"Wang Yinhuai","year":"2022","unstructured":"Yinhuai Wang, Shuzhou Yang, Yujie Hu, and Jian Zhang. 2022. NeRFocus: Neural Radiance Field for 3D Synthetic Defocus. arXiv preprint arXiv:2203.05189 (2022)."},{"key":"e_1_2_2_50_1","volume-title":"Plenoxels: Radiance Fields without Neural Networks. arXiv:2112.05131 [cs.CV]","author":"Yu Alex","year":"2021","unstructured":"Alex Yu, Sara Fridovich-Keil, Matthew Tancik, Qinhong Chen, Benjamin Recht, and Angjoo Kanazawa. 2021. Plenoxels: Radiance Fields without Neural Networks. arXiv:2112.05131 [cs.CV]"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1275808.1276379"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392383"},{"key":"e_1_2_2_53_1","volume-title":"Analyzing and improving neural radiance fields. arXiv preprint arXiv:2010.07492","author":"Zhang Kai","year":"2020","unstructured":"Kai Zhang, Gernot Riegler, Noah Snavely, and Vladlen Koltun. 2020b. Nerf++: Analyzing and improving neural radiance fields. arXiv preprint arXiv:2010.07492 (2020)."},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3388769.3407454"},{"key":"e_1_2_2_56_1","volume-title":"Computer Graphics Forum","author":"Zhou Tianshu","unstructured":"Tianshu Zhou, Jim X Chen, and Mark Pullen. 2007. Accurate depth of field simulation in real time. In Computer Graphics Forum, Vol. 26. Wiley Online Library, 15--23."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550454.3555521","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3550454.3555521","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:51:44Z","timestamp":1750182704000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3550454.3555521"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,30]]},"references-count":56,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["10.1145\/3550454.3555521"],"URL":"https:\/\/doi.org\/10.1145\/3550454.3555521","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,30]]},"assertion":[{"value":"2022-11-30","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}