{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T14:24:40Z","timestamp":1761402280518,"version":"build-2065373602"},"reference-count":65,"publisher":"Association for Computing Machinery (ACM)","issue":"1","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2026,2,28]]},"abstract":"<jats:p>\n                    Neural radiance fields, or NeRFs, have become the de facto approach for high-quality view synthesis from a collection of images captured from multiple viewpoints. However, many issues remain when capturing images in-the-wild under challenging conditions, such as in low light, high dynamic range, or with rapid motion, leading to smeared reconstructions with noticeable artifacts. In this work, we introduce\n                    <jats:italic toggle=\"yes\">quanta radiance fields<\/jats:italic>\n                    , a novel class of neural radiance fields that are trained at the granularity of individual photons using single-photon cameras (SPCs). We develop theory and practical computational techniques for building radiance fields and estimating dense camera poses from unconventional, stochastic, and high-speed binary frame sequences captured by SPCs. We demonstrate, both via simulations and a SPC hardware prototype, high-fidelity reconstructions under high-speed motion, in low light, and for extreme dynamic range settings.\n                  <\/jats:p>","DOI":"10.1145\/3770578","type":"journal-article","created":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T11:19:59Z","timestamp":1759835999000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Radiance Fields from Photons"],"prefix":"10.1145","volume":"45","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-4402-6444","authenticated-orcid":false,"given":"Sacha","family":"Jungerman","sequence":"first","affiliation":[{"name":"University of Wisconsin-Madison","place":["Madison, United States"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7495-1060","authenticated-orcid":false,"given":"Aryan","family":"Garg","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison","place":["Madison, United States"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2323-7700","authenticated-orcid":false,"given":"Mohit","family":"Gupta","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison","place":["Madison, United States"]}]}],"member":"320","published-online":{"date-parts":[[2025,10,25]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"crossref","unstructured":"Jonathan T. Barron Ben Mildenhall Matthew Tancik Peter Hedman Ricardo Martin-Brualla and Pratul P. Srinivasan. 2021. Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields. arXiv:2103.13415. Retrieved from https:\/\/arxiv.org\/abs\/\/2103.13415","DOI":"10.1109\/ICCV48922.2021.00580"},{"key":"e_1_3_3_3_2","article-title":"Zip-NeRF: Anti-aliased grid-based neural radiance fields","author":"Barron Jonathan T.","year":"2023","unstructured":"Jonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan, and Peter Hedman. 2023. Zip-NeRF: Anti-aliased grid-based neural radiance fields. ICCV (2023), 19697\u201319705.","journal-title":"ICCV"},{"key":"e_1_3_3_4_2","unstructured":"Chen Chen Qifeng Chen Jia Xu and Vladlen Koltun. 2018. Learning to See in the Dark. arXiv:1805.01934. Retrieved from https:\/\/arxiv.org\/abs\/\/1805.01934"},{"key":"e_1_3_3_5_2","unstructured":"Blender Online Community. 2018. Blender\u2014a 3D modelling and rendering package. Retrieved from http:\/\/www.blender.org"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1145\/3658193"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.3390\/s16071122"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42254-020-0174-8"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1364\/COSI.2011.JTuE1"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52733.2024.01965"},{"key":"e_1_3_3_11_2","first-page":"14346","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Garbin Stephan J.","year":"2021","unstructured":"Stephan J. Garbin, Marek Kowalski, Matthew Johnson, Jamie Shotton, and Julien Valentin. 2021. FastNeRF: High-fidelity neural rendering at 200FPS. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV). 14346\u201314355."},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-73036-8_4"},{"key":"e_1_3_3_13_2","first-page":"2512","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Goyal Bhavya","year":"2021","unstructured":"Bhavya Goyal and Mohit Gupta. 2021. Photon-starved scene inference using single photon cameras. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV). 2512\u20132521."},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2004.88"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01733"},{"key":"e_1_3_3_16_2","first-page":"5949","volume-title":"Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR)","author":"Hanson Alex","year":"2025","unstructured":"Alex Hanson, Allen Tu, Vasu Singla, Mayuka Jayawardhana, Matthias Zwicker, and Tom Goldstein. 2025. PUP 3D-GS: Principled uncertainty pruning for 3D gaussian splatting. In Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR). 5949\u20135958. Retrieved from https:\/\/pup3dgs.github.io\/"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/2980179.2980254"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-19781-9_36"},{"key":"e_1_3_3_19_2","volume-title":"Proc. CVPR","author":"Ingle Atul","year":"2019","unstructured":"Atul Ingle, Andreas Velten, and Mohit Gupta. 2019. High flux passive imaging with single photon sensors. In Proc. CVPR."},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3059293"},{"key":"e_1_3_3_21_2","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"Jungerman Sacha","year":"2023","unstructured":"Sacha Jungerman, Atul Ingle, and Mohit Gupta. 2023. Panoramas from photons. In Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)."},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/964965.808594"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3592433"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530180"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-73636-0_8"},{"key":"e_1_3_3_26_2","first-page":"12386","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Lee Dogyoon","year":"2023","unstructured":"Dogyoon Lee, Minhyeok Lee, Chajin Shin, and Sangyoun Lee. 2023. DP-NeRF: Deblurred neural radiance field with physical scene priors. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 12386\u201312396."},{"key":"e_1_3_3_27_2","unstructured":"Dongwoo Lee Jeongtaek Oh Jaesung Rim Sunghyun Cho and Kyoung Mu Lee. 2023. ExBluRF: Efficient radiance fields for extreme motion blurred images. In Proceedings of the IEEE\/CVF International Conference on Computer Vision.17639\u201317648."},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-73027-6_2"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/3355089.3356508"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00569"},{"key":"e_1_3_3_31_2","first-page":"1575","volume-title":"Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV)","author":"Liu Yuhao","year":"2022","unstructured":"Yuhao Liu, Felipe Gutierrez-Barragan, Atul Ingle, Mohit Gupta, and Andreas Velten. 2022. Single-photon camera guided extreme dynamic range imaging. In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV). 1575\u20131585."},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1364\/OE.21.010526"},{"key":"e_1_3_3_33_2","first-page":"8723","article-title":"Transientangelo: Few-viewpoint surface reconstruction using single-photon lidar","author":"Luo Weihan","year":"2025","unstructured":"Weihan Luo, Anagh Malik, and David B. Lindell. 2025. Transientangelo: Few-viewpoint surface reconstruction using single-photon lidar. In 2025 IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV). IEEE, 8723\u20138733.","journal-title":"2025 IEEE\/CVF Winter Conference on Applications of Computer Vision (WACV)"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1364\/OPTICA.4.001474"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01252"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3386569.3392470"},{"key":"e_1_3_3_37_2","doi-asserted-by":"crossref","unstructured":"Anagh Malik Noah Juravsky Ryan Po Gordon Wetzstein Kiriakos N. Kutulakos and David B. Lindell. 2024. Flying with photons: Rendering novel views of ropagating light. In European Conference on Computer Vision. Springer 333\u2013351.","DOI":"10.1007\/978-3-031-72664-4_19"},{"key":"e_1_3_3_38_2","article-title":"Transient neural radiance fields for lidar view synthesis and 3D reconstruction","author":"Malik Anagh","year":"2023","unstructured":"Anagh Malik, Parsa Mirdehghan, Sotiris Nousias, Kiriakos N. Kutulakos, and David B. Lindell. 2023. Transient neural radiance fields for lidar view synthesis and 3D reconstruction. NeurIPS (2023).","journal-title":"NeurIPS"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/2945.468400"},{"key":"e_1_3_3_40_2","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"Mildenhall Ben","year":"2018","unstructured":"Ben Mildenhall, Jonathan T. Barron, Jiawen Chen, Dillon Sharlet, Ren Ng, and Robert Carroll. 2018. Burst denoising with kernel prediction networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR52688.2022.01571"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58452-8_24"},{"key":"e_1_3_3_43_2","first-page":"5302","volume-title":"Computer Vision and Pattern Recognition (CVPR)","author":"Mu Fangzhou","year":"2024","unstructured":"Fangzhou Mu, Carter Sifferman, Sacha Jungerman, Yiquan Li, Mark Han, Michael Gleicher, Mohit Gupta, and Yin Li. 2024. Towards 3D vision with low-cost single-photon cameras. In Computer Vision and Pattern Recognition (CVPR). 5302\u20135311."},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3528223.3530127"},{"key":"e_1_3_3_45_2","volume-title":"CVPR","author":"Pearl Naama","year":"2022","unstructured":"Naama Pearl, Tali Treibitz, and Simon Korman. 2022. NAN: Noise-aware NeRFs for burst-denoising. In CVPR."},{"key":"e_1_3_3_46_2","volume-title":"CVPR","author":"Yu Sara Fridovich-Keil and Alex","year":"2022","unstructured":"Sara Fridovich-Keil and Alex Yu, Matthew Tancik, Qinhong Chen, Benjamin Recht, and Angjoo Kanazawa. 2022. Plenoxels: Radiance fields without neural networks. In CVPR."},{"key":"e_1_3_3_47_2","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1021\/acsmeasuresciau.1c00054","article-title":"Why and how savitzky-golay filters should be replaced","volume":"2","author":"Schmid Michael","year":"2022","unstructured":"Michael Schmid, David Rath, and Ulrike Diebold. 2022. Why and how savitzky-golay filters should be replaced. ACS Measurement Science Au 2 (2022), 185\u2013196. Retrieved from https:\/\/api.semanticscholar.org\/CorpusID:246988058","journal-title":"ACS Measurement Science Au"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.445"},{"key":"e_1_3_3_49_2","doi-asserted-by":"crossref","unstructured":"Trevor Seets Atul Ingle Martin Laurenzis and Andreas Velten. 2021. Motion adaptive deblurring with single-photon cameras. In Proceedings of the IEEE\/CVF Winter Conference on Applications of Computer Vision. 1945\u20131954.","DOI":"10.1109\/WACV48630.2021.00199"},{"key":"e_1_3_3_50_2","first-page":"1","article-title":"Very deep convolutional networks for large-scale image recognition","author":"Simonyan K","year":"2015","unstructured":"K Simonyan and A Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. 3rd International Conference on Learning Representations (ICLR 2015), 1\u201314.","journal-title":"3rd International Conference on Learning Representations (ICLR 2015)"},{"key":"e_1_3_3_51_2","unstructured":"Shreyas Singh Aryan Garg and Kaushik Mitra. 2024. HDRSplat: Gaussian splatting for high dynamic range 3D scene reconstruction from raw images. (2024). arXiv:2407.16503 [cs.CV] https:\/\/arxiv.org\/abs\/2407.16503"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV51070.2023.00750"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3588432.3591516"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/jstqe.2018.2867439"},{"key":"e_1_3_3_55_2","volume-title":"Proceedings of the 35th International Conference on Neural Information Processing Systems (NIPS \u201921)","author":"Wang Peng","year":"2021","unstructured":"Peng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt, Taku Komura, and Wenping Wang. 2021. NeuS: Learning neural implicit surfaces by volume rendering for multi-view reconstruction. In Proceedings of the 35th International Conference on Neural Information Processing Systems (NIPS \u201921). Curran Associates Inc., Red Hook, NY, USA, Article 2081, 13 pages."},{"key":"e_1_3_3_56_2","first-page":"1","volume-title":"European Conference on Computer Vision (ECCV)","author":"Wang Yuzhi","year":"2020","unstructured":"Yuzhi Wang, Haibin Huang, Qin Xu, Jiaming Liu, Yiqun Liu, and Jue Wang. 2020. Practical deep raw image denoising on mobile devices. In European Conference on Computer Vision (ECCV). 1\u201316."},{"key":"e_1_3_3_57_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_3_3_58_2","volume-title":"Proc. ICCV","author":"Wei Mian","year":"2023","unstructured":"Mian Wei, Sotiris Nousias, Rahul Gulve, David B Lindell, and Kiriakos N Kutulakos. 2023. Passive ultra-wideband single-photon imaging. In Proc. ICCV."},{"key":"e_1_3_3_59_2","volume-title":"European Conference on Computer Vision (ECCV)","author":"Wolf Yaniv","year":"2024","unstructured":"Yaniv Wolf, Amit Bracha, and Ron Kimmel. 2024. GS2Mesh: Surface reconstruction from gaussian splatting via novel stereo views. In European Conference on Computer Vision (ECCV)."},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2024468118"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2179306"},{"key":"e_1_3_3_62_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV48922.2021.00570"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR46437.2021.00455"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/WACV61041.2025.00375"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00068"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00589"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3770578","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T14:14:18Z","timestamp":1761401658000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3770578"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,25]]},"references-count":65,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,2,28]]}},"alternative-id":["10.1145\/3770578"],"URL":"https:\/\/doi.org\/10.1145\/3770578","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2025,10,25]]},"assertion":[{"value":"2024-10-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-23","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}