{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,18]],"date-time":"2026-08-18T01:43:56Z","timestamp":1787017436134,"version":"build-2736575974"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2024,6,25]],"date-time":"2024-06-25T00:00:00Z","timestamp":1719273600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2024,10,31]]},"abstract":"<jats:p>Non-line-of-sight (NLOS) imaging has the ability to recover 3D images of scenes outside the direct line of sight, which is of growing interest for diverse applications. Despite the remarkable progress, NLOS imaging of dynamic objects is still challenging. It requires a large amount of multibounce photons for the reconstruction of single-frame data. To overcome this obstacle, we develop a computational framework for dynamic time-of-flight NLOS imaging based on plug-and-play (PnP) algorithms. By combining imaging forward model with the deep denoising network from the computer vision community, we show a 4 frames-per-second (fps) 3D NLOS video recovery (128 \u00d7 128 \u00d7 512) in post-processing. Our method leverages the temporal similarity among adjacent frames and incorporates sparse priors and frequency filtering. This enables higher-quality reconstructions for complex scenes. Extensive experiments are conducted to verify the superior performance of our proposed algorithm both through simulations and real data.<\/jats:p>","DOI":"10.1145\/3665139","type":"journal-article","created":{"date-parts":[[2024,5,14]],"date-time":"2024-05-14T07:04:12Z","timestamp":1715670252000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["Plug-and-Play Algorithms for Dynamic Non-line-of-sight Imaging"],"prefix":"10.1145","volume":"43","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-8603-9976","authenticated-orcid":false,"given":"Juntian","family":"Ye","sequence":"first","affiliation":[{"name":"Physics, University of Science and Technology of China, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-0389-785X","authenticated-orcid":false,"given":"Yu","family":"Hong","sequence":"additional","affiliation":[{"name":"Physics, University of Science and Technology of China, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7733-3159","authenticated-orcid":false,"given":"Xiongfei","family":"Su","sequence":"additional","affiliation":[{"name":"Zhejiang University, Hangzhou, China and Westlake University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8311-7524","authenticated-orcid":false,"given":"Xin","family":"Yuan","sequence":"additional","affiliation":[{"name":"Westlake University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1643-225X","authenticated-orcid":false,"given":"Feihu","family":"Xu","sequence":"additional","affiliation":[{"name":"Physics, University of Science and Technology of China, Hefei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,6,25]]},"reference":[{"key":"e_1_3_3_2_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.25.011574"},{"key":"e_1_3_3_3_1","doi-asserted-by":"publisher","DOI":"10.1137\/080716542"},{"key":"e_1_3_3_4_1","doi-asserted-by":"publisher","DOI":"10.1561\/2200000016"},{"key":"e_1_3_3_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.38"},{"key":"e_1_3_3_6_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.23.020997"},{"key":"e_1_3_3_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2007.914731"},{"key":"e_1_3_3_8_1","doi-asserted-by":"crossref","unstructured":"Ruizhi Cao Frederic de Goumoens Baptiste Blochet Jian Xu and Changhuei Yang. 2022. High-resolution non-line-of-sight imaging employing active focusing. Nature Photonics 16 6 (2022) 462\u2013468.","DOI":"10.1038\/s41566-022-01009-8"},{"issue":"6","key":"e_1_3_3_9_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3414685.3417825","article-title":"Learned feature embeddings for non-line-of-sight imaging and recognition","volume":"39","author":"Chen Wenzheng","year":"2020","unstructured":"Wenzheng Chen, Fangyin Wei, Kiriakos N. Kutulakos, Szymon Rusinkiewicz, and Felix Heide. 2020. Learned feature embeddings for non-line-of-sight imaging and recognition. ACM Transactions on Graphics 39, 6 (2020), 1\u201318.","journal-title":"ACM Transactions on Graphics"},{"key":"e_1_3_3_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2007.901238"},{"key":"e_1_3_3_11_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42254-020-0174-8"},{"key":"e_1_3_3_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00104"},{"key":"e_1_3_3_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.366"},{"key":"e_1_3_3_14_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.20.019096"},{"key":"e_1_3_3_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2011.2168410"},{"key":"e_1_3_3_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3269977"},{"key":"e_1_3_3_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.418"},{"key":"e_1_3_3_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3368314"},{"key":"e_1_3_3_19_1","volume-title":"Proceedings of the 37th Conference on Neural Information Processing Systems","author":"Li Yue","year":"2023","unstructured":"Yue Li, Yueyi Zhang, Juntian Ye, Feihu Xu, and Zhiwei Xiong. 2023. Deep non-line-of-sight imaging from under-scanning measurements. In Proceedings of the 37th Conference on Neural Information Processing Systems."},{"key":"e_1_3_3_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00694"},{"key":"e_1_3_3_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322937"},{"key":"e_1_3_3_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCI.2022.3194721"},{"key":"e_1_3_3_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCP54855.2022.9887660"},{"issue":"1","key":"e_1_3_3_24_1","first-page":"1","article-title":"Phasor field diffraction-based reconstruction for fast non-line-of-sight imaging systems","volume":"11","author":"Liu Xiaochun","year":"2020","unstructured":"Xiaochun Liu, Sebastian Bauer, and Andreas Velten. 2020. Phasor field diffraction-based reconstruction for fast non-line-of-sight imaging systems. Nature Communications 11, 1 (2020), 1\u201313.","journal-title":"Nature Communications"},{"key":"e_1_3_3_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-1461-3"},{"key":"e_1_3_3_26_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-023-38898-4"},{"key":"e_1_3_3_27_1","unstructured":"Tomohiro Maeda Guy Satat Tristan Swedish Lagnojita Sinha and Ramesh Raskar. 2019. Recent advances in imaging around corners. arXiv:1910.05613. Retrieved from https:\/\/arxiv.org\/abs\/1910.05613"},{"key":"e_1_3_3_28_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-021-26721-x"},{"key":"e_1_3_3_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.acha.2008.07.002"},{"key":"e_1_3_3_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.246"},{"key":"e_1_3_3_31_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature25489"},{"key":"e_1_3_3_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2019.8747336"},{"key":"e_1_3_3_33_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.439372"},{"key":"e_1_3_3_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(92)90242-F"},{"key":"e_1_3_3_35_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-018-0868-6"},{"key":"e_1_3_3_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2007.383191"},{"key":"e_1_3_3_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00214"},{"key":"e_1_3_3_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2021.3076062"},{"key":"e_1_3_3_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00655"},{"key":"e_1_3_3_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCI.2016.2599778"},{"key":"e_1_3_3_41_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-12943-7"},{"key":"e_1_3_3_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2019.8803136"},{"key":"e_1_3_3_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00143"},{"key":"e_1_3_3_44_1","first-page":"1545","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Tsai Chia-Yin","year":"2019","unstructured":"Chia-Yin Tsai, Aswin C. Sankaranarayanan, and Ioannis Gkioulekas. 2019. Beyond volumetric albedo\u2013a surface optimization framework for non-line-of-sight imaging. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 1545\u20131555."},{"key":"e_1_3_3_45_1","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms1747"},{"key":"e_1_3_3_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/GlobalSIP.2013.6737048"},{"key":"e_1_3_3_47_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2024468118"},{"key":"e_1_3_3_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00696"},{"key":"e_1_3_3_49_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.26.009945"},{"key":"e_1_3_3_50_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.413774"},{"key":"e_1_3_3_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00148"},{"key":"e_1_3_3_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00152"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3665139","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3665139","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:58:33Z","timestamp":1750280313000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3665139"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,25]]},"references-count":51,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,10,31]]}},"alternative-id":["10.1145\/3665139"],"URL":"https:\/\/doi.org\/10.1145\/3665139","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,25]]},"assertion":[{"value":"2023-05-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-04-03","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}