{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,21]],"date-time":"2026-11-21T05:06:18Z","timestamp":1795237578228,"version":"4.10.3"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,6,21]],"date-time":"2023-06-21T00:00:00Z","timestamp":1687305600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,6,21]],"date-time":"2023-06-21T00:00:00Z","timestamp":1687305600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1955219"],"award-info":[{"award-number":["1955219"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Commun"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The ability to form reconstructions beyond line-of-sight view could be transformative in a variety of fields, including search and rescue, autonomous vehicle navigation, and reconnaissance. Most existing active non-line-of-sight (NLOS) imaging methods use data collection steps in which a pulsed laser is directed at several points on a relay surface, one at a time. The prevailing approaches include raster scanning of a rectangular grid on a vertical wall opposite the volume of interest to generate a collection of confocal measurements. These and a recent method that uses a horizontal relay surface are inherently limited by the need for laser scanning. Methods that avoid laser scanning to operate in a snapshot mode are limited to treating the hidden scene of interest as one or two point targets. In this work, based on more complete optical response modeling yet still without multiple illumination positions, we demonstrate accurate reconstructions of foreground objects while also introducing the capability of mapping the stationary scenery behind moving objects. The ability to count, localize, and characterize the sizes of hidden objects, combined with mapping of the stationary hidden scene, could greatly improve indoor situational awareness in a variety of applications.<\/jats:p>","DOI":"10.1038\/s41467-023-39327-2","type":"journal-article","created":{"date-parts":[[2023,6,21]],"date-time":"2023-06-21T08:02:49Z","timestamp":1687334569000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Non-line-of-sight snapshots and background mapping with an active corner camera"],"prefix":"10.1038","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1239-3003","authenticated-orcid":false,"given":"Sheila","family":"Seidel","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6763-8629","authenticated-orcid":false,"given":"Hoover","family":"Rueda-Chac\u00f3n","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9251-7231","authenticated-orcid":false,"given":"Iris","family":"Cusini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9840-0269","authenticated-orcid":false,"given":"Federica","family":"Villa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1715-501X","authenticated-orcid":false,"given":"Franco","family":"Zappa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"Yu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8471-7049","authenticated-orcid":false,"given":"Vivek K","family":"Goyal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,6,21]]},"reference":[{"key":"39327_CR1","doi-asserted-by":"publisher","first-page":"318","DOI":"10.1038\/s42254-020-0174-8","volume":"2","author":"D Faccio","year":"2020","unstructured":"Faccio, D., Velten, A. & Wetzstein, G. Non-line-of-sight imaging. Nat. Rev. Phys. 2, 318\u2013327 (2020).","journal-title":"Nat. Rev. Phys."},{"key":"39327_CR2","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1007\/s11263-014-0697-5","volume":"110","author":"A Torralba","year":"2014","unstructured":"Torralba, A. & Freeman, W. T. Accidental pinhole and pinspeck cameras: Revealing the scene outside the picture. Int. J. Computer Vision 110, 92\u2013112 (2014).","journal-title":"Int. J. Computer Vision"},{"key":"39327_CR3","doi-asserted-by":"crossref","unstructured":"Bouman, K. L. et al. Turning corners into cameras: Principles and methods. In: Proc. 23rd IEEE Int. Conf. Computer Vision, pp. 2270\u20132278 (2017).","DOI":"10.1109\/ICCV.2017.249"},{"key":"39327_CR4","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1109\/TCI.2018.2829599","volume":"4","author":"C Thrampoulidis","year":"2018","unstructured":"Thrampoulidis, C. et al. Exploiting occlusion in non-line-of-sight active imaging. IEEE Trans. Comput. Imaging 4, 419\u2013431 (2018).","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"39327_CR5","doi-asserted-by":"publisher","first-page":"9945","DOI":"10.1364\/OE.26.009945","volume":"26","author":"F Xu","year":"2018","unstructured":"Xu, F. et al. Revealing hidden scenes by photon-efficient occlusion-based opportunistic active imaging. Opt. Express 26, 9945\u20139962 (2018).","journal-title":"Opt. Express"},{"key":"39327_CR6","doi-asserted-by":"crossref","unstructured":"Baradad, M. et al. Inferring light fields from shadows. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 6267\u20136275 (2018).","DOI":"10.1109\/CVPR.2018.00656"},{"key":"39327_CR7","doi-asserted-by":"publisher","first-page":"472","DOI":"10.1038\/s41586-018-0868-6","volume":"565","author":"C Saunders","year":"2019","unstructured":"Saunders, C., Murray-Bruce, J. & Goyal, V. K. Computational periscopy with an ordinary digital camera. Nature 565, 472\u2013475 (2019).","journal-title":"Nature"},{"key":"39327_CR8","doi-asserted-by":"crossref","unstructured":"Yedidia, A. B., Baradad, M., Thrampoulidis, C., Freeman, W. T. & Wornell, G. W. Using unknown occluders to recover hidden scenes. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2019).","DOI":"10.1109\/CVPR.2019.01251"},{"key":"39327_CR9","doi-asserted-by":"crossref","unstructured":"Tanaka, K., Mukaigawa, Y., Kadambi, A. Polarized non-line-of-sight imaging. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2133\u20132142 (2020).","DOI":"10.1109\/CVPR42600.2020.00221"},{"key":"39327_CR10","doi-asserted-by":"publisher","first-page":"540","DOI":"10.1364\/JOSAA.377821","volume":"37","author":"D Lin","year":"2020","unstructured":"Lin, D., Hashemi, C. & Leger, J. R. Passive non-line-of-sight imaging using plenoptic information. J. Opt. Soc. Am. A 37, 540\u2013551 (2020).","journal-title":"J. Opt. Soc. Am. A"},{"key":"39327_CR11","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1080\/713820733","volume":"29","author":"AL Cohen","year":"1982","unstructured":"Cohen, A. L. Anti-pinhole imaging. Optica Acta. 29, 63\u201367 (1982).","journal-title":"Optica Acta."},{"key":"39327_CR12","unstructured":"Aittala, M. et al. Computational mirrors: Blind inverse light transport by deep matrix factorization. In: Proc. Advances in Neural Information Processing, pp. 14311\u201314321 (2019)."},{"key":"39327_CR13","doi-asserted-by":"crossref","unstructured":"Seidel, S. W. et al. Corner occluder computational periscopy: Estimating a hidden scene from a single photograph. In: Proc. IEEE Int. Conf. Computational Photography (2019).","DOI":"10.1109\/ICCPHOT.2019.8747342"},{"key":"39327_CR14","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1109\/TCI.2020.3037405","volume":"7","author":"SW Seidel","year":"2021","unstructured":"Seidel, S. W. et al. Two-dimensional non-line-of-sight scene estimation from a single edge occluder. IEEE Tran. Comput. Imaging\u00a07, 58\u201372 (2021).","journal-title":"IEEE Tran. Comput. Imaging"},{"key":"39327_CR15","doi-asserted-by":"crossref","unstructured":"Krska, W. et al. Double your corners, double your fun: The doorway camera. In: Proc. IEEE Int. Conf. Computational Photography, Pasadena, CA (2022).","DOI":"10.1109\/ICCP54855.2022.9887738"},{"key":"39327_CR16","doi-asserted-by":"crossref","unstructured":"Velten, A. et al. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nat. Commun. 3, 745 (2012).","DOI":"10.1038\/ncomms1747"},{"key":"39327_CR17","doi-asserted-by":"publisher","first-page":"20997","DOI":"10.1364\/OE.23.020997","volume":"23","author":"M Buttafava","year":"2015","unstructured":"Buttafava, M., Zeman, J., Tosi, A., Eliceiri, K. & Velten, A. Non-line-of-sight imaging using a time-gated single photon avalanche diode. Opt. Express 23, 20997\u201321011 (2015).","journal-title":"Opt. Express"},{"key":"39327_CR18","doi-asserted-by":"crossref","unstructured":"Pediredla, A. K., Buttafava, M., Tosi, A., Cossairt, O. & Veeraraghavan, A. Reconstructing rooms using photon echoes: A plane based model and reconstruction algorithm for looking around the corner. In: Proc. IEEE Int. Conf. Computational Photography, pp. 1\u201312 (2017).","DOI":"10.1109\/ICCPHOT.2017.7951478"},{"key":"39327_CR19","doi-asserted-by":"publisher","first-page":"783","DOI":"10.1364\/OE.25.011574","volume":"25","author":"V Arellano","year":"2017","unstructured":"Arellano, V., Gutierrez, D. & Jarabo, A. Fast back-projection for non-line of sight reconstruction. Opt. Express 25, 783\u2013792 (2017).","journal-title":"Opt. Express"},{"key":"39327_CR20","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1145\/3269977","volume":"38","author":"F Heide","year":"2019","unstructured":"Heide, F. et al. Non-line-of-sight imaging with partial occluders and surface normals. ACM Trans. Graph. 38, 22\u201312210 (2019).","journal-title":"ACM Trans. Graph."},{"key":"39327_CR21","doi-asserted-by":"crossref","unstructured":"Ahn, B., Dave, A., Veeraraghavan, A., Gkioulekas, I., Sankaranarayanan, A. Convolutional approximations to the general non-line-of-sight imaging operator. In: Proc. IEEE\/CVF Int. Conf. Computer Vision, pp. 7888\u20137898 (2019).","DOI":"10.1109\/ICCV.2019.00798"},{"key":"39327_CR22","doi-asserted-by":"publisher","first-page":"338","DOI":"10.1038\/nature25489","volume":"555","author":"M O\u2019Toole","year":"2018","unstructured":"O\u2019Toole, M., Lindell, D. B. & Wetzstein, G. Confocal non-line-of-sight imaging based on the light-cone transform. Nature 555, 338\u2013341 (2018).","journal-title":"Nature"},{"key":"39327_CR23","doi-asserted-by":"crossref","unstructured":"Lindell, D. B., Wetzstein, G. & O\u2019Toole, M. Wave-based non-line-of-sight imaging using fast f-k migration. ACM Trans. Graph. 38, 116 (2019).","DOI":"10.1145\/3306346.3322937"},{"key":"39327_CR24","doi-asserted-by":"crossref","unstructured":"Xin, S. et al. A theory of Fermat paths for non-line-of-sight shape reconstruction. In: Proc. IEEE Conf. Computer Vision and Pattern Recognition (2019).","DOI":"10.1109\/CVPR.2019.00696"},{"key":"39327_CR25","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1038\/s41586-019-1461-3","volume":"572","author":"X Liu","year":"2019","unstructured":"Liu, X. et al. Non-line-of-sight imaging using phasor-field virtual wave optics. Nature 572, 620\u2013623 (2019).","journal-title":"Nature"},{"key":"39327_CR26","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-19727-4","volume":"11","author":"J Rapp","year":"2020","unstructured":"Rapp, J. et al. Seeing around corners with edge-resolved transient imaging. Nat. Commun. 11, 5929 (2020).","journal-title":"Nat. Commun."},{"key":"39327_CR27","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1038\/nphoton.2015.234","volume":"10","author":"G Gariepy","year":"2016","unstructured":"Gariepy, G., Tonolini, F., Henderson, R., Leach, J. & Faccio, D. Detection and tracking of moving objects hidden from view. Nat. Photon. 10, 23\u201326 (2016).","journal-title":"Nat. Photon."},{"key":"39327_CR28","doi-asserted-by":"crossref","unstructured":"Metzler, C. A., Lindell, D. B. & Wetzstein, G. Keyhole imaging: Non-line-of-sight imaging and tracking of moving objects along a single optical path. IEEE Trans. Comput. Imaging. 7, 1\u201312 (2021).","DOI":"10.1109\/TCI.2020.3046472"},{"key":"39327_CR29","doi-asserted-by":"publisher","first-page":"10109","DOI":"10.1364\/OE.25.010109","volume":"25","author":"S Chan","year":"2017","unstructured":"Chan, S., Warburton, R. E., Gariepy, G., Leach, J. & Faccio, D. Non-line-of-sight tracking of people at long range. Opt. Express 25, 10109\u201310117 (2017).","journal-title":"Opt. Express"},{"key":"39327_CR30","doi-asserted-by":"publisher","first-page":"1634","DOI":"10.4236\/am.2012.311226","volume":"3","author":"PP Klein","year":"2012","unstructured":"Klein, P. P. On the ellipsoid and plane intersection equation. Appl. Mathematics 3, 1634\u20131640 (2012).","journal-title":"Appl. Mathematics"},{"key":"39327_CR31","unstructured":"Seidel, S. W. Edge-resolved non-line-of-sight imaging. PhD thesis, Boston University (September 2022)."},{"key":"39327_CR32","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1109\/JSTQE.2014.2342197","volume":"20","author":"F Villa","year":"2014","unstructured":"Villa, F. et al. Cmos imager with 1024 SPADs and TDCs for single-photon timing and 3-d time-of-flight. IEEE J. Sel. Top. Quantum Electronics 20, 364\u2013373 (2014).","journal-title":"IEEE J. Sel. Top. Quantum Electronics"},{"key":"39327_CR33","doi-asserted-by":"crossref","unstructured":"Bruschini, C., Homulle, H., Antolovic, I. M., Burri, S. & Charbon, E. Single-photon avalanche diode imagers in biophotonics: review and outlook. Light: Sci. Appl. 8, 87 (2019).","DOI":"10.1038\/s41377-019-0191-5"},{"key":"39327_CR34","doi-asserted-by":"crossref","unstructured":"Villa, F., Severini, F., Madonini, F. & Zappa, F. SPADs and SiPMs arrays for long-range high-speed light detection and ranging (LiDAR). Sensors 21, 3829 (2021).","DOI":"10.3390\/s21113839"},{"key":"39327_CR35","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1364\/OPTICA.386574","volume":"7","author":"K Morimoto","year":"2020","unstructured":"Morimoto, K. et al. Megapixel time-gated SPAD image sensor for 2D and 3D imaging applications. Optica 7, 346\u2013354 (2020).","journal-title":"Optica"},{"key":"39327_CR36","doi-asserted-by":"crossref","unstructured":"Riccardo, S., Conca, E., Sesta, V., Tosi, A. Fast-gated 16\u2009\u00d7\u200916 SPAD array with on-chip 6 ps TDCs for non-line-of-sight imaging. In: Proc. IEEE Photonics Conf., pp. 1\u20132 (2021).","DOI":"10.1109\/IPC48725.2021.9593045"},{"key":"39327_CR37","doi-asserted-by":"publisher","first-page":"2947","DOI":"10.1109\/JSSC.2019.2939083","volume":"54","author":"SW Hutchings","year":"2019","unstructured":"Hutchings, S. W. et al. A reconfigurable 3-d-stacked SPAD imager with in-pixel histogramming for flash LIDAR or high-speed time-of-flight imaging. IEEE J. Solid-State Circuits 54, 2947\u20132956 (2019).","journal-title":"IEEE J. Solid-State Circuits"},{"key":"39327_CR38","doi-asserted-by":"crossref","unstructured":"Renna, M. et al. Fast-gated 16\u2009\u00d7\u20091 SPAD array for non-line-of-sight imaging applications. Instruments 4, 14 (2020).","DOI":"10.3390\/instruments4020014"},{"key":"39327_CR39","doi-asserted-by":"publisher","unstructured":"Seidel, S. Active corner camera. Goyal-STIR-Group GitHub organization (2023). https:\/\/doi.org\/10.5281\/zenodo.7905475.","DOI":"10.5281\/zenodo.7905475"}],"container-title":["Nature Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41467-023-39327-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-023-39327-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41467-023-39327-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,21]],"date-time":"2023-06-21T08:03:17Z","timestamp":1687334597000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41467-023-39327-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,21]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["39327"],"URL":"https:\/\/doi.org\/10.1038\/s41467-023-39327-2","relation":{},"ISSN":["2041-1723"],"issn-type":[{"value":"2041-1723","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,21]]},"assertion":[{"value":"8 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 June 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 June 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"3677"}}