{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T15:57:02Z","timestamp":1788451022597,"version":"build-2803163510"},"reference-count":34,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,7,27]],"date-time":"2015-07-27T00:00:00Z","timestamp":1437955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2015,7,27]]},"abstract":"<jats:p>Over the last few years, depth cameras have become increasingly popular for a range of applications, including human-computer interaction and gaming, augmented reality, machine vision, and medical imaging. Many of the commercially-available devices use the time-of-flight principle, where active illumination is temporally coded and analyzed in the camera to estimate a per-pixel depth map of the scene. In this paper, we propose a fundamentally new imaging modality for all time-of-flight (ToF) cameras: per-pixel radial velocity measurement. The proposed technique exploits the Doppler effect of objects in motion, which shifts the temporal illumination frequency before it reaches the camera. Using carefully coded illumination and modulation frequencies of the ToF camera, object velocities directly map to measured pixel intensities. We show that a slight modification of our imaging system allows for color, depth, and velocity information to be captured simultaneously. Combining the optical flow computed on the RGB frames with the measured metric radial velocity allows us to further estimate the full 3D metric velocity field of the scene. The proposed technique has applications in many computer graphics and vision problems, for example motion tracking, segmentation, recognition, and motion deblurring.<\/jats:p>","DOI":"10.1145\/2766953","type":"journal-article","created":{"date-parts":[[2015,7,28]],"date-time":"2015-07-28T12:26:38Z","timestamp":1438086398000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":52,"title":["Doppler time-of-flight imaging"],"prefix":"10.1145","volume":"34","author":[{"given":"Felix","family":"Heide","sequence":"first","affiliation":[{"name":"University of British Columbia and KAUST and Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wolfgang","family":"Heidrich","sequence":"additional","affiliation":[{"name":"KAUST and University of British Columbia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthias","family":"Hullin","sequence":"additional","affiliation":[{"name":"University of Bonn"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gordon","family":"Wetzstein","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,7,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01420984"},{"key":"e_1_2_2_2_1","volume-title":"Modulation Transfer Function in Optical and ElectroOptical Systems","author":"Boreman G. D.","unstructured":"Boreman , G. D. 2001. Modulation Transfer Function in Optical and ElectroOptical Systems . SPIE Publications . Boreman, G. D. 2001. Modulation Transfer Function in Optical and ElectroOptical Systems. SPIE Publications."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSI.2008.916679"},{"key":"e_1_2_2_4_1","unstructured":"Ceperley P. 2015. Resonances waves and fields. http:\/\/resonanceswavesandfields.blogspot.com\/2011\/04\/28-valid-method-of-multiplying-two.html. {Online; accessed 20-January-2015}.  Ceperley P. 2015. Resonances waves and fields. http:\/\/resonanceswavesandfields.blogspot.com\/2011\/04\/28-valid-method-of-multiplying-two.html. {Online; accessed 20-January-2015}."},{"key":"e_1_2_2_5_1","volume-title":"Proc. SPIE 7239","author":"Conroy R.","unstructured":"Conroy , R. , Dorrington , A. , Kunnemeyer , R. , and Cree , M . 2009. Range Imager Performance Comparison in Homodyne and Heterodyne Operating Modes . In Proc. SPIE 7239 . Conroy, R., Dorrington, A., Kunnemeyer, R., and Cree, M. 2009. Range Imager Performance Comparison in Homodyne and Heterodyne Operating Modes. In Proc. SPIE 7239."},{"key":"e_1_2_2_6_1","first-page":"465","article-title":"\u00dcber das farbige Licht der Doppelsterne und einiger anderer Gestirne des Himmels","volume":"12","author":"Doppler C. J.","year":"1842","unstructured":"Doppler , C. J. 1842 . \u00dcber das farbige Licht der Doppelsterne und einiger anderer Gestirne des Himmels . Abhandlungen der K\u00f6nigl. B\u00f6hm. Gesellschaft der Wissenschaften 12 , 2, 465 -- 482 . Doppler, C. J. 1842. \u00dcber das farbige Licht der Doppelsterne und einiger anderer Gestirne des Himmels. Abhandlungen der K\u00f6nigl. B\u00f6hm. Gesellschaft der Wissenschaften 12, 2, 465--482.","journal-title":"Abhandlungen der K\u00f6nigl. B\u00f6hm. Gesellschaft der Wissenschaften"},{"key":"e_1_2_2_7_1","volume-title":"Proc. Meas. Sci. Technol.","volume":"18","author":"Dorrington A. A.","unstructured":"Dorrington , A. A. , Cree , M. J. , Payne , A. D. , Conroy , R. M. , and Carnegie , D. A . 2007. Achieving sub-millimetre precision with a solid-state full-field heterodyning range imaging camera . In Proc. Meas. Sci. Technol. , vol. 18 . Dorrington, A. A., Cree, M. J., Payne, A. D., Conroy, R. M., and Carnegie, D. A. 2007. Achieving sub-millimetre precision with a solid-state full-field heterodyning range imaging camera. In Proc. Meas. Sci. Technol., vol. 18."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03778-8_3"},{"key":"e_1_2_2_9_1","volume-title":"Proc. CVPR, 35--35","author":"Gokturk S.","unstructured":"Gokturk , S. , Yalcin , H. , and Bamji , C . 2004. A time-of-flight depth sensor - system description, issues and solutions . In Proc. CVPR, 35--35 . Gokturk, S., Yalcin, H., and Bamji, C. 2004. A time-of-flight depth sensor - system description, issues and solutions. In Proc. CVPR, 35--35."},{"key":"e_1_2_2_10_1","volume-title":"Proc. ICCP.","author":"Gu J.","unstructured":"Gu , J. , Hitomi , Y. , Mitsunaga , T. , and Nayar , S . 2010. Coded Rolling Shutter Photography: Flexible Space-Time Sampling . In Proc. ICCP. Gu, J., Hitomi, Y., Mitsunaga, T., and Nayar, S. 2010. Coded Rolling Shutter Photography: Flexible Space-Time Sampling. In Proc. ICCP."},{"key":"e_1_2_2_11_1","volume-title":"Phasor Imaging: A Generalization Of Correlation-Based Time-of-Flight Imaging. Tech. rep., Jun.","author":"Gupta M.","year":"2014","unstructured":"Gupta , M. , Nayar , S. K. , Hullin , M. , and Martin , J . 2014 . Phasor Imaging: A Generalization Of Correlation-Based Time-of-Flight Imaging. Tech. rep., Jun. Gupta, M., Nayar, S. K., Hullin, M., and Martin, J. 2014. Phasor Imaging: A Generalization Of Correlation-Based Time-of-Flight Imaging. Tech. rep., Jun."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461945"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.418"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1364\/OE.22.026338"},{"key":"e_1_2_2_15_1","volume-title":"Real-time Motion Compensation for PMD-ToF Images. In Lecture Notes in Computer Science","volume":"8200","author":"Hoegg T.","unstructured":"Hoegg , T. , Lefloch , D. , and Kolb , A . 2013 . Real-time Motion Compensation for PMD-ToF Images. In Lecture Notes in Computer Science , vol. 8200 . Hoegg, T., Lefloch, D., and Kolb, A. 2013. Real-time Motion Compensation for PMD-ToF Images. In Lecture Notes in Computer Science, vol. 8200."},{"key":"e_1_2_2_16_1","volume-title":"Proc. ICRA, IEEE, 1736--1741","author":"Honegger D.","unstructured":"Honegger , D. , Meier , L. , Tanskanen , P. , and Pollefeys , M . 2013. An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications . In Proc. ICRA, IEEE, 1736--1741 . Honegger, D., Meier, L., Tanskanen, P., and Pollefeys, M. 2013. An open source and open hardware embedded metric optical flow CMOS camera for indoor and outdoor applications. In Proc. ICRA, IEEE, 1736--1741."},{"key":"e_1_2_2_17_1","volume-title":"Proc. ECCV, 235--249","author":"Hontani H.","unstructured":"Hontani , H. , Oishi , G. , and Kitagawa , T . 2014. Local estimation of high velocity optical flow with correlation image sensor . In Proc. ECCV, 235--249 . Hontani, H., Oishi, G., and Kitagawa, T. 2014. Local estimation of high velocity optical flow with correlation image sensor. In Proc. ECCV, 235--249."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(81)90024-2"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2508363.2508428"},{"key":"e_1_2_2_20_1","volume-title":"Proc. ICCV, 159--166","author":"Kirmani A.","unstructured":"Kirmani , A. , Hutchison , T. , Davis , J. , and Raskar , R . 2009. Looking around the corner using transient imaging . In Proc. ICCV, 159--166 . Kirmani, A., Hutchison, T., Davis, J., and Raskar, R. 2009. Looking around the corner using transient imaging. In Proc. ICCV, 159--166."},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/3.910448"},{"key":"e_1_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Li Y. and Stuber G. 2006. Orthogonal Frequency Division Multiplexing for Wireless Communications. Springer.   Li Y. and Stuber G. 2006. Orthogonal Frequency Division Multiplexing for Wireless Communications. Springer.","DOI":"10.1007\/0-387-30235-2"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/11919629_53"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-03778-8_2"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88690-7_3"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024205"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601103"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995465"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964936"},{"key":"e_1_2_2_31_1","first-page":"3","article-title":"Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging","volume":"745","author":"Velten A.","year":"2012","unstructured":"Velten , A. , Willwacher , T. , Gupta , O. , Veeraraghavan , A. , Bawendi , M. , and Raskar , R. 2012 . Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging . Nat Commun 745 , 3 . Velten, A., Willwacher, T., Gupta, O., Veeraraghavan, A., Bawendi, M., and Raskar, R. 2012. Recovering three-dimensional shape around a corner using ultrafast time-of-flight imaging. Nat Commun 745, 3.","journal-title":"Nat Commun"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461928"},{"key":"e_1_2_2_33_1","volume-title":"Proc. ICSP","volume":"2","author":"Wei D.","unstructured":"Wei , D. , Masurel , P. , Kurihara , T. , and Ando , S . 2006. Optical flow determination with complex-sinusoidally modulated imaging . In Proc. ICSP , vol. 2 . Wei, D., Masurel, P., Kurihara, T., and Ando, S. 2006. Optical flow determination with complex-sinusoidally modulated imaging. In Proc. ICSP, vol. 2."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33718-5_39"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2010.2046811"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766953","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2766953","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:43:01Z","timestamp":1750225381000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766953"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,7,27]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,7,27]]}},"alternative-id":["10.1145\/2766953"],"URL":"https:\/\/doi.org\/10.1145\/2766953","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,7,27]]},"assertion":[{"value":"2015-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}