{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T16:07:12Z","timestamp":1780502832934,"version":"3.54.1"},"reference-count":40,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2017,7,20]],"date-time":"2017-07-20T00:00:00Z","timestamp":1500508800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,8,31]]},"abstract":"<jats:p>We present CoLux, a novel system for measuring micro 3D motion of multiple independently moving objects at macroscopic standoff distances. CoLux is based on speckle imaging, where the scene is illuminated with a coherent light source and imaged with a camera. Coherent light, on interacting with optically rough surfaces, creates a high-frequency speckle pattern in the captured images. The motion of objects results in movement of speckle, which can be measured to estimate the object motion. Speckle imaging is widely used for micro-motion estimation in several applications, including industrial inspection, scientific imaging, and user interfaces (e.g., optical mice). However, current speckle imaging methods are largely limited to measuring 2D motion (parallel to the sensor image plane) of a single rigid object. We develop a novel theoretical model for speckle movement due to multi-object motion, and present a simple technique based on global scale-space speckle motion analysis for measuring small (5--50 microns) compound motion of multiple objects, along all three axes. Using these tools, we develop a method for measuring 3D micro-motion histograms of multiple independently moving objects, without tracking the individual motion trajectories. In order to demonstrate the capabilities of CoLux, we develop a hardware prototype and a proof-of-concept subtle hand gesture recognition system with a broad range of potential applications in user interfaces and interactive computer graphics.<\/jats:p>","DOI":"10.1145\/3072959.3073607","type":"journal-article","created":{"date-parts":[[2017,7,21]],"date-time":"2017-07-21T12:24:07Z","timestamp":1500639847000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":29,"title":["CoLux"],"prefix":"10.1145","volume":"36","author":[{"given":"Brandon M.","family":"Smith","sequence":"first","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pratham","family":"Desai","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vishal","family":"Agarwal","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohit","family":"Gupta","sequence":"additional","affiliation":[{"name":"University of Wisconsin-Madison"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,7,20]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"crossref","unstructured":"E. Archbold and A. E. Ennos. 1972. Displacement measurement from double exposure laser photographs. Optical Acta (1972).  E. Archbold and A. E. Ennos. 1972. Displacement measurement from double exposure laser photographs. Optical Acta (1972).","DOI":"10.1080\/713818559"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature11578"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPHOT.2014.6831819"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-43205-1"},{"key":"e_1_2_2_5_1","doi-asserted-by":"crossref","unstructured":"A. Davis M. Rubinstein N. Wadhwa G. Mysore F. Durand and W. T. Freeman. 2014. The Visual Microphone: Passive Recovery of Sound from Video. ACM Trans. Graph. (2014).  A. Davis M. Rubinstein N. Wadhwa G. Mysore F. Durand and W. T. Freeman. 2014. The Visual Microphone: Passive Recovery of Sound from Video. ACM Trans. Graph. (2014).","DOI":"10.1145\/2601097.2601119"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/0030-4018(71)90057-5"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"e_1_2_2_8_1","unstructured":"M. Fran\u00e7on. 1979. Laser Speckle and Applications in Optics. Academic Press.  M. Fran\u00e7on. 1979. Laser Speckle and Applications in Optics. Academic Press."},{"key":"e_1_2_2_9_1","doi-asserted-by":"crossref","unstructured":"I. Freund. 1990. Looking Through Walls and Around Corners. Physica A: Statistical Mechanics and its Applications (1990).  I. Freund. 1990. Looking Through Walls and Around Corners. Physica A: Statistical Mechanics and its Applications (1990).","DOI":"10.1016\/0378-4371(90)90357-X"},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"J. Garc\u00eda Z. Zalevsky P. Garc\u00eda-Mart\u00ednez C. Ferreira M. Teicher and Y. Beiderman. 2008. Three-dimensional mapping and range measurement by means of projected speckle patterns. Applied Aptics (June 2008).  J. Garc\u00eda Z. Zalevsky P. Garc\u00eda-Mart\u00ednez C. Ferreira M. Teicher and Y. Beiderman. 2008. Three-dimensional mapping and range measurement by means of projected speckle patterns. Applied Aptics (June 2008).","DOI":"10.1364\/AO.47.003032"},{"key":"e_1_2_2_11_1","doi-asserted-by":"crossref","unstructured":"W J Godinez and K. Rohr. 2015. Tracking multiple particles in fluorescence time-lapse microscopy images via probabilistic data association. IEEE Trans Med Imaging (2015).  W J Godinez and K. Rohr. 2015. Tracking multiple particles in fluorescence time-lapse microscopy images via probabilistic data association. IEEE Trans Med Imaging (2015).","DOI":"10.1109\/ISBI.2015.7163928"},{"key":"e_1_2_2_12_1","unstructured":"J. W. Goodman. 2000. Statistical Optics. Wiley-Interscience.  J. W. Goodman. 2000. Statistical Optics. Wiley-Interscience."},{"key":"e_1_2_2_13_1","unstructured":"J. W. Goodman. 2007. Speckle Phenomena in Optics: Theory and Applications. Roberts and Company Publishers.  J. W. Goodman. 2007. Speckle Phenomena in Optics: Theory and Applications. Roberts and Company Publishers."},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"D. A. Gregory. 1976. Basic physical principles of defocused speckle photography: A tilt topology inspection technique. Optics and Laser Technology (1976).  D. A. Gregory. 1976. Basic physical principles of defocused speckle photography: A tilt topology inspection technique. Optics and Laser Technology (1976).","DOI":"10.1016\/0030-3992(76)90004-9"},{"key":"e_1_2_2_15_1","doi-asserted-by":"crossref","unstructured":"D. A. Gregory. 1978. Topological Speckle and Surface Inspection. In Speckle Metrology. Chapter 8.  D. A. Gregory. 1978. Topological Speckle and Surface Inspection. In Speckle Metrology. Chapter 8.","DOI":"10.1016\/B978-0-12-241360-5.50014-5"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2208331"},{"key":"e_1_2_2_17_1","doi-asserted-by":"crossref","unstructured":"P. Jacquot and P. K. Rastogi. 1979. Speckle motions induced by rigid-body movements in freespace geometry: an explicit investigation and extension to new cases. Applied Optics (1979).  P. Jacquot and P. K. Rastogi. 1979. Speckle motions induced by rigid-body movements in freespace geometry: an explicit investigation and extension to new cases. Applied Optics (1979).","DOI":"10.1364\/AO.18.002022"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1364\/AO.51.001396"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.491"},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"B. Judkewitz R. Horstmeyer I. M. Vellekoop I. N. Papadopoulos and C. Yang. 2015. Translation correlations in anisotropically scattering media. Nature Physics (2015).  B. Judkewitz R. Horstmeyer I. M. Vellekoop I. N. Papadopoulos and C. Yang. 2015. Translation correlations in anisotropically scattering media. Nature Physics (2015).","DOI":"10.1038\/nphys3373"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2010.937394"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSPCS.2015.7391783"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1038\/nphoton.2014.189"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1038\/nphoton.2012.150"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925953"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.powtec.2010.04.018"},{"key":"e_1_2_2_27_1","doi-asserted-by":"crossref","unstructured":"J. Shotton T. Sharp A. Kipman A. Fitzgibbon M. Finocchio A. Blake M. Cook and R. Moore. 2013. Real-time human pose recognition in parts from single depth images. Commun. ACM (2013).  J. Shotton T. Sharp A. Kipman A. Fitzgibbon M. Finocchio A. Blake M. Cook and R. Moore. 2013. Real-time human pose recognition in parts from single depth images. Commun. ACM (2013).","DOI":"10.1007\/978-3-642-28661-2_5"},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"S. K. Sinha. 1988. Improving the accuracy and resolution of particle image or laser speckle velocimetry. Experiments in Fluids (1988).  S. K. Sinha. 1988. Improving the accuracy and resolution of particle image or laser speckle velocimetry. Experiments in Fluids (1988).","DOI":"10.1007\/BF00226137"},{"key":"e_1_2_2_29_1","unstructured":"S.W. Smith. 2002. Digital Signal Processing: A Practical Guide for Engineers and Scientists. California Technical Publishing.  S.W. Smith. 2002. Digital Signal Processing: A Practical Guide for Engineers and Scientists. California Technical Publishing."},{"key":"e_1_2_2_30_1","doi-asserted-by":"crossref","unstructured":"P. Synnergren. 1997. Measurement of three-dimensional displacement fields and shape using electronic speckle photography. Optical Engineering (1997).  P. Synnergren. 1997. Measurement of three-dimensional displacement fields and shape using electronic speckle photography. Optical Engineering (1997).","DOI":"10.1117\/1.601456"},{"key":"e_1_2_2_31_1","doi-asserted-by":"crossref","unstructured":"H. J. Tiziani. 1972. A study of the use of laser speckle to measure small tilts. Opt. Commun. 5 (1972).  H. J. Tiziani. 1972. A study of the use of laser speckle to measure small tilts. Opt. Commun. 5 (1972).","DOI":"10.1016\/0030-4018(72)90095-8"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/B978-0-12-241360-5.50011-X"},{"key":"e_1_2_2_33_1","doi-asserted-by":"crossref","unstructured":"N. Wadhwa M. Rubinstein F. Durand and W. T. Freeman. 2013. Phase-Based Video Motion Processing. ACM Trans. Graph. (2013).  N. Wadhwa M. Rubinstein F. Durand and W. T. Freeman. 2013. Phase-Based Video Motion Processing. ACM Trans. Graph. (2013).","DOI":"10.1145\/2461912.2461966"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984565"},{"key":"e_1_2_2_35_1","doi-asserted-by":"crossref","unstructured":"F. Weichert D. Bachmann B. Rudak and D. Fisseler. 2013. Analysis of the Accuracy and Robustness of the Leap Motion Controller. Sensors (2013).  F. Weichert D. Bachmann B. Rudak and D. Fisseler. 2013. Analysis of the Accuracy and Robustness of the Leap Motion Controller. Sensors (2013).","DOI":"10.3390\/s130506380"},{"key":"e_1_2_2_36_1","unstructured":"H.-Y. Wu M. Rubinstein E. Shih J. Guttag F. Durand and W. T. Freeman. 2012. Eulerian Video Magnification for Revealing Subtle Changes in the World. ACM Trans. Graph. (2012).  H.-Y. Wu M. Rubinstein E. Shih J. Guttag F. Durand and W. T. Freeman. 2012. Eulerian Video Magnification for Revealing Subtle Changes in the World. ACM Trans. Graph. (2012)."},{"key":"e_1_2_2_37_1","doi-asserted-by":"crossref","unstructured":"C. Xu N. Ashwin X. Zhang and L. Cheng. 2015. Estimate Hand Poses Efficiently from Single Depth Images. IJCV (2015).  C. Xu N. Ashwin X. Zhang and L. Cheng. 2015. Estimate Hand Poses Efficiently from Single Depth Images. IJCV (2015).","DOI":"10.1007\/s11263-015-0826-9"},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"Z. Zalevsky Y. Beiderman I. Margalit S. Gingold M. Teicher V. Mico and J. Garcia. 2009. Simultaneous remote extraction of multiple speech sources and heart beats from secondary speckles pattern. Optics Express (2009).  Z. Zalevsky Y. Beiderman I. Margalit S. Gingold M. Teicher V. Mico and J. Garcia. 2009. Simultaneous remote extraction of multiple speech sources and heart beats from secondary speckles pattern. Optics Express (2009).","DOI":"10.1364\/OE.17.021566"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647380"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047261"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3072959.3073607","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3072959.3073607","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:37:23Z","timestamp":1750217843000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3072959.3073607"}},"subtitle":["multi-object 3D micro-motion analysis using speckle imaging"],"short-title":[],"issued":{"date-parts":[[2017,7,20]]},"references-count":40,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,8,31]]}},"alternative-id":["10.1145\/3072959.3073607"],"URL":"https:\/\/doi.org\/10.1145\/3072959.3073607","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,7,20]]},"assertion":[{"value":"2017-07-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}