{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,13]],"date-time":"2026-02-13T11:24:45Z","timestamp":1770981885096,"version":"3.50.1"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2007,7,29]],"date-time":"2007-07-29T00:00:00Z","timestamp":1185667200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2007,7,29]]},"abstract":"<jats:p>In this paper, we present a high speed optical motion capture method that can measure three dimensional motion, orientation, and incident illumination at tagged points in a scene. We use tracking tags that work in natural lighting conditions and can be imperceptibly embedded in attire or other objects. Our system supports an unlimited number of tags in a scene, with each tag uniquely identified to eliminate marker reacquisition issues. Our tags also provide incident illumination data which can be used to match scene lighting when inserting synthetic elements. The technique is therefore ideal for on-set motion capture or real-time broadcasting of virtual sets.<\/jats:p>\n          <jats:p>Unlike previous methods that employ high speed cameras or scanning lasers, we capture the scene appearance using the simplest possible optical devices - a light-emitting diode (LED) with a passive binary mask used as the transmitter and a photosensor used as the receiver. We strategically place a set of optical transmitters to spatio-temporally encode the volume of interest. Photosensors attached to scene points demultiplex the coded optical signals from multiple transmitters, allowing us to compute not only receiver location and orientation but also their incident illumination and the reflectance of the surfaces to which the photosensors are attached. We use our untethered tag system, called Prakash, to demonstrate methods of adding special effects to captured videos that cannot be accomplished using pure vision techniques that rely on camera images.<\/jats:p>","DOI":"10.1145\/1276377.1276422","type":"journal-article","created":{"date-parts":[[2007,9,14]],"date-time":"2007-09-14T13:44:55Z","timestamp":1189777495000},"page":"36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":46,"title":["Prakash"],"prefix":"10.1145","volume":"26","author":[{"given":"Ramesh","family":"Raskar","sequence":"first","affiliation":[{"name":"MERL, Cambridge, MA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hideaki","family":"Nii","sequence":"additional","affiliation":[{"name":"University of Tokyo"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bert","family":"deDecker","sequence":"additional","affiliation":[{"name":"Universiteit Hasselt, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yuki","family":"Hashimoto","sequence":"additional","affiliation":[{"name":"U of Electro-Communications, Tokyo"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jay","family":"Summet","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dylan","family":"Moore","sequence":"additional","affiliation":[{"name":"Syracuse University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yong","family":"Zhao","sequence":"additional","affiliation":[{"name":"Brown University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Westhues","sequence":"additional","affiliation":[{"name":"MERL, Cambridge, MA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Dietz","sequence":"additional","affiliation":[{"name":"MERL, Cambridge, MA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Barnwell","sequence":"additional","affiliation":[{"name":"MERL, Cambridge, MA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shree","family":"Nayar","sequence":"additional","affiliation":[{"name":"Columbia University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Masahiko","family":"Inami","sequence":"additional","affiliation":[{"name":"U of Electro-Communications, Tokyo"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Philippe","family":"Bekaert","sequence":"additional","affiliation":[{"name":"Universiteit Hasselt, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Noland","sequence":"additional","affiliation":[{"name":"U of North Carolina at Chapel Hill"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vlad","family":"Branzoi","sequence":"additional","affiliation":[{"name":"Columbia University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Erich","family":"Bruns","sequence":"additional","affiliation":[{"name":"Bauhaus University, Weimar"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2007,7,29]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/26.153360"},{"key":"e_1_2_2_2_1","first-page":"374","article-title":"Photometric Stereo with General","volume":"02","author":"Basri R.","year":"2001","unstructured":"Basri , R. , and Jacobs , D. 2001 . Photometric Stereo with General , Unknown Lighting. IEEE CVPR 02 , 374 -- 379 . Basri, R., and Jacobs, D. 2001. Photometric Stereo with General, Unknown Lighting. IEEE CVPR 02, 374--379.","journal-title":"Unknown Lighting. IEEE CVPR"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature02937"},{"key":"e_1_2_2_4_1","volume-title":"Symposium on Computer animation (SCA), 37--51","author":"Bhat K. S.","unstructured":"Bhat , K. S. , Twigg , C. D. , Hodgins , J. K. , Khosla , P. K. , Popovic , Z. , and Seitz , S. M . 2003. Estimating Cloth Simulation Parameters from Video . In Symposium on Computer animation (SCA), 37--51 . Bhat, K. S., Twigg, C. D., Hodgins, J. K., Khosla, P. K., Popovic, Z., and Seitz, S. M. 2003. Estimating Cloth Simulation Parameters from Video. In Symposium on Computer animation (SCA), 37--51."},{"key":"e_1_2_2_5_1","doi-asserted-by":"crossref","unstructured":"Bolas M. T. McDowall I. E. Hoberman P. and Fisher S. S. 2004. Snared Illumination.  Bolas M. T. McDowall I. E. Hoberman P. and Fisher S. S. 2004. Snared Illumination.","DOI":"10.1145\/1186155.1186180"},{"key":"e_1_2_2_6_1","unstructured":"Codamotion 2007. Charnwood Dynamics Ltd. http:\/\/www.charndyn.com\/.  Codamotion 2007. Charnwood Dynamics Ltd. http:\/\/www.charndyn.com\/."},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2004.30"},{"key":"e_1_2_2_8_1","unstructured":"Hamamatsu Photonics 2005. Si PIN Photodiode S6560.  Hamamatsu Photonics 2005. Si PIN Photodiode S6560."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.940014"},{"key":"e_1_2_2_10_1","volume-title":"2nd International Conference on Machine Automation (ICMA), 597--608","author":"Iltanen M.","unstructured":"Iltanen , M. , Kosola , H. , Palovuori , K. , and Vanhala , J . 1998. Optical Positioning and Tracking System for a Head Mounted Display Based on Spread Spectrum Technology . In 2nd International Conference on Machine Automation (ICMA), 597--608 . Iltanen, M., Kosola, H., Palovuori, K., and Vanhala, J. 1998. Optical Positioning and Tracking System for a Head Mounted Display Based on Spread Spectrum Technology. In 2nd International Conference on Machine Automation (ICMA), 597--608."},{"key":"e_1_2_2_11_1","volume-title":"Proceedings of ASME IMECE 2004 International Mechanical Engineering Congress and RD&amp;D Expo.","author":"Kang S.","unstructured":"Kang , S. , and Tesar , D . 2004. Indoor GPS Metrology System with 3D Probe for Precision Applications . In Proceedings of ASME IMECE 2004 International Mechanical Engineering Congress and RD&amp;D Expo. Kang, S., and Tesar, D. 2004. Indoor GPS Metrology System with 3D Probe for Precision Applications. In Proceedings of ASME IMECE 2004 International Mechanical Engineering Congress and RD&amp;D Expo."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1095034.1095045"},{"key":"e_1_2_2_13_1","unstructured":"LightPointe Communications 2007. Free Space Optics. http:\/\/www.freespaceoptics.org\/.  LightPointe Communications 2007. Free Space Optics. http:\/\/www.freespaceoptics.org\/."},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Ma H. and Paradiso J. A. 2002. The FindIT Flashlight: Responsive Tagging Based on Optically Triggered Microprocessor Wakeup. In Ubicomp 160--167.   Ma H. and Paradiso J. A. 2002. The FindIT Flashlight: Responsive Tagging Based on Optically Triggered Microprocessor Wakeup. In Ubicomp 160--167.","DOI":"10.1007\/3-540-45809-3_12"},{"key":"e_1_2_2_15_1","volume-title":"ID CAM: A Smart Camera for Scene Capturing and ID Recognition. In International Symposium on Mixed and Augmented Reality (ISMAR), 227--234","author":"Matsushita N.","unstructured":"Matsushita , N. , Hihara , D. , Ushiro , T. , Yoshimura , S. , Rekimoto , J. , and Yamamoto , Y . 2003 . ID CAM: A Smart Camera for Scene Capturing and ID Recognition. In International Symposium on Mixed and Augmented Reality (ISMAR), 227--234 . Matsushita, N., Hihara, D., Ushiro, T., Yoshimura, S., Rekimoto, J., and Yamamoto, Y. 2003. ID CAM: A Smart Camera for Scene Capturing and ID Recognition. In International Symposium on Mixed and Augmented Reality (ISMAR), 227--234."},{"key":"e_1_2_2_16_1","unstructured":"Motion Analysis Corporation 2006. Hawk-I Digital System.  Motion Analysis Corporation 2006. Hawk-I Digital System."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.528"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179849.1179988"},{"key":"e_1_2_2_19_1","unstructured":"Optotrak 2007. NDI Optotrak Certus Spatial Measurement. http:\/\/www.ndigital.com\/certus.php.  Optotrak 2007. NDI Optotrak Certus Spatial Measurement. http:\/\/www.ndigital.com\/certus.php."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1162\/105474600300040394"},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Patel S. N. and Abowd G. D. 2003. A 2-Way Laser-Assisted Selection Scheme for Handhelds in a Physical Environment. In Ubicomp 200--207.  Patel S. N. and Abowd G. D. 2003. A 2-Way Laser-Assisted Selection Scheme for Handhelds in a Physical Environment. In Ubicomp 200--207.","DOI":"10.1007\/978-3-540-39653-6_16"},{"key":"e_1_2_2_22_1","unstructured":"Phase Space Inc 2007. Impulse Camera. http:\/\/www.phasespace.com.  Phase Space Inc 2007. Impulse Camera. http:\/\/www.phasespace.com."},{"key":"e_1_2_2_23_1","unstructured":"PTI INC 2006. VisualEyez VZ 4000.  PTI INC 2006. VisualEyez VZ 4000."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015738"},{"key":"e_1_2_2_25_1","unstructured":"Ringwald M. 2002. Spontaneous Interaction with Everyday Devices Using a PDA Workshop on Supporting Spontaneous Interaction in Ubiquitous Computing Settings. In UbiComp.  Ringwald M. 2002. Spontaneous Interaction with Everyday Devices Using a PDA Workshop on Supporting Spontaneous Interaction in Ubiquitous Computing Settings. In UbiComp ."},{"key":"e_1_2_2_26_1","first-page":"11","article-title":"Big moves","volume":"29","author":"Robertson B.","year":"2006","unstructured":"Robertson , B. 2006 . Big moves . Computer Graphics World 29 , 11 (Nov). Robertson, B. 2006. Big moves. Computer Graphics World 29, 11 (Nov).","journal-title":"Computer Graphics World"},{"key":"e_1_2_2_27_1","unstructured":"Silicon Light Machines 2006. Gated Light Valve. http:\/\/www.siliconlight.com.  Silicon Light Machines 2006. Gated Light Valve. http:\/\/www.siliconlight.com."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/11853565_29"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/70.88064"},{"key":"e_1_2_2_30_1","unstructured":"ViconPeak 2006. Camera MX 40. http:\/\/www.vicon.com\/products\/mx40.html.  ViconPeak 2006. Camera MX 40. http:\/\/www.vicon.com\/products\/mx40.html."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258876"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2002.1046626"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1276377.1276422","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1276377.1276422","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T14:52:17Z","timestamp":1750258337000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1276377.1276422"}},"subtitle":["lighting aware motion capture using photosensing markers and multiplexed illuminators"],"short-title":[],"issued":{"date-parts":[[2007,7,29]]},"references-count":32,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2007,7,29]]}},"alternative-id":["10.1145\/1276377.1276422"],"URL":"https:\/\/doi.org\/10.1145\/1276377.1276422","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,7,29]]},"assertion":[{"value":"2007-07-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}