{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,15]],"date-time":"2026-07-15T20:45:47Z","timestamp":1784148347624,"version":"3.55.0"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2013,11,1]],"date-time":"2013-11-01T00:00:00Z","timestamp":1383264000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2013,11]]},"abstract":"<jats:p>Animated animatronic figures are a unique way to give physical presence to a character. However, their movement and expressions are often limited due to mechanical constraints. In this paper, we propose a complete process for augmenting physical avatars using projector-based illumination, significantly increasing their expressiveness. Given an input animation, the system decomposes the motion into low-frequency motion that can be physically reproduced by the animatronic head and high-frequency details that are added using projected shading. At the core is a spatio-temporal optimization process that compresses the motion in gradient space, ensuring faithful motion replay while respecting the physical limitations of the system. We also propose a complete multi-camera and projection system, including a novel defocused projection and subsurface scattering compensation scheme. The result of our system is a highly expressive physical avatar that features facial details and motion otherwise unattainable due to physical constraints.<\/jats:p>","DOI":"10.1145\/2508363.2508416","type":"journal-article","created":{"date-parts":[[2013,11,6]],"date-time":"2013-11-06T14:09:19Z","timestamp":1383746959000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":65,"title":["Augmenting physical avatars using projector-based illumination"],"prefix":"10.1145","volume":"32","author":[{"given":"Amit","family":"Bermano","sequence":"first","affiliation":[{"name":"Disney Research Zurich and ETH Zurich"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Philipp","family":"Br\u00fcschweiler","sequence":"additional","affiliation":[{"name":"Disney Research Zurich and ETH Zurich"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anselm","family":"Grundh\u00f6fer","sequence":"additional","affiliation":[{"name":"Disney Research Zurich"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daisuke","family":"Iwai","sequence":"additional","affiliation":[{"name":"Osaka University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bernd","family":"Bickel","sequence":"additional","affiliation":[{"name":"Disney Research Zurich"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Markus","family":"Gross","sequence":"additional","affiliation":[{"name":"Disney Research Zurich and ETH Zurich"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2013,11]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2159516.2159518"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964970"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185614"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2006.75"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401132.1401239"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311556"},{"key":"e_1_2_2_7_1","first-page":"2","article-title":"Performance driven facial animation using blendshape interpolation","volume":"2","author":"Chuang E.","year":"2002","unstructured":"Chuang , E. , and Bregler , C. 2002 . Performance driven facial animation using blendshape interpolation . Computer Science Technical Report, Stanford University 2 , 2 , 3. Chuang, E., and Bregler, C. 2002. Performance driven facial animation using blendshape interpolation. Computer Science Technical Report, Stanford University 2, 2, 3.","journal-title":"Computer Science Technical Report, Stanford University"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/258734.258884"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964951"},{"key":"e_1_2_2_10_1","doi-asserted-by":"crossref","unstructured":"Ekman P. and Friesen W. V. 1977. Facial action coding system.  Ekman P. and Friesen W. V. 1977. Facial action coding system.","DOI":"10.1037\/t27734-000"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/1401032.1401035"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1805964.1805966"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2013.136"},{"key":"e_1_2_2_14_1","doi-asserted-by":"crossref","unstructured":"Hartley R. I. and Zisserman A. 2004. Multiple View Geometry in Computer Vision. Cambridge University Press.   Hartley R. I. and Zisserman A. 2004. Multiple View Geometry in Computer Vision . Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2006.161"},{"key":"e_1_2_2_16_1","unstructured":"Havaldar P. Pighin F. and Lewis J. 2006. Performance driven facial animation. In ACM SIGGRAPH Courses.  Havaldar P. Pighin F. and Lewis J. 2006. Performance driven facial animation. In ACM SIGGRAPH Courses ."},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1111449.1111451"},{"key":"e_1_2_2_18_1","volume-title":"Proc. SGP.","author":"Kazhdan M.","unstructured":"Kazhdan , M. , Bolitho , M. , and Hoppe , H . 2006. Poisson surface reconstruction . In Proc. SGP. Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. In Proc. SGP."},{"key":"e_1_2_2_19_1","volume-title":"Int. Conference on Humanoid Robots (Humanoids), 99--104","author":"Kuratate T.","unstructured":"Kuratate , T. , Matsusaka , Y. , Pierce , B. , and Cheng , G . 2011. Mask-bot: A life-size robot head using talking head animation for human-robot communication . In Int. Conference on Humanoid Robots (Humanoids), 99--104 . Kuratate, T., Matsusaka, Y., Pierce, B., and Cheng, G. 2011. Mask-bot: A life-size robot head using talking head animation for human-robot communication. In Int. Conference on Humanoid Robots (Humanoids), 99--104."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2011.02035.x"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1731309.1731326"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778769"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR.2009.5336503"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073217"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2160125.2160142"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070719.2070724"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10055-010-0168-4"},{"key":"e_1_2_2_28_1","volume-title":"Humanoid Robots: New Developments. I-Tech, ch. Geminoid: Teleoperated Android of an Existing Person.","author":"Nishio S.","year":"2007","unstructured":"Nishio , S. , Ishiguro , H. , and Hagita , N . 2007 . Humanoid Robots: New Developments. I-Tech, ch. Geminoid: Teleoperated Android of an Existing Person. Nishio, S., Ishiguro, H., and Hagita, N. 2007. Humanoid Robots: New Developments. I-Tech, ch. Geminoid: Teleoperated Android of an Existing Person."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383290"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88458-3_41"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/280814.280861"},{"key":"e_1_2_2_32_1","volume-title":"Proc. Eurographics Workshop on Rendering Techniques, 89--102","author":"Raskar R.","unstructured":"Raskar , R. , Welch , G. , Low , K.-L. , and Bandyopadhyay , D . 2001. Shader lamps: Animating real objects with image-based illumination . In Proc. Eurographics Workshop on Rendering Techniques, 89--102 . Raskar, R., Welch, G., Low, K.-L., and Bandyopadhyay, D. 2001. Shader lamps: Animating real objects with image-based illumination. In Proc. Eurographics Workshop on Rendering Techniques, 89--102."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141920"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073257"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2159516.2159519"},{"key":"e_1_2_2_36_1","volume-title":"Proc. Int. Conference on Computer Vision","volume":"1","author":"Sukthankar R.","unstructured":"Sukthankar , R. , Stockton , R. G. , and Mullin , M. D . 2001. Smarter presentations: Exploiting homography in camera-projector systems . In Proc. Int. Conference on Computer Vision , vol. 1 , IEEE, 247--253. Sukthankar, R., Stockton, R. G., and Mullin, M. D. 2001. Smarter presentations: Exploiting homography in camera-projector systems. In Proc. Int. Conference on Computer Vision, vol. 1, IEEE, 247--253."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2006.15"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.819861"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/PG.2007.52"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141987"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141974"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.888718"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2508363.2508416","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2508363.2508416","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:28:39Z","timestamp":1750231719000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2508363.2508416"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,11]]},"references-count":42,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2013,11]]}},"alternative-id":["10.1145\/2508363.2508416"],"URL":"https:\/\/doi.org\/10.1145\/2508363.2508416","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,11]]},"assertion":[{"value":"2013-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}