{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T17:40:33Z","timestamp":1777657233969,"version":"3.51.4"},"reference-count":25,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2015,11,2]],"date-time":"2015-11-02T00:00:00Z","timestamp":1446422400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ISS-1420122"],"award-info":[{"award-number":["ISS-1420122"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100007458","name":"Qatar Foundation","doi-asserted-by":"publisher","award":["6928354"],"award-info":[{"award-number":["6928354"]}],"id":[{"id":"10.13039\/100007458","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2015,11,4]]},"abstract":"<jats:p>We present algorithms for extracting an image-space representation of object structure from video and using it to synthesize physically plausible animations of objects responding to new, previously unseen forces. Our representation of structure is derived from an image-space analysis of modal object deformation: projections of an object's resonant modes are recovered from the temporal spectra of optical flow in a video, and used as a basis for the image-space simulation of object dynamics. We describe how to extract this basis from video, and show that it can be used to create physically-plausible animations of objects without any knowledge of scene geometry or material properties.<\/jats:p>","DOI":"10.1145\/2816795.2818095","type":"journal-article","created":{"date-parts":[[2015,10,27]],"date-time":"2015-10-27T12:36:39Z","timestamp":1445949399000},"page":"1-7","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":34,"title":["Image-space modal bases for plausible manipulation of objects in video"],"prefix":"10.1145","volume":"34","author":[{"given":"Abe","family":"Davis","sequence":"first","affiliation":[{"name":"MIT CSAIL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Justin G.","family":"Chen","sequence":"additional","affiliation":[{"name":"MIT Dept. of Civil and Environmental Eng."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fr\u00e9do","family":"Durand","sequence":"additional","affiliation":[{"name":"MIT CSAIL"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,11,2]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Bathe K.-J. 2006. Finite element procedures. Klaus-Jurgen Bathe.  Bathe K.-J. 2006. Finite element procedures. Klaus-Jurgen Bathe."},{"key":"e_1_2_2_2_1","volume-title":"Proc. Of the International Modal Analysis Conference (IMAC) XXI, paper","volume":"265","author":"Brincker R.","unstructured":"Brincker , R. , Ventura , C. , and Andersen , P . 2003. Why output-only modal testing is a desirable tool for a wide range of practical applications . In Proc. Of the International Modal Analysis Conference (IMAC) XXI, paper , vol. 265 . Brincker, R., Ventura, C., and Andersen, P. 2003. Why output-only modal testing is a desirable tool for a wide range of practical applications. In Proc. Of the International Modal Analysis Conference (IMAC) XXI, paper, vol. 265."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsv.2015.01.024"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073273"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601119"},{"key":"e_1_2_2_6_1","volume-title":"The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (June).","author":"Davis A.","unstructured":"Davis , A. , Bouman , K. L. , Chen , J. G. , Rubinstein , M. , Durand , F. , and Freeman , W. T . 2015. Visual vibrometry: Estimating material properties from small motion in video . The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (June). Davis, A., Bouman, K. L., Chen, J. G., Rubinstein, M., Durand, F., and Freeman, W. T. 2015. Visual vibrometry: Estimating material properties from small motion in video. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (June)."},{"key":"e_1_2_2_7_1","volume-title":"Proceedings of IMAC-XVIII, the 18th International Modal Analysis Conference","author":"De Roeck G.","unstructured":"De Roeck , G. , Peeters , B. , and Ren , W . -X. 2000. Benchmark study on system identification through ambient vibration measurements . In Proceedings of IMAC-XVIII, the 18th International Modal Analysis Conference , San Antonio, Texas, 1106--1112. De Roeck, G., Peeters, B., and Ren, W.-X. 2000. Benchmark study on system identification through ambient vibration measurements. In Proceedings of IMAC-XVIII, the 18th International Modal Analysis Conference, San Antonio, Texas, 1106--1112."},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1021669406132"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymssp.2010.08.013"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2010.109"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566621"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/588272.588278"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601217"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383268"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.85660"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/74334.74355"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.345012"},{"key":"e_1_2_2_18_1","volume-title":"Theory of vibration","author":"Shabana A. A.","unstructured":"Shabana , A. A. 1991. Theory of vibration , vol. 2 . Springer . Shabana, A. A. 1991. Theory of vibration, vol. 2. Springer."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/18.119725"},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Stam J. 1996. Stochastic dynamics: Simulating the effects of turbulence on flexible structures.  Stam J. 1996. Stochastic dynamics: Simulating the effects of turbulence on flexible structures.","DOI":"10.1111\/1467-8659.00152"},{"key":"e_1_2_2_21_1","volume-title":"Proceedings of the Ninth IEEE International Conference on Computer Vision -","volume":"2","author":"Sun M.","unstructured":"Sun , M. , Jepson , A. D. , and Fiume , E . 2003. Video input driven animation (vida) . In Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2 , IEEE Computer Society, Washington, DC, USA, ICCV '03, 96--. Sun, M., Jepson, A. D., and Fiume, E. 2003. Video input driven animation (vida). In Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2, IEEE Computer Society, Washington, DC, USA, ICCV '03, 96--."},{"key":"e_1_2_2_22_1","volume-title":"IEEE Intl. Conf. Image Processing","volume":"3","author":"Szummer M.","unstructured":"Szummer , M. , and Picard , R. W . 1996. Temporal texture modeling . In IEEE Intl. Conf. Image Processing , vol. 3 , 823--826. Szummer, M., and Picard, R. W. 1996. Temporal texture modeling. In IEEE Intl. Conf. Image Processing, vol. 3, 823--826."},{"key":"e_1_2_2_23_1","unstructured":"Tao H. and Huang T. S. 1998. Connected vibrations: A modal analysis approach for non-rigid motion tracking. In CVPR IEEE Computer Society 735--740.   Tao H. and Huang T. S. 1998. Connected vibrations: A modal analysis approach for non-rigid motion tracking. In CVPR IEEE Computer Society 735--740."},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461966"},{"key":"e_1_2_2_25_1","volume-title":"Computational Photography (ICCP), 2014 IEEE International Conference on, IEEE.","author":"Wadhwa N.","unstructured":"Wadhwa , N. , Rubinstein , M. , Durand , F. , and Freeman , W. T . 2014. Riesz pyramid for fast phase-based video magnification . In Computational Photography (ICCP), 2014 IEEE International Conference on, IEEE. Wadhwa, N., Rubinstein, M., Durand, F., and Freeman, W. T. 2014. Riesz pyramid for fast phase-based video magnification. In Computational Photography (ICCP), 2014 IEEE International Conference on, IEEE."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2816795.2818095","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2816795.2818095","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:48:18Z","timestamp":1750225698000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2816795.2818095"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,11,2]]},"references-count":25,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2015,11,4]]}},"alternative-id":["10.1145\/2816795.2818095"],"URL":"https:\/\/doi.org\/10.1145\/2816795.2818095","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,11,2]]},"assertion":[{"value":"2015-11-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}