{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,17]],"date-time":"2026-07-17T06:06:59Z","timestamp":1784268419997,"version":"3.55.0"},"reference-count":52,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2018,7,30]],"date-time":"2018-07-30T00:00:00Z","timestamp":1532908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2018,8,31]]},"abstract":"<jats:p>We present a visual analogue for musical rhythm derived from an analysis of motion in video, and show that alignment of visual rhythm with its musical counterpart results in the appearance of dance. Central to our work is the concept of visual beats --- patterns of motion that can be shifted in time to control visual rhythm. By warping visual beats into alignment with musical beats, we can create or manipulate the appearance of dance in video. Using this approach we demonstrate a variety of retargeting applications that control musical synchronization of audio and video: we can change what song performers are dancing to, warp irregular motion into alignment with music so that it appears to be dancing, or search collections of video for moments of accidentally dance-like motion that can be used to synthesize musical performances.<\/jats:p>","DOI":"10.1145\/3197517.3201371","type":"journal-article","created":{"date-parts":[[2018,7,31]],"date-time":"2018-07-31T15:56:23Z","timestamp":1533052583000},"page":"1-11","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":56,"title":["Visual rhythm and beat"],"prefix":"10.1145","volume":"37","author":[{"given":"Abe","family":"Davis","sequence":"first","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maneesh","family":"Agrawala","sequence":"additional","affiliation":[{"name":"Stanford University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,7,30]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185562"},{"key":"e_1_2_2_2_1","unstructured":"Jean Charles Bazin and Alexander Sorkine-Hornung. 2016. ActionSnapping: Motion-Based Video Synchronization. In ECCV.  Jean Charles Bazin and Alexander Sorkine-Hornung. 2016. ActionSnapping: Motion-Based Video Synchronization. In ECCV."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185563"},{"key":"e_1_2_2_4_1","unstructured":"Sebastian B\u00f6ck and Gerhard Widmer. 2013. Maximum Filter Vibrato Suppression for Onset Detection.  Sebastian B\u00f6ck and Gerhard Widmer. 2013. Maximum Filter Vibrato Suppression for Onset Detection."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.2307\/1410948"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.3366\/drs.2011.0021"},{"key":"e_1_2_2_7_1","unstructured":"Kevin Burg and Jamie Beck. 2012. Cinemagraphs. (2012). http:\/\/cinemagraphs.com\/  Kevin Burg and Jamie Beck. 2012. Cinemagraphs. (2012). http:\/\/cinemagraphs.com\/"},{"key":"e_1_2_2_8_1","volume-title":"Audio-vision: Sound on Screen","author":"Chion M.","year":"1994"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073273"},{"key":"e_1_2_2_10_1","volume-title":"Automatic Synchronization of Background Music and Motion. In in Computer Animation,\u00e2\u0102\u0130 in Computer Graphics Forum","author":"Lee Hyun","year":"2005"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2016.00229"},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"H. Cowell and D. Nicholls. 1996. New Musical Resources. Cambridge University Press. https:\/\/books.google.com\/books?id=BeLDXA-7TdAC  H. Cowell and D. Nicholls. 1996. New Musical Resources. Cambridge University Press. https:\/\/books.google.com\/books?id=BeLDXA-7TdAC","DOI":"10.1017\/CBO9780511597329"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2016.2622271"},{"key":"e_1_2_2_14_1","volume-title":"Visual Vibrometry: Estimating Material Properties From Small Motion in Video. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Davis Abe"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2816795.2818095"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601119"},{"key":"e_1_2_2_17_1","volume-title":"In Proceedings of the 9th international conference on digital audio effects. 133--137","author":"Dixon Simon","year":"2006"},{"key":"e_1_2_2_18_1","volume-title":"2006 Fortieth Asilomar Conference on Signals, Systems and Computers. 59--63","author":"Dyaberi V."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1080\/09298210701653344"},{"key":"e_1_2_2_20_1","volume-title":"An Audio-based Real-time Beat Tracking System for Music With or Without Drum-sounds. 30 (09","author":"Goto Masataka","year":"2002"},{"key":"e_1_2_2_21_1","volume-title":"2010 IEEE International Conference on Acoustics, Speech and Signal Processing. 5522--5525","author":"Grosche P."},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23618"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459462"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/882262.882283"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601178"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3072959.3073653"},{"key":"e_1_2_2_27_1","volume-title":"An Introduction to Audio Content Analysis: Applications in Signal Processing and Music Informatics","author":"Lerch Alexander","edition":"1"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766966"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/1661445.1661774"},{"key":"e_1_2_2_30_1","unstructured":"LumBeat. 2013. 60 BPM Metronome. (Feb 2013). https:\/\/www.youtube.com\/watch?v=gsJEMH_emBM  LumBeat. 2013. 60 BPM Metronome. (Feb 2013). https:\/\/www.youtube.com\/watch?v=gsJEMH_emBM"},{"key":"e_1_2_2_31_1","volume-title":"Adrian Holovaty, Waldir Pimenta, and Hojin Lee.","author":"McFee Brian","year":"2017"},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","unstructured":"Brian McFee Colin Raffel Dawen Liang Daniel P. W. Ellis Matt McVicar Eric Battenberg and Oriol Nieto. 2015. librosa: Audio and Music Signal Analysis in Python.  Brian McFee Colin Raffel Dawen Liang Daniel P. W. Ellis Matt McVicar Eric Battenberg and Oriol Nieto. 2015. librosa: Audio and Music Signal Analysis in Python.","DOI":"10.25080\/Majora-7b98e3ed-003"},{"key":"e_1_2_2_33_1","volume-title":"Making Video Dance: A Step-by-step Guide to Creating Dance for the Screen","author":"McPherson K."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2011.19"},{"key":"e_1_2_2_35_1","volume-title":"Demorest","author":"Patel Aniruddh D.","year":"2013"},{"key":"e_1_2_2_36_1","doi-asserted-by":"crossref","unstructured":"Aniruddh D. Patel John R. Iversen Micah R. Bregman and Irena Schulz {n. d.}. Experimental Evidence for Synchronization to a Musical Beat in a Nonhuman Animal. Current Biology 19 10 (2017\/11\/14 {n. d.}) 827--830.  Aniruddh D. Patel John R. Iversen Micah R. Bregman and Irena Schulz {n. d.}. Experimental Evidence for Synchronization to a Musical Beat in a Nonhuman Animal. Current Biology 19 10 (2017\/11\/14 {n. d.}) 827--830.","DOI":"10.1016\/j.cub.2009.03.038"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.262"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.29"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13423-012-0371-2"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.345012"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.4324\/9780203472903"},{"key":"e_1_2_2_42_1","volume-title":"Just Dance Kids 2 I Am A Gummy Bear. (May","year":"2013"},{"key":"e_1_2_2_43_1","volume-title":"Experiencing Music Video: Aesthetics and Cultural Context","author":"Vernallis C."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1142010"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601208"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CISP.2008.721"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/1179622.1179626"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/218380.218422"},{"key":"e_1_2_2_49_1","volume-title":"Best Moments of First Obama\/Romney Debate. (Oct","year":"2012"},{"key":"e_1_2_2_50_1","volume-title":"Turtle dancing at Satisfaction HD. (May","year":"2015"},{"key":"e_1_2_2_51_1","volume-title":"Pyramidal implementation of the Lucas Kanade feature tracker","author":"Bouguet Jean","year":"2000"},{"key":"e_1_2_2_52_1","unstructured":"Zumba with Layryn. 2014. \"Danza Kuduro\" Zumba Routine. (Jun 2014). https:\/\/www.youtube.com\/watch?v=gH20VFWEMdM  Zumba with Layryn. 2014. \"Danza Kuduro\" Zumba Routine. (Jun 2014). https:\/\/www.youtube.com\/watch?v=gH20VFWEMdM"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201371","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3197517.3201371","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T01:39:45Z","timestamp":1750210785000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197517.3201371"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,30]]},"references-count":52,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2018,8,31]]}},"alternative-id":["10.1145\/3197517.3201371"],"URL":"https:\/\/doi.org\/10.1145\/3197517.3201371","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,30]]},"assertion":[{"value":"2018-07-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}