{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T11:16:35Z","timestamp":1772795795300,"version":"3.50.1"},"reference-count":25,"publisher":"Tsinghua University Press","issue":"3","license":[{"start":{"date-parts":[[2018,8,6]],"date-time":"2018-08-06T00:00:00Z","timestamp":1533513600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2018,8,6]],"date-time":"2018-08-06T00:00:00Z","timestamp":1533513600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Comp. Visual Media"],"published-print":{"date-parts":[[2018,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>In this paper we introduce a video post-processing method that enhances the rhythm of a dancing performance, in the sense that the dancing movements are more in time to the beat of the music. The dancing performance as observed in a video is analyzed and segmented into motion intervals delimited by motion beats. We present an image-space method to extract the motion beats of a video by detecting frames at which there is a significant change in direction or motion stops. The motion beats are then synchronized with the music beats such that as many beats as possible are matched with as little as possible time-warping distortion to the video. We show two applications for this cross-media synchronization: one where a given dance performance is enhanced to be better synchronized with its original music, and one where a given dance video is automatically adapted to be synchronized with different music.<\/jats:p>","DOI":"10.1007\/s41095-018-0115-y","type":"journal-article","created":{"date-parts":[[2018,8,6]],"date-time":"2018-08-06T10:15:51Z","timestamp":1533550551000},"page":"197-208","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Dance to the beat: Synchronizing motion to audio"],"prefix":"10.26599","volume":"4","author":[{"given":"Rachele","family":"Bellini","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanir","family":"Kleiman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Cohen-Or","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"11138","published-online":{"date-parts":[[2018,8,6]]},"reference":[{"key":"115_CR1","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1093\/acprof:oso\/9780199298723.003.0004","volume-title":"Music, Motor Control and the Brain","author":"B. H. Repp","year":"2006","unstructured":"Repp, B. H. Musical synchronization. In: Music, Motor Control and the Brain. Altenmuller, E.; Wiesendanger, M.; Keselring, J. Eds. Oxford University Press, 55\u201376, 2006."},{"issue":"3","key":"115_CR2","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1145\/882262.882283","volume":"22","author":"T.-h Kim","year":"2003","unstructured":"Kim, T.-h.; Park, S. I.; Shin, S. Y. Rhythmicmotion synthesis based on motion-beat analysis. ACM Transactions on Graphics Vol. 22, No. 3, 392\u2013401, 2003.","journal-title":"ACM Transactions on Graphics"},{"issue":"3","key":"115_CR3","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1111\/j.1467-8659.2006.00964.x","volume":"25","author":"T. Shiratori","year":"2006","unstructured":"Shiratori, T.; Nakazawa, A.; Ikeuchi, K. Dancing-tomusic character animation. Computer Graphics Forum Vol. 25, No. 3, 449\u2013458, 2006.","journal-title":"Computer Graphics Forum"},{"issue":"1","key":"115_CR4","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1109\/TMM.2011.2172401","volume":"14","author":"W.-T. Chu","year":"2012","unstructured":"Chu, W.-T.; Tsai, S.-Y. Rhythm of motion extraction and rhythm-based cross-media alignment for dance videos. IEEE Transactions on Multimedia Vol. 14, No. 1, 129\u2013141, 2012.","journal-title":"IEEE Transactions on Multimedia"},{"issue":"7","key":"115_CR5","doi-asserted-by":"publisher","first-page":"1688","DOI":"10.1523\/JNEUROSCI.05-07-01688.1985","volume":"5","author":"T. Flash","year":"1985","unstructured":"Flash, T.; Hogan, N. The coordination of arm movements: An experimentally confirmed mathematical model. Journal of Neuroscience Vol. 5, No. 7, 1688\u20131703, 1985.","journal-title":"Journal of Neuroscience"},{"issue":"3","key":"115_CR6","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1037\/0033-295X.96.3.459","volume":"96","author":"M. R. Jones","year":"1989","unstructured":"Jones, M. R.; Boltz, M. Dynamic attending and responses to time. Psychological Review Vol. 96, No. 3, 459\u2013491, 1989.","journal-title":"Psychological Review"},{"key":"115_CR7","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1145\/1179849.1180060","volume-title":"Proceedings of the ACM SIGGRAPH 2006 Sketches, Article","author":"T. Leyvand","year":"2006","unstructured":"Leyvand, T.; Cohen-Or, D.; Dror, G.; Lischinski, D. Digital face beautification. In: Proceedings of the ACM SIGGRAPH 2006 Sketches, Article No. 169, 2006."},{"issue":"4","key":"115_CR8","volume":"29","year":"2010","unstructured":"Zhou, S.; Fu, H.; Liu, L.; Cohen-Or, D.; Han, X. Parametric reshaping of human bodies in images. ACM Transactions on Graphics Vol. 29, No. 4, Article No. 126, 2010.","journal-title":"ACM Transactions on Graphics"},{"key":"115_CR9","first-page":"2286","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"F. Zhou","year":"2009","unstructured":"Zhou, F.; Torre, F. Canonical time warping for alignment of human behavior. In: Proceedings of the Advances in Neural Information Processing Systems, 2286\u20132294, 2009."},{"key":"115_CR10","first-page":"1282","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"F. Zhou","year":"2012","unstructured":"Zhou, F.; De la Torre, F. Generalized time warping for multi-modal alignment of human motion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1282\u20131289, 2012."},{"key":"115_CR11","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1007\/978-0-387-89024-1_17","volume-title":"Handbook of Multimedia for Digital Entertainment and Arts.","author":"J.-C. Yoon","year":"2009","unstructured":"Yoon, J.-C.; Lee, I.-K.; Byun, S. Automated music video generation using multi-level feature-based segmentation. In: Handbook of Multimedia for Digital Entertainment and Arts. Furht, B. Ed. Springer, 385\u2013401, 2009."},{"key":"115_CR12","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/11821045_22","volume":"4153","author":"J.-C. Yoon","year":"2006","unstructured":"Yoon, J.-C.; Lee, I.-K.; Lee, H.-C. Feature-based synchronization of video and background music. In: Advances in Machine Vision, Image Processing, and Pattern Analysis. Lecture Notes in Computer Science, Vol. 4153. Zheng, N.; Jiang, X.; Lan, X. Eds. Springer Berlin Heidelberg, 205\u2013214, 2006.","journal-title":"Advances in Machine Vision, Image Processing, and Pattern Analysis. Lecture Notes in Computer Science"},{"key":"115_CR13","first-page":"1","volume-title":"Proceedings of the ACM SIGGRAPH 2003 Sketches & Applications","author":"T. Jehan","year":"2003","unstructured":"Jehan, T.; Lew, M.; Vaucelle, C. Cati dance: Self-edited, self-synchronized music video. In: Proceedings of the ACM SIGGRAPH 2003 Sketches & Applications, 1\u20131, 2003."},{"issue":"4","key":"115_CR14","volume":"36","year":"2017","unstructured":"Suwajanakorn, S.; Seitz, S. M.; Kemelmacher-Shlizerman, I. Synthesizing Obama: Learning lip sync from audio. ACM Transactions on Graphics Vol. 36, No. 4, Article No. 95, 2017.","journal-title":"ACM Transactions on Graphics"},{"issue":"11","key":"115_CR15","doi-asserted-by":"publisher","first-page":"1409","DOI":"10.1109\/TPAMI.2002.1046148","volume":"24","author":"Y. Caspi","year":"2002","unstructured":"Caspi, Y.; Irani, M. Spatio-temporal alignment of sequences. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 24, No. 11, 1409\u20131424, 2002.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"115_CR16","first-page":"784","volume-title":"Proceedings of the 13th International Conference on Neural Information Processing Systems","author":"M. Slaney","year":"2000","unstructured":"Slaney, M.; Covell, M. FaceSync: A linear operator for measuring synchronization of video facial images and audio tracks. In: Proceedings of the 13th International Conference on Neural Information Processing Systems, 784\u2013790, 2000."},{"issue":"4","key":"115_CR17","volume":"33","year":"2014","unstructured":"Wang, O.; Schroers, C.; Zimmer, H.; Gross, M.; Sorkine-Hornung, A. VideoSnapping: Interactive synchronization of multiple videos. ACM Transactions on Graphics Vol. 33, No. 4, Article No. 77, 2014.","journal-title":"ACM Transactions on Graphics"},{"issue":"7","key":"115_CR18","doi-asserted-by":"publisher","first-page":"1218","DOI":"10.1109\/TVCG.2012.145","volume":"19","author":"S.-P. Lu","year":"2013","unstructured":"Lu, S.-P.; Zhang, S.-H.; Wei, J.; Hu, S.-M.; Martin, R. R. Timeline editing of objects in video. IEEE Transactions on Visualization and Computer Graphics Vol. 19, No. 7, 1218\u20131227, 2013.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"115_CR19","first-page":"857","volume-title":"Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition","author":"T. Shiratori","year":"2004","unstructured":"Shiratori, T.; Nakazawa, A.; Ikeuchi, K. Detecting dance motion structure through music analysis. In: Proceedings of the 6th IEEE International Conference on Automatic Face and Gesture Recognition, 857\u2013862, 2004."},{"key":"115_CR20","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1145\/1101826.1101857","volume-title":"Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval","author":"H. Denman","year":"2005","unstructured":"Denman, H.; Doyle, E.; Kokaram, A.; Lennon, D.; Dahyot, R.; Fuller, R. Exploiting temporal discontinuities for event detection and manipulation in video streams. In: Proceedings of the 7th ACM SIGMM International Workshop on Multimedia Information Retrieval, 183\u2013192, 2005."},{"issue":"1","key":"115_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/09298210701653252","volume":"36","author":"M. F. McKinney","year":"2007","unstructured":"McKinney, M. F.; Moelants, D.; Davies, M. E. P.; Klapuri, A. Evaluation of audio beat tracking and music tempo extraction algorithms. Journal of New Music Research Vol. 36, No. 1, 1\u201316, 2007.","journal-title":"Journal of New Music Research"},{"issue":"1","key":"115_CR22","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1080\/09298210701653344","volume":"36","author":"D. P. W. Ellis","year":"2007","unstructured":"Ellis, D. P. W. Beat tracking by dynamic programming. Journal of New Music Research Vol. 36, No. 1, 51\u201360, 2007.","journal-title":"Journal of New Music Research"},{"issue":"10","key":"115_CR23","doi-asserted-by":"publisher","first-page":"827","DOI":"10.1016\/j.cub.2009.03.038","volume":"19","author":"A. D. Patel","year":"2009","unstructured":"Patel, A. D.; Iversen, J. R.; Bregman, M. R.; Schulz, I. Experimental evidence for synchronization to a musical beat in a nonhuman animal. Current Biology Vol. 19, No. 10, 827\u2013830, 2009.","journal-title":"Current Biology"},{"issue":"1","key":"115_CR24","doi-asserted-by":"publisher","first-page":"459","DOI":"10.1111\/j.1749-6632.2009.04581.x","volume":"1169","author":"A. D. Patel","year":"2009","unstructured":"Patel, A. D.; Iversen, J. R.; Bregman, M. R.; Schulz, I. Studying synchronization to a musical beat in nonhuman animals. Annals of the New York Academy of Sciences Vol. 1169, No. 1, 459\u2013469, 2009.","journal-title":"Annals of the New York Academy of Sciences"},{"key":"115_CR25","first-page":"100","volume-title":"Proceedings of the 10th International Conference on Music Perception and Cognition","author":"A. D. Patel","year":"2008","unstructured":"Patel, A. D.; Iversen, J. R.; Bregman, M. R.; Schulz, I.; Schulz, C. Investigating the human-specificity of synchronization to music. In: Proceedings of the 10th International Conference on Music Perception and Cognition, 100\u2013104, 2008."}],"container-title":["Computational Visual Media"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41095-018-0115-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s41095-018-0115-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s41095-018-0115-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,3]],"date-time":"2024-12-03T00:49:49Z","timestamp":1733186989000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s41095-018-0115-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,6]]},"references-count":25,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,9]]}},"alternative-id":["115"],"URL":"https:\/\/doi.org\/10.1007\/s41095-018-0115-y","relation":{},"ISSN":["2096-0433","2096-0662"],"issn-type":[{"value":"2096-0433","type":"print"},{"value":"2096-0662","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,8,6]]},"assertion":[{"value":"3 February 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 March 2018","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 August 2018","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}