{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T13:35:09Z","timestamp":1792676109140,"version":"4.5.0"},"reference-count":35,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2015,7,27]],"date-time":"2015-07-27T00:00:00Z","timestamp":1437955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2015,7,27]]},"abstract":"<jats:p>We introduce music-driven video montage, a media format that offers a pleasant way to browse or summarize video clips collected from various occasions, including gatherings and adventures. In music-driven video montage, the music drives the composition of the video content. According to musical movement and beats, video clips are organized to form a montage that visually reflects the experiential properties of the music. Nonetheless, it takes enormous manual work and artistic expertise to create it. In this paper, we develop a framework for automatically generating music-driven video montages. The input is a set of video clips and a piece of background music. By analyzing the music and video content, our system extracts carefully designed temporal features from the input, and casts the synthesis problem as an optimization and solves the parameters through Markov Chain Monte Carlo sampling. The output is a video montage whose visual activities are cut and synchronized with the rhythm of the music, rendering a symphony of audio-visual resonance.<\/jats:p>","DOI":"10.1145\/2766966","type":"journal-article","created":{"date-parts":[[2015,7,28]],"date-time":"2015-07-28T12:26:38Z","timestamp":1438086398000},"page":"1-10","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["audeosynth"],"prefix":"10.1145","volume":"34","author":[{"given":"Zicheng","family":"Liao","sequence":"first","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yizhou","family":"Yu","sequence":"additional","affiliation":[{"name":"The University of Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bingchen","family":"Gong","sequence":"additional","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lechao","family":"Cheng","sequence":"additional","affiliation":[{"name":"Zhejiang University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,7,27]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015718"},{"key":"e_1_2_2_2_1","unstructured":"Andrieu C. 2003. An introduction to mcmc for machine learning.  Andrieu C. 2003. An introduction to mcmc for machine learning."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601198"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185562"},{"key":"e_1_2_2_5_1","unstructured":"Beck J. and Burg K. 2012. Cinemagraphs. http:\/\/cinemagraphs.com\/.  Beck J. and Burg K. 2012. Cinemagraphs. http:\/\/cinemagraphs.com\/."},{"key":"e_1_2_2_6_1","doi-asserted-by":"crossref","unstructured":"Bello J. P. Daudet L. Abdallah S. Duxbury C. Davies M. S M. B. and Member S. 2004. A tutorial on onset detection in music signals. In IEEE Transactions in Speech and Audio Processing.  Bello J. P. Daudet L. Abdallah S. Duxbury C. Davies M. S M. B. and Member S. 2004. A tutorial on onset detection in music signals. In IEEE Transactions in Speech and Audio Processing.","DOI":"10.1109\/TSA.2005.851998"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185563"},{"key":"e_1_2_2_8_1","volume-title":"Eurographics Uk Conference, 2002. Proceedings. The 20th, 38--44","author":"Cardle M.","unstructured":"Cardle , M. , Barthe , L. , Brooks , S. , and Robinson , P . 2002. Music-driven motion editing: local motion transformations Guided By Music Analysis . In Eurographics Uk Conference, 2002. Proceedings. The 20th, 38--44 . Cardle, M., Barthe, L., Brooks, S., and Robinson, P. 2002. Music-driven motion editing: local motion transformations Guided By Music Analysis. In Eurographics Uk Conference, 2002. Proceedings. The 20th, 38--44."},{"key":"e_1_2_2_9_1","volume-title":"Semantic segmentation and summarization of music","author":"Chai W.","unstructured":"Chai , W. 2006. Semantic segmentation and summarization of music . In IEEE Signal Processing Magazine , 124--132. Chai, W. 2006. Semantic segmentation and summarization of music. In IEEE Signal Processing Magazine, 124--132."},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180639.1180653"},{"key":"e_1_2_2_11_1","volume-title":"-M","author":"Cheng M.-M.","year":"2014","unstructured":"Cheng , M.-M. , Mitra , N. J. , Huang , X. , Torr , P. H. S. , and Hu , S . -M . 2014 . Global contrast based salient region detection. IEEE TPAMI. Cheng, M.-M., Mitra, N. J., Huang, X., Torr, P. H. S., and Hu, S.-M. 2014. Global contrast based salient region detection. IEEE TPAMI."},{"key":"e_1_2_2_12_1","doi-asserted-by":"crossref","unstructured":"Chib S. and Greenberg E. 1995. Understanding the metropolis-hastings algorithm.  Chib S. and Greenberg E. 1995. Understanding the metropolis-hastings algorithm.","DOI":"10.2307\/2684568"},{"key":"e_1_2_2_13_1","volume-title":"Audio-Vision: Sound on the Screen","author":"Chion M.","unstructured":"Chion , M. 1994. Audio-Vision: Sound on the Screen . New York : Columbia University Press . Chion, M. 1994. Audio-Vision: Sound on the Screen. New York: Columbia University Press."},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073273"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2006.281"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601119"},{"key":"e_1_2_2_17_1","volume-title":"On Film Editing: An Introduction to the Art of Film Construction","author":"Dmytryk E.","unstructured":"Dmytryk , E. 2010. On Film Editing: An Introduction to the Art of Film Construction . London : Focal Press . Dmytryk, E. 2010. On Film Editing: An Introduction to the Art of Film Construction. London: Focal Press."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383322"},{"key":"e_1_2_2_19_1","volume-title":"Dancing in the distraction factory: Music, television and popular culture","author":"Goodwin A.","unstructured":"Goodwin , A. 1992. Dancing in the distraction factory: Music, television and popular culture . Minneapolis : University of Minnesota Press. Goodwin, A. 1992. Dancing in the distraction factory: Music, television and popular culture. Minneapolis: University of Minnesota Press."},{"key":"e_1_2_2_20_1","unstructured":"Huber D. M. 1991. The MIDI Manual. Indiana: SAMS.   Huber D. M. 1991. The MIDI Manual. Indiana: SAMS."},{"key":"e_1_2_2_21_1","doi-asserted-by":"crossref","unstructured":"Irani M. Anandan P. Bergen J. Kumar R. and Hsu S. 1996. Efficient representations of video sequences and their applications. In Signal Processing: Image Communication 327--351.  Irani M. Anandan P. Bergen J. Kumar R. and Hsu S. 1996. Efficient representations of video sequences and their applications. In Signal Processing: Image Communication 327--351.","DOI":"10.1016\/0923-5965(95)00055-0"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2380116.2380149"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778833"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601178"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2005.00860.x"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461950"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073223"},{"key":"e_1_2_2_28_1","volume-title":"Los Angeles: Silman-James Press.","author":"Murch W.","year":"2001","unstructured":"Murch , W. 2001 . In the blink of an eye. Los Angeles: Silman-James Press. Murch, W. 2001. In the blink of an eye. Los Angeles: Silman-James Press."},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.29"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.345012"},{"key":"e_1_2_2_31_1","unstructured":"Shiratori T. Nakazawa A. and Ikeuchi K. 2005. Dancing-to-music character animation. 353--362.  Shiratori T. Nakazawa A. and Ikeuchi K. 2005. Dancing-to-music character animation. 353--362."},{"key":"e_1_2_2_32_1","unstructured":"Swift A. 2014. An introduction to midi. http:\/\/www.doc.ic.ac.uk\/~nd\/surprise_97\/journal\/vol1\/aps2\/.  Swift A. 2014. An introduction to midi. http:\/\/www.doc.ic.ac.uk\/~nd\/surprise_97\/journal\/vol1\/aps2\/."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601208"},{"key":"e_1_2_2_34_1","volume-title":"Experiencing music video: Aesthetics and cultural context","author":"Wesseling C.","unstructured":"Wesseling , C. 2004. Experiencing music video: Aesthetics and cultural context . New York : Columbia University Press . Wesseling, C. 2004. Experiencing music video: Aesthetics and cultural context. New York: Columbia University Press."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024156.2024184"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766966","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2766966","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T05:43:01Z","timestamp":1750225381000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2766966"}},"subtitle":["music-driven video montage"],"short-title":[],"issued":{"date-parts":[[2015,7,27]]},"references-count":35,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2015,7,27]]}},"alternative-id":["10.1145\/2766966"],"URL":"https:\/\/doi.org\/10.1145\/2766966","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,7,27]]},"assertion":[{"value":"2015-07-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}