{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T17:10:38Z","timestamp":1776964238131,"version":"3.51.4"},"reference-count":49,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2015,1,7]],"date-time":"2015-01-07T00:00:00Z","timestamp":1420588800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Singapore National Research Foundation under its International Research Centre @ Singapore Funding Initiative"},{"name":"IDM Programme Office through the Centre of Social Media Innovations for Communities"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2015,1,7]]},"abstract":"<jats:p>In recent years, with the rapid development of camera technology and portable devices, we have witnessed a flourish of user generated videos, which are gradually reshaping the traditional professional video oriented media market. The volume of user generated videos in repositories is increasing at a rapid rate. In today's video retrieval systems, a simple query will return many videos which seriously increase the viewing burden. To manage these video retrievals and provide viewers with an efficient way to browse, we introduce a system to automatically generate a summarization from multiple user generated videos and present their salience to viewers in an enjoyable manner. Among multiple consumer videos, we find their qualities to be highly diverse due to various factors such as a photographer's experience or environmental conditions at the time of capture. Such quality inspires us to include a video quality evaluation component into the video summarization since videos with poor qualities can seriously degrade the viewing experience. We first propose a probabilistic model to evaluate the aesthetic quality of each user generated video. This model compares the rich aesthetics information from several well-known photo databases with generic unlabeled consumer videos, under a human perception component indicating the correlation between a video and its constituting frames. Subjective studies were carried out with the results indicating that our method is reliable. Then a novel graph-based formulation is proposed for the multi-video summarization task. Desirable summarization criteria is incorporated as the graph attributes and the problem is solved through a dynamic programming framework. Comparisons with several state-of-the-art methods demonstrate that our algorithm performs better than other methods in generating a skimming video in preserving the essential scenes from the original multiple input videos, with smooth transitions among consecutive segments and appealing aesthetics overall.<\/jats:p>","DOI":"10.1145\/2659520","type":"journal-article","created":{"date-parts":[[2015,1,12]],"date-time":"2015-01-12T20:02:10Z","timestamp":1421092930000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Aesthetics-Guided Summarization from Multiple User Generated Videos"],"prefix":"10.1145","volume":"11","author":[{"given":"Ying","family":"Zhang","sequence":"first","affiliation":[{"name":"National University of Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luming","family":"Zhang","sequence":"additional","affiliation":[{"name":"National University of Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roger","family":"Zimmermann","sequence":"additional","affiliation":[{"name":"National University of Singapore, Singapore"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,1,7]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1873951.1873990"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2011.2148490"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2011.2166951"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.177"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/11744078_23"},{"key":"e_1_2_1_6_1","volume-title":"Proceedings of the IEEE International Conference on Image Processing.","author":"Datta Ritendra","unstructured":"Ritendra Datta , Jia Li , and James Z. Wang . 2008. Algorithmic inferencing of aesthetics and emotion in natural images: An exposition . In Proceedings of the IEEE International Conference on Image Processing. Ritendra Datta, Jia Li, and James Z. Wang. 2008. Algorithmic inferencing of aesthetics and emotion in natural images: An exposition. In Proceedings of the IEEE International Conference on Image Processing."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995467"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2003.812758"},{"key":"e_1_2_1_9_1","unstructured":"GeoVid 2013. GeoVid -- Georeferenced Video Portal. http:\/\/geovid.org\/. (2013). GeoVid 2013. GeoVid -- Georeferenced Video Portal. http:\/\/geovid.org\/. (2013)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2071926"},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Jonathan Harel Christof Koch and Pietro Perona. 2007. Graph-based visual saliency. In Advances in Neural Information Processing Systems. Jonathan Harel Christof Koch and Pietro Perona. 2007. Graph-based visual saliency. In Advances in Neural Information Processing Systems.","DOI":"10.7551\/mitpress\/7503.003.0073"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/319463.319691"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/973264.973270"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.348"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1002\/ima.10067"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1247480.1247546"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1126004.1126005"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the International Workshop on Content-Based Multimedia Indexing.","author":"Li Yingbo","unstructured":"Yingbo Li and B. Merialdo . 2010a. Multi-video summarization based on AV-MMR . In Proceedings of the International Workshop on Content-Based Multimedia Indexing. Yingbo Li and B. Merialdo. 2010a. Multi-video summarization based on AV-MMR. In Proceedings of the International Workshop on Content-Based Multimedia Indexing."},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the International Workshop on Image Analysis for Multimedia Interactive Services.","author":"Li Yingbo","unstructured":"Yingbo Li and B. Merialdo . 2010b. Multi-video summarization based on Video-MMR . In Proceedings of the International Workshop on Image Analysis for Multimedia Interactive Services. Yingbo Li and B. Merialdo. 2010b. Multi-video summarization based on Video-MMR. In Proceedings of the International Workshop on Image Analysis for Multimedia Interactive Services."},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the International Workshop on Content-Based Multimedia Indexing.","author":"Li Yingbo","unstructured":"Yingbo Li and B. Merialdo . 2011. Multi-video summarization based on OB-MMR . In Proceedings of the International Workshop on Content-Based Multimedia Indexing. Yingbo Li and B. Merialdo. 2011. Multi-video summarization based on OB-MMR. In Proceedings of the International Workshop on Content-Based Multimedia Indexing."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88690-7_29"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126444"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2007.04.002"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/1888150.1888152"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2005.1405707"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2393373"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.2298\/CSIS1001085S"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1142020.1142023"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5555\/1153922.1154356"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2071977"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1631272.1631351"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1198302.1198305"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/1698924.1699251"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2009.5459207"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2502081.2508121"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.24.000B61"},{"key":"e_1_2_1_37_1","volume-title":"Bovik","author":"Wang Zhou","year":"2003","unstructured":"Zhou Wang , Hamid R. Sheikh , and Alan C . Bovik . 2003 . Objective video quality assessment. In The Handbook of Video Databases: Design and Applications , 1041--1078. Zhou Wang, Hamid R. Sheikh, and Alan C. Bovik. 2003. Objective video quality assessment. In The Handbook of Video Databases: Design and Applications, 1041--1078."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2506364.2506370"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2008.917346"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1180639.1180699"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.130"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2011.5946616"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2457450.2457456"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2014.2303650"},{"key":"e_1_2_1_45_1","first-page":"5","article-title":"Actively learning human gaze shifting paths for photo cropping","volume":"23","author":"Zhang Luming","year":"2013","unstructured":"Luming Zhang , Yue Gao , Rongrong Ji , Qionghai Dai , and Xuelong Li . 2013 c. Actively learning human gaze shifting paths for photo cropping . IEEE Trans. Image Process. 23 , 5 . Luming Zhang, Yue Gao, Rongrong Ji, Qionghai Dai, and Xuelong Li. 2013c. Actively learning human gaze shifting paths for photo cropping. IEEE Trans. Image Process. 23, 5.","journal-title":"IEEE Trans. Image Process."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2012.2223226"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-35725-1_35"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2155555.2155565"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2396461"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2659520","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2659520","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:19:21Z","timestamp":1750231161000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2659520"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,1,7]]},"references-count":49,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2015,1,7]]}},"alternative-id":["10.1145\/2659520"],"URL":"https:\/\/doi.org\/10.1145\/2659520","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,1,7]]},"assertion":[{"value":"2014-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-01-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}