{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:30:28Z","timestamp":1760232628204,"version":"build-2065373602"},"reference-count":31,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2022,11,22]],"date-time":"2022-11-22T00:00:00Z","timestamp":1669075200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61876104","2018A030307034"],"award-info":[{"award-number":["61876104","2018A030307034"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003453","name":"Guangdong Natural Science Foundation","doi-asserted-by":"publisher","award":["61876104","2018A030307034"],"award-info":[{"award-number":["61876104","2018A030307034"]}],"id":[{"id":"10.13039\/501100003453","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Nowadays, with the increased numbers of video cameras, the amount of recorded video is growing. Efficient video browsing and retrieval are critical issues when considering the amount of raw video data to be condensed. Activity-based video synopsis is a popular approach to solving the video condensation problem. However, conventional synopsis methods always consists of complicated and pairwise energy terms that involve a time-consuming optimization problem. In this paper, we propose a simple online video synopsis framework in which the number of collisions of objects is classified first. Different optimization strategies are applied according to different collision situations to maintain a balance among the computational cost, condensation ratio, and collision cost. Secondly, tube-resizing coefficients that are dynamic in different frames are adaptively assigned to a newly generated tube. Therefore, a suitable mapping result can be obtained in order to represent the proper size of the activity in each frame of the synopsis video. The maximum number of activities can be displayed in one frame with minimal collisions. Finally, in order to remove motion anti-facts and improve the visual quality of the condensed video, a smooth term is introduced to constrain the resizing coefficients. Experimental results on extensive videos validate the efficiency of the proposed method.<\/jats:p>","DOI":"10.3390\/s22239046","type":"journal-article","created":{"date-parts":[[2022,11,22]],"date-time":"2022-11-22T08:29:58Z","timestamp":1669105798000},"page":"9046","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Real-Time Video Synopsis via Dynamic and Adaptive Online Tube Resizing"],"prefix":"10.3390","volume":"22","author":[{"given":"Xiaoxin","family":"Liao","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering, Shantou University, Shantou 515063, China"},{"name":"Key Lab of Digital Signal and Image Processing of Guangdong Province, Shantou 515063, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Song","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Shantou University, Shantou 515063, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7557-9526","authenticated-orcid":false,"given":"Zemin","family":"Cai","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Shantou University, Shantou 515063, China"},{"name":"Key Lab of Digital Signal and Image Processing of Guangdong Province, Shantou 515063, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wray, M., Doughty, H., and Damen, D. (2021, January 20\u201325). On Semantic Similarity in Video Retrieval. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00365"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhang, C., Gupta, A., and Zisserman, A. (2021, January 20\u201325). Temporal Query Networks for Fine-grained Video Understanding. Proceedings of the 2021 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00446"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2572","DOI":"10.1109\/TIP.2009.2026677","article-title":"Video condensation by ribbon carving","volume":"18","author":"Li","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3798","DOI":"10.1109\/TIP.2018.2823420","article-title":"Video synopsis in complex situations","volume":"27","author":"Li","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_5","unstructured":"Feng, S., Lei, Z., Yi, D., and Li, S.Z. (2012, January 16\u201321). Online content-aware video condensation. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_6","unstructured":"Smith, M., and Kanade, T. (1998, January 3). Video skimming and characterization through the combination of image and language understanding. Proceedings of the 1998 IEEE International Workshop on Content-Based Access of Image and Video Database, Bombay, India."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1198302.1198305","article-title":"Video abstraction: A systematic review and classification","volume":"3","author":"Truong","year":"2007","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl."},{"key":"ref_8","unstructured":"Kang, H.W., Chen, X.Q., Matsushita, Y., and Tang, X. (2006, January 17\u201322). Space-Time Video Montage. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Chakraborty, S., Tickoo, O., and Iyer, R. (2015, January 26\u201330). Towards Distributed Video Summarization. Proceedings of the 23rd ACM International Conference on Multimedia, Brisbane Australia.","DOI":"10.1145\/2733373.2806355"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1007\/s11042-005-0895-9","article-title":"Adaptive video fast forward","volume":"26","author":"Petrovic","year":"2005","journal-title":"Multimed. Tools Appl."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, H., Meng, W., and Liu, Z. (2012, January 29\u201331). Key frame extraction of online video based on optimized frame difference. Proceedings of the 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery, Chongqing, China.","DOI":"10.1109\/FSKD.2012.6233777"},{"key":"ref_12","unstructured":"Rav-Acha, A., Pritch, Y., and Peleg, S. (2006, January 17\u201322). Making a Long Video Short: Dynamic Video Synopsis. Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906), New York, NY, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Pritch, Y., Rav-Acha, A., Gutman, A., and Peleg, S. (2007, January 14\u201321). Webcam Synopsis: Peeking Around the World. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4408934"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1971","DOI":"10.1109\/TPAMI.2008.29","article-title":"Nonchronological Video Synopsis and Indexing","volume":"30","author":"Pritch","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1709","DOI":"10.1109\/TIP.2010.2101613","article-title":"ViBe: A universal background subtraction algorithm for video sequences","volume":"20","author":"Barnich","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Avidan, S., Brostow, G., Ciss\u00e9, M., Farinella, G.M., and Hassner, T. (2022, January 23\u201327). PolyphonicFormer: Unified Query Learning for Depth-Aware Video Panoptic Segmentation. Proceedings of the Computer Vision\u2014ECCV, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19821-2"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ventura, C., Bellver, M., Girbau, A., Salvador, A., Marques, F., and Giro-i Nieto, X. (2019, January 15\u201320). RVOS: End-To-End Recurrent Network for Video Object Segmentation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00542"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Guo, C., Fan, B., Gu, J., Zhang, Q., Xiang, S., Prinet, V., and Pan, C. (2019, January 15\u201320). Progressive Sparse Local Attention for Video Object Detection. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Long Beach, CA, USA.","DOI":"10.1109\/ICCV.2019.00401"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wang, Q., Zhang, L., Bertinetto, L., Hu, W., and Torr, P.H. (2019, January 15\u201320). Fast online object tracking and segmentation: A unifying approach. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00142"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1007\/s11760-020-01794-1","article-title":"Object-based video synopsis approach using particle swarm optimization","volume":"15","author":"Moussa","year":"2021","journal-title":"Signal Image Video Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.1109\/LSP.2018.2848842","article-title":"Parallelized tube rearrangement algorithm for online video synopsis","volume":"25","author":"Ra","year":"2018","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2408","DOI":"10.1109\/TITS.2016.2518622","article-title":"Order-preserving condensation of moving objects in surveillance videos","volume":"17","author":"Nguyen","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1417","DOI":"10.1109\/TCSVT.2014.2308603","article-title":"Maximum a posteriori probability estimation for online surveillance video synopsis","volume":"24","author":"Huang","year":"2014","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3873","DOI":"10.1109\/TIP.2019.2903322","article-title":"Rearranging online tubes for streaming video synopsis: A dynamic graph coloring approach","volume":"28","author":"Ruan","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Xu, M., Li, S.Z., Li, B., Yuan, X.T., and Xiang, S.M. (2008, January 30\u201321). A set theoretical method for video synopsis. Proceedings of the 1st ACM International Conference on Multimedia Information Retrieval, Vancouver, BC, Canada.","DOI":"10.1145\/1460096.1460156"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Angadi, S., and Naik, V. (2014, January 8\u201310). Entropy based fuzzy C means clustering and key frame extraction for sports video summarization. Proceedings of the 2014 Fifth International Conference on Signal and Image Processing, Bangalore, India.","DOI":"10.1109\/ICSIP.2014.49"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1016\/j.patcog.2014.08.002","article-title":"Video summarization via minimum sparse reconstruction","volume":"48","author":"Mei","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1109\/TIP.2015.2507942","article-title":"Surveillance Video Synopsis via Scaling Down Objects","volume":"25","author":"Li","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1109\/TPAMI.2004.1262177","article-title":"What energy functions can be minimized via graph cuts?","volume":"26","author":"Kolmogorov","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1126\/science.220.4598.671","article-title":"Optimization by simulated annealing","volume":"220","author":"Kirkpatrick","year":"1983","journal-title":"Science"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1465","DOI":"10.1109\/TIP.2019.2942543","article-title":"Collision-free video synopsis incorporating object speed and size changes","volume":"29","author":"Nie","year":"2019","journal-title":"IEEE Trans. Image Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9046\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:24:08Z","timestamp":1760145848000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/23\/9046"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,22]]},"references-count":31,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["s22239046"],"URL":"https:\/\/doi.org\/10.3390\/s22239046","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,11,22]]}}}