{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,18]],"date-time":"2026-04-18T06:00:33Z","timestamp":1776492033388,"version":"3.51.2"},"publisher-location":"New York, NY, USA","reference-count":47,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,12]],"date-time":"2020-10-12T00:00:00Z","timestamp":1602460800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"EPSRC","award":["EP\/R026424\/1"],"award-info":[{"award-number":["EP\/R026424\/1"]}]},{"DOI":"10.13039\/501100007601","name":"Horizon 2020","doi-asserted-by":"publisher","award":["H2020-780656 ReTV"],"award-info":[{"award-number":["H2020-780656 ReTV"]}],"id":[{"id":"10.13039\/501100007601","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,12]]},"DOI":"10.1145\/3394171.3413632","type":"proceedings-article","created":{"date-parts":[[2020,10,12]],"date-time":"2020-10-12T13:10:18Z","timestamp":1602508218000},"page":"1056-1064","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["Performance over Random"],"prefix":"10.1145","author":[{"given":"Evlampios","family":"Apostolidis","sequence":"first","affiliation":[{"name":"Information Technologies Institute, Centre for Research and Technology Hellas &amp; Queen Mary University of London, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eleni","family":"Adamantidou","sequence":"additional","affiliation":[{"name":"Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandros I.","family":"Metsai","sequence":"additional","affiliation":[{"name":"Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vasileios","family":"Mezaris","sequence":"additional","affiliation":[{"name":"Information Technologies Institute, Centre for Research and Technology Hellas, Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ioannis","family":"Patras","sequence":"additional","affiliation":[{"name":"Queen Mary University of London, London, United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,10,12]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2011.08.007"},{"key":"e_1_3_2_2_2_1","volume-title":"Proc. of the Multi Media Modeling","author":"Apostolidis Evlampios","year":"2020","unstructured":"Evlampios Apostolidis , Eleni Adamantidou , Alexandros I. Metsai , Vasileios Mezaris , and Ioannis Patras . 2020. Unsupervised Video Summarization via Attention-Driven Adversarial Learning . In Proc. of the Multi Media Modeling 2020 , Yong Man Ro, Wen- Huang Cheng , Junmo Kim, Wei-Ta Chu, Peng Cui, Jung Woo Choi, Min-Chun Hu, and Wesley De Neve (Eds.). Springer International Publishing , Cham, 492--504. Evlampios Apostolidis, Eleni Adamantidou, Alexandros I. Metsai, Vasileios Mezaris, and Ioannis Patras. 2020. Unsupervised Video Summarization via Attention-Driven Adversarial Learning. In Proc. of the Multi Media Modeling 2020, Yong Man Ro, Wen-Huang Cheng, Junmo Kim, Wei-Ta Chu, Peng Cui, Jung Woo Choi, Min-Chun Hu, and Wesley De Neve (Eds.). Springer International Publishing, Cham, 492--504."},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3347449.3357482"},{"key":"e_1_3_2_2_4_1","volume-title":"Proc. of the 2013 XXVI Conf. on Graphics, Patterns and Images. 226--233","author":"Edward J. Y.","unstructured":"Edward J. Y. C. Cahuina and Guillermo C. Chavez. 2013. A New Method for Static Video Summarization Using Local Descriptors and Video Temporal Segmentation . In Proc. of the 2013 XXVI Conf. on Graphics, Patterns and Images. 226--233 . Edward J. Y. C. Cahuina and Guillermo C. Chavez. 2013. A New Method for Static Video Summarization Using Local Descriptors and Video Temporal Segmentation. In Proc. of the 2013 XXVI Conf. on Graphics, Patterns and Images. 226--233."},{"key":"e_1_3_2_2_5_1","volume-title":"Proc. of the Artificial Neural Networks - ICANN","author":"Chasanis Vasileios","year":"2008","unstructured":"Vasileios Chasanis , Aristidis Likas , and Nikolaos Galatsanos . 2008. Efficient Video Shot Summarization Using an Enhanced Spectral Clustering Approach . In Proc. of the Artificial Neural Networks - ICANN 2008 , V\u00e9ra K\u016frkov\u00e1, Roman Neruda , and Jan Koutn\u00edk (Eds.). Springer Berlin Heidelberg , Berlin, Heidelberg, 847--856. Vasileios Chasanis, Aristidis Likas, and Nikolaos Galatsanos. 2008. Efficient Video Shot Summarization Using an Enhanced Spectral Clustering Approach. In Proc. of the Artificial Neural Networks - ICANN 2008, V\u00e9ra K\u016frkov\u00e1, Roman Neruda, and Jan Koutn\u00edk (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 847--856."},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338533.3366583"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMSP.2019.8901741"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/SIBGRAPI.2008.31"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2010.08.004"},{"key":"e_1_3_2_2_10_1","volume-title":"Proc. of the 2015 IEEE Int. Conf. on Computer Vision Workshop (ICCVW). 1071--1077","author":"Demir Mahmut","unstructured":"Mahmut Demir and H. Isil Bozma . 2015. Video Summarization via Segments Summary Graphs . In Proc. of the 2015 IEEE Int. Conf. on Computer Vision Workshop (ICCVW). 1071--1077 . Mahmut Demir and H. Isil Bozma. 2015. Video Summarization via Segments Summary Graphs. In Proc. of the 2015 IEEE Int. Conf. on Computer Vision Workshop (ICCVW). 1071--1077."},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2013.10.005"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2012.06.013"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2019.00085"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-21074-8_4"},{"key":"e_1_3_2_2_15_1","volume-title":"Advances in Neural Information Processing Systems 27","author":"Gong Boqing","year":"2069","unstructured":"Boqing Gong , Wei-Lun Chao , Kristen Grauman , and Fei Sha . 2014. Diverse Sequential Subset Selection for Supervised Video Summarization . In Advances in Neural Information Processing Systems 27 , Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger (Eds.). Curran Associates, Inc. , 2069 --2077. Boqing Gong, Wei-Lun Chao, Kristen Grauman, and Fei Sha. 2014. Diverse Sequential Subset Selection for Supervised Video Summarization. In Advances in Neural Information Processing Systems 27, Z. Ghahramani, M. Welling, C. Cortes, N. D. Lawrence, and K. Q. Weinberger (Eds.). Curran Associates, Inc., 2069--2077."},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632267"},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10584-0_33"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298928"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3351056"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/76.809161"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10844-016-0441-4"},{"key":"e_1_3_2_2_22_1","volume-title":"Video Summarization with Attention-Based Encoder-Decoder Networks","author":"Ji Zhong","year":"2019","unstructured":"Zhong Ji , Kailin Xiong , Yanwei Pang , and Xuelong Li. 2019. Video Summarization with Attention-Based Encoder-Decoder Networks . IEEE Transactions on Circuits and Systems for Video Technology ( 2019 ), 1--1. Zhong Ji, Kailin Xiong, Yanwei Pang, and Xuelong Li. 2019. Video Summarization with Attention-Based Encoder-Decoder Networks. IEEE Transactions on Circuits and Systems for Video Technology (2019), 1--1."},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33018537"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/33.3.239"},{"key":"e_1_3_2_2_25_1","volume-title":"CRC Standard Probability and Statistics Tables and Formulae","author":"Kokoska Stephen","unstructured":"Stephen Kokoska and Daniel Zwillinger . 2000. CRC Standard Probability and Statistics Tables and Formulae . Crc Press . Stephen Kokoska and Daniel Zwillinger. 2000. CRC Standard Probability and Statistics Tables and Formulae. Crc Press."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/WACV.2019.00056"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2695887"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2004.05.020"},{"key":"e_1_3_2_2_29_1","volume-title":"Proc. of the 2019 IEEE Int. Conf. on Image Processing (ICIP). 3377--3381","author":"Liu Yen-Ting","unstructured":"Yen-Ting Liu , Yu-Jhe Li , Fu-En Yang , Shang-Fu Chen , and Yu-Chiang F. Wang . 2019. Learning Hierarchical Self-Attention for Video Summarization . In Proc. of the 2019 IEEE Int. Conf. on Image Processing (ICIP). 3377--3381 . Yen-Ting Liu, Yu-Jhe Li, Fu-En Yang, Shang-Fu Chen, and Yu-Chiang F. Wang. 2019. Learning Hierarchical Self-Attention for Video Summarization. In Proc. of the 2019 IEEE Int. Conf. on Image Processing (ICIP). 3377--3381."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.318"},{"key":"e_1_3_2_2_31_1","first-page":"303","article-title":"Unsupervised Video Summarization via Dynamic Modeling-Based Hierarchical Clustering. In Proc. of the 12th","volume":"2","author":"Mahmoud Karim M.","year":"2013","unstructured":"Karim M. Mahmoud , Nagia M. Ghanem , and Mohamed A. Ismail . 2013 Unsupervised Video Summarization via Dynamic Modeling-Based Hierarchical Clustering. In Proc. of the 12th Int. Conf. on Machine Learning and Applications , Vol. 2. 303 -- 308 . Karim M. Mahmoud, Nagia M. Ghanem, and Mohamed A. Ismail. 2013 Unsupervised Video Summarization via Dynamic Modeling-Based Hierarchical Clustering. In Proc. of the 12th Int. Conf. on Machine Learning and Applications, Vol. 2. 303--308.","journal-title":"Int. Conf. on Machine Learning and Applications"},{"key":"e_1_3_2_2_32_1","volume-title":"Proc. of the 2019 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR).","author":"Mayu Otani Esa Rahtu","year":"2019","unstructured":"Esa Rahtu Mayu Otani , Yuta Nakahima and Janne Heikkil\u00e4 . 2019 . Rethinking the Evaluation of Video Summaries . In Proc. of the 2019 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). Esa Rahtu Mayu Otani, Yuta Nakahima and Janne Heikkil\u00e4. 2019. Rethinking the Evaluation of Video Summaries. In Proc. of the 2019 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2014.08.002"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2789332"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-54193-8_23"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00809"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3350992"},{"key":"e_1_3_2_2_38_1","volume-title":"Proc. of the 2018 AAAI Conf. on Artificial Intelligence. 216--223","author":"Wei Huawei","year":"2018","unstructured":"Huawei Wei , Bingbing Ni , Yichao Yan , Huanyu Yu , Xiaokang Yang , and Chen Yao . 2018 . Video Summarization via Semantic Attended Networks . In Proc. of the 2018 AAAI Conf. on Artificial Intelligence. 216--223 . Huawei Wei, Bingbing Ni, Yichao Yan, Huanyu Yu, Xiaokang Yang, and Chen Yao. 2018. Video Summarization via Semantic Attended Networks. In Proc. of the 2018 AAAI Conf. on Artificial Intelligence. 216--223."},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299154"},{"key":"e_1_3_2_2_40_1","volume-title":"Proc. of the 2019 AAAI Conf. on Artificial Intelligence.","author":"Yuan Li","year":"2019","unstructured":"Li Yuan , Francis Eng Hock Tay , Ping Li , Li Zhou , and Jiashi Feng . 2019 . CycleSUM: Cycle-Consistent Adversarial LSTM Networks for Unsupervised Video Summarization . In Proc. of the 2019 AAAI Conf. on Artificial Intelligence. Li Yuan, Francis Eng Hock Tay, Ping Li, Li Zhou, and Jiashi Feng. 2019. CycleSUM: Cycle-Consistent Adversarial LSTM Networks for Unsupervised Video Summarization. In Proc. of the 2019 AAAI Conf. on Artificial Intelligence."},{"key":"e_1_3_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46478-7_47"},{"key":"e_1_3_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3321408.3322622"},{"key":"e_1_3_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3123266.3123328"},{"key":"e_1_3_2_2_44_1","volume-title":"HSA-RNN: Hierarchical StructureAdaptive RNN for Video Summarization. In 2018 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 7405--7414","author":"Zhao Bin","year":"2018","unstructured":"Bin Zhao , Xuelong Li , and Xiaoqiang Lu . 2018 . HSA-RNN: Hierarchical StructureAdaptive RNN for Video Summarization. In 2018 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 7405--7414 . Bin Zhao, Xuelong Li, and Xiaoqiang Lu. 2018. HSA-RNN: Hierarchical StructureAdaptive RNN for Video Summarization. In 2018 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). 7405--7414."},{"key":"e_1_3_2_2_45_1","volume-title":"Property-Constrained Dual Learning for Video Summarization","author":"Zhao Bin","year":"2019","unstructured":"Bin Zhao , Xuelong Li , and Xiaoqiang Lu. 2019. Property-Constrained Dual Learning for Video Summarization . IEEE Transactions on Neural Networks and Learning Systems ( 2019 ), 1--12. Bin Zhao, Xuelong Li, and Xiaoqiang Lu. 2019. Property-Constrained Dual Learning for Video Summarization. IEEE Transactions on Neural Networks and Learning Systems (2019), 1--12."},{"key":"e_1_3_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.12255"},{"key":"e_1_3_2_2_47_1","volume-title":"Proc. of the 2018 British Machine Vision Conferenve (BMVC)","author":"Zhou Kaiyang","year":"2018","unstructured":"Kaiyang Zhou , Tao Xiang , and Andrea Cavallaro . 2018 . Video Summarisation by Classification with Deep Reinforcement Learning . In Proc. of the 2018 British Machine Vision Conferenve (BMVC) Kaiyang Zhou, Tao Xiang, and Andrea Cavallaro. 2018. Video Summarisation by Classification with Deep Reinforcement Learning. In Proc. of the 2018 British Machine Vision Conferenve (BMVC)"}],"event":{"name":"MM '20: The 28th ACM International Conference on Multimedia","location":"Seattle WA USA","acronym":"MM '20","sponsor":["SIGMM ACM Special Interest Group on Multimedia"]},"container-title":["Proceedings of the 28th ACM International Conference on Multimedia"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394171.3413632","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3394171.3413632","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:15Z","timestamp":1750193235000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3394171.3413632"}},"subtitle":["A Robust Evaluation Protocol for Video Summarization Methods"],"short-title":[],"issued":{"date-parts":[[2020,10,12]]},"references-count":47,"alternative-id":["10.1145\/3394171.3413632","10.1145\/3394171"],"URL":"https:\/\/doi.org\/10.1145\/3394171.3413632","relation":{},"subject":[],"published":{"date-parts":[[2020,10,12]]},"assertion":[{"value":"2020-10-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}