{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,7]],"date-time":"2026-04-07T03:35:46Z","timestamp":1775532946487,"version":"3.50.1"},"reference-count":44,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,12,8]],"date-time":"2021-12-08T00:00:00Z","timestamp":1638921600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005416","name":"Norwegian Research Council","doi-asserted-by":"publisher","award":["327717"],"award-info":[{"award-number":["327717"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>The current gold standard for extracting highlight clips from soccer games is the use of manual annotations and clippings, where human operators define the start and end of an event and trim away the unwanted scenes. This is a tedious, time-consuming, and expensive task, to the extent of being rendered infeasible for use in lower league games. In this paper, we aim to automate the process of highlight generation using logo transition detection, scene boundary detection, and optional scene removal. We experiment with various approaches, using different neural network architectures on different datasets, and present two models that automatically find the appropriate time interval for extracting goal events. These models are evaluated both quantitatively and qualitatively, and the results show that we can detect logo and scene transitions with high accuracy and generate highlight clips that are highly acceptable for viewers. We conclude that there is considerable potential in automating the overall soccer video clipping process.<\/jats:p>","DOI":"10.3390\/make3040049","type":"journal-article","created":{"date-parts":[[2021,12,10]],"date-time":"2021-12-10T02:07:18Z","timestamp":1639102038000},"page":"990-1008","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["AI-Based Video Clipping of Soccer Events"],"prefix":"10.3390","volume":"3","author":[{"given":"Joakim Olav","family":"Valand","sequence":"first","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"},{"name":"Department of Informatics, University of Oslo, 0373 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haris","family":"Kadragic","sequence":"additional","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"},{"name":"Department of Informatics, University of Oslo, 0373 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3332-1201","authenticated-orcid":false,"given":"Steven Alexander","family":"Hicks","sequence":"additional","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"},{"name":"Department of Computer Science, Oslo Metropolitan University, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6026-0929","authenticated-orcid":false,"given":"Vajira Lasantha","family":"Thambawita","sequence":"additional","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"},{"name":"Department of Computer Science, Oslo Metropolitan University, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0991-4418","authenticated-orcid":false,"given":"Cise","family":"Midoglu","sequence":"additional","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tomas","family":"Kupka","sequence":"additional","affiliation":[{"name":"Forzasys AS, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7067-6477","authenticated-orcid":false,"given":"Dag","family":"Johansen","sequence":"additional","affiliation":[{"name":"Department of Computer Science, UIT The Arctic University of Norway, 9037 Troms\u00f8, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3153-2064","authenticated-orcid":false,"given":"Michael Alexander","family":"Riegler","sequence":"additional","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"},{"name":"Department of Computer Science, UIT The Arctic University of Norway, 9037 Troms\u00f8, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2073-7029","authenticated-orcid":false,"given":"P\u00e5l","family":"Halvorsen","sequence":"additional","affiliation":[{"name":"SimulaMet, 0167 Oslo, Norway"},{"name":"Department of Computer Science, Oslo Metropolitan University, 0167 Oslo, Norway"},{"name":"Forzasys AS, 0167 Oslo, Norway"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,8]]},"reference":[{"key":"ref_1","unstructured":"FIFA.com (2021, December 04). More Than Half the World Watched Record-Breaking 2018 World Cup. Available online: https:\/\/www.fifa.com\/worldcup\/news\/more-than-half-the-world-watched-record-breaking-2018-world-cup."},{"key":"ref_2","unstructured":"(2021, December 04). Why the Sports Industry is Booming in 2020 (and Which Key Players Are Driving Growth). Available online: https:\/\/www.torrens.edu.au\/blog\/why-sports-industry-is-booming-in-2020-which-key-players-driving-growth."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Giancola, S., Amine, M., Dghaily, T., and Ghanem, B. (2018, January 18\u201322). SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videos. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00223"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kapela, R., McGuinness, K., Swietlicka, A., and O\u2019Connor, N.E. (2014). Real-Time Event Detection in Field Sport Videos. Proceedings of CVPR, Springer.","DOI":"10.1007\/978-3-319-09396-3_14"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Cioppa, A., Deliege, A., Giancola, S., Ghanem, B., Droogenbroeck, M., Gade, R., and Moeslund, T. (2020, January 14\u201319). A Context-Aware Loss Function for Action Spotting in Soccer Videos. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01314"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tomei, M., Baraldi, L., Calderara, S., Bronzin, S., and Cucchiara, R. (2021). RMS-Net: Regression and Masking for Soccer Event Spotting. arXiv.","DOI":"10.1109\/ICPR48806.2021.9412268"},{"key":"ref_7","unstructured":"Rongved, O.A.N., Hicks, S.A., Thambawita, V., Stensland, H.K., Zouganeli, E., Johansen, D., Riegler, M.A., and Halvorsen, P. (2020, January 2\u20134). Real-Time Detection of Events in Soccer Videos using 3D Convolutional Neural Networks. Proceedings of the IEEE International Symposium on Multimedia (ISM), Naples, Italy."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep Residual Learning for Image Recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_9","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_10","unstructured":"Sou\u010dek, T., and Loko\u010d, J. (2020). TransNet V2: An effective deep network architecture for fast shot transition detection. arXiv."},{"key":"ref_11","unstructured":"Tang, S., Feng, L., Kuang, Z., Chen, Y., and Zhang, W. (2018). Fast Video Shot Transition Localization with Deep Structured Models. arXiv."},{"key":"ref_12","unstructured":"Awad, G., Butt, A.A., Curtis, K., Lee, Y., Fiscus, J., Godil, A., Delgado, A., Zhang, J., Godard, E., and Diduch, L. (2020). TRECVID 2020: Comprehensive campaign for evaluating video retrieval tasks across multiple application domains, Proceedings of TREC Video Retrieval Evaluation (TRECVID)."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Valand, J.O., Haris, K., Hicks, S.A., Thambawita, V., Midoglu, C., Kupka, T., Johansen, D., Riegler, M.A., and Halvorsen, P. (2021, January 6\u20138). Automated Clipping of Soccer Events using Machine Learning. Proceedings of the IEEE International Symposium on Multimedia (ISM), Naples, Italy.","DOI":"10.1109\/ISM52913.2021.00042"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., and Fei-Fei, L. (2014, January 23\u201328). Large-Scale Video Classification with Convolutional Neural Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.223"},{"key":"ref_15","unstructured":"Simonyan, K., and Zisserman, A. (2014, January 8\u201313). Two-Stream Convolutional Networks for Action Recognition in Videos. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Montreal, QC, Canada."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Feichtenhofer, C., Pinz, A., and Zisserman, A. (2016, January 27\u201330). Convolutional Two-Stream Network Fusion for Video Action Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.213"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Carreira, J., and Zisserman, A. (2017, January 21\u201326). Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.502"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Shou, Z., Wang, D., and Chang, S.F. (2016, January 27\u201330). Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.119"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Wang, L., Xiong, Y., Wang, Z., Qiao, Y., Lin, D., Tang, X., and Gool, L.V. (2016, January 11\u201314). Temporal Segment Networks: Towards Good Practices for Deep Action Recognition. Proceedings of the European Conference Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46484-8_2"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Tran, D., Bourdev, L., Fergus, R., Torresani, L., and Paluri, M. (2015, January 7\u201313). Learning Spatiotemporal Features with 3D Convolutional Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.510"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Tran, D., Wang, H., Torresani, L., Ray, J., LeCun, Y., and Paluri, M. (2018, January 18\u201322). A Closer Look at Spatiotemporal Convolutions for Action Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00675"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2016.10.018","article-title":"The THUMOS challenge on action recognition for videos \u201cin the wild\u201d","volume":"155","author":"Idrees","year":"2017","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_23","unstructured":"Ren, S., He, K., Girshick, R., and Sun, J. (2015, January 7\u201312). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Proceedings of the International Conference on Neural Information Processing Systems (NIPS), Montreal, QC, Canada."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Xu, H., Das, A., and Saenko, K. (2017, January 22\u201329). R-C3D: Region Convolutional 3D Network for Temporal Activity Detection. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.617"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lin, T., Liu, X., Li, X., Ding, E., and Wen, S. (2019, January 27\u201328). BMN: Boundary-Matching Network for Temporal Action Proposal Generation. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00399"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Lin, T., Zhao, X., Su, H., Wang, C., and Yang, M. (2018, January 8\u201314). BSN: Boundary Sensitive Network for Temporal Action Proposal Generation. Proceedings of the European Conference Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01225-0_1"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"020503","DOI":"10.1117\/1.2199878","article-title":"Shot boundary detection without threshold parameters","volume":"15","author":"Koumaras","year":"2006","journal-title":"J. Electron. Imaging"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zawbaa, H.M., El-Bendary, N., Hassanien, A.E., and Abraham, A. (2011, January 19\u201321). SVM-based soccer video summarization system. Proceedings of the World Congress on Nature and Biologically Inspired Computing, Salamanca, Spain.","DOI":"10.1109\/NaBIC.2011.6089409"},{"key":"ref_29","first-page":"63","article-title":"Event Detection Based Approach for Soccer Video Summarization Using Machine learning","volume":"7","author":"Zawbaa","year":"2012","journal-title":"Int. J. Multimed. Ubiquitous Eng. (IJMUE)"},{"key":"ref_30","unstructured":"Xu, P., Xie, L., Chang, S.F., Divakaran, A., Vetro, A., and Sun, H. (2001, January 22\u201325). Algorithms and system for segmentation and structure analysis in soccer video. Proceedings of the IEEE International Conference on Multimedia and Expo (ICME), Tokyo, Japan."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Rafiq, M., Rafiq, G., Agyeman, R., Jin, S.I., and Choi, G.S. (2020). Scene Classification for Sports Video Summarization Using Transfer Learning. Sensors, 20.","DOI":"10.3390\/s20061702"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ren, R., and Jose, J.M. (2005). Football Video Segmentation Based on Video Production Strategy. Proceedings of ECIR\u2014Advances in Information Retrieval, Springer.","DOI":"10.1007\/978-3-540-31865-1_31"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Raventos, A., Quijada, R., Torres, L., and Tarres, F. (2014). Automatic Summarization of Soccer Highlights Using Audio-visual Descriptors. arXiv.","DOI":"10.1186\/s40064-015-1065-9"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Tjondronegoro, D., Chen, Y.P.P., and Pham, B. (2003, January 7). Sports video summarization using highlights and play-breaks. Proceedings of the ACM SIGMM International Workshop on Multimedia Information Retrieval (MIR), Berkeley, CA, USA.","DOI":"10.1145\/973264.973296"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"460913","DOI":"10.1155\/2008\/460913","article-title":"Motion Entropy Feature and Its Applications to Event-Based Segmentation of Sports Video","volume":"2008","author":"Chen","year":"2008","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Baraldi, L., Grana, C., and Cucchiara, R. (2015, January 2\u20134). Shot and Scene Detection via Hierarchical Clustering for Re-using Broadcast Video. Proceedings of the International Conference on Computer Analysis of Images and Patterns (CAIP), Valletta, Malta.","DOI":"10.1007\/978-3-319-23192-1_67"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Baraldi, L., Grana, C., and Cucchiara, R. (2015, January 26\u201330). A Deep Siamese Network for Scene Detection in Broadcast Videos. Proceedings of the ACM conference on multimedia (ACM MM), Brisbane, Australia.","DOI":"10.1145\/2733373.2806316"},{"key":"ref_38","unstructured":"Sou\u010dek, T. (2021, December 04). Deep Learning-Based Approaches for Shot Transition Detection and Known-Item Search in Video. Available online: https:\/\/github.com\/soCzech\/MasterThesis."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Deli\u00e8ge, A., Cioppa, A., Giancola, S., Seikavandi, M.J., Dueholm, J.V., Nasrollahi, K., Ghanem, B., Moeslund, T.B., and Droogenbroeck, M.V. (2020). SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videos. arXiv.","DOI":"10.1109\/CVPRW53098.2021.00508"},{"key":"ref_40","unstructured":"Keras (2021, December 04). ResNet and ResNetV2. Available online: https:\/\/keras.io\/api\/applications\/resnet\/."},{"key":"ref_41","unstructured":"Chollet, F. (2021, December 04). Keras. Available online: https:\/\/keras.io."},{"key":"ref_42","first-page":"249","article-title":"Understanding the difficulty of training deep feedforward neural networks","volume":"9","author":"Glorot","year":"2010","journal-title":"J. Mach. Learn. Res.\u2014Proc. Track"},{"key":"ref_43","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 22\u201324). ImageNet: A large-scale hierarchical image database. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/3\/4\/49\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:43:29Z","timestamp":1760168609000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/3\/4\/49"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,8]]},"references-count":44,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["make3040049"],"URL":"https:\/\/doi.org\/10.3390\/make3040049","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,8]]}}}