{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,28]],"date-time":"2025-12-28T13:47:45Z","timestamp":1766929665950,"version":"3.37.3"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,7,4]],"date-time":"2022-07-04T00:00:00Z","timestamp":1656892800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,4]],"date-time":"2022-07-04T00:00:00Z","timestamp":1656892800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2023,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In the last years, scientific and industrial research has experienced a growing interest in acquiring large annotated data sets to train artificial intelligence algorithms for tackling problems in different domains. In this context, we have observed that even the market for football data has substantially grown. The analysis of football matches relies on the annotation of both individual players\u2019 and team actions, as well as the athletic performance of players. Consequently, annotating football events at a fine-grained level is a very expensive and error-prone task. Most existing semi-automatic tools for football match annotation rely on cameras and computer vision. However, those tools fall short in capturing team dynamics and in extracting data of players who are not visible in the camera frame. To address these issues, in this manuscript we present FootApp, an AI-based system for football match annotation. First, our system relies on an advanced and mixed user interface that exploits both vocal and touch interaction. Second, the motor performance of players is captured and processed by applying machine learning algorithms to data collected from inertial sensors worn by players. Artificial intelligence techniques are then used to check the consistency of generated labels, including those regarding the physical activity of players, to automatically recognize annotation errors. Notably, we implemented a full prototype of the proposed system, performing experiments to show its effectiveness in a real-world adoption scenario.<\/jats:p>","DOI":"10.1007\/s11042-022-13359-0","type":"journal-article","created":{"date-parts":[[2022,7,4]],"date-time":"2022-07-04T07:20:56Z","timestamp":1656919256000},"page":"5547-5567","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["FootApp: An AI-powered system for football match annotation"],"prefix":"10.1007","volume":"82","author":[{"given":"Silvio","family":"Barra","sequence":"first","affiliation":[]},{"given":"Salvatore M.","family":"Carta","sequence":"additional","affiliation":[]},{"given":"Alessandro","family":"Giuliani","sequence":"additional","affiliation":[]},{"given":"Alessia","family":"Pisu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7862-8362","authenticated-orcid":false,"given":"Alessandro Sebastian","family":"Podda","sequence":"additional","affiliation":[]},{"given":"Daniele","family":"Riboni","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,7,4]]},"reference":[{"key":"13359_CR1","unstructured":"Adorf J (2013) Web speech api. KTH Royal Institute of Technology"},{"key":"13359_CR2","doi-asserted-by":"publisher","unstructured":"Alan O, Akpinar S, Sabuncu O, Cicekli N, Alpaslan F (2008) Ontological video annotation and querying system for soccer games. In: 2008 23rd International Symposium on Computer and Information Sciences, pp 1\u20136. https:\/\/doi.org\/10.1109\/ISCIS.2008.4717936","DOI":"10.1109\/ISCIS.2008.4717936"},{"issue":"10","key":"13359_CR3","doi-asserted-by":"publisher","first-page":"3605","DOI":"10.1016\/j.patcog.2010.04.019","volume":"43","author":"K Altun","year":"2008","unstructured":"Altun K, Barshan B, Tun\u00e7el O (2008) Comparative study on classifying human activities with miniature inertial and magnetic sensors. Pattern Recogn 43(10):3605\u20133620","journal-title":"Pattern Recogn"},{"issue":"2","key":"13359_CR4","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1016\/j.cviu.2003.06.004","volume":"92","author":"J Assfalg","year":"2003","unstructured":"Assfalg J, Bertini M, Colombo C, Del Bimbo A, Nunziati W (2003) Semantic annotation of soccer videos: automatic highlights identification. Comput Vis Image Underst 92(2):285\u2013305. https:\/\/doi.org\/10.1016\/j.cviu.2003.06.004. Special issue on video retrieval and summarization","journal-title":"Comput Vis Image Underst"},{"issue":"2","key":"13359_CR5","doi-asserted-by":"publisher","first-page":"313","DOI":"10.1007\/s11042-009-0342-4","volume":"48","author":"L Ballan","year":"2010","unstructured":"Ballan L, Bertini M, Del Bimbo A, Serra G (2010) Semantic annotation of soccer videos by visual instance clustering and spatial\/temporal reasoning in ontologies. Multimed Tools Appl 48(2):313\u2013337","journal-title":"Multimed Tools Appl"},{"key":"13359_CR6","doi-asserted-by":"publisher","unstructured":"Barra S, Carcangiu A, Carta S, Podda AS, Riboni D (2020) A voice user interface for football event tagging applications. In: Proceedings of the International Conference on Advanced Visual Interfaces, AVI \u201920. Association for Computing Machinery, New York, NY. https:\/\/doi.org\/10.1145\/3399715.3399967","DOI":"10.1145\/3399715.3399967"},{"issue":"3","key":"13359_CR7","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1109\/JAS.2020.1003132","volume":"7","author":"S Barra","year":"2020","unstructured":"Barra S, Carta SM, Corriga A, Podda AS, Recupero DR (2020) Deep learning and time series-to-image encoding for financial forecasting. IEEE\/CAA J Automat Sin 7(3):683\u2013692. https:\/\/doi.org\/10.1109\/JAS.2020.1003132","journal-title":"IEEE\/CAA J Automat Sin"},{"key":"13359_CR8","doi-asserted-by":"crossref","unstructured":"Borgelt C, Kruse R (2002) Induction of association rules: Apriori implementation. In: Compstat, pp 395\u2013400. Springer","DOI":"10.1007\/978-3-642-57489-4_59"},{"key":"13359_CR9","doi-asserted-by":"publisher","DOI":"10.4324\/9780203890691","volume-title":"Performance assessment for field sports","author":"C Carling","year":"2008","unstructured":"Carling C, Reilly T, Williams AM (2008) Performance assessment for field sports. Routledge, Evanston"},{"issue":"6","key":"13359_CR10","doi-asserted-by":"publisher","first-page":"790","DOI":"10.1109\/TSMCC.2012.2198883","volume":"42","author":"L Chen","year":"2012","unstructured":"Chen L, Hoey J, Nugent CD, Cook DJ, Yu Z (2012) Sensor-based activity recognition. IEEE Trans Syst Man Cybern Part C Appl Rev 42 (6):790\u2013808","journal-title":"IEEE Trans Syst Man Cybern Part C Appl Rev"},{"key":"13359_CR11","doi-asserted-by":"crossref","unstructured":"Cioppa A, Deliege A, Giancola S, Ghanem B, Droogenbroeck MV, Gade R, Moeslund TB (2020) A context-aware loss function for action spotting in soccer videos. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","DOI":"10.1109\/CVPR42600.2020.01314"},{"key":"13359_CR12","doi-asserted-by":"crossref","unstructured":"Fernandez D, Varas D, Espadaler J, Masuda I, Ferreira J, Woodward A, Rodriguez D, Giro-i Nieto X, Carlos Riveiro J, Bou E (2017) Vits: Video tagging system from massive web multimedia collections. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV) Workshops","DOI":"10.1109\/ICCVW.2017.48"},{"key":"13359_CR13","unstructured":"Goal.com: Footballers don\u2019t wear bras - sporting reasons for under-shirt clothing explained. https:\/\/www.goal.com\/en-au\/news\/footballers-dont-wear-bras-sporting-reasons-under-shirt-clothing-\/1aakl5v6271f814s624c5ws52t. Accessed 30 Nov 2021"},{"issue":"4","key":"13359_CR14","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1123\/jtpe.16.4.500","volume":"16","author":"J-F Grehaigne","year":"1997","unstructured":"Grehaigne J-F, Godbout P, Bouthier D (1997) Performance assessment in team sports. J Teach Phys Educ 16(4):500\u2013516","journal-title":"J Teach Phys Educ"},{"issue":"9","key":"13359_CR15","doi-asserted-by":"publisher","first-page":"2701","DOI":"10.1109\/JBHI.2020.2974425","volume":"24","author":"D Hao","year":"2020","unstructured":"Hao D, Zhang L, Sumkin J, Mohamed A, Wu S (2020) Inaccurate labels in weakly-supervised deep learning: Automatic identification and correction and their impact on classification performance. IEEE J Biomed Health Inform 24(9):2701\u20132710. https:\/\/doi.org\/10.1109\/JBHI.2020.2974425","journal-title":"IEEE J Biomed Health Inform"},{"key":"13359_CR16","doi-asserted-by":"crossref","unstructured":"Haryanto AW, Mawardi EK et al (2018) Influence of word normalization and chi-squared feature selection on support vector machine (svm) text classification. In: 2018 International seminar on application for technology of information and communication, pp 229\u2013233. IEEE","DOI":"10.1109\/ISEMANTIC.2018.8549748"},{"issue":"2","key":"13359_CR17","doi-asserted-by":"publisher","first-page":"846","DOI":"10.1016\/j.asoc.2012.10.007","volume":"13","author":"M-S Hosseini","year":"2013","unstructured":"Hosseini M-S, Eftekhari-Moghadam A-M (2013) Fuzzy rule-based reasoning approach for event detection and annotation of broadcast soccer video. Appl Soft Comput 13(2):846\u2013866. https:\/\/doi.org\/10.1016\/j.asoc.2012.10.007","journal-title":"Appl Soft Comput"},{"issue":"5","key":"13359_CR18","doi-asserted-by":"publisher","first-page":"1166","DOI":"10.1109\/TITB.2010.2051955","volume":"14","author":"AM Khan","year":"2010","unstructured":"Khan AM, Lee Y-K, Lee SY, Kim T-S (2010) A triaxial accelerometer-based physical-activity recognition via augmented-signal features and a hierarchical recognizer. IEEE Trans Inf Technol Biomed 14(5):1166\u20131172","journal-title":"IEEE Trans Inf Technol Biomed"},{"issue":"9","key":"13359_CR19","doi-asserted-by":"publisher","first-page":"2347","DOI":"10.1109\/TMM.2019.2896494","volume":"21","author":"X Li","year":"2019","unstructured":"Li X, Xu C, Wang X, Lan W, Jia Z, Yang G, Xu J (2019) Coco-cn for cross-lingual image tagging, captioning, and retrieval. IEEE Trans Multimedia 21(9):2347\u20132360. https:\/\/doi.org\/10.1109\/TMM.2019.2896494","journal-title":"IEEE Trans Multimedia"},{"issue":"6","key":"13359_CR20","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1109\/MIS.2005.105","volume":"20","author":"H Liu","year":"2005","unstructured":"Liu H, Dougherty ER, Dy JG, Torkkola K, Tuv E, Peng H, Ding C, Long F, Berens M, Parsons L et al (2005) Evolving feature selection. IEEE Intell Syst 20(6):64\u201376","journal-title":"IEEE Intell Syst"},{"issue":"6","key":"13359_CR21","doi-asserted-by":"crossref","first-page":"e1329","DOI":"10.1002\/widm.1329","volume":"9","author":"JM Luna","year":"2019","unstructured":"Luna JM, Fournier-Viger P, Ventura S (2019) Frequent itemset mining: A 25 years review. Wiley Interdiscip Rev Data Min Knowl Disc 9(6):e1329","journal-title":"Wiley Interdiscip Rev Data Min Knowl Disc"},{"key":"13359_CR22","doi-asserted-by":"publisher","unstructured":"Ma S, Shao E, Xie X, Liu W (2020) Event detection in soccer video based on self-attention. In: 2020 IEEE 6th International Conference on Computer and Communications (ICCC), pp 1852\u20131856. https:\/\/doi.org\/10.1109\/ICCC51575.2020.9344896","DOI":"10.1109\/ICCC51575.2020.9344896"},{"key":"13359_CR23","doi-asserted-by":"publisher","first-page":"100612","DOI":"10.1016\/j.softx.2020.100612","volume":"12","author":"L Morra","year":"2020","unstructured":"Morra L, Manigrasso F, Lamberti F (2020) Soccer: Computer graphics meets sports analytics for soccer event recognition. SoftwareX 12:100612. https:\/\/doi.org\/10.1016\/j.softx.2020.100612","journal-title":"SoftwareX"},{"key":"13359_CR24","doi-asserted-by":"publisher","unstructured":"Presti DL, Massaroni C, Caponero M, Formica D, Schena E (2021) Cardiorespiratory monitoring using a mechanical and an optical system. In: 2021 IEEE International Symposium on Medical Measurements and Applications (MeMeA), pp 1\u20136. https:\/\/doi.org\/10.1109\/MeMeA52024.2021.9478750","DOI":"10.1109\/MeMeA52024.2021.9478750"},{"key":"13359_CR25","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1109\/LSP.2021.3049997","volume":"28","author":"X Qian","year":"2021","unstructured":"Qian X, Cheng X, Cheng G, Yao X, Jiang L (2021) Two-stream encoder gan with progressive training for co-saliency detection. IEEE Signal Process Lett 28:180\u2013184. https:\/\/doi.org\/10.1109\/LSP.2021.3049997","journal-title":"IEEE Signal Process Lett"},{"issue":"3","key":"13359_CR26","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1007\/s00779-010-0331-7","volume":"15","author":"D Riboni","year":"2011","unstructured":"Riboni D, Bettini C (2011) Cosar: hybrid reasoning for context-aware activity recognition. Pers Ubiquit Comput 15(3):271\u2013289","journal-title":"Pers Ubiquit Comput"},{"key":"13359_CR27","unstructured":"S\u00e1mano A, Ocegueda-Hern\u00e1ndez VC, Guerrero-Carrizales F, Fuentes JM, Mendizabal-Ruiz G Gvr: An intuitive tool for the visualization and easy interpretation of advanced exploration methods for the analysis of soccer matches"},{"issue":"1","key":"13359_CR28","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1007\/s11760-016-0916-3","volume":"11","author":"RA Sharma","year":"2017","unstructured":"Sharma RA, Gandhi V, Chari V, Jawahar CV (2017) Automatic analysis of broadcast football videos using contextual priors. SIViP 11(1):171\u2013178","journal-title":"SIViP"},{"key":"13359_CR29","volume-title":"Support vector machines, vol. 2","author":"J Shawe-Taylor","year":"2000","unstructured":"Shawe-Taylor J, Cristianini N (2000) Support vector machines, vol. 2. Cambridge University Press, Cambridge"},{"key":"13359_CR30","doi-asserted-by":"crossref","unstructured":"Sorano D, Carrara F, Cintia P, Falchi F, Pappalardo L (2020) Automatic pass annotation from soccer videostreams based on object detection and lstm. arXiv:2007.06475","DOI":"10.1007\/978-3-030-67670-4_29"},{"key":"13359_CR31","doi-asserted-by":"crossref","unstructured":"Sorano D, Carrara F, Cintia P, Falchi F, Pappalardo L (2021) Automatic pass annotation from soccer video streams based on object detection and lstm. In: Dong Y, Ifrim G, Mladeni\u0107 D, Saunders C, Van Hoecke S (eds) Machine Learning and Knowledge Discovery in Databases. Applied Data Science and Demo Track, pp 475\u2013490. Springer International Publishing, Cham","DOI":"10.1007\/978-3-030-67670-4_29"},{"issue":"5","key":"13359_CR32","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1109\/MCG.2016.102","volume":"36","author":"M Stein","year":"2016","unstructured":"Stein M, Janetzko H, Breitkreutz T, Seebacher D, Schreck T, Grossniklaus M, Couzin ID, Keim DA (2016) Director\u2019s cut: Analysis and annotation of soccer matches. IEEE Comput Graph Appl 36(5):50\u201360. https:\/\/doi.org\/10.1109\/MCG.2016.102","journal-title":"IEEE Comput Graph Appl"},{"issue":"2","key":"13359_CR33","doi-asserted-by":"publisher","first-page":"632","DOI":"10.1109\/TCSVT.2020.2982580","volume":"31","author":"R Theagarajan","year":"2021","unstructured":"Theagarajan R, Bhanu B (2021) An automated system for generating tactical performance statistics for individual soccer players from videos. IEEE Trans Circuits Syst Video Technol 31(2):632\u2013646. https:\/\/doi.org\/10.1109\/TCSVT.2020.2982580","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"issue":"2","key":"13359_CR34","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1016\/j.patcog.2010.08.011","volume":"44","author":"A Verikas","year":"2011","unstructured":"Verikas A, Gelzinis A, Bacauskiene M (2011) Mining data with random forests: A survey and results of new tests. Pattern Recogn 44(2):330\u2013349","journal-title":"Pattern Recogn"},{"key":"13359_CR35","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.patrec.2018.02.010","volume":"119","author":"J Wang","year":"2019","unstructured":"Wang J, Chen Y, Hao S, Peng X, Hu L (2019) Deep learning for sensor-based activity recognition: A survey. Pattern Recogn Lett 119:3\u201311","journal-title":"Pattern Recogn Lett"},{"issue":"5","key":"13359_CR36","doi-asserted-by":"publisher","first-page":"1104","DOI":"10.1109\/TCSVT.2016.2515280","volume":"27","author":"Z Wang","year":"2017","unstructured":"Wang Z, Yu J, He Y (2017) Soccer video event annotation by synchronization of attack-defense clips and match reports with coarse-grained time information. IEEE Trans Circuits Syst Video Technol 27(5):1104\u20131117. https:\/\/doi.org\/10.1109\/TCSVT.2016.2515280","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"key":"13359_CR37","doi-asserted-by":"publisher","unstructured":"Xu Y, Kong Q, Huang Q, Wang W, Plumbley MD (2017) Convolutional gated recurrent neural network incorporating spatial features for audio tagging. In: 2017 International Joint Conference on Neural Networks (IJCNN), pp 3461\u20133466. https:\/\/doi.org\/10.1109\/IJCNN.2017.7966291","DOI":"10.1109\/IJCNN.2017.7966291"},{"key":"13359_CR38","first-page":"619","volume":"2","author":"F Yan","year":"2005","unstructured":"Yan F, Christmas W, Kittler J (2005) A tennis ball tracking algorithm for automatic annotation of tennis match. In British machine vision conference 2:619\u2013628","journal-title":"In British machine vision conference"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-022-13359-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-022-13359-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-022-13359-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,28]],"date-time":"2024-09-28T11:18:32Z","timestamp":1727522312000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-022-13359-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,4]]},"references-count":38,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,2]]}},"alternative-id":["13359"],"URL":"https:\/\/doi.org\/10.1007\/s11042-022-13359-0","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"type":"print","value":"1380-7501"},{"type":"electronic","value":"1573-7721"}],"subject":[],"published":{"date-parts":[[2022,7,4]]},"assertion":[{"value":"26 February 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 March 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 June 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 July 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Conflict of interests"}}]}}