{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T18:23:23Z","timestamp":1778610203203,"version":"3.51.4"},"reference-count":67,"publisher":"Springer Science and Business Media LLC","issue":"20","license":[{"start":{"date-parts":[[2023,12,27]],"date-time":"2023-12-27T00:00:00Z","timestamp":1703635200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,27]],"date-time":"2023-12-27T00:00:00Z","timestamp":1703635200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001858","name":"VINNOVA","doi-asserted-by":"publisher","award":["2021-02107"],"award-info":[{"award-number":["2021-02107"]}],"id":[{"id":"10.13039\/501100001858","id-type":"DOI","asserted-by":"publisher"}]},{"name":"RISE Research Institutes of Sweden"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The International Football Association Board decided to introduce Video Assistant Referee (VAR) in 2018. This led to the need to develop methods for quality control of the VAR-systems. This article focuses on the important aspect to evaluate the video quality. Video Quality assessment has matured in the sense that there are standardized, commercial products and established open-source solutions to measure it with objective methods. Previous research has primarily focused on the end-user quality assessment. How to assess the video in the contribution phase of the chain is less studied. The novelties of this study are two-fold: 1) The user study is specifically targeting video experts i.e., to assess the perceived quality of video professionals working with video production. 2) Six video quality models have been independently benchmarked against the user data and evaluated to show which of the models could provide the best predictions of perceived quality. The independent evaluation is important to get unbiased results as shown by the Video Quality Experts Group. An experiment was performed involving 25 video experts in which they rated the perceived quality. The video formats tested were High-Definition TV both progressive and interlaced as well as a quarters size format that was scaled down half the size in both width and height. The videos were encoded with both H.264 and Motion JPEG for the full size but only H.264 for the quarter size. Bitrates ranged from 80 Mbit\/s down to 10 Mbit\/s. We could see that for H.264 that the quality was overall very good but dropped somewhat for 10 Mbit\/s. For Motion JPEG the quality dropped over the whole range. For the interlaced format the degradation that was based on a simple deinterlacing method did receive overall low ratings. For the quarter size three different scaling algorithms were evaluated. Lanczos performed the best and Bilinear the worst. The performance of six different video quality models were evaluated for 1080p and 1080i. The Video Quality Metric for Variable Frame Delay had the best performance for both formats, followed by Video Multimethod Assessment Fusion method and the Video Quality Metric General model.<\/jats:p>","DOI":"10.1007\/s11042-023-17741-4","type":"journal-article","created":{"date-parts":[[2023,12,27]],"date-time":"2023-12-27T03:02:07Z","timestamp":1703646127000},"page":"58783-58825","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Video expert assessment of high quality video for Video Assistant Referee (VAR): A comparative study"],"prefix":"10.1007","volume":"83","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5060-9402","authenticated-orcid":false,"given":"Kjell","family":"Brunnstr\u00f6m","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anders","family":"Djupsj\u00f6backa","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Johsan","family":"Billingham","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katharina","family":"Wistel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"B\u00f6rje","family":"Andr\u00e9n","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9839-7488","authenticated-orcid":false,"given":"Oskars","family":"Ozolins","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicolas","family":"Evans","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,12,27]]},"reference":[{"issue":"1","key":"17741_CR1","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1007\/s12283-023-00408-6","volume":"26","author":"K Brunnstr\u00f6m","year":"2023","unstructured":"Brunnstr\u00f6m K, Djupsj\u00f6backa A, Ozolins O, Billingham J, Wistel K, Evans N (2023) Quality measurement methods for video assisting refereeing systems. Sports Eng 26(1):17. https:\/\/doi.org\/10.1007\/s12283-023-00408-6","journal-title":"Sports Eng"},{"key":"17741_CR2","unstructured":"Wolf S, Pinson M (2011) Video Quality Model for Variable Frame Delay (VQM_VFD) (NTIA Technical Memorandum TM-11-482). National Telecommunications and Information Administration (NTIA), Boulder"},{"key":"17741_CR3","unstructured":"Li Z, Aaron A, Katsavounidis I, Moorthy AK, Manohara M (2016). Toward a practical perceptual video quality metric. Netflix Technology Blog. https:\/\/medium.com\/netflix-techblog\/toward-a-practical-perceptual-video-quality-metric-653f208b9652, Access Date: Oct 23, 2018"},{"key":"17741_CR4","unstructured":"ITU-T (2016) Objective perceptual multimedia video quality measurement of HDTV for digital cable television in the presence of a full reference (ITU-T Rec. J.341). International Telecommunication Union, Telecommunication standardization sector"},{"key":"17741_CR5","unstructured":"ITU-T (2004) Objective perceptual video quality measurement techniques for digital cable television in the presence of full reference (ITU-T Rec. J.144). International Telecommunication Union, Telecommunication standardization sector"},{"key":"17741_CR6","unstructured":"ITU-T (2017) Vocabulary for performance, quality of service and quality of experience (ITU-T Rec. P.10\/G.100). International Telecommunication Union (ITU), Place des Nations, CH-1211 Geneva 20"},{"key":"17741_CR7","unstructured":"Le Callet P, M\u00f6ller S, Perkis A (2012) Qualinet White Paper on Definitions of Quality of Experience (2012). European Network on Quality of Experience in Multimedia Systems and Services (COST Action IC 1003) (Version 1.2 (http:\/\/www.qualinet.eu\/images\/stories\/QoE_whitepaper_v1.2.pdf)), Lausanne, Switzerland"},{"key":"17741_CR8","unstructured":"ITU-R (2023) Methodology for the subjective assessment of the quality of television pictures (ITU-R Rec. BT.500-15). International Telecommunication Union (ITU)"},{"key":"17741_CR9","unstructured":"ITU-T (2008) Subjective video quality assessment methods for multimedia applications (ITU-T Rec. P.910). International Telecommunication Union, Telecommunication standardization sector"},{"key":"17741_CR10","unstructured":"ITU-T (2021) Methods for the subjective assessment of video quality, audio quality and audiovisual quality of Internet video and distribution quality television in any environment (ITU-T Rec. P.913). International Telecommunication Union, Telecommunication standardization sector"},{"key":"17741_CR11","doi-asserted-by":"publisher","unstructured":"Lee C, Choi H, Lee E, Lee S, Choe J (2006) Comparison of various subjective video quality assessment methods. In: Image Quality and System Performance III, San Jose, CA, United States, SPIE. https:\/\/doi.org\/10.1117\/12.651056","DOI":"10.1117\/12.651056"},{"key":"17741_CR12","unstructured":"Huynh-Thu Q, Ghanbari M (2005) A comparison of subjective video quality assessment methods for low-bit rate and low-resolution video. In: IASTED Int. Conf. on Signal Image Process. IASTED, pp 70\u201376"},{"key":"17741_CR13","doi-asserted-by":"publisher","unstructured":"Tominaga T, Hayashi T, Okamoto J, Takahashi A (2010) Performance comparisons of subjective quality assessment methods for mobile video. In: Second International Workshop on Quality of Multimedia Experience (QoMEX 2010). Trondheim, Norway, pp 82\u201387. https:\/\/doi.org\/10.1109\/QOMEX.2010.5517948","DOI":"10.1109\/QOMEX.2010.5517948"},{"key":"17741_CR14","doi-asserted-by":"publisher","unstructured":"Berger K, Koudota Y, Barkowsky M, Callet PL (2015). Subjective quality assessment comparing UHD and HD resolution in HEVC transmission chains. In: 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX), p 1-6. https:\/\/doi.org\/10.1109\/QoMEX.2015.7148114","DOI":"10.1109\/QoMEX.2015.7148114"},{"key":"17741_CR15","unstructured":"Pitrey Y, Barkowsky M, Le Callet P, P\u00e9pion R (2010) Subjective quality evaluation of H.264 high-definition video coding versus spatial up-scaling and interlacing. In: Euro ITV. Tampere, Finland"},{"key":"17741_CR16","unstructured":"Barkowsky M, Staelens N, Janowski L, Koudota Y, Leszczuk M, Urvoy M, Hummelbrunner P, Sedano I, Brunnstr\u00f6m K (2012) Subjective experiment dataset for joint development of hybrid video quality measurement algorithms. In Proc of the Third Workshop on Quality of Experience for Multimedia Content Sharing (QoEMCS), EuroITV 2012, Berlin, Germany"},{"key":"17741_CR17","doi-asserted-by":"publisher","unstructured":"Choe J-H, Jeong T-U, Choi H, Lee E-J, Lee S-W, Lee C-H (2007) Subjective video quality assessment methods for multimedia applications. J Broadcast Eng 12. https:\/\/doi.org\/10.5909\/JBE.2007.12.2.177","DOI":"10.5909\/JBE.2007.12.2.177"},{"key":"17741_CR18","unstructured":"EBU (2011) Signal Quality in HDTV Production and Broadcast Services (Recommendation R132). European Broadcasting Union (EBU), Geneva"},{"key":"17741_CR19","doi-asserted-by":"publisher","unstructured":"Pinson MH (2022) Why no reference metrics for image and video quality lack accuracy and reproducibility. IEEE Trans Broadcast: 1\u201321. https:\/\/doi.org\/10.1109\/TBC.2022.3191059","DOI":"10.1109\/TBC.2022.3191059"},{"key":"17741_CR20","unstructured":"VQEG (2010) Report on the validation of video quality models for high definition video content. Video Quality Experts Group (VQEG). https:\/\/www.vqeg.org\/media\/4212\/vqeg_hdtv_final_report_version_2.0.zip. Accessed 6 Dec 2023"},{"issue":"3","key":"17741_CR21","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1109\/MSP.2009.932162","volume":"26","author":"K Brunnstr\u00f6m","year":"2009","unstructured":"Brunnstr\u00f6m K, Hands D, Speranza F, Webster A (2009) VQEG validation and ITU standardisation of objective perceptual video quality metrics. IEEE Signal Process Mag 26(3):96\u2013101. https:\/\/doi.org\/10.1109\/MSP.2009.932162","journal-title":"IEEE Signal Process Mag"},{"key":"17741_CR22","unstructured":"VQEG (2009) Validation of reduced-reference and no-reference objective models for standard definition television, phase I. Video Quality Experts Group (VQEG). https:\/\/www.vqeg.org\/media\/66832\/rrnr-tv_final_report_v1_9.pdf. Accessed 6 Dec 2023"},{"key":"17741_CR23","unstructured":"VQEG (2008) Final report from the Video Quality Experts Group on the validation of objective models of multimedia quality assessment, phase I (VQEG Final Report of MM Phase I Validation Test). Video Quality Experts Group (VQEG). https:\/\/www.vqeg.org\/media\/66834\/vqeg_mm_report_final_v26.pdf. Accessed 6 Dec 2023"},{"key":"17741_CR24","unstructured":"VQEG (2003) Final report from the video quality experts group on the validation of objective models of video quality assessment, phase II (VQEG Final Report of FR-TV Phase II Validation Test). Video Quality Experts Group (VQEG). https:\/\/www.vqeg.org\/media\/4176\/vqegii_final_report.doc. Accessed 6 Dec 2023"},{"key":"17741_CR25","unstructured":"VQEG (2000) Final report from the video quality experts group on the validation of objective models of video quality assessment. Video Quality Experts Group (VQEG). https:\/\/www.vqeg.org\/media\/8212\/frtv_phase1_final_report.doc. Accessed 6 Dec 2023"},{"issue":"3","key":"17741_CR26","doi-asserted-by":"publisher","first-page":"660","DOI":"10.1109\/TBC.2008.2000733","volume":"54","author":"S Winkler","year":"2008","unstructured":"Winkler S, Mohandas P (2008) The evolution of video quality measurement: from PSNR to hybrid metrics. IEEE Trans Broadcast 54(3):660\u2013668. https:\/\/doi.org\/10.1109\/TBC.2008.2000733","journal-title":"IEEE Trans Broadcast"},{"issue":"1","key":"17741_CR27","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1186\/1687-5281-2014-40","volume":"2014","author":"M Shahid","year":"2014","unstructured":"Shahid M, Rossholm A, L\u00f6vstr\u00f6m B, Zepernick H-J (2014) No-reference image and video quality assessment: a classification and review of recent approaches. EURASIP J Image Video Process 2014(1):40. https:\/\/doi.org\/10.1186\/1687-5281-2014-40","journal-title":"EURASIP J Image Video Process"},{"key":"17741_CR28","doi-asserted-by":"publisher","DOI":"10.1017\/ATSIP.2013.5","volume":"2","author":"T-J Liu","year":"2013","unstructured":"Liu T-J, Lin Y-C, Lin W, Kuo CCJ (2013) Visual quality assessment: recent developments, coding applications and future trends. APSIPA Trans Signal Inf Process 2:e4. https:\/\/doi.org\/10.1017\/ATSIP.2013.5","journal-title":"APSIPA Trans Signal Inf Process"},{"key":"17741_CR29","doi-asserted-by":"publisher","first-page":"193020","DOI":"10.1109\/ACCESS.2020.3032080","volume":"8","author":"A Raake","year":"2020","unstructured":"Raake A, Borer S, Satti SM, Gustafsson J, Rao RRR, Medagli S, List P, G\u00f6ring S, Lindero D, Robitza W, Heikkil\u00e4 G, Broom S, Schmidmer C, Feiten B, W\u00fcstenhagen U, Wittmann T, Obermann M, Bitto R (2020) Multi-model standard for bitstream-, pixel-based and hybrid video quality assessment of UHD\/4K: ITU-T P.1204. IEEE Access 8:193020\u2013193049. https:\/\/doi.org\/10.1109\/ACCESS.2020.3032080","journal-title":"IEEE Access"},{"key":"17741_CR30","unstructured":"Shahid M (2014) Methods for objective and subjective video quality assessment and for speech enhancement. (15), Blekinge Institute of Technology Doctoral Dissertation Series, Blekinge Institute of Technology, Karlskrona, Doctoral thesis, comprehensive summary. http:\/\/bth.diva-portal.org\/smash\/get\/diva2:833983\/FULLTEXT01.pdf. Accessed 6 Dec 2023"},{"key":"17741_CR31","doi-asserted-by":"publisher","unstructured":"Pinson M, Wolf S (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50(3):312\u2013322. https:\/\/doi.org\/10.1109\/TBC.2004.834028","DOI":"10.1109\/TBC.2004.834028"},{"key":"17741_CR32","doi-asserted-by":"publisher","unstructured":"Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600\u2013612. https:\/\/doi.org\/10.1109\/TIP.2003.819861","DOI":"10.1109\/TIP.2003.819861"},{"issue":"1","key":"17741_CR33","doi-asserted-by":"publisher","DOI":"10.1117\/1.2160515","volume":"45","author":"C Lee","year":"2006","unstructured":"Lee C, Cho S, Choe J, Jeong T, Ahn W, Lee E (2006) Objective video quality assessment. Opt Eng 45(1):017004. https:\/\/doi.org\/10.1117\/1.2160515","journal-title":"Opt Eng"},{"issue":"2","key":"17741_CR34","doi-asserted-by":"publisher","first-page":"430","DOI":"10.1109\/TIP.2005.859378","volume":"15","author":"HR Sheikh","year":"2006","unstructured":"Sheikh HR, Bovik AC (2006) Image information and visual quality. IEEE Trans Image Process 15(2):430\u2013444. https:\/\/doi.org\/10.1109\/TIP.2005.859378","journal-title":"IEEE Trans Image Process"},{"issue":"7","key":"17741_CR35","doi-asserted-by":"publisher","first-page":"1467","DOI":"10.1109\/TCSVT.2017.2683504","volume":"28","author":"M Cheon","year":"2018","unstructured":"Cheon M, Lee J (2018) Subjective and objective quality assessment of compressed 4K UHD videos for immersive experience. IEEE Trans Circuits Syst Video Technol 28(7):1467\u20131480. https:\/\/doi.org\/10.1109\/TCSVT.2017.2683504","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"key":"17741_CR36","doi-asserted-by":"publisher","unstructured":"Rao RRR, G\u00f6ring S, Robitza W, Feiten B, Raake A (2019) AVT-VQDB-UHD-1: a large scale video quality database for UHD-1. In: 2019 IEEE International Symposium on Multimedia (ISM), p 17-177. https:\/\/doi.org\/10.1109\/ISM46123.2019.00012","DOI":"10.1109\/ISM46123.2019.00012"},{"key":"17741_CR37","unstructured":"ITU-T (2020) Statistical analysis, evaluation and reporting guidelines of quality measurements (ITU-T P.1401). International Telecommunication Union, Telecommunication standardization sector, Geneva"},{"key":"17741_CR38","unstructured":"ITU-T (2010) Reference algorithm for computing peak signa to noise ratio of a processed video sequence with compensation for constant spatial shifts, constant temporal shift, and constant luminance gain and offset (ITU-T Rec. J.340). International Telecommunication Union (ITU), Telecommunication Standardization Sector"},{"key":"17741_CR39","doi-asserted-by":"publisher","unstructured":"Wulf S, Z\u00f6lzer U (2012) Full-reference video quality assessment on high-definition video content. In: 2012 6th International Conference on Signal Processing and Communication Systems, p 1\u201310. https:\/\/doi.org\/10.1109\/ICSPCS.2012.6507948","DOI":"10.1109\/ICSPCS.2012.6507948"},{"key":"17741_CR40","doi-asserted-by":"publisher","unstructured":"Simone FD, Naccari M, Tagliasacchi M, Dufaux F, Tubaro S, Ebrahimi T (2009) Subjective assessment of H.264\/AVC video sequences transmitted over a noisy channel. In: 2009 International Workshop on Quality of Multimedia Experience, p 204-209. https:\/\/doi.org\/10.1109\/QOMEX.2009.5246952","DOI":"10.1109\/QOMEX.2009.5246952"},{"key":"17741_CR41","doi-asserted-by":"publisher","unstructured":"Simone FD, Tagliasacchi M, Naccari M, Tubaro S, Ebrahimi T (2010) A H.264\/AVC video database for the evaluation of quality metrics. In: 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, p 2430\u20132433. https:\/\/doi.org\/10.1109\/ICASSP.2010.5496296","DOI":"10.1109\/ICASSP.2010.5496296"},{"issue":"6","key":"17741_CR42","doi-asserted-by":"publisher","first-page":"1427","DOI":"10.1109\/TIP.2010.2042111","volume":"19","author":"K Seshadrinathan","year":"2010","unstructured":"Seshadrinathan K, Soundararajan R, Bovik AC, Cormack LK (2010) Study of subjective and objective quality assessment of video. IEEE Trans Image Process 19(6):1427\u20131441. https:\/\/doi.org\/10.1109\/TIP.2010.2042111","journal-title":"IEEE Trans Image Process"},{"key":"17741_CR43","doi-asserted-by":"publisher","unstructured":"Sedano I, Brunnstr\u00f6m K, Kihl M, Aurelius A (2014) Full-reference video quality metric assisted development of no-reference video quality metrics for real time network monitoring. EURASIP J Image Video Process 2014(4). https:\/\/doi.org\/10.1186\/1687-5281-2014-4","DOI":"10.1186\/1687-5281-2014-4"},{"key":"17741_CR44","unstructured":"ITU-T (2021) H.264 : Advanced video coding for generic audiovisual services (ITU-T Rec. H.264). International Telecommunication Union"},{"key":"17741_CR45","unstructured":"ITU-T (2016) High efficiency video coding (ITU-T Rec. H.265). International Telecommunication Union, Telecommunication standardization sector"},{"key":"17741_CR46","doi-asserted-by":"publisher","unstructured":"Ling S, Baveye Y, Nandakumar D, Sethuraman S, Callet PL (2020) Towards better quality assessment of high-quality videos. In: Proceedings of the 1st Workshop on Quality of Experience (QoE) in Visual Multimedia Applications. Association for Computing Machinery, Seattle, pp 3\u20139. https:\/\/doi.org\/10.1145\/3423328.3423496","DOI":"10.1145\/3423328.3423496"},{"key":"17741_CR47","unstructured":"ITU-R (2015) Parameter values for the HDTV standards for production and international programme exchange (Rec. ITU-R BT.709-6). International Telecommunication Union, Radiocommunication Sector"},{"key":"17741_CR48","unstructured":"Haglund L (2006) The SVT high definition multi format test set. Sveriges Television AB (SVT), Stockholm"},{"key":"17741_CR49","unstructured":"Apple Inc. (2008) Shake: Advanced digital composition. https:\/\/web.archive.org\/web\/20080122073447\/http:\/\/www.apple.com\/shake, Access Date: 11 Oct 2023"},{"key":"17741_CR50","unstructured":"Wikipedia (2023) Shake (software). https:\/\/en.wikipedia.org\/wiki\/Shake_(software), Access Date: 11 Oct 2023"},{"key":"17741_CR51","unstructured":"Brunnstr\u00f6m K, Cousseau R, Jonsson J, Koudota Y, Bagazov V, Barkowsky M (2014) VQEGPlayer: open source software for subjective video quality experiments in windows. Video Quality Experts Group (VQEG). www.vqeg.org, Available from: http:\/\/vqegjeg.intec.ugent.be\/wiki\/index.php\/VQEGplayer-main. Accessed 19 Dec 2023"},{"key":"17741_CR52","unstructured":"FFMPEG (2023) FFMPEG: complete, cross-platform solution to record, convert and stream audio and video. www.ffmpeg.org, Access Date: 7 Aug 2023"},{"key":"17741_CR53","unstructured":"Matlab (2006) corr -\u00a0Linear or rank correlation. https:\/\/se.mathworks.com\/help\/stats\/corr.html#mw_ae4a6910-6565-47ce-a488-30ebfb787127, Access Date: 1 May 2023"},{"key":"17741_CR54","unstructured":"Holm S (1979) A simple sequentially rejective multiple test procedure, Scand J Stat 6(2):65\u201370"},{"issue":"1","key":"17741_CR55","doi-asserted-by":"publisher","first-page":"72","DOI":"10.2307\/1412159","volume":"15","author":"C Spearman","year":"1904","unstructured":"Spearman C (1904) The proof and measurement of association between two things. Am J Psychol 15(1):72\u2013101. https:\/\/doi.org\/10.2307\/1412159","journal-title":"Am J Psychol"},{"issue":"3","key":"17741_CR56","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1007\/BF00994018","volume":"20","author":"C Cortes","year":"1995","unstructured":"Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn 20(3):273\u2013297. https:\/\/doi.org\/10.1007\/BF00994018","journal-title":"Mach Learn"},{"issue":"5","key":"17741_CR57","doi-asserted-by":"publisher","first-page":"935","DOI":"10.1109\/TMM.2011.2152382","volume":"13","author":"S Li","year":"2011","unstructured":"Li S, Zhang F, Ma L, Ngan KN (2011) Image quality assessment by separately evaluating detail losses and additive impairments. IEEE Trans Multimedia 13(5):935\u2013949. https:\/\/doi.org\/10.1109\/TMM.2011.2152382","journal-title":"IEEE Trans Multimedia"},{"key":"17741_CR58","unstructured":"Hanhart P (2013) VQMT: Video Quality Measurement Tool. https:\/\/www.epfl.ch\/labs\/mmspg\/downloads\/vqmt\/, Access Date: 7 Apr 2021"},{"key":"17741_CR59","unstructured":"Pinson M (2019) VQM - Video Quality Metric. https:\/\/github.com\/NTIA\/vqm, Access Date: 7 Apr 2021"},{"issue":"7","key":"17741_CR60","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1109\/34.192463","volume":"11","author":"SG Mallat","year":"1989","unstructured":"Mallat SG (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11(7):674\u2013693. https:\/\/doi.org\/10.1109\/34.192463","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"17741_CR61","doi-asserted-by":"crossref","unstructured":"Daubechies I (1992) Ten lectures on wavelets. Society for Industrial and Applied Mathematics","DOI":"10.1137\/1.9781611970104"},{"key":"17741_CR62","doi-asserted-by":"publisher","unstructured":"Simoncelli EP, Freeman WT (1995) The steerable pyramid: a flexible architecture for multi-scale derivative computation. In: Proceedings. International Conference on Image Processing, vol. 3, p 444-447. https:\/\/doi.org\/10.1109\/ICIP.1995.537667","DOI":"10.1109\/ICIP.1995.537667"},{"key":"17741_CR63","doi-asserted-by":"publisher","DOI":"10.4324\/9781410609243","volume-title":"Designing experiments and analyzing data : a model comparison perspective","author":"SE Maxwell","year":"2003","unstructured":"Maxwell SE, Delaney HD (2003) Designing experiments and analyzing data\u202f: a model comparison perspective, 2nd edn. Lawrence Erlbaum Associates Inc., Mahwah","edition":"2"},{"issue":"5","key":"17741_CR64","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1117\/1.JEI.27.5.053013","volume":"27","author":"K Brunnstr\u00f6m","year":"2018","unstructured":"Brunnstr\u00f6m K, Barkowsky M (2018) Statistical quality of experience analysis: on planning the sample size and statistical significance testing. J Electron Imaging 27(5):11. https:\/\/doi.org\/10.1117\/1.JEI.27.5.053013","journal-title":"J Electron Imaging"},{"key":"17741_CR65","doi-asserted-by":"publisher","unstructured":"Hossfeld T, Schatz R, Egger S (2011) SOS: The MOS is not enough! In: 2011 Third International Workshop on Quality of Multimedia Experience (QoMEX). Mechelen, Belgium: IEEE Xplore, p 131-136. https:\/\/doi.org\/10.1109\/QoMEX.2011.6065690","DOI":"10.1109\/QoMEX.2011.6065690"},{"key":"17741_CR66","doi-asserted-by":"publisher","unstructured":"Speranza F, Poulin F, Renaud R, Caron M, Dupras J (2010) Objective and subjective quality assessment with expert and non-expert viewers. In: 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX), p 46-51. https:\/\/doi.org\/10.1109\/QOMEX.2010.5518177","DOI":"10.1109\/QOMEX.2010.5518177"},{"key":"17741_CR67","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-021-01586-5","author":"K Rezaee","year":"2021","unstructured":"Rezaee K, Rezakhani SM, Khosravi MR, Moghimi MK (2021) A survey on deep learning-based real-time crowd anomaly detection for secure distributed video surveillance. Pers Ubiquit Comput. https:\/\/doi.org\/10.1007\/s00779-021-01586-5","journal-title":"Pers Ubiquit Comput"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-17741-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-023-17741-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-17741-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,3]],"date-time":"2024-06-03T09:31:53Z","timestamp":1717407113000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-023-17741-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,27]]},"references-count":67,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["17741"],"URL":"https:\/\/doi.org\/10.1007\/s11042-023-17741-4","relation":{},"ISSN":["1573-7721"],"issn-type":[{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,27]]},"assertion":[{"value":"19 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 October 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 November 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 December 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"All participating users signed a consent form before the participation in the study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"All authors have given their consent for publication.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"RISE has business contracts with FIFA and is the organisation to perform certification measurement for Quality of VAR on behalf of FIFA.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest\/Competing interests"}}]}}