{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,2]],"date-time":"2025-12-02T15:04:00Z","timestamp":1764687840928,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2019,10,26]],"date-time":"2019-10-26T00:00:00Z","timestamp":1572048000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In this paper we present a novel no-reference video quality measure, NR-FFM (no-reference frame\u2013freezing measure), designed to estimate quality degradations caused by frame freezing of streamed video. The performance of the measure was evaluated using 40 degraded video sequences from the laboratory for image and video engineering (LIVE) mobile database. Proposed quality measure can be used in different scenarios such as mobile video transmission by itself or in combination with other quality measures. These two types of applications were presented and studied together with considerations on relevant normalization issues. The results showed promising correlation values between the user assigned quality and the estimated quality scores.<\/jats:p>","DOI":"10.3390\/s19214655","type":"journal-article","created":{"date-parts":[[2019,10,28]],"date-time":"2019-10-28T04:44:31Z","timestamp":1572237871000},"page":"4655","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["No-Reference Objective Video Quality Measure for Frame Freezing Degradation"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0262-5595","authenticated-orcid":false,"given":"Emil","family":"Dumic","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, University North, 42000 Vara\u017edin, Croatia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4795-9510","authenticated-orcid":false,"given":"Anamaria","family":"Bjelopera","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computing, University of Dubrovnik, 20000 Dubrovnik, Croatia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,26]]},"reference":[{"unstructured":"ITU-R (2012). BT.500-13 Methodology for the Subjective Assessment of the Quality of Television Pictures, International Telecommunication Union\/ITU Radiocommunication Sector.","key":"ref_1"},{"unstructured":"Video Quality Experts Group (2019, October 14). Final Report from the Video Quality Experts Group on the Validation of Objective Models of Multimedia Quality. Available online: http:\/\/www.vqeg.org\/.","key":"ref_2"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"930","DOI":"10.13164\/re.2017.0930","article-title":"Evaluation of Blur and Gaussian Noise Degradation in Images Using Statistical Model of Natural Scene and Perceptual Image Quality Measure","volume":"26","author":"Bjelopera","year":"2017","journal-title":"Radioengineering"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1109\/TBC.2011.2104671","article-title":"Objective video quality assessment methods: A classification, review, and performance comparison","volume":"57","author":"Chikkerur","year":"2011","journal-title":"IEEE Trans. Broadcast."},{"unstructured":"Loncaric, M., Tralic, D., Brzica, M., Vukovic, J., Lovrinic, J., Dumic, E., and Grgic, S. (2008, January 10\u201312). Testing picture quality in HDTV systems. Proceedings of the 50th International Symposium ELMAR, Zadar, Croatia.","key":"ref_5"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image Quality Assessment: From Error Visibility to Structural Similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2284","DOI":"10.1109\/TIP.2007.901820","article-title":"VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images","volume":"16","author":"Chandler","year":"2007","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1179\/1743131X15Y.0000000011","article-title":"Reduced Reference Blockiness and Blurriness Meter for Image Quality Assessment","volume":"63","author":"Haque","year":"2015","journal-title":"Imaging Sci. J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1109\/TIP.2009.2034992","article-title":"Motion Tuned Spatio-temporal Quality Assessment of Natural Videos","volume":"19","author":"Seshadrinathan","year":"2010","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1109\/TBC.2004.834028","article-title":"A new standardized method for objectively measuring video quality","volume":"50","author":"Pinson","year":"2004","journal-title":"IEEE Trans. Broadcast."},{"key":"ref_11","first-page":"684","article-title":"Video Quality Assessment by Reduced Reference Spatio-temporal Entropic Differencing","volume":"23","author":"Soundararajan","year":"2013","journal-title":"IEEE Trans. Image Process."},{"unstructured":"Dumic, E., and Grgic, S. (2013, January 25\u201327). Reduced Video Quality Measure Based on 3D Steerable Wavelet Transform and Modified Structural Similarity Index. Proceedings of the 55th International Symposium ELMAR, Zadar, Croatia.","key":"ref_12"},{"unstructured":"Wolf, S.M., and Pinson, H. (2011). Video Quality Model for Variable Frame Delay (VQM_VFD), The National Telecommunications and Information Administration.","key":"ref_13"},{"doi-asserted-by":"crossref","unstructured":"Qi, Y., and Dai, M. (2006, January 18\u201320). The Effect of Frame Freezing and Frame Skipping on Video Quality. Proceedings of the International Conference on Intelligent Information Hiding and Multimedia, Pasadena, CA, USA.","key":"ref_14","DOI":"10.1109\/IIH-MSP.2006.265032"},{"unstructured":"Huynh-Thu, Q., and Ghanbari, M. (2009, January 7\u201311). No-reference temporal quality metric for video impaired by frame freezing artefacts. Proceedings of the 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt.","key":"ref_15"},{"unstructured":"You, J., Hannuksela, M.M., and Gabbouj, M. (2009, January 7\u201311). An objective video quality metric based on spatiotemporal distortion. Proceedings of the 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt.","key":"ref_16"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1109\/TBC.2014.2365260","article-title":"Temporal Video Quality Model Accounting for Variable Frame Delay Distortions","volume":"60","author":"Pinson","year":"2014","journal-title":"IEEE Trans. Broadcast."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1109\/JSTSP.2012.2212417","article-title":"Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies","volume":"6","author":"Moorthy","year":"2012","journal-title":"IEEE J. Sel. Top. Signal Process."},{"doi-asserted-by":"crossref","unstructured":"Borer, S. (2010, January 21\u201323). A model of jerkiness for temporal impairments in video transmission. Proceedings of the 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX), Trondheim, Norway.","key":"ref_19","DOI":"10.1109\/QOMEX.2010.5516155"},{"unstructured":"Wolf, S. (2009, January 15\u201316). A no reference (NR) and reduced reference (RR) metric for detecting dropped video frames. Proceedings of the Fourth International Workshop on Video Processing and Quality Metrics for Consumer Electronics (VPQM), Scottsdale, AZ, USA.","key":"ref_20"},{"doi-asserted-by":"crossref","unstructured":"Usman, M.A., Usman, M.R., and Shin, S.Y. (2016, January 5\u20138). A no reference method for detection of dropped video frames in live video streaming. Proceedings of the Eighth International Conference on Ubiquitous and Future Networks (ICUFN), Vienna, Austria.","key":"ref_21","DOI":"10.1109\/ICUFN.2016.7537155"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1080\/02564602.2016.1185975","article-title":"A no reference video quality metric based on jerkiness estimation focusing on multiple frame freezing in video streaming","volume":"34","author":"Usman","year":"2017","journal-title":"IETE Tech. Rev."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2344","DOI":"10.1109\/TMM.2018.2801722","article-title":"A novel no-reference metric for estimating the impact of frame freezing artifacts on perceptual quality of streamed videos","volume":"20","author":"Usman","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_24","first-page":"1570","article-title":"The impact of temporal impairment on quality of experience (QOE) in Video streaming: A no reference (NR) subjective and objective study","volume":"9","author":"Usman","year":"2015","journal-title":"Int. J. Comput. Electr. Autom. Control Inf. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"134","DOI":"10.1109\/TMM.2014.2368272","article-title":"A novel no-reference video quality metric for evaluating temporal jerkiness due to frame freezing","volume":"17","author":"Xue","year":"2014","journal-title":"IEEE Trans. Multimed."},{"doi-asserted-by":"crossref","unstructured":"Babi\u0107, D., Stefanovi\u0107, D., Vranje\u0161, M., and Herceg, M. (2019). Real-time no-reference histogram-based freezing artifact detection algorithm for UHD videos. Multimed. Tools Appl., 1\u201323.","key":"ref_26","DOI":"10.1007\/s11042-019-7184-5"},{"doi-asserted-by":"crossref","unstructured":"Grbi\u0107, R., Stefanovi\u0107, D., Vranje\u0161, M., and Herceg, M. (2019). Real-time video freezing detection for 4K UHD videos. J. Real-Time Image Process., 1\u201315.","key":"ref_27","DOI":"10.1007\/s11554-019-00873-y"},{"unstructured":"(2019, October 14). VQEG Final Report of HDTV Validation Test, 2010 VQEG, Available online: https:\/\/www.its.bldrdoc.gov\/vqeg\/projects\/hdtv\/hdtv.aspx.","key":"ref_28"},{"unstructured":"(2019, October 14). The Consumer Digital Video Library. Available online: www.cdvl.org.","key":"ref_29"},{"unstructured":"ITU-T (1999). P.910: Subjective Video Quality Assessment Methods for Multimedia Applications, International Telecommunication Union.","key":"ref_30"},{"unstructured":"Miettinen, K., Neittaanm\u00e4ki, P., M\u00e4kel\u00e4, M.M., and P\u00e9riaux, J. (1999). Evolutionary Algorithms in Engineering and Computer Science, John Wiley & Sons Ltd.","key":"ref_31"},{"unstructured":"Hauke, J., and Kossowski, T. (2007, January 13\u201315). Comparison of Values of Pearson\u2019s and Spearman\u2019s Correlation Coefficient on the Same Sets of Data. Proceedings of the MAT TRIAD 2007 Conference, Birmingham, UK.","key":"ref_32"},{"unstructured":"David Garson, G. (2013). Correlation (Statistical Associates \u201cBlue Book\u201d Series Book 3), Statistical Associates Publishing.","key":"ref_33"},{"unstructured":"Sheikh, H.R. (2004). Image Quality Assessment Using Natural Scene Statistics. [Ph.D. Thesis, University of Texas at Austin].","key":"ref_34"},{"doi-asserted-by":"crossref","unstructured":"Larson, E.C., and Chandler, D.M. (2010). Most apparent distortion: Full-reference image quality assessment and the role of strategy. J. Electron. Imaging, 19.","key":"ref_35","DOI":"10.1117\/1.3267105"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4522","DOI":"10.1109\/TIP.2012.2206044","article-title":"3D Steerable Wavelets in practice","volume":"21","author":"Chenouard","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1109\/TIP.2011.2166082","article-title":"RRED indices: Reduced reference entropic differencing for image quality assessment","volume":"21","author":"Soundararajan","year":"2012","journal-title":"IEEE Trans. Image Process."},{"unstructured":"Wolf, S. (2019, October 14). A No Reference (NR) and Reduced Reference (RR) Metric for Detecting Dropped Video Frames, NTIA Technical Memorandum TM-09-456, October 2008, Available online: https:\/\/www.its.bldrdoc.gov\/publications\/details.aspx?pub=2493.","key":"ref_38"},{"unstructured":"(2019, October 14). CVQM Source Code for Matlab, Available online: https:\/\/www.its.bldrdoc.gov\/resources\/video-quality-research\/guides-and-tutorials\/description-of-vqm-tools.aspx.","key":"ref_39"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4655\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:29:35Z","timestamp":1760189375000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/21\/4655"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,26]]},"references-count":39,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["s19214655"],"URL":"https:\/\/doi.org\/10.3390\/s19214655","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,10,26]]}}}