{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T17:29:44Z","timestamp":1754155784370,"version":"3.41.2"},"reference-count":39,"publisher":"Emerald","issue":"1","license":[{"start":{"date-parts":[[2016,4,4]],"date-time":"2016-04-04T00:00:00Z","timestamp":1459728000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJPCC"],"published-print":{"date-parts":[[2016,4,4]]},"abstract":"<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Purpose<\/jats:title>\n<jats:p>The Video Quality Metric (VQM) is one of the most used objective methods to assess video quality, because of its high correlation with the human visual system (HVS). VQM is, however, not viable in real-time deployments such as mobile streaming, not only due to its high computational demands but also because, as a Full Reference (FR) metric, it requires both the original video and its impaired counterpart. In contrast, No Reference (NR) objective algorithms operate directly on the impaired video and are considerably faster but loose out in accuracy. The purpose of this paper is to study how differently NR metrics perform in the presence of network impairments.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Design\/methodology\/approach<\/jats:title>\n<jats:p>The authors assess eight NR metrics, alongside a lightweight FR metric, using VQM as benchmark in a self-developed network-impaired video data set. This paper covers a range of methods, a diverse set of video types and encoding conditions and a variety of network impairment test-cases.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Findings<\/jats:title>\n<jats:p>The authors show the extent by which packet loss affects different video types, correlating the accuracy of NR metrics to the FR benchmark. This paper helps identifying the conditions under which simple metrics may be used effectively and indicates an avenue to control the quality of streaming systems.<\/jats:p>\n<\/jats:sec>\n<jats:sec>\n<jats:title content-type=\"abstract-subheading\">Originality\/value<\/jats:title>\n<jats:p>Most studies in literature have focused on assessing streams that are either unaffected by the network (e.g. looking at the effects of video compression algorithms) or are affected by synthetic network impairments (i.e. via simulated network conditions). The authors show that when streams are affected by real network conditions, assessing Quality of Experience becomes even harder, as the existing metrics perform poorly.<\/jats:p>\n<\/jats:sec>","DOI":"10.1108\/ijpcc-01-2016-0008","type":"journal-article","created":{"date-parts":[[2016,4,29]],"date-time":"2016-04-29T08:27:57Z","timestamp":1461918477000},"page":"66-86","source":"Crossref","is-referenced-by-count":17,"title":["An experimental survey of no-reference video quality assessment methods"],"prefix":"10.1108","volume":"12","author":[{"given":"Maria","family":"Torres Vega","sequence":"first","affiliation":[]},{"given":"Vittorio","family":"Sguazzo","sequence":"additional","affiliation":[]},{"given":"Decebal Constantin","family":"Mocanu","sequence":"additional","affiliation":[]},{"given":"Antonio","family":"Liotta","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"year":"2010","key":"key2020121619471232000_ref001","article-title":"A model of jerkiness for temporal impairments in video transmission"},{"issue":"11","key":"key2020121619471232000_ref002","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.1109\/TCSVT.2010.2077474","article-title":"No-reference quality assessment of h.264\/avc encoded video","volume":"20","year":"2010","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"issue":"2","key":"key2020121619471232000_ref003","first-page":"165","article-title":"Objective video quality assessment methods: a classification, review, and performance comparison","volume":"57","year":"2011","journal-title":"TBC"},{"issue":"2","key":"key2020121619471232000_ref004","article-title":"No-reference image quality assessment using blur and noise","volume":"3","year":"2009","journal-title":"International Journal of Electrical, Computer, Energetic, Electronic and Communication Engineering"},{"issue":"1","key":"key2020121619471232000_ref005","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1109\/TIP.2010.2053549","article-title":"No-reference blur assessment of digital pictures based on multifeature classifiers","volume":"20","year":"2011","journal-title":"IEEE Transactions on Image Processing"},{"first-page":"2949","article-title":"Human visual system based no-reference objective image sharpness metric","year":"2006","key":"key2020121619471232000_ref006"},{"issue":"7","key":"key2020121619471232000_ref007","first-page":"469","article-title":"No-reference image and video quality estimation: applications and human-motivated design","volume":"25","year":"2010","journal-title":"Signal Processing: Image Communication"},{"key":"key2020121619471232000_ref008","first-page":"216","article-title":"Use of content complexity factors in video over ip quality monitoring","volume-title":"International Workshop on Quality of Multimedia Experience","year":"2009"},{"first-page":"1244","article-title":"Hybrid no-reference video quality metric based on multiway plsr","year":"2012","key":"key2020121619471232000_ref009"},{"volume-title":"Kendall\u2019s Advanced Theory of Statistics","year":"1987","key":"key2020121619471232000_ref010"},{"year":"2012","key":"key2020121619471232000_ref011","article-title":"Qualinet white paper on definitions of quality of experience"},{"issue":"8","key":"key2020121619471232000_ref012","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/MSPEC.2013.6565557","article-title":"The cognitive NET is coming","volume":"50","year":"2013","journal-title":"IEEE Spectrum"},{"first-page":"525","article-title":"Instantaneous video quality assessment for lightweight devices","year":"2013","key":"key2020121619471232000_ref013"},{"year":"2008","key":"key2020121619471232000_ref014","article-title":"A no-reference perceptual blockiness metric"},{"issue":"3","key":"key2020121619471232000_ref016","first-page":"151","article-title":"The value of relative quality in video delivery","volume":"7","year":"2011","journal-title":"Journal of Mobile Multimedia"},{"issue":"4","key":"key2020121619471232000_ref015","first-page":"1","article-title":"Quality of experience models for multimedia streaming","volume":"2","year":"2010","journal-title":"IJMCMC"},{"first-page":"758","article-title":"Deep learning for objective quality assessment of 3d images","year":"2014","key":"key2020121619471232000_ref018"},{"year":"2014","key":"key2020121619471232000_ref017","article-title":"Network performance assessment with quality of experience benchmarks"},{"first-page":"1","article-title":"When does lower bitrate give higher quality in modern video services?","year":"2014","key":"key2020121619471232000_ref019"},{"first-page":"1278","article-title":"Reduced reference image quality assessment via boltzmann machines","year":"2015","key":"key2020121619471232000_ref020"},{"year":"2014","key":"key2020121619471232000_ref021","article-title":"A low computational complexity blockiness estimation based on spatial analysis"},{"issue":"3","key":"key2020121619471232000_ref022","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1109\/TBC.2004.834028","article-title":"A new standardized method for objectively measuring video quality","volume":"50","year":"2004","journal-title":"IEEE Transactions on Broadcasting"},{"issue":"2","key":"key2020121619471232000_ref023","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1049\/ip-vis:19990238","article-title":"Estimation of image noise variance","volume":"146","year":"1999","journal-title":"IEEE Proceedings Visual, Image, Signal Processing"},{"year":"2005","key":"key2020121619471232000_ref024","article-title":"Analyzing the spatial quality of internet streaming video"},{"issue":"6","key":"key2020121619471232000_ref025","doi-asserted-by":"crossref","first-page":"1427","DOI":"10.1109\/TIP.2010.2042111","article-title":"Study of subjective and objective quality assessment of video","volume":"19","year":"2010","journal-title":"IEEE Transactions on Image Processing"},{"first-page":"75270","article-title":"A subjective study to evaluate video quality assessment algorithms","year":"2010","key":"key2020121619471232000_ref026"},{"year":"2011","key":"key2020121619471232000_ref027","article-title":"A reduced complexity no-reference artificial neural network based video quality predictor"},{"issue":"1","key":"key2020121619471232000_ref028","article-title":"No-reference image and video quality assessment: a classification and review of recent approaches","volume":"40","year":"2014","journal-title":"EURASIP Journal on Image and Video Processing"},{"issue":"5","key":"key2020121619471232000_ref029","article-title":"Prediction of structural similarity index of compressed video at a macroblock level","volume":"18","year":"2011","journal-title":"IEEE Signal Processing Letters"},{"year":"2008","key":"key2020121619471232000_ref030","article-title":"Quantifying the influence of network conditions on the service quality experienced by a thin client user"},{"issue":"1","key":"key2020121619471232000_ref031","first-page":"116","article-title":"Assessing the qoe in video services over lossy networks","volume":"24","year":"2015","journal-title":"Journal of Network and Systems Management"},{"year":"2015","key":"key2020121619471232000_ref033","article-title":"Cognitive no-reference video quality assessment for mobile streaming services"},{"year":"2015","key":"key2020121619471232000_ref034","article-title":"Cognitive streaming on android devices"},{"year":"2015","key":"key2020121619471232000_ref035","article-title":"Accuracy of no-reference quality metrics in network-impaired video streams"},{"year":"2014","key":"key2020121619471232000_ref032","article-title":"End-to-end performance evaluation in high-speed wireless networks"},{"issue":"2","key":"key2020121619471232000_ref036","first-page":"121","article-title":"Video quality assessment based on structural distortion measurement","volume":"19","year":"2004","journal-title":"Signal Processing: Image Communication"},{"edition":"1 edn","volume-title":"Digital Video Quality: Vision Models and Metrics","year":"2005","key":"key2020121619471232000_ref037"},{"issue":"11","key":"key2020121619471232000_ref038","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1109\/97.641398","article-title":"A generalized block-edge impairment metric for video coding","volume":"4","year":"1997","journal-title":"IEEE Signal Processing Letters"},{"year":"2010","key":"key2020121619471232000_ref039","article-title":"Impact of frame rate and resolution on objective QoE metrics"}],"container-title":["International Journal of Pervasive Computing and Communications"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/IJPCC-01-2016-0008","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJPCC-01-2016-0008\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/IJPCC-01-2016-0008\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,24]],"date-time":"2025-07-24T22:05:08Z","timestamp":1753394708000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/ijpcc\/article\/12\/1\/66-86\/161170"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,4,4]]},"references-count":39,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2016,4,4]]}},"alternative-id":["10.1108\/IJPCC-01-2016-0008"],"URL":"https:\/\/doi.org\/10.1108\/ijpcc-01-2016-0008","relation":{},"ISSN":["1742-7371"],"issn-type":[{"type":"print","value":"1742-7371"}],"subject":[],"published":{"date-parts":[[2016,4,4]]}}}