{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:45:56Z","timestamp":1760240756900,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2019,9,20]],"date-time":"2019-09-20T00:00:00Z","timestamp":1568937600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>When it comes to evaluating perceptual quality of digital media for overall quality of experience assessment in immersive video applications, typically two main approaches stand out: Subjective and objective quality evaluation. On one hand, subjective quality evaluation offers the best representation of perceived video quality assessed by the real viewers. On the other hand, it consumes a significant amount of time and effort, due to the involvement of real users with lengthy and laborious assessment procedures. Thus, it is essential that an objective quality evaluation model is developed. The speed-up advantage offered by an objective quality evaluation model, which can predict the quality of rendered virtual views based on the depth maps used in the rendering process, allows for faster quality assessments for immersive video applications. This is particularly important given the lack of a suitable reference or ground truth for comparing the available depth maps, especially when live content services are offered in those applications. This paper presents a no-reference depth map quality evaluation model based on a proposed depth map edge confidence measurement technique to assist with accurately estimating the quality of rendered (virtual) views in immersive multi-view video content. The model is applied for depth image-based rendering in multi-view video format, providing comparable evaluation results to those existing in the literature, and often exceeding their performance.<\/jats:p>","DOI":"10.3390\/fi11100204","type":"journal-article","created":{"date-parts":[[2019,9,20]],"date-time":"2019-09-20T10:48:14Z","timestamp":1568976494000},"page":"204","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["No-Reference Depth Map Quality Evaluation Model Based on Depth Map Edge Confidence Measurement in Immersive Video Applications"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1465-6495","authenticated-orcid":false,"given":"Safak","family":"Dogan","sequence":"first","affiliation":[{"name":"Institute for Digital Technologies, Loughborough University London, London, E20 3BS, UK"}]},{"given":"Nasser","family":"Haddad","sequence":"additional","affiliation":[{"name":"Inmarsat, London, EC1Y 1AX, UK"}]},{"given":"Erhan","family":"Ekmekcioglu","sequence":"additional","affiliation":[{"name":"Institute for Digital Technologies, Loughborough University London, London, E20 3BS, UK"}]},{"given":"Ahmet M.","family":"Kondoz","sequence":"additional","affiliation":[{"name":"Institute for Digital Technologies, Loughborough University London, London, E20 3BS, UK"}]}],"member":"1968","published-online":{"date-parts":[[2019,9,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1109\/TBC.2010.2102950","article-title":"3D-TV content storage and transmission","volume":"57","author":"Vetro","year":"2011","journal-title":"IEEE Trans. Broadcast."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Tanimoto, M. (July, January 28). Overview of FTV (Free-Viewpoint Television). Proceedings of the IEEE International Conference on Multimedia and Expo (ICME 2009), New York, NY, USA.","DOI":"10.1109\/ICME.2009.5202803"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Merkle, P., Smolic, A., Muller, K., and Wiegand, T. (2007, January 16\u201319). Multi-view video plus depth representation and coding. Proceedings of the IEEE International Conference on Image Processing (ICIP 2007), San Antonio, TX, USA.","DOI":"10.1109\/ICIP.2007.4378926"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1117\/12.524762","article-title":"Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV","volume":"5291","author":"Fehn","year":"2004","journal-title":"Proc. SPIE"},{"key":"ref_5","unstructured":"(2019, June 25). Middlebury Stereo Evaluation. Available online: http:\/\/vision.middlebury.edu\/stereo\/eval\/."},{"key":"ref_6","unstructured":"(2019, June 25). The KITTI Vision Benchmark Suite. Available online: http:\/\/www.cvlibs.net\/datasets\/kitti\/."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1023\/A:1014573219977","article-title":"A taxonomy and evaluation of dense two-frame stereo correspondence algorithms","volume":"47","author":"Scharstein","year":"2002","journal-title":"Int. J. Comp. Vis."},{"key":"ref_8","unstructured":"Yang, Q. (2012, January 16\u201321). A Non-local cost aggregation method for stereo matching. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2012), Providence, RI, USA."},{"key":"ref_9","unstructured":"Hirschmuller, H. (2005, January 20\u201325). Accurate and efficient stereo processing by semi-global matching and mutual information. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), San Diego, CA, USA."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1023\/A:1014554110407","article-title":"Real-time correlation-based stereo vision with reduced border errors","volume":"47","author":"Hirschmuller","year":"2002","journal-title":"Int. J. Comp. Vis."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1222","DOI":"10.1109\/34.969114","article-title":"Fast approximate energy minimization via graph cuts","volume":"23","author":"Boykov","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1109\/TPAMI.2003.1206509","article-title":"Stereo matching using belief propagation","volume":"25","author":"Sun","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ghanbari, M. (2011). Standard Codecs: Image Compression to Advanced Video Coding, IET. [3rd ed.].","DOI":"10.1049\/PBTE054E"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Fernando, A., Worrall, S.T., and Ekmekcioglu, E. (2013). 3DTV: Processing and Transmission of 3D Video Signals, John Wiley & Sons Ltd.. [3rd ed.].","DOI":"10.1002\/9781118705711"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1587\/transinf.2017MUP0011","article-title":"A study on quality metrics for 360 video communications","volume":"E101\u2013D","author":"Tran","year":"2018","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_16","first-page":"22","article-title":"Quality assessment in the context of FTV: Challenges, first answers and open issues","volume":"11","author":"Battisti","year":"2016","journal-title":"IEEE COMSOC MMTC Commun. Front."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1109\/JSTSP.2016.2632045","article-title":"Stereoscopic video quality assessment using binocular energy","volume":"11","author":"Galkandage","year":"2017","journal-title":"IEEE J. Sel. Top. Sig. Process."},{"key":"ref_18","first-page":"1","article-title":"Reduced-reference video quality assessment using a static video pattern","volume":"25","author":"Kourtis","year":"2016","journal-title":"Spie J. Electron. Imaging"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1109\/TBC.2019.2892092","article-title":"Reduced reference quality assessment of light field images","volume":"65","author":"Paudyal","year":"2019","journal-title":"IEEE Trans. Broadcast."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1652","DOI":"10.1109\/TIP.2017.2781420","article-title":"NIQSV+: A no-reference synthesized view quality assessment metric","volume":"27","author":"Tian","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1109\/TIP.2017.2766780","article-title":"Blind stereoscopic video quality assessment: From depth perception to overall experience","volume":"27","author":"Chen","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.ins.2017.05.051","article-title":"A no-reference optical flow-based quality evaluator for stereoscopic videos in curvelet domain","volume":"414","author":"Yang","year":"2017","journal-title":"Inf. Sci."},{"key":"ref_23","first-page":"1","article-title":"Assessing visual quality of omnidirectional videos","volume":"12","author":"Xu","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1918","DOI":"10.1109\/TIP.2005.854492","article-title":"No-reference quality assessment using natural scene statistics: JPEG2000","volume":"14","author":"Sheikh","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Moorthy, A.K., and Bovik, A.C. (2010, January 26\u201329). A Two-stage Framework for Blind Image Quality Assessment. Proceedings of the IEEE International Conference on Image Processing (ICIP 2010), Hong Kong, China.","DOI":"10.1109\/ICIP.2010.5651745"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1109\/LSP.2010.2043888","article-title":"A two-step framework for constructing blind image quality indices","volume":"17","author":"Moorthy","year":"2010","journal-title":"IEEE Sig. Process. Lett."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4695","DOI":"10.1109\/TIP.2012.2214050","article-title":"No-reference image quality assessment in the spatial domain","volume":"21","author":"Mittal","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","article-title":"Making a completely blind image quality analyzer","volume":"20","author":"Mittal","year":"2013","journal-title":"IEEE Sig. Process. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2798","DOI":"10.1109\/TIP.2013.2251643","article-title":"Image sharpness assessment based on local phase coherence","volume":"22","author":"Hassen","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1016\/j.image.2014.06.006","article-title":"No-reference image quality assessment based on spatial and spectral entropies","volume":"29","author":"Liu","year":"2014","journal-title":"Sig. Process. Image Commun."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1109\/TCSVT.2004.823391","article-title":"Stereo analysis by hybrid recursive matching for real-time immersive video conferencing","volume":"14","author":"Atzpadin","year":"2004","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mei, X., Sun, X., Dong, W., Wang, H., and Zhang, X. (2013, January 23\u201328). Segment-tree based cost aggregation for stereo matching. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2013), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.47"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Spangenberg, R., Langner, T., Adfeldt, S., and Rojas, R. (2014, January 8\u201311). Large scale semi-global matching on the CPU. Proceedings of the IEEE Intelligent Vehicles Symposium (IV 2014), Dearborn, MI, USA.","DOI":"10.1109\/IVS.2014.6856419"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Shen, Y., Li, J., and Lu, C. (2014, January 14\u201316). Depth map enhancement method based on joint bilateral filter. Proceedings of the International Congress on Image and Signal Processing (CISP 2014), Dalian, China.","DOI":"10.1109\/CISP.2014.7003768"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"De Silva, D.V.S.X., Fernando, W.A.C., Kodikaraarachchi, H., Worrall, S.T., and Kondoz, A.M. (2011, January 9\u201312). Improved depth map filtering for 3D-TV systems. Proceedings of the IEEE International Conference on Consumer Electronics (ICCE 2011), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2011.5722787"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Zhu, C., Zhao, Y., Yu, L., and Tanimoto, M. (2013). 3D-TV System with Depth-Image-Based Rendering: Architectures, Techniques and Challenges, Springer. [1st ed.].","DOI":"10.1007\/978-1-4419-9964-1"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Abdulkadir, A., and Sadka, A.H. (2013, January 12\u201314). Metric aspect of depth image-based rendering. Proceedings of the International Conference on Communications, Signal Processing, and their Applications (ICCSPA 2013), Sharjah, UAE.","DOI":"10.1109\/ICCSPA.2013.6487285"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Haddad, N., Dogan, S., Arachchi, H.K., De Silva, V., and Kondoz, A.M. (2014, January 2\u20134). A disocclusion replacement approach to subjective assessment for depth map quality evaluation. Proceedings of the 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON 2014), Budapest, Hungary.","DOI":"10.1109\/3DTV.2014.6874733"},{"key":"ref_39","unstructured":"International Telecommunication Union (2012). ITU-R BT. 500-13: Methodology for the Subjective Assessment of the Quality of Television Pictures, International Telecommunication Union."},{"key":"ref_40","unstructured":"International Telecommunication Union (2007). ITU-R BT. 1788: Methodology for the Subjective Assessment of Video Quality in Multimedia Applications, International Telecommunication Union."},{"key":"ref_41","unstructured":"Tanimoto, M., Fujii, M., Panahpour, M., and Wilderboer, M. (2009). Depth Estimation Reference Software DERS 5.0, International Organization for Standardization. Technical Report, ISO\/IEC JTC1\/SC29\/WG11."},{"key":"ref_42","unstructured":"Lee, S., and Ho, Y. (2008). Enhancement of Temporal Consistency for Multi-view Depth Map Estimation, International Organization for Standardization. ISO\/IEC MPEG Doc. M15594."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1109\/TPAMI.2012.156","article-title":"Fast Cost-Volume Filtering for Visual Correspondence and Beyond","volume":"35","author":"Hosni","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_44","unstructured":"International Telecommunication Union (2010). ITU-R J.340: Reference Algorithm for Computing Peak Signal to Noise Ratio of a Processed Video Sequence with Compensation for Constant Spatial Shifts, Constant Temporal Shift, and Constant Luminance Gain and Offset, International Telecommunication Union."},{"key":"ref_45","unstructured":"Zhao, Y., and Yu, L. (2009). Perceptual Measurement for Evaluating Quality of View Synthesis, International Organization for Standardization. ISO\/IEC MPEG Doc. M16407."},{"key":"ref_46","unstructured":"Wang, Z., Lu, L., and Bovik, A.C. (2002, January 22\u201325). Video quality assessment using structural distortion measurement. Proceedings of the IEEE International Conference on Image Processing (ICIP 2002), Rochester, NY, USA."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1109\/TBC.2004.834028","article-title":"A new standardized method for objectively measuring video quality","volume":"50","author":"Pinson","year":"2004","journal-title":"IEEE Trans. Broadcast."},{"key":"ref_48","unstructured":"(2019, June 25). Laboratory for Image and Video Engineering\u2014The University of Texas at Austin. Available online: http:\/\/live.ece.utexas.edu\/research\/quality\/index.htm."}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/10\/204\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:22:11Z","timestamp":1760188931000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/10\/204"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,20]]},"references-count":48,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["fi11100204"],"URL":"https:\/\/doi.org\/10.3390\/fi11100204","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2019,9,20]]}}}