{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T21:07:18Z","timestamp":1761599238246,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2022,9,19]],"date-time":"2022-09-19T00:00:00Z","timestamp":1663545600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972239","62071122","2020GY-024","2021GY-182"],"award-info":[{"award-number":["61972239","62071122","2020GY-024","2021GY-182"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Key Research and Development Program Projects of Shaanxi Province","award":["61972239","62071122","2020GY-024","2021GY-182"],"award-info":[{"award-number":["61972239","62071122","2020GY-024","2021GY-182"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The quality of synthesized images directly affects the practical application of virtual view synthesis technology, which typically uses a depth-image-based rendering (DIBR) algorithm to generate a new viewpoint based on texture and depth images. Current view synthesis quality metrics commonly evaluate the quality of DIBR-synthesized images, where the DIBR process is computationally expensive and time-consuming. In addition, the existing view synthesis quality metrics cannot achieve robustness due to the shallow hand-crafted features. To avoid the complicated DIBR process and learn more efficient features, this paper presents a blind quality prediction model for view synthesis based on HEterogeneous DIstortion Perception, dubbed HEDIP, which predicts the image quality of view synthesis from texture and depth images. Specifically, the texture and depth images are first fused based on discrete cosine transform to simulate the distortion of view synthesis images, and then the spatial and gradient domain features are extracted in a Two-Channel Convolutional Neural Network (TCCNN). Finally, a fully connected layer maps the extracted features to a quality score. Notably, the ground-truth score of the source image cannot effectively represent the labels of each image patch during training due to the presence of local distortions in view synthesis image. So, we design a Heterogeneous Distortion Perception (HDP) module to provide effective training labels for each image patch. Experiments show that with the help of the HDP module, the proposed model can effectively predict the quality of view synthesis. Experimental results demonstrate the effectiveness of the proposed model.<\/jats:p>","DOI":"10.3390\/s22187081","type":"journal-article","created":{"date-parts":[[2022,9,20]],"date-time":"2022-09-20T04:28:55Z","timestamp":1663648135000},"page":"7081","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Blind Quality Prediction for View Synthesis Based on Heterogeneous Distortion Perception"],"prefix":"10.3390","volume":"22","author":[{"given":"Haozhi","family":"Shi","sequence":"first","affiliation":[{"name":"School of Physics, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3095-6655","authenticated-orcid":false,"given":"Lanmei","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Physics, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guibao","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Physics and Telecommunication Engineering, Shaanxi University of Technology, Hanzhong 723001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/MSP.2010.939077","article-title":"Free-viewpoint TV","volume":"28","author":"Tanimoto","year":"2010","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_2","unstructured":"Tehrani, M.P., Senoh, T., Okui, M., Yamamoto, K., Inoue, N., Fujii, T., and Nakamura, H. (2013). Proposal to Consider a New Work Item and Its Use Case-Rei: An Ultra-Multiview 3D Display, ISO. ISO\/IEC JTC1\/SC29\/WG11\/m30022."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1332","DOI":"10.1109\/JSTSP.2011.2166245","article-title":"Towards a new quality metric for 3-D synthesized view assessment","volume":"5","author":"Bosc","year":"2011","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1109\/LSP.2020.2988830","article-title":"Blind quality index of depth images based on structural statistics for view synthesis","volume":"27","author":"Huang","year":"2020","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.apgeog.2018.01.016","article-title":"GIS numerical and remote sensing analyses of forest changes in the Toplica region for the period of 1953\u20132013","volume":"92","year":"2018","journal-title":"Appl. Geogr."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1109\/TMM.2017.2760062","article-title":"Quality assessment of DIBR-synthesized images by measuring local geometric distortions and global sharpness","volume":"20","author":"Li","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1613","DOI":"10.1109\/TIP.2022.3144892","article-title":"VCRNet: Visual Compensation Restoration Network for No-Reference Image Quality Assessment","volume":"31","author":"Pan","year":"2022","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2117","DOI":"10.1109\/TIP.2005.859389","article-title":"An information fidelity criterion for image quality assessment using natural scene statistics","volume":"14","author":"Sheikh","year":"2005","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1109\/TIP.2005.859378","article-title":"Image information and visual quality","volume":"15","author":"Sheikh","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","unstructured":"Gu, K., Zhai, G., Yang, X., and Zhang, W. (2013, January 19\u201323). A new reduced-reference image quality assessment using structural degradation model. Proceedings of the 2013 IEEE International Symposium on Circuits and Systems (ISCAS), Brijing, China."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1680","DOI":"10.1109\/TIP.2005.864165","article-title":"Quality-aware images","volume":"15","author":"Wang","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"105928","DOI":"10.1016\/j.asoc.2019.105928","article-title":"Fuzzy C-means clustering through SSIM and patch for image segmentation","volume":"87","author":"Tang","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1109\/LSP.2010.2043888","article-title":"A two-step framework for constructing blind image quality indices","volume":"17","author":"Moorthy","year":"2010","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4695","DOI":"10.1109\/TIP.2012.2214050","article-title":"No-reference image quality assessment in the spatial domain","volume":"21","author":"Mittal","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","article-title":"Making a \u201ccompletely blind\u201d image quality analyzer","volume":"20","author":"Mittal","year":"2013","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kang, L., Ye, P., Li, Y., and Doermann, D. (2014, January 23\u201328). Convolutional neural networks for no-reference image quality assessment. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.224"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2200","DOI":"10.1109\/TIP.2018.2883741","article-title":"Two-stream convolutional networks for blind image quality assessment","volume":"28","author":"Yan","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2603","DOI":"10.1109\/TMM.2019.2904879","article-title":"Naturalness-aware deep no-reference image quality assessment","volume":"21","author":"Yan","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Tian, S., Zhang, L., Morin, L., and Deforges, O. (2017, January 5\u20139). NIQSV: A no reference image quality assessment metric for 3D synthesized views. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.","DOI":"10.1109\/ICASSP.2017.7952356"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1652","DOI":"10.1109\/TIP.2017.2781420","article-title":"NIQSV+: A no-reference synthesized view quality assessment metric","volume":"27","author":"Tian","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1109\/TIP.2017.2733164","article-title":"Model-based referenceless quality metric of 3D synthesized images using local image description","volume":"27","author":"Gu","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, J., Wang, S., Zeng, K., and Wang, Z. (2017, January 10\u201314). Quality assessment of multi-view-plus-depth images. Proceedings of the 2017 IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, China.","DOI":"10.1109\/ICME.2017.8019542"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1109\/TMM.2017.2748460","article-title":"No-reference view synthesis quality prediction for 3-D videos based on color\u2013depth interactions","volume":"20","author":"Shao","year":"2017","journal-title":"IEEE Trans. Multimed."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2509","DOI":"10.1109\/TCSVT.2020.3024882","article-title":"Predicting the quality of view synthesis with color-depth image fusion","volume":"31","author":"Li","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"473","DOI":"10.1080\/01431160500207088","article-title":"Sub-pixel mapping of rural land cover objects from fine spatial resolution satellite sensor imagery using super-resolution pixel-swapping","volume":"27","author":"Thornton","year":"2006","journal-title":"Int. J. Remote Sens."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"990","DOI":"10.1109\/LSP.2020.2999788","article-title":"A fast image fusion with discrete cosine transform","volume":"27","author":"Wang","year":"2020","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5524","DOI":"10.1109\/TIP.2019.2919416","article-title":"Fast blind quality assessment of DIBR-synthesized video based on high-high wavelet subband","volume":"28","author":"Kukolj","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/TBC.2019.2906768","article-title":"Multiscale natural scene statistical analysis for no-reference quality evaluation of DIBR-synthesized views","volume":"66","author":"Gu","year":"2019","journal-title":"IEEE Trans. Broadcast."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"4566","DOI":"10.1109\/TIP.2019.2912463","article-title":"No-reference quality assessment for view synthesis using DoG-based edge statistics and texture naturalness","volume":"28","author":"Zhou","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1802","DOI":"10.1109\/TIP.2019.2945675","article-title":"Blind quality metric of DIBR-synthesized images in the discrete wavelet transform domain","volume":"29","author":"Wang","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1109\/TMM.2020.2980185","article-title":"Quality index for view synthesis by measuring instance degradation and global appearance","volume":"23","author":"Li","year":"2021","journal-title":"IEEE Trans. Multimed."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/T-C.1974.223784","article-title":"Discrete cosine transform","volume":"C-23","author":"Ahmed","year":"1974","journal-title":"IEEE Trans. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Huang, Y., Meng, X., and Li, L. (2020, January 6\u20138). No-reference quality prediction for DIBR-synthesized images using statistics of fused color-depth images. Proceedings of the 2020 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR), Shenzhen, China.","DOI":"10.1109\/MIPR49039.2020.00035"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"Imagenet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_36","unstructured":"Song, R., Ko, H., and Kuo, C. (2014). MCL-3D: A database for stereoscopic image quality assessment using 2D-image-plus-depth source. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1737","DOI":"10.1109\/TMM.2018.2888830","article-title":"Blind quality assessment of 3-D synthesized views based on hybrid feature classes","volume":"21","author":"Rodrigues","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Farid, M.S., Lucenteforte, M., and Grangetto, M. (October, January 30). Depth image based rendering with inverse mapping. Proceedings of the 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP), Cagliari, Italy.","DOI":"10.1109\/MMSP.2013.6659277"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1314","DOI":"10.1049\/el.2020.1791","article-title":"DIBR-synthesised video quality assessment by measuring geometric distortion and spatiotemporal inconsistency","volume":"56","author":"Huang","year":"2020","journal-title":"Electron. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2579","DOI":"10.1109\/TIP.2015.2426416","article-title":"A feature-enriched completely blind image quality evaluator","volume":"24","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"4850","DOI":"10.1109\/TIP.2014.2355716","article-title":"Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features","volume":"23","author":"Xue","year":"2014","journal-title":"IEEE Trans. Image Process."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Sandi\u0107-Stankovi\u0107, D., Kukolj, D., and Le Callet, P. (2015, January 26\u201329). DIBR synthesized image quality assessment based on morphological wavelets. Proceedings of the 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX), Pilos, Greece.","DOI":"10.1109\/QoMEX.2015.7148143"},{"key":"ref_43","first-page":"3","article-title":"Multi-scale synthesized view assessment based on morphological pyramids","volume":"67","author":"Kukolj","year":"2016","journal-title":"J. Electr. Eng."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"4120","DOI":"10.1109\/TII.2018.2888861","article-title":"A highly efficient blind image quality assessment metric of 3-D synthesized images using outlier detection","volume":"15","author":"Jakhetiya","year":"2018","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_45","first-page":"1","article-title":"Viewpoint-Based Kernel Fuzzy Clustering With Weight Information Granules","volume":"2022","author":"Tang","year":"2022","journal-title":"IEEE Trans. Emerg. Top. Comput. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/7081\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:34:28Z","timestamp":1760142868000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/18\/7081"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,19]]},"references-count":45,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22187081"],"URL":"https:\/\/doi.org\/10.3390\/s22187081","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,9,19]]}}}