{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T16:32:39Z","timestamp":1782405159539,"version":"3.54.5"},"reference-count":27,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,8]],"date-time":"2022-01-08T00:00:00Z","timestamp":1641600000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Generating high-quality panorama is a key element in promoting the development of VR content. The panoramas generated by the traditional image stitching algorithm have some limitations, such as artifacts and irregular shapes. We consider solving this problem from the perspective of view synthesis. We propose a view synthesis approach based on optical flow to generate a high-quality omnidirectional panorama. In the first stage, we present a novel optical flow estimation algorithm to establish a dense correspondence between the overlapping areas of the left and right views. The result obtained can be approximated as the parallax of the scene. In the second stage, the reconstructed version of the left and the right views is generated by warping the pixels under the guidance of optical flow, and the alpha blending algorithm is used to synthesize the final novel view. Experimental results demonstrate that the subjective experience obtained by our approach is better than the comparison algorithm without cracks or artifacts. Besides the commonly used image quality assessment PSNR and SSIM, we also calculate MP-PSNR, which can provide accurate high-quality predictions for synthesized views. Our approach can achieve an improvement of about 1 dB in MP-PSNR and PSNR and 25% in SSIM, respectively.<\/jats:p>","DOI":"10.3390\/s22020470","type":"journal-article","created":{"date-parts":[[2022,1,9]],"date-time":"2022-01-09T23:08:26Z","timestamp":1641769706000},"page":"470","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Generating High-Quality Panorama by View Synthesis Based on Optical Flow Estimation"],"prefix":"10.3390","volume":"22","author":[{"given":"Wenxin","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yumei","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China"},{"name":"Research Center of Networks and Communications, Peng Cheng Laboratory, Shenzhen 518066, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China"},{"name":"Research Center of Networks and Communications, Peng Cheng Laboratory, Shenzhen 518066, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1007\/s11263-006-0002-3","article-title":"Automatic Panoramic Image Stitching using Invariant Features","volume":"74","author":"Brown","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zaragoza, J., Chin, T.-J., Brown, M.S., and Suter, D. (2013, January 23\u201328). As-projective-as-possible image stitching with moving dlt. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.303"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Chang, C.-H., Sato, Y., and Chuang, Y.-Y. (2014, January 23\u201328). Shape preserving half-projective warps for image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.422"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Lin, C.-C., Pankanti, S.U., Ramamurthy, K.N., and Aravkin, A.Y. (2015, January 7\u201312). Adaptive as-natural-as-possible image stitching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298719"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lin, K., Jiang, N., Cheong, L.-F., Do, M., and Lu, J. (2016, January 11\u201314). Seagull: Seam-guided local alignment for parallax-tolerant image stitching. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_23"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Thatte, J., and Girod, B. (2019, January 1\u20134). A statistical model for disocclusions in depth-based novel view synthesis. Proceedings of the 2019 IEEE Visual Communications and Image Processing (VCIP), Sydney, Australia.","DOI":"10.1109\/VCIP47243.2019.8966071"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zou, D., Ren, J.S., Jiang, Z., and Chen, X. (2019, January 15\u201320). Structure-preserving stereoscopic view synthesis with multi-scale adversarial correlation matching. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00601"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1828","DOI":"10.1109\/TVCG.2019.2898799","article-title":"MegaParallax: Casual 360\u00b0 Panoramas with Motion Parallax","volume":"25","author":"Bertel","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xu, B., and Jia, Y. (2017, January 17\u201320). Wide-angle image stitching using multihomography warping. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296525"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chai, Q., and Liu, S. (2016, January 11\u201315). Shape-optimizing hybrid warping for image stitching. Proceedings of the 2016 IEEE International Conference on Multimedia and Expo (ICME), Seattle, WA, USA.","DOI":"10.1109\/ICME.2016.7552928"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1109\/TMM.2019.2932573","article-title":"Stereoscopic Image Stitching via Disparity-Constrained Warping and Blending","volume":"22","author":"Fan","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Richardt, C., Pritch, Y., Zimmer, H., and Sorkine-Hornung, A. (2013, January 23\u201328). Megastereo: Constructing high resolution stereo panoramas. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.166"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1109\/34.910880","article-title":"Omnistereo: Panoramic stereo imaging","volume":"23","author":"Peleg","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","unstructured":"Stankiewicz, O., Wegner, K., Tanimoto, M., and Doma\u2019nski, M. (2021, June 07). Enhanced View Synthesis Reference Software (VSRS) for Free-VIEWPOINT Television. Available online: https:\/\/svn.multimedia.edu.pl\/vsrs."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2980179.2980251","article-title":"Learning-based view synthesis for light field cameras","volume":"35","author":"Kalantari","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2487228.2487238","article-title":"Depth synthesis and local warps for plausible image-based navigation","volume":"32","author":"Chaurasia","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_17","first-page":"1","article-title":"Stereo magnification: Learning view synthesis using multiplane images","volume":"37","author":"Zhou","year":"2018","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Flynn, J., Neulander, I., Philbin, J., and Snavely, N. (2016, January 27\u201330). Deepstereo: Learning to predict new views from the world\u2019s imagery. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.595"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2601097.2601195","article-title":"First-person hyper-lapse videos","volume":"33","author":"Kopf","year":"2014","journal-title":"ACM Trans. Graph."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Aliev, K.-A., Sevastopolsky, A., Kolos, M., Ulyanov, D., and Lempitsky, V. (2020). Neural point-based graphics. Computer Vision\u2013ECCV 2020: 16th European Conference, Glasgow, UK, 23\u201328 August 2020, Springer.","DOI":"10.1007\/978-3-030-58542-6_42"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3306346.3323035","article-title":"Deferred neural rendering: Image synthesis using neural textures","volume":"38","author":"Thies","year":"2019","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sitzmann, V., Thies, J., Heide, F., NieBner, M., Wetzstein, G., and Zollhofer, M. (2019, January 15\u201320). Deepvoxels: Learning persistent 3d feature embeddings. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00254"},{"key":"ref_23","unstructured":"Facebook (2022, January 04). Surround360 System, Surround360 Website. Available online: https:\/\/github.com\/facebook\/Surround360."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Honauer, K., Johannsen, O., Kondermann, D., and Goldluecke, B. (2016). A dataset and evaluation methodology for depth estimation on 4d light fields. Asian Conference on Computer Vision, Taipei, Taiwan, 20\u201324 November 2016, Springer.","DOI":"10.1007\/978-3-319-54187-7_2"},{"key":"ref_25","unstructured":"Scharstein, D., and Szeliski, R. (2003, January 18\u201320). High-accuracy stereo depth maps using structured light. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? The kitti vision benchmark suite. Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sandic-Stankovic, D., Kukolj, D., and Le Callet, P. (2015, January 8\u201310). Dibr synthesized image quality assessment based on morphological pyramids. Proceedings of the 2015 3DTV-Conference: The True Vision\u2014Capture, Transmission and Display of 3D Video (3DTVCON), Lisbon, Portugal.","DOI":"10.1109\/3DTV.2015.7169368"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/2\/470\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:13:13Z","timestamp":1760364793000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/2\/470"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,8]]},"references-count":27,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["s22020470"],"URL":"https:\/\/doi.org\/10.3390\/s22020470","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,8]]}}}