{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:42:36Z","timestamp":1760233356104,"version":"build-2065373602"},"reference-count":23,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,30]],"date-time":"2022-12-30T00:00:00Z","timestamp":1672358400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61976164","62276182","61876221","2022GY-061"],"award-info":[{"award-number":["61976164","62276182","61876221","2022GY-061"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Natural Science Basic Research Program of Shaanxi","award":["61976164","62276182","61876221","2022GY-061"],"award-info":[{"award-number":["61976164","62276182","61876221","2022GY-061"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Panoramic videos are shot by an omnidirectional camera or a collection of cameras, and can display a view in every direction. They can provide viewers with an immersive feeling. The study of super-resolution of panoramic videos has attracted much attention, and many methods have been proposed, especially deep learning-based methods. However, due to complex architectures of all the methods, they always result in a large number of hyperparameters. To address this issue, we propose the first lightweight super-resolution method with self-calibrated convolution for panoramic videos. A new deformable convolution module is designed first, with self-calibration convolution, which can learn more accurate offset and enhance feature alignment. Moreover, we present a new residual dense block for feature reconstruction, which can significantly reduce the parameters while maintaining performance. The performance of the proposed method is compared to those of the state-of-the-art methods, and is verified on the MiG panoramic video dataset.<\/jats:p>","DOI":"10.3390\/s23010392","type":"journal-article","created":{"date-parts":[[2022,12,30]],"date-time":"2022-12-30T03:19:46Z","timestamp":1672370386000},"page":"392","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Lightweight Super-Resolution with Self-Calibrated Convolution for Panoramic Videos"],"prefix":"10.3390","volume":"23","author":[{"given":"Fanjie","family":"Shang","sequence":"first","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5961-5569","authenticated-orcid":false,"given":"Hongying","family":"Liu","sequence":"additional","affiliation":[{"name":"The Medical College, Tianjin University, Tianjin 300072, China"}]},{"given":"Wanhao","family":"Ma","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Yuanyuan","family":"Liu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Licheng","family":"Jiao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}]},{"given":"Fanhua","family":"Shang","sequence":"additional","affiliation":[{"name":"College of Intelligence and Computing, Tianjin University, Tianjin 300350, China"}]},{"given":"Lijun","family":"Wang","sequence":"additional","affiliation":[{"name":"Hangzhou Institute of Technology, Xidian University, Hangzhou 311231, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9447-6023","authenticated-orcid":false,"given":"Zhenyu","family":"Zhou","sequence":"additional","affiliation":[{"name":"Hunan University of Science and Engineering, Yongzhou 425199, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Wang, L., Guo, Y., Lin, Z., Deng, X., and An, W. (2018, January 2\u20136). Learning for video super-resolution through HR optical flow estimation. Proceedings of the Asian Conference on Computer Vision (ACCV), Perth, Australia.","DOI":"10.1007\/978-3-030-20887-5_32"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Tian, Y., Zhang, Y., Fu, Y., and Xu, C. (2020, January 13\u201319). TDAN: Temporally-deformable alignment network for video super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00342"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Wang, X., Chan, K.C.K., Yu, K., Dong, C., and Loy, C.C. (2019, January 15\u201320). EDVR: Video restoration with enhanced deformable convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Long Beach, CA, USA.","DOI":"10.1109\/CVPRW.2019.00247"},{"key":"ref_4","unstructured":"Liu, H., Ruan, Z., Fang, C., Zhao, P., Shang, F., Liu, Y., and Wang, L. (2020). A single frame and multi-frame joint network for 360-degree panorama video super-resolution. arXiv."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Caballero, J., Ledig, C., Aitken, A., Acosta, A., Totz, J., Wang, Z., and Shi, W. (2017, January 21\u201326). Real-time video super-resolution with spatio-temporal networks and motion compensation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.304"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"4323","DOI":"10.1109\/TIP.2020.2967596","article-title":"Deep video super-resolution using HR optical flow estimation","volume":"29","author":"Wang","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yi, P., Wang, Z., Jiang, K., Jiang, J., Lu, T., Tian, X., and Ma, J. (2021, January 10\u201317). Omniscient video super-resolution. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00439"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ozcinar, C., Rana, A., and Smolic, A. (2019, January 27\u201329). Super-resolution of omnidirectional images using adversarial learning. Proceedings of the 21st International Workshop on Multimedia Signal Processing (MMSP), Kuala Lumpur, Malaysia.","DOI":"10.1109\/MMSP.2019.8901764"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.-Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3151","DOI":"10.1109\/TIP.2011.2144609","article-title":"Joint registration and super-resolution with omnidirectional images","volume":"20","author":"Arican","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bagnato, L., Boursier, Y., Frossard, P., and Vandergheynst, P. (2010, January 26\u201329). Plenoptic based super-resolution for omnidirectional image sequences. Proceedings of the IEEE International Conference on Image Processing (ICIP), Hong Kong, China.","DOI":"10.1109\/ICIP.2010.5652095"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Rivadeneira, R.E., Sappa, A.D., Vintimilla, B.X., and Hammoud, R. (2022). A Novel Domain Transfer-Based Approach for Unsupervised Thermal Image Super-Resolution. Sensors, 12.","DOI":"10.3390\/s22062254"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kim, B., Jin, Y., Lee, J., and Kim, S. (2021). High-Efficiency Super-Resolution FMCW Radar Algorithm Based on FFT Estimation. Sensors, 21.","DOI":"10.3390\/s21124018"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Fakour-Sevom, V., Guldogan, E., and K\u00e4m\u00e4r\u00e4inen, J.-K. (2018, January 27\u201329). 360 panorama super-resolution using deep convolutional networks. Proceedings of the International Conference on Computer Vision Theory and Applications (VISAPP), Funchal, Portugal.","DOI":"10.5220\/0006618901590165"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014, January 6\u201312). Learning a deep convolutional network for image super-resolution. Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Li, S., Lin, C., Liao, K., Zhao, Y., and Zhang, X. (2020, January 22\u201326). Panoramic image quality-enhancement by fusing neural textures of the adaptive initial viewport. Proceedings of the IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Atlanta, GA, USA.","DOI":"10.1109\/VRW50115.2020.00259"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, J.-J., Hou, Q., Cheng, M., Wang, C., and Feng, J. (2020, January 13\u201319). Improving convolutional networks with self-calibrated convolutions. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01011"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Maaten, L.V.D., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhang, X., Zhou, X., Lin, M., and Sun, J. (2018, January 18\u201323). Shufflenet: An extremely efficient convolutional neural network for mobile devices. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00716"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ma, N., Zhang, X., Zheng, H., and Sun, J. (2018, January 8\u201314). Shufflenet V2: Practical guidelines for efficient CNN architecture design. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01264-9_8"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1109\/TCI.2016.2532323","article-title":"Video super-resolution with convolutional neural networks","volume":"2","author":"Kappeler","year":"2016","journal-title":"IEEE Trans. Comput. Imaging"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sajjadi, M.S.M., Vemulapalli, R., and Brown, M. (2018, January 18\u201323). Frame-recurrent video super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00693"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Du, J., Cheng, K., Yu, Y., Wang, D., and Zhou, H. (2021). Panchromatic Image super-resolution via self attention-augmented wasserstein generative adversarial network. Sensors, 21.","DOI":"10.3390\/s21062158"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/392\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:56:07Z","timestamp":1760147767000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/1\/392"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,30]]},"references-count":23,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23010392"],"URL":"https:\/\/doi.org\/10.3390\/s23010392","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2022,12,30]]}}}