{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T15:22:33Z","timestamp":1771514553307,"version":"3.50.1"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T00:00:00Z","timestamp":1709251200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T00:00:00Z","timestamp":1709251200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100010909","name":"Young Scientists Fund","doi-asserted-by":"publisher","award":["62001432"],"award-info":[{"award-number":["62001432"]}],"id":[{"id":"10.13039\/501100010909","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["CUC18LG024"],"award-info":[{"award-number":["CUC18LG024"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Vis. Intell."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Acquiring high-resolution light fields (LFs) is expensive. LF angular superresolution aims to synthesize the required number of views from a given sparse set of spatially high-resolution images. Existing methods struggle with sparsely sampled LFs captured with large baselines. Some methods rely on depth estimation and view reprojection, and are sensitive to textureless and occluded regions. Other non-depth based methods suffer from aliasing or blurring effects due to the large disparity. In addition, most methods require specific models for different interpolation rates, which reduces their flexibility in practice. In this paper, we propose a learning framework that overcomes these challenges by exploiting the global and local structures of LFs. Our framework includes aggregation across both the angular and spatial dimensions to fully exploit the input data and a novel bilateral upsampling module that upsamples each epipolar plane image while better preserving its local parallax structure. Furthermore, our method predicts the weights of the interpolation filters based on both subpixel offset and range difference, allowing angular superresolution at different rates with a single model. We show that our non-depth based method outperforms the state-of-the-art methods in terms of handling large disparities and flexibility on both real-world and synthetic LF images.<\/jats:p>","DOI":"10.1007\/s44267-024-00039-w","type":"journal-article","created":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T06:02:35Z","timestamp":1709272955000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["GLGNet: light field angular superresolution with arbitrary interpolation rates"],"prefix":"10.1007","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9963-6110","authenticated-orcid":false,"given":"Li","family":"Fang","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0288-9221","authenticated-orcid":false,"given":"Qian","family":"Wang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3562-5612","authenticated-orcid":false,"given":"Long","family":"Ye","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,3,1]]},"reference":[{"issue":"3","key":"39_CR1","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1145\/1073204.1073259","volume":"24","author":"B. Wilburn","year":"2005","unstructured":"Wilburn, B., Joshi, N., Vaish, V., Talvala, E. V., Ant\u00fanez, E., Barth, A., et al. (2005). High performance imaging using large camera arrays. ACM Transactions on Graphics, 24(3), 765\u2013776.","journal-title":"ACM Transactions on Graphics"},{"key":"39_CR2","volume-title":"Proceedings of the 8th international conference on quality of multimedia experience","author":"M. Rerabek","year":"2016","unstructured":"Rerabek, M., & Ebrahimi, T. (2016). New light field image dataset. [Paper presentation]. Proceedings of the 8th international conference on quality of multimedia experience. Lisbon, Portugal."},{"key":"39_CR3","unstructured":"Ng, R., Levoy, M., Br\u00e9dif, M., Duval, G., Horowitz, M., & Hanrahan, P. (2005). Light field photography with a hand-held plenoptic camera. Technical report, Stanford University."},{"issue":"6","key":"39_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2980179.2980251","volume":"35","author":"N. K. Kalantari","year":"2016","unstructured":"Kalantari, N. K., Wang, T. C., & Ramamoorthi, R. (2016). Learning-based view synthesis for light field cameras. ACM Transactions on Graphics, 35(6), 1\u201310.","journal-title":"ACM Transactions on Graphics"},{"key":"39_CR5","first-page":"6319","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"G. Wu","year":"2017","unstructured":"Wu, G., Zhao, M., Wang, L., Dai, Q., Chai, T., & Liu, Y. (2017). Light field reconstruction using deep convolutional network on EPI. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 6319\u20136327). Piscataway: IEEE."},{"key":"39_CR6","first-page":"333","volume-title":"Proceedings of the European conference on computer vision","author":"Y. Wang","year":"2018","unstructured":"Wang, Y., Liu, F., Wang, Z., Hou, G., Sun, Z., & Tan, T. (2018). End-to-end view synthesis for light field imaging with pseudo 4DCNN. In Proceedings of the European conference on computer vision (pp. 333\u2013348). Cham: Springer."},{"key":"39_CR7","first-page":"137","volume-title":"Proceedings of the European conference on computer vision","author":"H. W. F. Yeung","year":"2018","unstructured":"Yeung, H. W. F., Hou, J., Chen, J., Chung, Y. Y., & Chen, X. (2018). Fast light field reconstruction with deep coarse-to-fine modeling of spatial-angular clues. In Proceedings of the European conference on computer vision (pp. 137\u2013152). Cham: Springer."},{"issue":"7","key":"39_CR8","doi-asserted-by":"publisher","first-page":"3261","DOI":"10.1109\/TIP.2019.2895463","volume":"28","author":"G. Wu","year":"2019","unstructured":"Wu, G., Liu, Y., Dai, Q., & Chai, T. (2019). Learning sheared EPI structure for light field reconstruction. IEEE Transactions on Image Processing, 28(7), 3261\u20133273.","journal-title":"IEEE Transactions on Image Processing"},{"key":"39_CR9","first-page":"11141","volume-title":"Proceedings of the AAAI conference on artificial intelligence","author":"J. Jin","year":"2020","unstructured":"Jin, J., Hou, J., Yuan, H., & Kwong, S. (2020). Learning light field angular super-resolution via a geometry-aware network. In Proceedings of the AAAI conference on artificial intelligence (pp. 11141\u201311148). Palo Alto: AAAI Press."},{"key":"39_CR10","volume":"2022","author":"Q. Wang","year":"2022","unstructured":"Wang, Q., Fang, L., Ye, L., Zhong, W., Hu, F., & Zhang, Q. (2022). Flexible light field angular superresolution via a deep coarse-to-fine framework. Wireless Communications and Mobile Computing, 2022, Article No. 4570755.","journal-title":"Wireless Communications and Mobile Computing"},{"issue":"1","key":"39_CR11","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1109\/TPAMI.2022.3152488","volume":"45","author":"Y. Wang","year":"2023","unstructured":"Wang, Y., Wang, L., Wu, G., Yang, J., An, W., Yu, J., et al. (2023). Disentangling light fields for super-resolution and disparity estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(1), 425\u2013443.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"39_CR12","first-page":"5515","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"J. Flynn","year":"2016","unstructured":"Flynn, J., Neulander, I., Philbin, J., & Snavely, N. (2016). Deepstereo: learning to predict new views from the world\u2019s imagery. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 5515\u20135524). Piscataway: IEEE."},{"issue":"6","key":"39_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3130800.3130855","volume":"36","author":"E. Penner","year":"2017","unstructured":"Penner, E., & Zhang, L. (2017). Soft 3D reconstruction for view synthesis. ACM Transactions on Graphics, 36(6), 1\u201311.","journal-title":"ACM Transactions on Graphics"},{"key":"39_CR14","first-page":"24","volume-title":"Proceedings of the IEEE international conference on computer vision workshops","author":"Y. Yoon","year":"2015","unstructured":"Yoon, Y., Jeon, H. G., Yoo, D., Lee, J. Y., & So Kweon, I. (2015). Learning a deep convolutional network for light-field image super-resolution. In Proceedings of the IEEE international conference on computer vision workshops (pp. 24\u201332). Piscataway: IEEE."},{"issue":"9","key":"39_CR15","first-page":"5430","volume":"44","author":"G. Wu","year":"2021","unstructured":"Wu, G., Liu, Y., Fang, L., & Chai, T. (2021). Revisiting light field rendering with deep anti-aliasing neural network. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(9), 5430\u20135444.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"3","key":"39_CR16","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1109\/TPAMI.2013.147","volume":"36","author":"S. Wanner","year":"2013","unstructured":"Wanner, S., & Goldluecke, B. (2013). Variational light field analysis for disparity estimation and super-resolution. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(3), 606\u2013619.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"4","key":"39_CR17","first-page":"1","volume":"32","author":"C. Kim","year":"2013","unstructured":"Kim, C., Zimmer, H., Pritch, Y., Sorkine-Hornung, A., & Gross, M. H. (2013). Scene reconstruction from high spatio-angular resolution light fields. ACM Transactions on Graphics, 32(4), 1\u201312.","journal-title":"ACM Transactions on Graphics"},{"key":"39_CR18","first-page":"41","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"S. Wanner","year":"2012","unstructured":"Wanner, S., & Goldluecke, B. (2012). Globally consistent depth labeling of 4D light fields. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 41\u201348). Piscataway: IEEE."},{"key":"39_CR19","first-page":"1547","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"H. G. Jeon","year":"2015","unstructured":"Jeon, H. G., Park, J., Choe, G., Park, J., Bok, Y., Tai, Y. W., et al. (2015). Accurate depth map estimation from a lenslet light field camera. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1547\u20131555). Piscataway: IEEE."},{"key":"39_CR20","first-page":"2243","volume-title":"Proceedings of the IEEE international conference on computer vision","author":"P. P. Srinivasan","year":"2017","unstructured":"Srinivasan, P. P., Wang, T., Sreelal, A., Ramamoorthi, R., & Ng, R. (2017). Learning to synthesize a 4D RGBD light field from a single image. In Proceedings of the IEEE international conference on computer vision (pp. 2243\u20132251). Piscataway: IEEE."},{"issue":"4","key":"39_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3197517.3201292","volume":"37","author":"T. Zhou","year":"2018","unstructured":"Zhou, T., Tucker, R., Flynn, J., Fyffe, G., & Snavely, N. (2018). Stereo magnification: learning view synthesis using multiplane images. ACM Transactions on Graphics, 37(4), 1\u201312.","journal-title":"ACM Transactions on Graphics"},{"key":"39_CR22","doi-asserted-by":"crossref","unstructured":"Mildenhall, B., Srinivasan, P. P., Ortiz-Cayon, R., Kalantari, N. K., Ramamoorthi, R., Ng, R., et\u00a0al. Local light field fusion: practical view synthesis with prescriptive sampling guidelines. ACM Transactions on Graphics, 38(4), 1\u201314.","DOI":"10.1145\/3306346.3322980"},{"issue":"4","key":"39_CR23","doi-asserted-by":"publisher","first-page":"1819","DOI":"10.1109\/TPAMI.2020.3026039","volume":"44","author":"J. Jin","year":"2020","unstructured":"Jin, J., Hou, J., Chen, J., Zeng, H., Kwong, S., & Yu, J. (2020). Deep coarse-to-fine dense light field reconstruction with flexible sampling and geometry-aware fusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(4), 1819\u20131836.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"39_CR24","first-page":"22","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition workshops","author":"K. Mitra","year":"2012","unstructured":"Mitra, K., & Veeraraghavan, A. (2012). Light field denoising, light field superresolution and stereo camera based refocussing using a GMM light field patch prior. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops (pp. 22\u201328). Piscataway: IEEE."},{"issue":"1","key":"39_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2682631","volume":"34","author":"L. Shi","year":"2014","unstructured":"Shi, L., Hassanieh, H., Davis, A., Katabi, D., & Durand, F. (2014). Light field reconstruction using sparsity in the continuous Fourier domain. ACM Transactions on Graphics, 34(1), 1\u201313.","journal-title":"ACM Transactions on Graphics"},{"issue":"1","key":"39_CR26","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1109\/TPAMI.2017.2653101","volume":"40","author":"S. Vagharshakyan","year":"2017","unstructured":"Vagharshakyan, S., Bregovic, R., & Gotchev, A. (2017). Light field reconstruction using shearlet transform. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(1), 133\u2013147.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"39_CR27","first-page":"88","volume-title":"Proceedings of the 10th European conference on computer vision","author":"A. Levin","year":"2008","unstructured":"Levin, A., Freeman, W. T., & Durand, F. (2008). Understanding camera trade-offs through a Bayesian analysis of light field projections. In D. A. Forsyth, P. H. S. Torr, & A. Zisserman (Eds.), Proceedings of the 10th European conference on computer vision (pp. 88\u2013101). Cham: Springer."},{"issue":"4","key":"39_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2461912.2461914","volume":"32","author":"K. Marwah","year":"2013","unstructured":"Marwah, K., Wetzstein, G., Bando, Y., & Raskar, R. (2013). Compressive light field photography using overcomplete dictionaries and optimized projections. ACM Transactions on Graphics, 32(4), 1\u201312.","journal-title":"ACM Transactions on Graphics"},{"key":"39_CR29","doi-asserted-by":"publisher","first-page":"830","DOI":"10.1109\/TCI.2020.2986092","volume":"6","author":"Y. Wang","year":"2020","unstructured":"Wang, Y., Liu, F., Zhang, K., Wang, Z., Sun, Z., & Tan, T. (2020). High-fidelity view synthesis for light field imaging with extended pseudo 4DCNN. IEEE Transactions on Computational Imaging, 6, 830\u2013842.","journal-title":"IEEE Transactions on Computational Imaging"},{"key":"39_CR30","doi-asserted-by":"publisher","first-page":"171009","DOI":"10.1109\/ACCESS.2020.3023505","volume":"8","author":"L. Fang","year":"2020","unstructured":"Fang, L., Zhong, W., Ye, L., Li, R., & Zhang, Q. (2020). Light field reconstruction with a hybrid sparse regularization-pseudo 4DCNN framework. IEEE Access, 8, 171009\u2013171020.","journal-title":"IEEE Access"},{"key":"39_CR31","doi-asserted-by":"publisher","first-page":"8999","DOI":"10.1109\/TIP.2021.3122089","volume":"30","author":"G. Wu","year":"2021","unstructured":"Wu, G., Wang, Y., Liu, Y., Fang, L., & Chai, T. (2021). Spatial-angular attention network for light field reconstruction. IEEE Transactions on Image Processing, 30, 8999\u20139013.","journal-title":"IEEE Transactions on Image Processing"},{"key":"39_CR32","first-page":"2472","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"Y. Zhang","year":"2018","unstructured":"Zhang, Y., Tian, Y., Kong, Y., Zhong, B., & Fu, Y. (2018). Residual dense network for image super-resolution. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2472\u20132481). Piscataway: IEEE."},{"key":"39_CR33","first-page":"1874","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"W. Shi","year":"2016","unstructured":"Shi, W., Caballero, J., Husz\u00e1r, F., Totz, J., Aitken, A. P., Bishop, R., et al. (2016). Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1874\u20131883). Piscataway: IEEE."},{"key":"39_CR34","first-page":"1575","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition","author":"X. Hu","year":"2019","unstructured":"Hu, X., Mu, H., Zhang, X., Wang, Z., Tan, T., & Sun, J. (2019). Meta-SR: a magnification-arbitrary network for super-resolution. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 1575\u20131584). Piscataway: IEEE."},{"key":"39_CR35","first-page":"7794","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"X. Wang","year":"2018","unstructured":"Wang, X., Girshick, R., Gupta, A., & He, K. (2018). Non-local neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 7794\u20137803). Piscataway: IEEE."},{"key":"39_CR36","first-page":"1511","volume-title":"Proceedings of the IEEE international conference on computer vision","author":"Q. Chen","year":"2017","unstructured":"Chen, Q., & Koltun, V. (2017). Photographic image synthesis with cascaded refinement networks. In Proceedings of the IEEE international conference on computer vision (pp. 1511\u20131520). Piscataway: IEEE."},{"key":"39_CR37","volume-title":"Proceedings of the 3rd international conference on learning representations","author":"K. Simonyan","year":"2015","unstructured":"Simonyan, K., & Zisserman, A. (2015). Very deep convolutional networks for large-scale image recognition. [Paper presentation]. Proceedings of the 3rd international conference on learning representations. San Diego, US."},{"key":"39_CR38","first-page":"19","volume-title":"Proceedings of the 13th Asian conference on computer vision","author":"K. Honauer","year":"2017","unstructured":"Honauer, K., Johannsen, O., Kondermann, D., & Goldluecke, B. (2017). A dataset and evaluation methodology for depth estimation on 4D light fields. In Proceedings of the 13th Asian conference on computer vision (pp. 19\u201334). Cham: Springer."},{"key":"39_CR39","unstructured":"Raj, A. S., Lowney, M., Shah, R., & Wetzstein, G. (2016). Stanford lytro light field archive. Retrieved December 22, 2023, from http:\/\/lightfields.stanford.edu\/LF2016.html."},{"key":"39_CR40","first-page":"225","volume-title":"Proceedings of the 18th international workshop on vision, modeling, and visualization","author":"S. Wanner","year":"2013","unstructured":"Wanner, S., Meister, S., & Goldluecke, B. (2013). Datasets and benchmarks for densely sampled 4D light fields. In Proceedings of the 18th international workshop on vision, modeling, and visualization (pp. 225\u2013226). Aire-la-Ville: Eurographics Association."},{"issue":"12","key":"39_CR41","doi-asserted-by":"publisher","first-page":"5867","DOI":"10.1109\/TIP.2019.2923323","volume":"28","author":"J. Shi","year":"2019","unstructured":"Shi, J., Jiang, X., & Guillemot, C. (2019). A framework for learning depth from a flexible subset of dense and sparse light field views. IEEE Transactions on Image Processing, 28(12), 5867\u20135880.","journal-title":"IEEE Transactions on Image Processing"}],"container-title":["Visual Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44267-024-00039-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44267-024-00039-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44267-024-00039-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,1]],"date-time":"2024-03-01T06:05:41Z","timestamp":1709273141000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44267-024-00039-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,1]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["39"],"URL":"https:\/\/doi.org\/10.1007\/s44267-024-00039-w","relation":{},"ISSN":["2731-9008"],"issn-type":[{"value":"2731-9008","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,1]]},"assertion":[{"value":"8 August 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 February 2024","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 February 2024","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 March 2024","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no competing interests to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"6"}}