{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T18:27:18Z","timestamp":1779906438852,"version":"3.53.1"},"reference-count":29,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T00:00:00Z","timestamp":1729641600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"faculty research fund of Sejong University in 2024","award":["IITP-RS-2022-00156318"],"award-info":[{"award-number":["IITP-RS-2022-00156318"]}]},{"name":"MSIT (Ministry of Science and ICT), Korea","award":["IITP-RS-2022-00156318"],"award-info":[{"award-number":["IITP-RS-2022-00156318"]}]},{"name":"Graduate School of Metaverse Convergence support program","award":["IITP-RS-2022-00156318"],"award-info":[{"award-number":["IITP-RS-2022-00156318"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Recent advancements in the field of super resolution (SR) have seen the adoption of generative adversarial networks (GANs) for realistic images. In this case, when performing with low-resolution (LR) images, several challenges arise due to the loss of high-frequency details from high-resolution (HR) images, potentially leading to unwanted distortions in the generated SR images. Our paper presents a novel solution by using two-dimensional structure consistency (TSC) for image analysis. The TSC serves as a mask, enabling adaptive analysis based on the unique frequency characteristics of different image regions. Furthermore, a mutual loss mechanism, which dynamically adjusts the training process based on the results filtered by the TSC-based mask, is introduced. Additionally, the TSC loss is proposed to enhance our model capacity to generate precise TSC in high-frequency regions. As a result, our method effectively reduces distortions in high-frequency areas while preserving clarity in regions containing low-frequency components. Our method outperforms other SR techniques, demonstrating superior results in both qualitative and quantitative evaluations. Quantitative measurements, including PSNR, SSIM, and the perceptual metric LPIPS, show comparable PSNR and SSIM values, while the perceptual SR quality is notably improved according to the LPIPS metric.<\/jats:p>","DOI":"10.3390\/jimaging10110266","type":"journal-article","created":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T04:28:43Z","timestamp":1729657723000},"page":"266","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Frequency Domain-Based Super Resolution Using Two-Dimensional Structure Consistency for Ultra-High-Resolution Display"],"prefix":"10.3390","volume":"10","author":[{"given":"Yu Lim","family":"Seo","sequence":"first","affiliation":[{"name":"Samsung Electronics, Suwon-si 16677, Gyeonggi-do, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4809-956X","authenticated-orcid":false,"given":"Suk-Ju","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Sogang University, Seoul 04107, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yeon-Kug","family":"Moon","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence and Data Science, Sejong University, Seoul 05006, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Timofte, R., De Smet, V., and Van Gool, L. (2014, January 1\u20135). A+: Adjusted anchored neighborhood regression for fast super-resolution. Proceedings of the Asian Conference on Computer Vision, Singapore.","DOI":"10.1007\/978-3-319-16817-3_8"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1109\/TMM.2016.2614427","article-title":"Retrieval compensated group structured sparsity for image super-resolution","volume":"19","author":"Liu","year":"2016","journal-title":"IEEE Trans. Multimed."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1109\/TMM.2016.2515997","article-title":"Consistent coding scheme for single-image super-resolution via independent dictionaries","volume":"18","author":"Yang","year":"2016","journal-title":"IEEE Trans. Multimed."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014, January 6\u201312). Learning a deep convolutional network for image super-resolution. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., and Tang, X. (2016, January 8\u201316). Accelerating the super-resolution convolutional neural network. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherland.","DOI":"10.1007\/978-3-319-46475-6_25"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27\u201330). Accurate image super-resolution using very deep convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.182"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lai, W.-S., Huang, J.-B., Ahuja, N., and Yang, M.-H. (2017, January 21\u201326). Deep Laplacian pyramid networks for fast and accurate super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.618"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Huszar, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_9","first-page":"2672","article-title":"Generative adversarial nets","volume":"27","author":"Goodfellow","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Johnson, J., Alahi, A., and Fei-Fei, L. (2016, January 8\u201316). Perceptual losses for real-time style transfer and super-resolution. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherland.","DOI":"10.1007\/978-3-319-46475-6_43"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Sajjadi, M.S., Scholkopf, B., and Hirsch, M. (2017, January 22\u201329). Enhancenet: Single image super-resolution through automated texture synthesis. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.481"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., and Loy, C.C. (2018, January 8\u201314). Esrgan: Enhanced super-resolution generative adversarial networks. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-11021-5_5"},{"key":"ref_13","unstructured":"Rad, M.S., Bozorgtabar, B., Marti, U.-V., Basler, M., Ekenel, H.K., and Thiran, J.-P. (November, January 27). Srobb: Targeted perceptual loss for single image super- resolution. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ma, C., Rao, Y., Cheng, Y., Chen, C., Lu, J., and Zhou, J. (2020, January 14\u201319). Structure- preserving super resolution with gradient guidance. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00779"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Mechrez, R., Talmi, I., Shama, F., and Zelnik-Manor, L. (2018, January 2\u20136). Maintaining natural image statistics with the contextual loss. Proceedings of the Asian Conference on Computer Vision, Perth, Australia.","DOI":"10.1007\/978-3-030-20893-6_27"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mechrez, R., Talmi, I., and Zelnik-Manor, L. (2018, January 8\u201314). The contextual loss for image transformation with non-aligned data. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01264-9_47"},{"key":"ref_17","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_18","unstructured":"Deng, X., Yang, R., Xu, M., and Dragotti, P.L. (November, January 27). Wavelet domain style transfer for an effective perception-distortion trade-off in single image super-resolution. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Fritsche, M., Gu, S., and Timofte, R. (2019, January 27\u201328). Frequency separation for real- world super-resolution. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Republic of Korea.","DOI":"10.1109\/ICCVW.2019.00445"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Lee, K.M. (2017, January 21\u201326). Enhanced deep residual networks for single image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., and Fu, Y. (2018, January 8\u201314). Image super- resolution using very deep residual channel attention networks. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_18"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollar, P. (2017, January 22\u201329). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Shi, W., Caballero, J., Husza, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., and Wang, Z. (2016, January 27\u201330). Real-time single image and video super- resolution using an efficient sub-pixel convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.207"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Agustsson, E., and Timofte, R. (2017, January 21\u201326). Ntire 2017 challenge on single image super-resolution: Dataset and study. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.150"},{"key":"ref_25","unstructured":"Bevilacqua, M., Roumy, A., Guillemot, C., and Alberi-Morel, M.L. (2012, January 3\u20137). Low-complexity single-image super-resolution based on nonnegative neighbour embedding. Proceedings of the British Machine Vision Conference, Surrey, UK."},{"key":"ref_26","unstructured":"Zeyde, R., Elad, M., and Protter, M. (2010, January 24\u201330). On single image scale-up using sparse-representations. Proceedings of the International Conference on Curves and surfaces, Avignon, France."},{"key":"ref_27","first-page":"416","article-title":"A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics","volume":"Volume 2","author":"Martin","year":"2001","journal-title":"Proceedings of the IEEE International Conference on Computer Vision"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Huang, J.-B., Singh, A., and Ahuja, N. (2015, January 7\u201312). Single image super-resolution from transformed self-exemplars. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299156"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Soh, J.W., Park, G.Y., Jo, J., and Cho, N.I. (2019, January 16\u201320). Natural and realistic single image super-resolution with explicit natural manifold discrimination. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00831"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/11\/266\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:18:17Z","timestamp":1760113097000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/11\/266"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,23]]},"references-count":29,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["jimaging10110266"],"URL":"https:\/\/doi.org\/10.3390\/jimaging10110266","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,23]]}}}