{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T11:18:29Z","timestamp":1780053509490,"version":"3.54.0"},"reference-count":32,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2023,5,11]],"date-time":"2023-05-11T00:00:00Z","timestamp":1683763200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61573182"],"award-info":[{"award-number":["61573182"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["NS2020025"],"award-info":[{"award-number":["NS2020025"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2023,9,30]]},"abstract":"<jats:p>Since the neural network was introduced into the super-resolution (SR) field, many SR deep models have been proposed and have achieved excellent results. However, there are two main drawbacks: one is that the methods based on the best peak-signal-to-noise ratio (PSNR) do not have enough comfortable visual quality; the other is that although the SR models based on generative adversarial network (GAN) have satisfactory visual quality, the structure of the reconstructed image has apparent defects. Therefore, according to the characteristics that human eyes are sensitive to high-frequency components in images, this article proposes an improved image SRGAN model based on high-frequency information fusion (HIFGAN). It builds a feature extraction network for high-frequency information fusion by designing a lightweight spatial attention module and improving the network architecture of enhanced super-resolution GAN (ESRGAN). It makes the generator in the GAN network have better feature recovery ability, reduces the dependence of the later training on the decider and loss function, and makes the generated image structure more consistent with the real situation. In addition, we build a high-frequency loss function to optimize the training of the generator network. Detailed experimental results show that HIFGAN performs excellently in both objective criterion evaluation and subjective visual effect. Compared with the state-of-the-art GAN-based SR networks, the reconstructed image by our model is more precise and complete in texture details.<\/jats:p>","DOI":"10.1145\/3578934","type":"journal-article","created":{"date-parts":[[2023,1,4]],"date-time":"2023-01-04T13:07:11Z","timestamp":1672837631000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["HIFGAN: A High-Frequency Information-Based Generative Adversarial Network for Image Super-Resolution"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0445-6497","authenticated-orcid":false,"given":"Xin","family":"Yang","sequence":"first","affiliation":[{"name":"College of Automation Engineering, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4630-8097","authenticated-orcid":false,"given":"Hengrui","family":"Li","sequence":"additional","affiliation":[{"name":"College of Automation Engineering, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6146-2282","authenticated-orcid":false,"given":"Xiaochuan","family":"Li","sequence":"additional","affiliation":[{"name":"College of Automation Engineering, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7400-9065","authenticated-orcid":false,"given":"Tao","family":"Li","sequence":"additional","affiliation":[{"name":"College of Automation Engineering, Nanjing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,5,11]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"184","volume-title":"European Conference on Computer Vision","author":"Dong Chao","year":"2014","unstructured":"Chao Dong, Chen Change Loy, Kaiming He, and Xiaoou Tang. 2014. Learning a deep convolutional network for image super-resolution. In European Conference on Computer Vision. Springer, Cham. 184\u2013199. Retrieved Jan 10, 2020 from 10.1007\/978-3-319-10593-2_13"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10586-022-03631-1"},{"key":"e_1_3_1_4_2","first-page":"136","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops","author":"Lim Bee","year":"2017","unstructured":"Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. 2017. Enhanced deep residual networks for single image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 136\u2013144. Retrieved Jan 10, 2013 from 10.48550\/arXiv.1707.02921"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-020-09958-4"},{"key":"e_1_3_1_6_2","first-page":"4681","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Ledig Christian","year":"2017","unstructured":"Christian Ledig, Lucas Theis, Ferenc Husz\u00e1r, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, and Alykhan Tejani. 2017. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4681\u20134690. Retrieved Jan 10, 2020 from 10.48550\/arXiv.1609.04802"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1406.2661"},{"key":"e_1_3_1_8_2","first-page":"606","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Wang Xintao","year":"2018","unstructured":"Xintao Wang, Ke Yu, Chao Dong, and Chen Change Loy. 2018. Recovering realistic texture in image super-resolution by deep spatial feature transform. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 606\u2013615. Retrieved Jan 10, 2020 from 10.48550\/arXiv.1804.02815"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1409.1556"},{"key":"e_1_3_1_10_2","first-page":"770","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"He Kaiming","year":"2016","unstructured":"Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770\u2013778. Retrieved Dec 10, 2020 from 10.48550\/arXiv.1512.03385"},{"key":"e_1_3_1_11_2","first-page":"1874","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Shi Wenzhe","year":"2016","unstructured":"Wenzhe Shi, Jose Caballero, Ferenc Husz\u00e1r, and Johannes Totz. 2016. Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1874\u20131883. Retrieved July 15, 2020 from 10.48550\/arXiv.1609.05158"},{"key":"e_1_3_1_12_2","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV\u201918)","author":"Wang Xintao","year":"2018","unstructured":"Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, and Yiha Liu. 2018. ESRGAN: 2018. Enhanced super-resolution generative adversarial networks. In Proceedings of the European Conference on Computer Vision (ECCV\u201918). Retrieved July 15, 2020 from 10.48550\/arXiv.1809.00219"},{"key":"e_1_3_1_13_2","first-page":"2359","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Liu Jie","year":"2020","unstructured":"Jie Liu, Wenjie Zhang, Yuting Tang, Jie Tang, and Gangshan Wu. 2020. Residual feature aggregation network for image super-resolution. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 2359\u20132368. Retrieved Dec 15, 2020 from 10.48550\/arXiv.1802.08797"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1506.02025"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2003.821718"},{"key":"e_1_3_1_16_2","first-page":"624","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Lai Wei-Sheng","year":"2017","unstructured":"Wei-Sheng Lai, Jia-Bin Huang, Narendra Ahuja, and Ming-Hsuan Yang. 2017. Deep Laplacian pyramid networks for fast and accurate super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 624\u2013632. Retrieved July 10, 2020 from 10.1109\/TPAMI.2018.2865304"},{"key":"e_1_3_1_17_2","first-page":"1637","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Kim J.","year":"2016","unstructured":"J. Kim, J. Kwon Lee, and K. Mu Lee. 2016. Deeply-recursive convolutional network for image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1637\u20131645. Retrieved July 12, 2020 from 10.48550\/arXiv.1511.04491"},{"key":"e_1_3_1_18_2","first-page":"3147","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917)","author":"Tai Y.","year":"2017","unstructured":"Y. Tai, J. Yang, and X. Liu. 2017. Image super-resolution via deep recursive residual net- work. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR\u201917). 3147\u20133155. Retrieved July 10, 2020 from https:\/\/ieeexplore.ieee.org\/stamp\/stamp.jsp?tp=&arnumber=8099781."},{"key":"e_1_3_1_19_2","first-page":"4539","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Tai Ying","year":"2017","unstructured":"Ying Tai, Jian Yang, Xiaoming Liu, and Chunyan Xu. 2017. MemNet: A persistent memory network for image restoration. In Proceedings of the IEEE International Conference on Computer Vision. 4539--4547. Retrieved July 12, 2020 from 10.48550\/arXiv.1708.02209"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2018.8545648"},{"key":"e_1_3_1_21_2","doi-asserted-by":"crossref","unstructured":"M. Haris G. Shakhnarovich and N. Ukita. 2019. Deep back-projection networks for single image super-resolution. arXiv:1904.05677. Retrieved July 15 2020 from 10.48550\/arXiv.1803.02735","DOI":"10.1109\/CVPR.2019.00402"},{"key":"e_1_3_1_22_2","first-page":"2472","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Zhang Yulun","year":"2018","unstructured":"Yulun Zhang, Yapeng Tian, Yu Kong, Bineng Zhong, and Yun Fu. 2018. Residual dense network for image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2472\u20132481. Retrieved Dec 20, 2021 from 10.48550\/arXiv.1802.08797"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvcir.2021.103019"},{"key":"e_1_3_1_24_2","doi-asserted-by":"crossref","unstructured":"Marco Bevilacqua Aline Roumy Christine Guillemot and Alberi Morel Marie-Line. 2012. Low-complexity single-image super-resolution based on nonnegative neighbor embedding. Retrieved July 16 2020 from http:\/\/www.bmva.org\/bmvc\/2012\/BMVC\/paper135\/abstract135.pdf.","DOI":"10.5244\/C.26.135"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27413-8_47"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.161"},{"key":"e_1_3_1_27_2","first-page":"5197","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Huang J. B.","year":"2015","unstructured":"J. B. Huang, A. Singh, and N. Ahuja. 2015. Single image super-resolution from transformed self-exemplars. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5197\u20135206. 10.1109\/CVPR.2015.7299156"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-4020-z"},{"key":"e_1_3_1_29_2","first-page":"586","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Zhang Richard","year":"2018","unstructured":"Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shechtman, and Oliver Wang. 2018. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 586\u2013595. Retrieved July 18, 2020 from 10.48550\/arXiv.1801.03924"},{"key":"e_1_3_1_30_2","first-page":"6228","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Blau Y.","year":"2018","unstructured":"Y. Blau and T. Michaeli. 2018. The perception-distortion tradeoff. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 6228\u20136237. Retrieved July 18, 2020 from 10.48550\/arXiv.1711.06077"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-67070-2_6"},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","unstructured":"Xintao Wang Liangbin Xie Chao Dong and Ying Shan. 2021. Real-ESRGAN: Training real-world blind super-resolution with pure synthetic data. Retrieved Jan 10 2022 from 10.1109\/ICCVW54120.2021.00217","DOI":"10.1109\/ICCVW54120.2021.00217"},{"key":"e_1_3_1_33_2","first-page":"7769","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Ma Cheng","year":"2020","unstructured":"Cheng Ma, Yongming Rao, Yean Cheng, Ce Chen, Jiwen Lu, and Jie Zhou. 2020. Structure-preserving super resolution with gradient guidance. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 7769\u20137778. Retrieved Jan 10, 2022 from https:\/\/ieeexplore.ieee.org\/document\/7938379."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3578934","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3578934","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:08:53Z","timestamp":1750183733000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3578934"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,11]]},"references-count":32,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,9,30]]}},"alternative-id":["10.1145\/3578934"],"URL":"https:\/\/doi.org\/10.1145\/3578934","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,11]]},"assertion":[{"value":"2021-12-28","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}