{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T06:24:23Z","timestamp":1762064663981,"version":"build-2065373602"},"reference-count":51,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T00:00:00Z","timestamp":1661990400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Hefei Municipal Natural Science Foundation","award":["2021008","1401B042019"],"award-info":[{"award-number":["2021008","1401B042019"]}]},{"name":"Anhui Province Scientific and Technological Research Programs","award":["2021008","1401B042019"],"award-info":[{"award-number":["2021008","1401B042019"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Resolution is an intuitive assessment for the visual quality of images, which is limited by physical devices. Recently, image super-resolution (SR) models based on deep convolutional neural networks (CNNs) have made significant progress. However, most existing SR models require high computational costs with network depth, hindering practical application. In addition, these models treat intermediate features equally and rarely explore the discriminative capacity hidden in their abundant features. To tackle these issues, we propose an attention network with information distillation(AIDN) for efficient and accurate image super-resolution, which adaptively modulates the feature responses by modeling the interactions between channel dimension and spatial features. Specifically, gated channel transformation (GCT) is introduced to gather global contextual information among different channels to modulate intermediate high-level features. Moreover, a recalibrated attention module (RAM) is proposed to rescale these feature responses, and RAM concentrates the essential contents around spatial locations. Benefiting from the gated channel transformation and spatial information masks working jointly, our proposed AIDN can obtain a more powerful ability to identify information. It effectively improves computational efficiency while improving reconstruction accuracy. Comprehensive quantitative and qualitative evaluations demonstrate that our AIDN outperforms state-of-the-art models in terms of reconstruction performance and visual quality.<\/jats:p>","DOI":"10.3390\/e24091226","type":"journal-article","created":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T21:27:17Z","timestamp":1662067637000},"page":"1226","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Attention Network with Information Distillation for Super-Resolution"],"prefix":"10.3390","volume":"24","author":[{"given":"Huaijuan","family":"Zang","sequence":"first","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data, Ministry of Education, School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China"}]},{"given":"Ying","family":"Zhao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data, Ministry of Education, School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China"}]},{"given":"Chao","family":"Niu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data, Ministry of Education, School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China"}]},{"given":"Haiyan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data, Ministry of Education, School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China"}]},{"given":"Shu","family":"Zhan","sequence":"additional","affiliation":[{"name":"Key Laboratory of Knowledge Engineering with Big Data, Ministry of Education, School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","article-title":"ImageNet Large Scale Visual Recognition Challenge","volume":"115","author":"Russakovsky","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Guo, T., Dai, T., Liu, L., Zhu, Z., and Xia, S.-T. (2021). S2A:Scale Attention-Aware Networks for Video Super-Resolution. Entropy, 23.","DOI":"10.3390\/e23111398"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1007\/s11554-021-01127-6","article-title":"Lightweight network with one-shot aggregation for image super-resolution","volume":"18","author":"Tang","year":"2021","journal-title":"J. Real-Time Image Process."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/j.neunet.2021.08.002","article-title":"Learning lightweight super-resolution networks with weight pruning","volume":"144","author":"Jiang","year":"2021","journal-title":"Neural Netw."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014, January 6\u201312). Learning a deep convolutional network for image super-resolution. Proceedings of the European Conference on Computer Vision\u2014ECCV 2014, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (July, January 26). Accurate image super-resolution using very deep convolutional networks. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.182"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (July, January 26). Deeply-recursive convolutional network for image super-resolution. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.181"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Dong, C., Chen, C.L., and Tang, X.O. (2016, January 8\u201316). Accelerating the Super-Resolution Convolutional Neural Network. Proceedings of the 2016 European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_25"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Shi, W., Caballero, J., Husz\u00e1r, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., and Wang, Z. (July, January 26). Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.207"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Lee, K.M. (2017, January 21\u201326). Enhanced deep residual networks for single image super-resolution. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"103254","DOI":"10.1016\/j.cviu.2021.103254","article-title":"Lightweight adaptive weighted network for single image super-resolution","volume":"211","author":"Li","year":"2021","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tong, T., Li, G., Liu, X.J., and Gao, Q.Q. (2017, January 22\u201329). Image Super-Resolution Using Dense Skip Connections. Proceedings of the 2017 IEEE\/CVF International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.514"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Maaten, L.V.D., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Song, D., Xu, C., Jia, X., Chen, Y., Xu, C., and Wang, Y. (2020, January 7\u201312). Efficient residual dense block search for image super-resolution. Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI), New York, NY, USA.","DOI":"10.1609\/aaai.v34i07.6877"},{"key":"ref_16","unstructured":"Zoph, B., and Le, Q.V. (2017, January 24\u201326). Neural architecture search with reinforcement learning. Proceedings of the International Conference on Learning Representations, Toulon, France."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, Y.L., Li, K.P., Li, K., Wang, L.C., Zhong, B.E., and Fu, Y. (2018, January 8\u201314). Image Super-Resolution Using Very Deep Residual Channel Attention Networks. Proceedings of the 2018 European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_18"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hui, Z., Wang, X., and Gao, X. (2018, January 18\u201322). Fast and accurate single image superresolution via information distillation network. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00082"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1443","DOI":"10.1109\/TCYB.2020.2970104","article-title":"MADNet: A Fast and Lightweight Network for Single-Image Super Resolution","volume":"51","author":"Lan","year":"2021","journal-title":"IEEE Trans. Cybern."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Lai, W.S., Huang, J.B., Ahuja, N., and Yang, M.H. (2017, January 21\u201326). Deep Laplacian pyramid networks for fast and accurate super-resolution. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.618"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1271","DOI":"10.1109\/JAS.2021.1004009","article-title":"Lightweight Image Super-Resolution via Weighted Multi-Scale Residual Network","volume":"8","author":"Sun","year":"2021","journal-title":"IEEE\/CAA J. Autom. Sin."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1489","DOI":"10.1109\/TMM.2020.2999182","article-title":"Coarse-to-fine cnn for image super-resolution","volume":"23","author":"Tian","year":"2020","journal-title":"IEEE Trans. Multimed."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, J., Zhang, W.J., Tang, Y.T., Tang, J., and Wu, G.S. (2020, January 14\u201319). Residual Feature Aggregation Network for Image Super-Resolution. In Proceedings of the 2020 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00243"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Tian, Y., Kong, Y., Zhong, B., and Fu, Y. (2018, January 18\u201322). Residual dense network for image super-resolution. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00262"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1924","DOI":"10.1109\/TMM.2020.3005025","article-title":"Accurate and Efficient Image Super-Resolution via Global-Local Adjusting Dense Network","volume":"23","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Multimed."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ahn, N., Kang, B., and Sohn, K. (2018, January 8\u201314). Fast, accurate, and lightweight super-resolution with cascading residual network. Proceedings of the 2018 European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01249-6_16"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhu, F.Y., and Zhao, Q.J. (2019, January 27). Efficient single image super-resolution via hybrid residual feature learning with compact back-projection network. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00300"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Song, D.H., Wang, Y.H., Chen, H.T., Xu, C.J., and Tao, D.C. (2021, January 19\u201325). AdderSR: Towards Energy Efficient Image Super-Resolution. Proceedings of the 2021 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Online.","DOI":"10.1109\/CVPR46437.2021.01539"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chu, X., Zhang, B., Ma, H., Xu, R., Li, J., and Li, Q. (2020, January 10\u201315). Fast, accurate and lightweight super-resolution with neural architecture search. Proceedings of the Conference: 2020 25th International Conference on Pattern Recognition (ICPR), Online.","DOI":"10.1109\/ICPR48806.2021.9413080"},{"key":"ref_30","first-page":"1","article-title":"Exploring more diverse network architectures for single image super-resolution","volume":"235","author":"Chen","year":"2022","journal-title":"Knowl.-Based Syst."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201322). Squeeze-and-Excitation Networks. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Wang, X.L., Girshick, R., Gupta, A., and He, K.M. (2018, January 18\u201322). Non-local Neural Networks. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00813"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Woo, S.H.Y., Park, J.C., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yang, Z.X., Zhu, L.C., Wu, Y., and Yang, Y. (2020, January 14\u201319). Gated Channel Transformation for Visual Recognition. Proceedings of the 2020 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01181"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, Q.L., Wu, B.G., Zhu, P.F., Li, P.H., Zuo, W.M., and Hu, Q.H. (2020, January 14\u201319). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the 2020 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01155"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Dai, T., Cai, J.R., Zhang, Y.B., Xia, S.T., and Zhang, L. (2019, January 16\u201320). Second-order Attention Network for Single Image Super-Resolution. Proceedings of the 2019 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01132"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1192","DOI":"10.1109\/TPAMI.2020.3021088","article-title":"Densely Residual Laplacian Super-Resolution","volume":"44","author":"Anwar","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3911","DOI":"10.1109\/TCSVT.2019.2915238","article-title":"Channel-wise and spatial feature modulation network for single image super-resolution","volume":"30","author":"Hu","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mei, Y.Q., Fan, Y.C., Zhou, Y.Q., and Huang, L.C. (2020, January 14\u201319). Image Super-Resolution with Cross-Scale Non-Local Attention and Exhaustive Self-Exemplars Mining. Proceedings of the 2020 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00573"},{"key":"ref_40","first-page":"84","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Agustsson, E., and Timofte, R. (2017, January 21\u201326). Ntire 2017 challenge on single image super-resolution: Dataset and study. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.150"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Bevilacqua, M., Roumy, A., Guillemot, C., and Morel, M.l. (2012, January 3\u20137). Low-complexity single-image super-resolution based on nonnegative neighbor embedding. Proceedings of the British Machine Vision Conference, Surrey, UK.","DOI":"10.5244\/C.26.135"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Boissonnat, J.-D., Chenin, P., Cohen, A., Christian, G., Lyche, T., Mazure, M.-L., and Schumaker, L. (2012). On single image scale-up using sparse-representations. Curves and Surfaces, Springer.","DOI":"10.1007\/978-3-642-27413-8"},{"key":"ref_44","unstructured":"Martin, D., Fowlkes, C., Tal, D., and Malik, J. (2001, January 7\u201314). A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. Proceedings of the 8th International Conference on Computer Vision, Vancouver, BC, Canada."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Huang, J., Singh, A., and Ahuja, N. (2015, January 7\u201312). Single image super-resolution from transformed self-exemplars. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299156"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"21811","DOI":"10.1007\/s11042-016-4020-z","article-title":"Sketch-based manga retrieval using manga109 dataset","volume":"76","author":"Matsui","year":"2017","journal-title":"Multimed. Tools Appl."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_48","unstructured":"Kingma, D., and Ba, J. (2014, January 14\u201316). Adam: A method for stochastic optimization. Proceedings of the International Conference on Learning Representations, Banff, AB, Canada."},{"key":"ref_49","unstructured":"Maas, A.L., Hannun, A.Y., and Ng, A.Y. (2013, January 16\u201321). Rectifier nonlinearities improve neural network acoustic models. Proceedings of the ICML Workshop on Deep Learning for Audio, Speech and Language Processing, Atlanta, GA, USA."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Chu, X., Zhang, B., Xu, R., and Ma, H. (2020, January 23\u201328). Multi-objective reinforced evolution in mobile neural architecture search. Proceedings of the European Conference on Computer Vision (ECCV), Online.","DOI":"10.1007\/978-3-030-66823-5_6"},{"key":"ref_51","first-page":"107831","article-title":"Single image super-resolution with multi-scale information cross-fusion network","volume":"179","author":"Hu","year":"2021","journal-title":"Image Process."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/9\/1226\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:21:45Z","timestamp":1760142105000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/9\/1226"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,1]]},"references-count":51,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["e24091226"],"URL":"https:\/\/doi.org\/10.3390\/e24091226","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,9,1]]}}}