{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T02:30:42Z","timestamp":1750732242653,"version":"3.41.0"},"reference-count":55,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2023,8,25]],"date-time":"2023-08-25T00:00:00Z","timestamp":1692921600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62076255"],"award-info":[{"award-number":["62076255"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100019081","name":"Hunan Provincial Science and Technology Plan Project","doi-asserted-by":"crossref","award":["2020SK2059"],"award-info":[{"award-number":["2020SK2059"]}],"id":[{"id":"10.13039\/501100019081","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Science Foundation of Hunan Province, China","award":["2019JJ20025 and 2019JJ40406"],"award-info":[{"award-number":["2019JJ20025 and 2019JJ40406"]}]},{"name":"National Social Science Fund of China","award":["20&ZD120"],"award-info":[{"award-number":["20&ZD120"]}]},{"DOI":"10.13039\/501100012476","name":"Fundamental Research Funds for the Central Universities of the Central South University","doi-asserted-by":"crossref","award":["2021zzts0751"],"award-info":[{"award-number":["2021zzts0751"]}],"id":[{"id":"10.13039\/501100012476","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2024,1,31]]},"abstract":"<jats:p>Reference-based image super-resolution (RefSR) aims to reconstruct high-resolution (HR) images from low-resolution (LR) images by introducing HR reference images. The key step of RefSR is to transfer reference features to LR features. However, existing methods still lack an efficient transfer mechanism, resulting in blurry details in the generated image. In this article, we propose a double-layer search module and an adaptive pooling fusion module group for reference-based image super-resolution, called DLASR. Based on the re-search strategy, the double-layer search module can produce an accurate index map and score map. These two maps are used to filter out accurate reference features, which greatly increases the efficiency of feature transfer in the later stage. Through two continuous feature-enhancement steps, the adaptive pooling fusion module group can transfer more valuable reference features to the corresponding LR features. In addition, a structure reconstruction module is proposed to recover the geometric information of the images, which further improves the visual quality of the generated image. We conduct comparative experiments on a variety of datasets, and the results prove that DLASR achieves significant improvements over other state-of-the-art methods, in terms of quantitative accuracy and qualitative visual effect. The code is available at https:\/\/github.com\/clttyou\/DLASR.<\/jats:p>","DOI":"10.1145\/3604937","type":"journal-article","created":{"date-parts":[[2023,6,22]],"date-time":"2023-06-22T05:20:12Z","timestamp":1687411212000},"page":"1-23","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Double-Layer Search and Adaptive Pooling Fusion for Reference-Based Image Super-Resolution"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4143-6399","authenticated-orcid":false,"given":"Kehua","family":"Guo","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Central South University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5500-2471","authenticated-orcid":false,"given":"Liang","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Central South University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1349-3399","authenticated-orcid":false,"given":"Xiangyuan","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Central South University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9957-7867","authenticated-orcid":false,"given":"Xiaoyan","family":"Kui","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Central South University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7852-4934","authenticated-orcid":false,"given":"Jian","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Central South University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9040-7247","authenticated-orcid":false,"given":"Heyuan","family":"Shi","sequence":"additional","affiliation":[{"name":"KLISS, BNRist, Tsinghua University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,8,25]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2005.851684"},{"key":"e_1_3_1_3_2","first-page":"1","volume-title":"Proceedings of the 2014 IEEE International Conference on Computational Photography (ICCP)","author":"Boominathan Vivek","year":"2014","unstructured":"Vivek Boominathan, Kaushik Mitra, and Ashok Veeraraghavan. 2014. Improving resolution and depth-of-field of light field cameras using a hybrid imaging system. In Proceedings of the 2014 IEEE International Conference on Computational Photography (ICCP). IEEE, 1\u201310."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2015.2439281"},{"key":"e_1_3_1_6_2","first-page":"82","volume-title":"Proceedings of the Scientific Cooperations International Workshops on Electrical and Computer Engineering Subfields","author":"Farajzadeh Nacer","year":"2014","unstructured":"Nacer Farajzadeh and Negin S. Rezaei. 2014. Vehicle logo recognition using image matching and textural features. In Proceedings of the Scientific Cooperations International Workshops on Electrical and Computer Engineering Subfields. 82\u201386."},{"key":"e_1_3_1_7_2","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1145\/1275808.1276496","volume-title":"ACM SIGGRAPH 2007 Papers","author":"Fattal Raanan","year":"2007","unstructured":"Raanan Fattal. 2007. Image upsampling via imposed edge statistics. In ACM SIGGRAPH 2007 Papers. 95\u2013102."},{"key":"e_1_3_1_8_2","article-title":"Texture synthesis using convolutional neural networks","author":"Gatys Leon A.","year":"2015","unstructured":"Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. 2015. Texture synthesis using convolutional neural networks. arXiv preprint arXiv:1505.07376 (2015).","journal-title":"arXiv preprint arXiv:1505.07376"},{"key":"e_1_3_1_9_2","article-title":"Generative adversarial networks","author":"Goodfellow Ian J.","year":"2014","unstructured":"Ian J. Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial networks. arXiv preprint arXiv:1406.2661 (2014).","journal-title":"arXiv preprint arXiv:1406.2661"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00545"},{"issue":"6","key":"e_1_3_1_11_2","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural features for image classification","author":"Haralick Robert M.","year":"1973","unstructured":"Robert M. Haralick, Karthikeyan Shanmugam, and Its\u2019 Hak Dinstein. 1973. Textural features for image classification. IEEE Trans. Syst Man.Cybe6 (1973), 610\u2013621.","journal-title":"IEEE Trans. Syst Man.Cybe"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2019.2916751"},{"key":"e_1_3_1_14_2","doi-asserted-by":"crossref","first-page":"2366","DOI":"10.1109\/ICPR.2010.579","volume-title":"Proceedings of the 2010 20th International Conference on Pattern Recognition","author":"Hore Alain","year":"2010","unstructured":"Alain Hore and Djemel Ziou. 2010. Image quality metrics: PSNR vs. SSIM. In Proceedings of the 2010 20th International Conference on Pattern Recognition. IEEE, 2366\u20132369."},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.243"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7299156"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3417333"},{"key":"e_1_3_1_18_2","article-title":"ADAM: A method for stochastic optimization","author":"Kingma Diederik P.","year":"2014","unstructured":"Diederik P. Kingma and Jimmy Ba. 2014. ADAM: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).","journal-title":"arXiv preprint arXiv:1412.6980"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.19"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.265"},{"issue":"1","key":"e_1_3_1_21_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3377874","article-title":"A deep learning approach for face hallucination guided by facial boundary responses","volume":"16","author":"Li Mengyan","year":"2020","unstructured":"Mengyan Li, Zhaoyu Zhang, Guochen Xie, and Jun Yu. 2020. A deep learning approach for face hallucination guided by facial boundary responses. ACM Trans. Multimedia Comput. Commun. 16, 1 (2020), 1\u201323.","journal-title":"ACM Trans. Multimedia Comput. Commun."},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/83.951537"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3282445"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.151"},{"key":"e_1_3_1_25_2","article-title":"Network in network","author":"Lin Min","year":"2013","unstructured":"Min Lin, Qiang Chen, and Shuicheng Yan. 2013. Network in network. arXiv preprint arXiv:1312.4400 (2013).","journal-title":"arXiv preprint arXiv:1312.4400"},{"issue":"2","key":"e_1_3_1_26_2","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1080\/2150704X.2019.1693071","article-title":"Deepsat v2: Feature augmented convolutional neural nets for satellite image classification","volume":"11","author":"Liu Qun","year":"2020","unstructured":"Qun Liu, Saikat Basu, Sangram Ganguly, Supratik Mukhopadhyay, Robert DiBiano, Manohar Karki, and Ramakrishna Nemani. 2020. Deepsat v2: Feature augmented convolutional neural nets for satellite image classification. Remote Sensing Letters 11, 2 (2020), 156\u2013165.","journal-title":"Remote Sensing Letters"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/3465220"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.5555\/850924.851523"},{"key":"e_1_3_1_29_2","first-page":"715","volume-title":"Proceedings of the European Conference on Computer Vision","author":"Lugmayr Andreas","year":"2020","unstructured":"Andreas Lugmayr, Martin Danelljan, Luc Van Gool, and Radu Timofte. 2020. SRFLOW: Learning the super-resolution space with normalizing flow. In Proceedings of the European Conference on Computer Vision. Springer, 715\u2013732."},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2020.107332"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-016-4020-z"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2003.1203207"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.481"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.207"},{"key":"e_1_3_1_35_2","article-title":"Very deep convolutional networks for large-scale image recognition","author":"Simonyan Karen","year":"2014","unstructured":"Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).","journal-title":"arXiv preprint arXiv:1409.1556"},{"key":"e_1_3_1_36_2","first-page":"1","volume-title":"Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition","author":"Sun Jian","year":"2008","unstructured":"Jian Sun, Zongben Xu, and Heung-Yeung Shum. 2008. Image super-resolution using gradient profile prior. In Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1\u20138."},{"issue":"6","key":"e_1_3_1_37_2","doi-asserted-by":"crossref","first-page":"1529","DOI":"10.1109\/TIP.2010.2095871","article-title":"Gradient profile prior and its applications in image super-resolution and enhancement","volume":"20","author":"Sun Jian","year":"2010","unstructured":"Jian Sun, Zongben Xu, and Heung-Yeung Shum. 2010. Gradient profile prior and its applications in image super-resolution and enhancement. IEEE Trans. Image Process. 20, 6 (2010), 1529\u20131542.","journal-title":"IEEE Trans. Image Process."},{"key":"e_1_3_1_38_2","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV) Workshops","author":"Wang Xintao","year":"2018","unstructured":"Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Yu Qiao, and Chen Change Loy. 2018. ESRGAN: Enhanced super-resolution generative adversarial networks. In Proceedings of the European Conference on Computer Vision (ECCV) Workshops."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2015.2414877"},{"key":"e_1_3_1_40_2","first-page":"5791","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Yang Fuzhi","year":"2020","unstructured":"Fuzhi Yang, Huan Yang, Jianlong Fu, Hongtao Lu, and Baining Guo. 2020. Learning texture transformer network for image super-resolution. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 5791\u20135800."},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2017.2750403"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2013.2279315"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27413-8_47"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3398685"},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2006.877407"},{"key":"e_1_3_1_46_2","first-page":"3096","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Zhang Wenlong","year":"2019","unstructured":"Wenlong Zhang, Yihao Liu, Chao Dong, and Yu Qiao. 2019. Ranksrgan: Generative adversarial networks with ranker for image super-resolution. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 3096\u20133105."},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_18"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00262"},{"key":"e_1_3_1_49_2","first-page":"7982","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Zhang Zhifei","year":"2019","unstructured":"Zhifei Zhang, Zhaowen Wang, Zhe Lin, and Hairong Qi. 2019. Image super-resolution by neural texture transfer. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition. 7982\u20137991."},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1109\/TCI.2018.2838457"},{"key":"e_1_3_1_51_2","volume-title":"Proceedings of the BMVC","author":"Zheng Haitian","year":"2017","unstructured":"Haitian Zheng, Mengqi Ji, Lei Han, Ziwei Xu, Haoqian Wang, Yebin Liu, and Lu Fang. 2017. Learning cross-scale correspondence and patch-based synthesis for reference-based super-resolution. In Proceedings of the BMVC."},{"key":"e_1_3_1_52_2","first-page":"88","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV)","author":"Zheng Haitian","year":"2018","unstructured":"Haitian Zheng, Mengqi Ji, Haoqian Wang, Yebin Liu, and Lu Fang. 2018. Crossnet: An end-to-end reference-based super resolution network using cross-scale warping. In Proceedings of the European Conference on Computer Vision (ECCV). 88\u2013104."},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58539-6_12"},{"key":"e_1_3_1_54_2","article-title":"Cross view capture for stereo image super-resolution","author":"Zhu Xiangyuan","year":"2021","unstructured":"Xiangyuan Zhu, Kehua Guo, Hui Fang, Liang Chen, Sheng Ren, and Bin Hu. 2021. Cross view capture for stereo image super-resolution. IEEE Trans. Multimedia (2021).","journal-title":"IEEE Trans. Multimedia"},{"key":"e_1_3_1_55_2","article-title":"Lightweight image super-resolution with expectation-maximization attention mechanism","author":"Zhu Xiangyuan","year":"2021","unstructured":"Xiangyuan Zhu, Kehua Guo, Sheng Ren, Bin Hu, Min Hu, and Hui Fang. 2021. Lightweight image super-resolution with expectation-maximization attention mechanism. IEEE Trans. Circuits Syst. Video Techn. (2021).","journal-title":"IEEE Trans. Circuits Syst. Video Techn."},{"key":"e_1_3_1_56_2","first-page":"5417","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Zhu Yu","year":"2015","unstructured":"Yu Zhu, Yanning Zhang, Boyan Bonev, and Alan L. Yuille. 2015. Modeling deformable gradient compositions for single-image super-resolution. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5417\u20135425."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604937","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3604937","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:37Z","timestamp":1750178797000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604937"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,25]]},"references-count":55,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1,31]]}},"alternative-id":["10.1145\/3604937"],"URL":"https:\/\/doi.org\/10.1145\/3604937","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2023,8,25]]},"assertion":[{"value":"2022-10-07","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-13","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-08-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}