{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T16:17:41Z","timestamp":1771949861224,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":33,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,12,23]],"date-time":"2022-12-23T00:00:00Z","timestamp":1671753600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,12,23]]},"DOI":"10.1145\/3579109.3579137","type":"proceedings-article","created":{"date-parts":[[2023,3,14]],"date-time":"2023-03-14T07:46:29Z","timestamp":1678779989000},"page":"162-168","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Cross Knowledge Distillation for Image Super-Resolution"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8180-7065","authenticated-orcid":false,"given":"Hangxiang","family":"Fang","sequence":"first","affiliation":[{"name":"College of Information Science and Electronic Engineering, Zhejiang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2627-6761","authenticated-orcid":false,"given":"Xinyi","family":"Hu","sequence":"additional","affiliation":[{"name":"College of Information Science and Electronic Engineering, Zhejiang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6048-6549","authenticated-orcid":false,"given":"Haoji","family":"Hu","sequence":"additional","affiliation":[{"name":"College of Information Science and Electronic Engineering, Zhejiang University, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,3,14]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.1999.790414"},{"key":"e_1_3_2_1_2_1","volume-title":"Kaiming He, and Xiaoou Tang. Image super-resolution using deep convolutional networks","author":"Dong Chao","year":"2015","unstructured":"Chao Dong , Chen Change Loy , Kaiming He, and Xiaoou Tang. Image super-resolution using deep convolutional networks . IEEE transactions on pattern analysis and machine intelligence, 38(2):295\u2013307, 2015 . Chao Dong, Chen Change Loy, Kaiming He, and Xiaoou Tang. Image super-resolution using deep convolutional networks. IEEE transactions on pattern analysis and machine intelligence, 38(2):295\u2013307, 2015."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.182"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPRW.2017.151"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_18"},{"key":"e_1_3_2_1_6_1","volume-title":"Rethinking the value of network pruning. arXiv preprint arXiv:1810.05270 Add to Citavi project by ArXiv ID","author":"Liu Zhuang","year":"2018","unstructured":"Zhuang Liu , Mingjie Sun , Tinghui Zhou , Gao Huang , and Trevor Darrell . Rethinking the value of network pruning. arXiv preprint arXiv:1810.05270 Add to Citavi project by ArXiv ID , 2018 . Zhuang Liu, Mingjie Sun, Tinghui Zhou, Gao Huang, and Trevor Darrell. Rethinking the value of network pruning. arXiv preprint arXiv:1810.05270 Add to Citavi project by ArXiv ID, 2018."},{"key":"e_1_3_2_1_7_1","first-page":"34","article-title":"Aligned structured sparsity learning for efficient image super-resolution","author":"Zhang Yulun","year":"2021","unstructured":"Yulun Zhang , Huan Wang , Can Qin , and Yun Fu . Aligned structured sparsity learning for efficient image super-resolution . Advances in Neural Information Processing Systems , 34 , 2021 . Yulun Zhang, Huan Wang, Can Qin, and Yun Fu. Aligned structured sparsity learning for efficient image super-resolution. Advances in Neural Information Processing Systems, 34, 2021.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_8_1","volume-title":"Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 Add to Citavi project by ArXiv ID","author":"Han Song","year":"2015","unstructured":"Song Han , Huizi Mao , and William J Dally . Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 Add to Citavi project by ArXiv ID , 2015 . Song Han, Huizi Mao, and William J Dally. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv preprint arXiv:1510.00149 Add to Citavi project by ArXiv ID, 2015."},{"key":"e_1_3_2_1_9_1","volume-title":"Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 Add to Citavi project by ArXiv ID","author":"Hinton Geoffrey","year":"2015","unstructured":"Geoffrey Hinton , Oriol Vinyals , and Jeff Dean . Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 Add to Citavi project by ArXiv ID , 2015 . Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 Add to Citavi project by ArXiv ID, 2015."},{"key":"e_1_3_2_1_10_1","first-page":"541","volume-title":"Asian Conference on Computer Vision","author":"Gao Qinquan","unstructured":"Qinquan Gao , Yan Zhao , Gen Li , and Tong Tong . Image super-resolution using knowledge distillation . In Asian Conference on Computer Vision , pages 527\u2013 541 . Springer, 2018. Qinquan Gao, Yan Zhao, Gen Li, and Tong Tong. Image super-resolution using knowledge distillation. In Asian Conference on Computer Vision, pages 527\u2013541. Springer, 2018."},{"key":"e_1_3_2_1_11_1","first-page":"522","volume-title":"2020 IEEE International Conference on Image Processing (ICIP)","author":"He Zibin","unstructured":"Zibin He , Tao Dai , Jian Lu , Yong Jiang , and Shu-Tao Xia . Fakd : Feature-affinity based knowledge distillation for efficient image super-resolution . In 2020 IEEE International Conference on Image Processing (ICIP) , pages 518\u2013 522 . IEEE, 2020. Zibin He, Tao Dai, Jian Lu, Yong Jiang, and Shu-Tao Xia. Fakd: Feature-affinity based knowledge distillation for efficient image super-resolution. In 2020 IEEE International Conference on Image Processing (ICIP), pages 518\u2013522. IEEE, 2020."},{"key":"e_1_3_2_1_12_1","first-page":"1818","volume-title":"2021 IEEE International Conference on Image Processing (ICIP)","author":"Huang Qiu","unstructured":"Qiu Huang , Yuxin Zhang , Haoji Hu , Yongdong Zhu , and Zhifeng Zhao . Binarizing super-resolution networks by pixel-correlation knowledge distillation . In 2021 IEEE International Conference on Image Processing (ICIP) , pages 1814\u2013 1818 . IEEE, 2021. Qiu Huang, Yuxin Zhang, Haoji Hu, Yongdong Zhu, and Zhifeng Zhao. Binarizing super-resolution networks by pixel-correlation knowledge distillation. In 2021 IEEE International Conference on Image Processing (ICIP), pages 1814\u20131818. IEEE, 2021."},{"key":"e_1_3_2_1_13_1","first-page":"5198","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"34","author":"Mirzadeh Seyed Iman","year":"2020","unstructured":"Seyed Iman Mirzadeh , Mehrdad Farajtabar , Ang Li , Nir Levine , Akihiro Matsukawa , and Hassan Ghasemzadeh . Improved knowledge distillation via teacher assistant . In Proceedings of the AAAI Conference on Artificial Intelligence , volume 34 , pages 5191\u2013 5198 , 2020 . Seyed Iman Mirzadeh, Mehrdad Farajtabar, Ang Li, Nir Levine, Akihiro Matsukawa, and Hassan Ghasemzadeh. Improved knowledge distillation via teacher assistant. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 5191\u20135198, 2020."},{"key":"e_1_3_2_1_14_1","volume-title":"Residual knowledge distillation. arXiv preprint arXiv:2002.09168 Add to Citavi project by ArXiv ID","author":"Gao Mengya","year":"2020","unstructured":"Mengya Gao , Yujun Shen , Quanquan Li , and Chen Change Loy . Residual knowledge distillation. arXiv preprint arXiv:2002.09168 Add to Citavi project by ArXiv ID , 2020 . Mengya Gao, Yujun Shen, Quanquan Li, and Chen Change Loy. Residual knowledge distillation. arXiv preprint arXiv:2002.09168 Add to Citavi project by ArXiv ID, 2020."},{"key":"e_1_3_2_1_15_1","first-page":"3210","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"34","author":"Bai Haoli","year":"2020","unstructured":"Haoli Bai , Jiaxiang Wu , Irwin King , and Michael Lyu . Few shot network compression via cross distillation . In Proceedings of the AAAI Conference on Artificial Intelligence , volume 34 , pages 3203\u2013 3210 , 2020 . Haoli Bai, Jiaxiang Wu, Irwin King, and Michael Lyu. Few shot network compression via cross distillation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pages 3203\u20133210, 2020."},{"key":"e_1_3_2_1_16_1","first-page":"3529","volume-title":"International Conference on Machine Learning","author":"Kornblith Simon","unstructured":"Simon Kornblith , Mohammad Norouzi , Honglak Lee , and Geoffrey Hinton . Similarity of neural network representations revisited . In International Conference on Machine Learning , pages 3519\u2013 3529 . PMLR,2019. Simon Kornblith, Mohammad Norouzi, Honglak Lee, and Geoffrey Hinton. Similarity of neural network representations revisited. In International Conference on Machine Learning, pages 3519\u20133529. PMLR,2019."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00262"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.754"},{"key":"e_1_3_2_1_19_1","first-page":"13611","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Jin Qing","year":"2021","unstructured":"Qing Jin , Jian Ren , Oliver J Woodford , Jiazhuo Wang , Geng Yuan , Yanzhi Wang , and Sergey Tulyakov . Teachers do more than teach: Compressing image-to-image models . In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition , pages 13600\u2013 13611 , 2021 . Qing Jin, Jian Ren, Oliver J Woodford, Jiazhuo Wang, Geng Yuan, Yanzhi Wang, and Sergey Tulyakov. Teachers do more than teach: Compressing image-to-image models. In Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, pages 13600\u201313611, 2021."},{"key":"e_1_3_2_1_20_1","first-page":"482","volume-title":"European Conference on Computer Vision","author":"Lee Wonkyung","unstructured":"Wonkyung Lee , Junghyup Lee , Dohyung Kim , and Bumsub Ham . Learning with privileged information for efficient image super-resolution . In European Conference on Computer Vision , pages 465\u2013 482 . Springer, 2020. Wonkyung Lee, Junghyup Lee, Dohyung Kim, and Bumsub Ham. Learning with privileged information for efficient image super-resolution. In European Conference on Computer Vision, pages 465\u2013482. Springer, 2020."},{"key":"e_1_3_2_1_21_1","first-page":"407","volume-title":"European conference on computer vision","author":"Dong Chao","unstructured":"Chao Dong , Chen Change Loy , and Xiaoou Tang . Accelerating the super-resolution convolutional neural network . In European conference on computer vision , pages 391\u2013 407 . Springer, 2016. Chao Dong, Chen Change Loy, and Xiaoou Tang. Accelerating the super-resolution convolutional neural network. In European conference on computer vision, pages 391\u2013407. Springer, 2016."},{"key":"e_1_3_2_1_22_1","volume-title":"Towards compact single image super-resolution via contrastive self-distillation. arXiv preprint arXiv:2105.11683 Add to Citavi project by ArXiv ID","author":"Wang Yanbo","year":"2021","unstructured":"Yanbo Wang , Shaohui Lin , Yanyun Qu , Haiyan Wu , Zhizhong Zhang , Yuan Xie , and Angela Yao . Towards compact single image super-resolution via contrastive self-distillation. arXiv preprint arXiv:2105.11683 Add to Citavi project by ArXiv ID , 2021 . Yanbo Wang, Shaohui Lin, Yanyun Qu, Haiyan Wu, Zhizhong Zhang, Yuan Xie, and Angela Yao. Towards compact single image super-resolution via contrastive self-distillation. arXiv preprint arXiv:2105.11683 Add to Citavi project by ArXiv ID, 2021."},{"key":"e_1_3_2_1_23_1","first-page":"2775","volume-title":"IJCAI","author":"Wang Hui","year":"2018","unstructured":"Hui Wang , Hanbin Zhao , Xi Li , and Xu Tan . Progressive blockwise knowledge distillation for neural network acceleration . In IJCAI , pages 2769\u2013 2775 , 2018 . Hui Wang, Hanbin Zhao, Xi Li, and Xu Tan. Progressive blockwise knowledge distillation for neural network acceleration. In IJCAI, pages 2769\u20132775, 2018."},{"key":"e_1_3_2_1_24_1","first-page":"1374","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision","author":"Tung Frederick","year":"2019","unstructured":"Frederick Tung and Greg Mori . Similarity-preserving knowledge distillation . In Proceedings of the IEEE\/CVF International Conference on Computer Vision , pages 1365\u2013 1374 , 2019 . Frederick Tung and Greg Mori. Similarity-preserving knowledge distillation. In Proceedings of the IEEE\/CVF International Conference on Computer Vision, pages 1365\u20131374, 2019."},{"key":"e_1_3_2_1_25_1","volume-title":"Do wide and deep networks learn the same things? uncovering how neural network representations vary with width and depth. arXiv preprint arXiv:2010.15327 Add to Citavi project by ArXiv ID","author":"Nguyen Thao","year":"2020","unstructured":"Thao Nguyen , Maithra Raghu , and Simon Kornblith . Do wide and deep networks learn the same things? uncovering how neural network representations vary with width and depth. arXiv preprint arXiv:2010.15327 Add to Citavi project by ArXiv ID , 2020 . Thao Nguyen, Maithra Raghu, and Simon Kornblith. Do wide and deep networks learn the same things? uncovering how neural network representations vary with width and depth. arXiv preprint arXiv:2010.15327 Add to Citavi project by ArXiv ID, 2020."},{"key":"e_1_3_2_1_26_1","first-page":"135","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition workshops","author":"Agustsson Eirikur","year":"2017","unstructured":"Eirikur Agustsson and Radu Timofte . Ntire 2017 challenge on single image super-resolution: Dataset and study . In Proceedings of the IEEE conference on computer vision and pattern recognition workshops , pages 126\u2013 135 , 2017. Eirikur Agustsson and Radu Timofte. Ntire 2017 challenge on single image super-resolution: Dataset and study. In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pages 126\u2013135, 2017."},{"key":"e_1_3_2_1_27_1","unstructured":"Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980  Diederik P Kingma and Jimmy Ba. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980"},{"key":"e_1_3_2_1_28_1","volume-title":"Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer. arXiv preprint arXiv:1612.03928 Add to Citavi project by ArXiv ID","author":"Zagoruyko Sergey","year":"2016","unstructured":"Sergey Zagoruyko and Nikos Komodakis . Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer. arXiv preprint arXiv:1612.03928 Add to Citavi project by ArXiv ID , 2016 . Sergey Zagoruyko and Nikos Komodakis. Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer. arXiv preprint arXiv:1612.03928 Add to Citavi project by ArXiv ID, 2016."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.26.135"},{"key":"e_1_3_2_1_30_1","first-page":"730","volume-title":"International conference on curves and surfaces","author":"Zeyde Roman","unstructured":"Roman Zeyde , Michael Elad , and Matan Protter . On single image scale-up using sparse-representations . In International conference on curves and surfaces , pages 711\u2013 730 . Springer, 2010. Roman Zeyde, Michael Elad, and Matan Protter. On single image scale-up using sparse-representations. In International conference on curves and surfaces, pages 711\u2013730. Springer, 2010."},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2001.937655"},{"key":"e_1_3_2_1_32_1","first-page":"5206","volume-title":"Proceedings of the IEEE conference on computer vision and pattern recognition","author":"Huang Jia-Bin","year":"2015","unstructured":"Jia-Bin Huang , Abhishek Singh , and Narendra Ahuja . Single image super-resolution from transformed self-exemplars . In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 5197\u2013 5206 , 2015 . Jia-Bin Huang, Abhishek Singh, and Narendra Ahuja. Single image super-resolution from transformed self-exemplars. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 5197\u20135206, 2015."},{"key":"e_1_3_2_1_33_1","volume-title":"Image quality assessment: from error visibility to structural similarity","author":"Wang Zhou","year":"2004","unstructured":"Zhou Wang , Alan C Bovik , Hamid R Sheikh , and Eero P Simoncelli . Image quality assessment: from error visibility to structural similarity . IEEE transactions on image processing, 13(4):600\u2013612, 2004 . Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600\u2013612, 2004."}],"event":{"name":"ICVIP 2022: 2022 The 6th International Conference on Video and Image Processing","location":"Shanghai China","acronym":"ICVIP 2022"},"container-title":["2022 The 6th International Conference on Video and Image Processing"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579109.3579137","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3579109.3579137","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:38:06Z","timestamp":1750178286000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3579109.3579137"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,23]]},"references-count":33,"alternative-id":["10.1145\/3579109.3579137","10.1145\/3579109"],"URL":"https:\/\/doi.org\/10.1145\/3579109.3579137","relation":{},"subject":[],"published":{"date-parts":[[2022,12,23]]},"assertion":[{"value":"2023-03-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}