{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,22]],"date-time":"2025-11-22T11:23:57Z","timestamp":1763810637684,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":20,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,10,26]],"date-time":"2021-10-26T00:00:00Z","timestamp":1635206400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Natural Science Foundation of Guangdong","award":["2020A1515010652"],"award-info":[{"award-number":["2020A1515010652"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61902093"],"award-info":[{"award-number":["61902093"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shenzhen Foundational Research Funding Under Grant","award":["20200805173048001"],"award-info":[{"award-number":["20200805173048001"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,10,26]]},"DOI":"10.1145\/3459637.3482194","type":"proceedings-article","created":{"date-parts":[[2021,11,15]],"date-time":"2021-11-15T15:45:32Z","timestamp":1636991132000},"page":"3383-3387","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Student Can Also be a Good Teacher"],"prefix":"10.1145","author":[{"given":"Jun","family":"Rao","sequence":"first","affiliation":[{"name":"Harbin Institute of Technology, Shenzhen, Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tao","family":"Qian","sequence":"additional","affiliation":[{"name":"Harbin Institute of Technology, Shenzhen, Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuhan","family":"Qi","sequence":"additional","affiliation":[{"name":"Harbin Institute of Technology, Shenzhen, Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yulin","family":"Wu","sequence":"additional","affiliation":[{"name":"Harbin Institute of Technology, Shenzhen, Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qing","family":"Liao","sequence":"additional","affiliation":[{"name":"Harbin Institute of Technology, Shenzhen, Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xuan","family":"Wang","sequence":"additional","affiliation":[{"name":"Harbin Institute of Technology, Shenzhen, Shenzhen, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,10,30]]},"reference":[{"key":"e_1_3_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1553374.1553380"},{"volume-title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","year":"2019","author":"Devlin Jacob","key":"e_1_3_2_2_2_1"},{"key":"e_1_3_2_2_3_1","unstructured":"Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly etal 2020. An image is worth 16x16 words: Transformers for image recognition at scale. In ICLR. OpenReview.net.  Alexey Dosovitskiy Lucas Beyer Alexander Kolesnikov Dirk Weissenborn Xiaohua Zhai Thomas Unterthiner Mostafa Dehghani Matthias Minderer Georg Heigold Sylvain Gelly et al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. In ICLR. OpenReview.net."},{"key":"e_1_3_2_2_4_1","unstructured":"J. Frankle and M. Carbin. 2019. The Lottery Ticket Hypothesis: Finding Small Trainable Neural Networks. In ICLR. OpenReview.net.  J. Frankle and M. Carbin. 2019. The Lottery Ticket Hypothesis: Finding Small Trainable Neural Networks. In ICLR. OpenReview.net."},{"key":"e_1_3_2_2_5_1","unstructured":"Yunchao Gong Liu Liu Ming Yang and Lubomir Bourdev. 2015. Compressing deep convolutional networks using vector quantization. In ICLR. OpenReview. net.  Yunchao Gong Liu Liu Ming Yang and Lubomir Bourdev. 2015. Compressing deep convolutional networks using vector quantization. In ICLR. OpenReview. net."},{"key":"e_1_3_2_2_6_1","unstructured":"Song Han Huizi Mao and William J Dally. 2016. Deep compression: Compressing deep neural networks with pruning trained quantization and huffman coding. In ICLR. OpenReview.net.  Song Han Huizi Mao and William J Dally. 2016. Deep compression: Compressing deep neural networks with pruning trained quantization and huffman coding. In ICLR. OpenReview.net."},{"key":"e_1_3_2_2_7_1","unstructured":"Geoffrey E. Hinton Oriol Vinyals and Jeffrey Dean. 2014. Distilling the Knowledge in a Neural Network. In NIPS.  Geoffrey E. Hinton Oriol Vinyals and Jeffrey Dean. 2014. Distilling the Knowledge in a Neural Network. In NIPS."},{"key":"e_1_3_2_2_8_1","unstructured":"Wonjae Kim Bokyung Son and Ildoo Kim. 2021. ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision. In ICML.  Wonjae Kim Bokyung Son and Ildoo Kim. 2021. ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision. In ICML."},{"key":"e_1_3_2_2_9_1","unstructured":"Kuang-Huei Lee Xi Chen Gang Hua Houdong Hu and Xiaodong He. 2018. Stacked cross attention for image-text matching. In ECCV. 201--216.  Kuang-Huei Lee Xi Chen Gang Hua Houdong Hu and Xiaodong He. 2018. Stacked cross attention for image-text matching. In ECCV. 201--216."},{"volume-title":"Unicoder-VL: A Universal Encoder for Vision and Language by Cross-Modal Pre-Training","author":"Li Gen","key":"e_1_3_2_2_10_1"},{"volume-title":"ECCV","author":"Lin Tsung-Yi","key":"e_1_3_2_2_11_1"},{"key":"e_1_3_2_2_12_1","unstructured":"Ilya Loshchilov and Frank Hutter. 2019. DecoupledWeight Decay Regularization. In ICLR. OpenReview.net.  Ilya Loshchilov and Frank Hutter. 2019. DecoupledWeight Decay Regularization. In ICLR. OpenReview.net."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/3454287.3454289"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/2627435.2670313"},{"volume-title":"LXMERT: Learning Cross-Modality Encoder Representations from Transformers","year":"2019","author":"Tan Hao","key":"e_1_3_2_2_15_1"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295349"},{"volume-title":"Multi- Modality Cross Attention Network for Image and Sentence Matching","author":"Wei Xi","key":"e_1_3_2_2_17_1","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR42600.2020.01095"},{"volume-title":"BERTof- Theseus: Compressing BERT by Progressive Module Replacing","author":"Xu Canwen","key":"e_1_3_2_2_18_1"},{"key":"e_1_3_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00166"},{"volume-title":"Li","year":"2020","author":"Zhang Qi","key":"e_1_3_2_2_20_1"}],"event":{"name":"CIKM '21: The 30th ACM International Conference on Information and Knowledge Management","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"],"location":"Virtual Event Queensland Australia","acronym":"CIKM '21"},"container-title":["Proceedings of the 30th ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3459637.3482194","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3459637.3482194","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:12Z","timestamp":1750191132000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3459637.3482194"}},"subtitle":["Extracting Knowledge from Vision-and-Language Model for Cross-Modal Retrieval"],"short-title":[],"issued":{"date-parts":[[2021,10,26]]},"references-count":20,"alternative-id":["10.1145\/3459637.3482194","10.1145\/3459637"],"URL":"https:\/\/doi.org\/10.1145\/3459637.3482194","relation":{},"subject":[],"published":{"date-parts":[[2021,10,26]]},"assertion":[{"value":"2021-10-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}