{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,5]],"date-time":"2026-09-05T16:43:43Z","timestamp":1788626623973,"version":"build-2803163510"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2023,7,12]],"date-time":"2023-07-12T00:00:00Z","timestamp":1689120000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62102128 and 62021001"],"award-info":[{"award-number":["62102128 and 62021001"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["WK3490000007"],"award-info":[{"award-number":["WK3490000007"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"name":"GPU cluster built by MCC Lab of Information Science and Technology Institution"},{"name":"Supercomputing Center of the USTC"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2023,11,30]]},"abstract":"<jats:p>\n            On many popular social websites, images are usually associated with some meta-data such as textual tags, which involve semantic information relevant to the image and can be used to supervise the representation learning for image retrieval. However, these user-provided tags are usually polluted by noise, therefore the main challenge lies in mining the potential useful information from those noisy tags. Many previous works simply treat different tags equally to generate supervision, which will inevitably distract the network learning. To this end, we propose a new framework, termed as Weakly Supervised Hashing with Reconstructive Cross-modal Attention\u00a0(WSHRCA), to learn compact visual-semantic representation with more reliable supervision for retrieval task. Specifically, for each image-tag pair, the weak supervision from tags is refined by cross-modal attention, which takes image feature as query to aggregate the most content-relevant tags. Therefore, tags with relevant content will be more prominent while noisy tags will be suppressed, which provides more accurate supervisory information. To improve the effectiveness of hash learning, the image embedding in WSHRCA is reconstructed from hash code, which is further optimized by cross-modal constraint and explicitly improves hash learning. The experiments on two widely-used datasets demonstrate the effectiveness of our proposed method for weakly-supervised image retrieval. The code is available at\n            <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" xlink:href=\"https:\/\/github.com\/duyc168\/weakly-supervised-hashing\">https:\/\/github.com\/duyc168\/weakly-supervised-hashing<\/jats:ext-link>\n            .\n          <\/jats:p>","DOI":"10.1145\/3589185","type":"journal-article","created":{"date-parts":[[2023,4,8]],"date-time":"2023-04-08T10:31:29Z","timestamp":1680949889000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Weakly Supervised Hashing with Reconstructive Cross-modal Attention"],"prefix":"10.1145","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-7521-9517","authenticated-orcid":false,"given":"Yongchao","family":"Du","sequence":"first","affiliation":[{"name":"University of Science and Technology of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3048-6980","authenticated-orcid":false,"given":"Min","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Artificial Intelligence, Hefei Comprehensive National Science Center"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0918-7524","authenticated-orcid":false,"given":"Zhenbo","family":"Lu","sequence":"additional","affiliation":[{"name":"Institute of Artificial Intelligence, Hefei Comprehensive National Science Center"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1690-9836","authenticated-orcid":false,"given":"Wengang","family":"Zhou","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2188-3028","authenticated-orcid":false,"given":"Houqiang","family":"Li","sequence":"additional","affiliation":[{"name":"University of Science and Technology of China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,7,12]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.124"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00134"},{"key":"e_1_3_1_4_2","first-page":"1328","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Cao Yue","year":"2017","unstructured":"Yue Cao, Mingsheng Long, Jianmin Wang, and Shichen Liu. 2017. Deep visual-semantic quantization for efficient image retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1328\u20131337."},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10455"},{"issue":"1","key":"e_1_3_1_6_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2990504","article-title":"Approximate asymmetric search for binary embedding codes","volume":"13","author":"Chiu Chih-Yi","year":"2016","unstructured":"Chih-Yi Chiu, Yu-Cyuan Liou, and Amorntip Prayoonwong. 2016. Approximate asymmetric search for binary embedding codes. ACM Transactions on Multimedia Computing, Communications, and Applications 13, 1 (2016), 1\u201325.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/1646396.1646452"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2019.2940693"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"e_1_3_1_10_2","article-title":"An image is worth 16x16 words: Transformers for image recognition at scale","author":"Dosovitskiy Alexey","year":"2020","unstructured":"Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, et\u00a0al. 2020. An image is worth 16x16 words: Transformers for image recognition at scale. International Conference on Learning Representations (2020).","journal-title":"International Conference on Learning Representations"},{"key":"e_1_3_1_11_2","first-page":"10375","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Gattupalli Vijetha","year":"2019","unstructured":"Vijetha Gattupalli, Yaoxin Zhuo, and Baoxin Li. 2019. Weakly supervised deep image hashing through tag embeddings. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 10375\u201310384."},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.240"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.193"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"e_1_3_1_15_2","first-page":"2957","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Heo Jae-Pil","year":"2012","unstructured":"Jae-Pil Heo, Youngwoon Lee, Junfeng He, Shih-Fu Chang, and Sung-Eui Yoon. 2012. Spherical hashing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2957\u20132964."},{"key":"e_1_3_1_16_2","article-title":"One loss for all: Deep hashing with a single cosine similarity based learning objective","volume":"34","author":"Hoe Jiun Tian","year":"2021","unstructured":"Jiun Tian Hoe, Kam Woh Ng, Tianyu Zhang, Chee Seng Chan, Yi-Zhe Song, and Tao Xiang. 2021. One loss for all: Deep hashing with a single cosine similarity based learning objective. Advances in Neural Information Processing Systems 34 (2021).","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/1460096.1460104"},{"key":"e_1_3_1_18_2","first-page":"12085","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"Jang Young Kyun","year":"2021","unstructured":"Young Kyun Jang and Nam Ik Cho. 2021. Self-supervised product quantization for deep unsupervised image retrieval. In Proceedings of the IEEE International Conference on Computer Vision. 12085\u201312094."},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.57"},{"key":"e_1_3_1_20_2","first-page":"916","volume-title":"Proceedings of the ACM International Conference on Multimedia","author":"Jin Lu","year":"2020","unstructured":"Lu Jin, Zechao Li, Yonghua Pan, and Jinhui Tang. 2020. Weakly-supervised image hashing through masked visual-semantic graph-based reasoning. In Proceedings of the ACM International Conference on Multimedia. 916\u2013924."},{"key":"e_1_3_1_21_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Simonyan Andrew Zisserman Karen","year":"2015","unstructured":"Andrew Zisserman Karen Simonyan. 2015. Very deep convolutional networks for large-scale image recognition. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_1_22_2","first-page":"5041","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Klein Benjamin","year":"2019","unstructured":"Benjamin Klein and Lior Wolf. 2019. End-to-end supervised product quantization for image search and retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 5041\u20135050."},{"key":"e_1_3_1_23_2","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky Alex","year":"2012","unstructured":"Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Proceedings of the Advances in Neural Information Processing Systems 25 (2012), 1097\u20131105.","journal-title":"In Proceedings of the Advances in Neural Information Processing Systems"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3152126"},{"key":"e_1_3_1_25_2","first-page":"1711","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence","author":"Li Wu-Jun","year":"2016","unstructured":"Wu-Jun Li, Sheng Wang, and Wang-Cheng Kang. 2016. Feature learning based deep supervised hashing with pairwise labels. In Proceedings of the International Joint Conference on Artificial Intelligence. 1711\u20131717."},{"key":"e_1_3_1_26_2","first-page":"2002","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"35","author":"Li Yunqiang","year":"2021","unstructured":"Yunqiang Li and Jan van Gemert. 2021. Deep unsupervised image hashing by maximizing bit entropy. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 2002\u20132010."},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2422956.2422958"},{"issue":"4","key":"e_1_3_1_28_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3355394","article-title":"Efficient image hashing with geometric invariant vector distance for copy detection","volume":"15","author":"Liu Shiguang","year":"2019","unstructured":"Shiguang Liu and Ziqing Huang. 2019. Efficient image hashing with geometric invariant vector distance for copy detection. ACM Transactions on Multimedia Computing, Communications, and Applications 15, 4 (2019), 1\u201322.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.3169\/mta.6.2"},{"key":"e_1_3_1_30_2","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv:1301.3781. Retrieved from https:\/\/arxiv.org\/abs\/1301.3781"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.388"},{"key":"e_1_3_1_32_2","unstructured":"Zexuan Qiu Qinliang Su Zijing Ou Jianxing Yu and Changyou Chen. 2021. Unsupervised hashing with contrastive information bottleneck. arXiv:2105.06138. Retrieved from https:\/\/arxiv.org\/abs\/2105.06138"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2018.2789887"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/3356316"},{"key":"e_1_3_1_35_2","first-page":"2818","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Shen Yuming","year":"2020","unstructured":"Yuming Shen, Jie Qin, Jiaxin Chen, Mengyang Yu, Li Liu, Fan Zhu, Fumin Shen, and Ling Shao. 2020. Auto-encoding twin-bottleneck hashing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2818\u20132827."},{"issue":"10","key":"e_1_3_1_36_2","doi-asserted-by":"crossref","first-page":"2730","DOI":"10.1109\/TCSVT.2017.2715227","article-title":"Weakly supervised multimodal hashing for scalable social image retrieval","volume":"28","author":"Tang Jinhui","year":"2017","unstructured":"Jinhui Tang and Zechao Li. 2017. Weakly supervised multimodal hashing for scalable social image retrieval. IEEE Transactions on Circuits and Systems for Video Technology 28, 10 (2017), 2730\u20132741.","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"},{"key":"e_1_3_1_37_2","first-page":"5998","volume-title":"In Proceedings of the Advances in Neural Information Processing Systems","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In In Proceedings of the Advances in Neural Information Processing Systems. 5998\u20136008."},{"key":"e_1_3_1_38_2","first-page":"2755","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","volume":"35","author":"Wang Jinpeng","year":"2021","unstructured":"Jinpeng Wang, Bin Chen, Qiang Zhang, Zaiqiao Meng, Shangsong Liang, and Shutao Xia. 2021. Weakly supervised deep hyperspherical quantization for image retrieval. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 2755\u20132763."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2017.2699960"},{"issue":"3","key":"e_1_3_1_40_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3328995","article-title":"Deep scalable supervised quantization by self-organizing map","volume":"15","author":"Wang Min","year":"2019","unstructured":"Min Wang, Wengang Zhou, Qi Tian, and Houqiang Li. 2019. Deep scalable supervised quantization by self-organizing map. ACM Transactions on Multimedia Computing, Communications, and Applications 15, 3 (2019), 1\u201318.","journal-title":"ACM Transactions on Multimedia Computing, Communications, and Applications"},{"key":"e_1_3_1_41_2","article-title":"Deep enhanced weakly-supervised hashing with iterative tag refinement","author":"Wang Min","year":"2021","unstructured":"Min Wang, Wengang Zhou, Qi Tian, and Houqiang Li. 2021. Deep enhanced weakly-supervised hashing with iterative tag refinement. IEEE Transactions on Multimedia (2021).","journal-title":"IEEE Transactions on Multimedia"},{"key":"e_1_3_1_42_2","first-page":"4","volume-title":"Proceedings of the Advances in Neural Information Processing Systems","author":"Weiss Yair","year":"2008","unstructured":"Yair Weiss, Antonio Torralba, Robert Fergus, et\u00a0al. 2008. Spectral hashing. In Proceedings of the Advances in Neural Information Processing Systems. 4."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v28i1.8952"},{"key":"e_1_3_1_44_2","first-page":"1064","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Yang Erkun","year":"2018","unstructured":"Erkun Yang, Cheng Deng, Tongliang Liu, Wei Liu, and Dacheng Tao. 2018. Semantic structure-based unsupervised deep hashing. In Proceedings of the AAAI Conference on Artificial Intelligence. 1064\u20131070."},{"key":"e_1_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00306"},{"key":"e_1_3_1_46_2","first-page":"3083","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Yuan Li","year":"2020","unstructured":"Li Yuan, Tao Wang, Xiaopeng Zhang, Francis EH Tay, Zequn Jie, Wei Liu, and Jiashi Feng. 2020. Central similarity quantization for efficient image and video retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3083\u20133092."},{"key":"e_1_3_1_47_2","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Zhang Hanwang","year":"2016","unstructured":"Hanwang Zhang, Na Zhao, Xindi Shang, Huanbo Luan, and Tat-seng Chua. 2016. Discrete image hashing using large weakly annotated photo collections. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_1_48_2","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Zhang Junjie","year":"2018","unstructured":"Junjie Zhang, Qi Wu, Jian Zhang, Chunhua Shen, and Jianfeng Lu. 2018. Kill two birds with one stone: Weakly-supervised neural network for image annotation and tag refinement. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_1_49_2","first-page":"838","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Zhang Ting","year":"2014","unstructured":"Ting Zhang, Chao Du, and Jingdong Wang. 2014. Composite quantization for approximate nearest neighbor search. In Proceedings of the International Conference on Machine Learning. 838\u2013846."},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v30i1.10235"},{"issue":"4","key":"e_1_3_1_51_2","first-page":"1478","article-title":"Dual-level semantic transfer deep hashing for efficient social image retrieval","volume":"31","author":"Zhu Lei","year":"2020","unstructured":"Lei Zhu, Hui Cui, Zhiyong Cheng, Jingjing Li, and Zheng Zhang. 2020. Dual-level semantic transfer deep hashing for efficient social image retrieval. IEEE Transactions on Circuits and Systems for Video Technology 31, 4 (2020), 1478\u20131489.","journal-title":"IEEE Transactions on Circuits and Systems for Video Technology"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589185","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3589185","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:48:53Z","timestamp":1750182533000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3589185"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,12]]},"references-count":50,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2023,11,30]]}},"alternative-id":["10.1145\/3589185"],"URL":"https:\/\/doi.org\/10.1145\/3589185","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,12]]},"assertion":[{"value":"2022-03-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-03-15","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-07-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}