{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T10:07:05Z","timestamp":1761646025956,"version":"3.41.0"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2014,2,1]],"date-time":"2014-02-01T00:00:00Z","timestamp":1391212800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"SKLSDE Foundation"},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Major Project of China"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2014,2]]},"abstract":"<jats:p>This article defines a new hashing task motivated by real-world applications in content-based image retrieval, that is, effective data indexing and retrieval given mixed query (query image together with user-provided keywords). Our work is distinguished from state-of-the-art hashing research by two unique features: (1) Unlike conventional image retrieval systems, the input query is a combination of an exemplar image and several descriptive keywords, and (2) the input image data are often associated with multiple labels. It is an assumption that is more consistent with the realistic scenarios. The mixed image-keyword query significantly extends traditional image-based query and better explicates the user intention. Meanwhile it complicates semantics-based indexing on the multilabel data. Though several existing hashing methods can be adapted to solve the indexing task, unfortunately they all prove to suffer from low effectiveness. To enhance the hashing efficiency, we propose a novel scheme \u201cboosted shared hashing\u201d. Unlike prior works that learn the hashing functions on either all image labels or a single label, we observe that the hashing function can be more effective if it is designed to index over an optimal label subset. In other words, the association between labels and hash bits are moderately sparse. The sparsity of the bit-label association indicates greatly reduced computation and storage complexities for indexing a new sample, since only limited number of hashing functions will become active for the specific sample. We develop a Boosting style algorithm for simultaneously optimizing both the optimal label subsets and hashing functions in a unified formulation, and further propose a query-adaptive retrieval mechanism based on hash bit selection for mixed queries, no matter whether or not the query words exist in the training data. Moreover, we show that the proposed method can be easily extended to the case where the data similarity is gauged by nonlinear kernel functions. Extensive experiments are conducted on standard image benchmarks like CIFAR-10, NUS-WIDE and a-TRECVID. The results validate both the sparsity of the bit-label association and the convergence of the proposed algorithm, and demonstrate that the proposed hashing scheme achieves substantially superior performances over state-of-the-art methods under the same hash bit budget.<\/jats:p>","DOI":"10.1145\/2540990","type":"journal-article","created":{"date-parts":[[2014,2,11]],"date-time":"2014-02-11T14:39:42Z","timestamp":1392129582000},"page":"1-21","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":22,"title":["Mixed image-keyword query adaptive hashing over multilabel images"],"prefix":"10.1145","volume":"10","author":[{"given":"Xianglong","family":"Liu","sequence":"first","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yadong","family":"Mu","sequence":"additional","affiliation":[{"name":"Columbia University, New York"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bo","family":"Lang","sequence":"additional","affiliation":[{"name":"Beihang University, Beijing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shih-Fu","family":"Chang","sequence":"additional","affiliation":[{"name":"Columbia University, New York"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,2,14]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/361002.361007"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/276698.276781"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007379606734"},{"volume-title":"Proceedings of the British Machine Vision Conference.","author":"Chatfield K.","key":"e_1_2_1_4_1","unstructured":"K. Chatfield , V. Lempitsky , A. Vedaldi , and A. Zisserman . 2011. The devil is in the details: An evaluation of recent feature encoding methods . In Proceedings of the British Machine Vision Conference. K. Chatfield, V. Lempitsky, A. Vedaldi, and A. Zisserman. 2011. The devil is in the details: An evaluation of recent feature encoding methods. In Proceedings of the British Machine Vision Conference."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1646396.1646452"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/997817.997857"},{"volume-title":"Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.","author":"Deng J.","key":"e_1_2_1_7_1","unstructured":"J. Deng , W. Dong , R. Socher , L.-J. Li , K. Li , and L. Fei-Fei . 2009. ImageNet: A large-scale hierarchical image database . In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei. 2009. ImageNet: A large-scale hierarchical image database. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition."},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2790--2797","author":"Elhamifar E.","key":"e_1_2_1_8_1","unstructured":"E. Elhamifar and R. Vidal . 2009. Sparse subspace clustering . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2790--2797 . E. Elhamifar and R. Vidal. 2009. Sparse subspace clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2790--2797."},{"volume-title":"Proceedings of the 2nd European Conference on Computational Learning Theory (EuroCOLT'95)","author":"Freund Y.","key":"e_1_2_1_9_1","unstructured":"Y. Freund and R. E. Schapire . 1995. A decision-theoretic generalization of on-line learning and an application to boosting . In Proceedings of the 2nd European Conference on Computational Learning Theory (EuroCOLT'95) . Springer, 23--37. Y. Freund and R. E. Schapire. 1995. A decision-theoretic generalization of on-line learning and an application to boosting. In Proceedings of the 2nd European Conference on Computational Learning Theory (EuroCOLT'95). Springer, 23--37."},{"key":"e_1_2_1_10_1","unstructured":"J. Friedman T. Hastie and R. Tibshirani. 1998. Additive logistic regression: a statistical view of boosting. In Annals of Statistics. J. Friedman T. Hastie and R. Tibshirani. 1998. Additive logistic regression: a statistical view of boosting. In Annals of Statistics."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995432"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the International Conference on Machine Learning.","author":"He J.","year":"2012","unstructured":"J. He , S. Kumar , and S.-F. Chang . 2012 . On the difficulty of nearest neighbor search . In Proceedings of the International Conference on Machine Learning. J. He, S. Kumar, and S.-F. Chang. 2012. On the difficulty of nearest neighbor search. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1835804.1835946"},{"key":"e_1_2_1_14_1","volume-title":"Handbook of Discrete and Computational Geometry","author":"Indyk P.","unstructured":"P. Indyk . 2004. Nearest neighbours in high-dimensional spaces . In Handbook of Discrete and Computational Geometry 2 nd Ed., E. Goodman and J. O'Rourke, Eds . Chapter 39, CRC Press . P. Indyk. 2004. Nearest neighbours in high-dimensional spaces. In Handbook of Discrete and Computational Geometry 2nd Ed., E. Goodman and J. O'Rourke, Eds. Chapter 39, CRC Press.","edition":"2"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/276698.276876"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/1754428.1754431"},{"key":"e_1_2_1_17_1","unstructured":"A. Krizhevsky. 2009. Learning multiple layers of features from tiny images. Tech. rep. A. Krizhevsky. 2009. Learning multiple layers of features from tiny images. Tech. rep."},{"key":"e_1_2_1_18_1","unstructured":"B. Kulis and T. Darrell. 2009. Learning to hash with binary reconstructive embeddings. In Advances in Neural Information Processing Systems. B. Kulis and T. Darrell. 2009. Learning to hash with binary reconstructive embeddings. In Advances in Neural Information Processing Systems."},{"volume-title":"Proceedings of the IEEE International Conference on Computer Vision.","author":"Kulis B.","key":"e_1_2_1_19_1","unstructured":"B. Kulis and K. Grauman . 2009. Kernelized locality-sensitive hashing for scalable image search . In Proceedings of the IEEE International Conference on Computer Vision. B. Kulis and K. Grauman. 2009. Kernelized locality-sensitive hashing for scalable image search. In Proceedings of the IEEE International Conference on Computer Vision."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.68"},{"key":"e_1_2_1_21_1","doi-asserted-by":"crossref","unstructured":"H. Lee A. Battle R. Raina and A. Y. Ng. 2007. Efficient sparse coding algorithms. In Advances in Neural Information Processing Systems B. Sch\u00f6lkopf J. Platt and T. Hoffman Eds. 801--808. H. Lee A. Battle R. Raina and A. Y. Ng. 2007. Efficient sparse coding algorithms. In Advances in Neural Information Processing Systems B. Sch\u00f6lkopf J. Platt and T. Hoffman Eds. 801--808.","DOI":"10.7551\/mitpress\/7503.003.0105"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2012.2199970"},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.","author":"Liu W.","year":"2012","unstructured":"W. Liu , J. Wang , R. Ji , Y.-G. Jiang , and S.-F. Chang . 2012 a. Supervised hashing with kernels . In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. W. Liu, J. Wang, R. Ji, Y.-G. Jiang, and S.-F. Chang. 2012a. Supervised hashing with kernels. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the International Conference on Machine Learning.","author":"Liu W.","year":"2011","unstructured":"W. Liu , J. Wang , S. Kumar , and S.-F. Chang . 2011 . Hashing with graphs . In Proceedings of the International Conference on Machine Learning. W. Liu, J. Wang, S. Kumar, and S.-F. Chang. 2011. Hashing with graphs. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2393347.2396337"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2324796.2324819"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1991996.1992003"},{"key":"e_1_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Y. Mu X. Chen X. Liu T.-S. Chua and S. Yan. 2012. Multimedia semantics-aware query-adaptive hashing with bits reconfigurability. Int. J. Multimedia Information Retrieval 1--12. Y. Mu X. Chen X. Liu T.-S. Chua and S. Yan. 2012. Multimedia semantics-aware query-adaptive hashing with bits reconfigurability. Int. J. Multimedia Information Retrieval 1--12.","DOI":"10.1007\/s13735-012-0003-7"},{"volume-title":"Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.","author":"Mu Y.","key":"e_1_2_1_29_1","unstructured":"Y. Mu , J. Shen , and S. Yan . 2010. Weakly-supervised hashing in kernel space . In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. Y. Mu, J. Shen, and S. Yan. 2010. Weakly-supervised hashing in kernel space. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011139631724"},{"key":"e_1_2_1_31_1","first-page":"40","article-title":"Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition. In Conference Record of the 27th Asilomar Conference on Signals","volume":"1","author":"Pati Y.","year":"1993","unstructured":"Y. Pati , R. Rezaiifar , and P. S. Krishnaprasad . 1993 . Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition. In Conference Record of the 27th Asilomar Conference on Signals , Systems and Computers. Vol. 1 , 40 -- 44 . Y. Pati, R. Rezaiifar, and P. S. Krishnaprasad. 1993. Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition. In Conference Record of the 27th Asilomar Conference on Signals, Systems and Computers. Vol. 1, 40--44.","journal-title":"Systems and Computers."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2072298.2072354"},{"volume-title":"Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition.","author":"Torralba A.","key":"e_1_2_1_33_1","unstructured":"A. Torralba , K. Murphy , and W. Freeman . 2004. Sharing features: efficient boosting procedures for multiclass object detection . In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition. A. Torralba, K. Murphy, and W. Freeman. 2004. Sharing features: efficient boosting procedures for multiclass object detection. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition."},{"key":"e_1_2_1_34_1","unstructured":"A. Vedaldi and B. Fulkerson. 2008. VLFeat: An open and portable library of computer vision algorithms. http:\/\/www.vlfeat.org\/. A. Vedaldi and B. Fulkerson. 2008. VLFeat: An open and portable library of computer vision algorithms. http:\/\/www.vlfeat.org\/."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539994"},{"key":"e_1_2_1_36_1","volume-title":"Proceedings of the InternationalConference on Machine Learning.","author":"Wang J.","year":"2010","unstructured":"J. Wang , S. Kumar , and S.-F. Chang . 2010 b. Sequential projection learning for hashing with compact codes . In Proceedings of the InternationalConference on Machine Learning. J. Wang, S. Kumar, and S.-F. Chang. 2010b. Sequential projection learning for hashing with compact codes. In Proceedings of the InternationalConference on Machine Learning."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.48"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.5555\/1577069.1577078"},{"key":"e_1_2_1_39_1","unstructured":"Y. Weiss A. Torralba and R. Fergus. 2008. Spectral hashing. In Advances in Neural Information Processing Systems. Y. Weiss A. Torralba and R. Fergus. 2008. Spectral hashing. In Advances in Neural Information Processing Systems."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281192.1281281"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.12"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.5555\/2354409.2354692"},{"volume-title":"Advances in Neural Information Processing Systems","author":"Yuille A. L.","key":"e_1_2_1_43_1","unstructured":"A. L. Yuille . 2002. The concave-convex procedure (cccp) . In Advances in Neural Information Processing Systems . MIT Press . A. L. Yuille. 2002. The concave-convex procedure (cccp). In Advances in Neural Information Processing Systems. MIT Press."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2009916.2009950"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2540990","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2540990","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:09:54Z","timestamp":1750234194000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2540990"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,2]]},"references-count":44,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2014,2]]}},"alternative-id":["10.1145\/2540990"],"URL":"https:\/\/doi.org\/10.1145\/2540990","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2014,2]]},"assertion":[{"value":"2013-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-02-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}