{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:45:48Z","timestamp":1760150748018,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T00:00:00Z","timestamp":1642636800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Fine-grained image retrieval aims at searching relevant images among fine-grained classes given a query. The main difficulty of this task derives from the small interclass distinction and the large intraclass variance of fine-grained images, posing severe challenges to the methods that only resort to global or local features. In this paper, we propose a novel fine-grained image retrieval method, where global\u2013local aware feature representation is learned. Specifically, the global feature is extracted by selecting the most relevant deep descriptors. Meanwhile, we explore the intrinsic relationship of different parts via the frequent pattern mining, thus obtaining the representative local feature. Further, an aggregation feature that learns global\u2013local aware feature representation is designed. Consequently, the discriminative ability among different fine-grained classes is enhanced. We evaluate the proposed method on five popular fine-grained datasets. Extensive experimental results demonstrate that the performance of fine-grained image retrieval is improved with the proposed global\u2013local aware representation.<\/jats:p>","DOI":"10.3390\/e24020156","type":"journal-article","created":{"date-parts":[[2022,1,20]],"date-time":"2022-01-20T22:40:20Z","timestamp":1642718420000},"page":"156","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Revisiting Local Descriptors via Frequent Pattern Mining for Fine-Grained Image Retrieval"],"prefix":"10.3390","volume":"24","author":[{"given":"Min","family":"Zheng","sequence":"first","affiliation":[{"name":"Beijing Key Lab of Traffic Data Analysis and Mining, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yangliao","family":"Geng","sequence":"additional","affiliation":[{"name":"Beijing Key Lab of Traffic Data Analysis and Mining, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingyong","family":"Li","sequence":"additional","affiliation":[{"name":"Beijing Key Lab of Traffic Data Analysis and Mining, Beijing Jiaotong University, Beijing 100044, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1109\/34.895972","article-title":"Content-Based Image Retrieval at the End of the Early Years","volume":"22","author":"Smeulders","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 21\u201326). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1007\/s11263-017-1016-8","article-title":"End-to-End Learning of Deep Visual Representations for Image Retrieval","volume":"124","author":"Gordo","year":"2017","journal-title":"Int. J. Comput. Vis."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"636","DOI":"10.1109\/TMM.2015.2408566","article-title":"Fine-Grained Image Search","volume":"17","author":"Xie","year":"2015","journal-title":"IEEE Trans. Multimed."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zheng, X., Ji, R., Sun, X., Wu, Y., Huang, F., and Yang, Y. (2018, January 13\u201319). Centralized Ranking Loss with Weakly Supervised Localization for Fine-Grained Object Retrieval. Proceedings of the International Joint Conference on Artificial Intelligence, Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/171"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zheng, X., Ji, R., Sun, X., Zhang, B., Wu, Y., and Huang, F. (2019, January 25\u201330). Towards Optimal Fine Grained Retrieval via Decorrelated Centralized Loss with Normalize-Scale Layer. Proceedings of the AAAI Conference on Artificial Intelligence, Austin, TX, USA.","DOI":"10.1609\/aaai.v33i01.33019291"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2868","DOI":"10.1109\/TIP.2017.2688133","article-title":"Selective Convolutional Descriptor Aggregation for Fine-Grained Image Retrieval","volume":"26","author":"Wei","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","unstructured":"Simonyan, K., and Zisserman, A. (2015). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Li, A., Sun, J., Ng, J., Yu, R., Morariu, V.I., and Davis, L. (2017, January 21\u201326). Generating Holistic 3D Scene Abstractions for Text-Based Image Retrieval. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.210"},{"key":"ref_10","unstructured":"Sural, S., Qian, G., and Pramanik, S. (2002, January 22\u201325). Segmentation and histogram generation using the HSV color space for image retrieval. Proceedings of the International Conference on Image Processing, New York, NY, USA."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1109\/TMM.2008.2001357","article-title":"Content-Based Image Retrieval Using Multiresolution Color and Texture Features","volume":"10","author":"Chun","year":"2008","journal-title":"IEEE Trans. Multimed."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1109\/TITB.2007.904149","article-title":"A Spine X-ray Image Retrieval System Using Partial Shape Matching","volume":"12","author":"Xu","year":"2008","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Xiao, Y., Wang, C., and Gao, X. (2020, January 14\u201319). Evade Deep Image Retrieval by Stashing Private Images in the Hash Space. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00967"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1109\/TMM.2019.2929957","article-title":"Improved Deep Hashing With Soft Pairwise Similarity for Multi-Label Image Retrieval","volume":"22","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Multimed."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1271","DOI":"10.1109\/TIP.2019.2940693","article-title":"Scalable Deep Hashing for Large-Scale Social Image Retrieval","volume":"29","author":"Cui","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"103820","DOI":"10.1016\/j.imavis.2019.10.006","article-title":"Fine-Grained Image Retrieval via Piecewise Cross Entropy loss","volume":"93","author":"Zeng","year":"2020","journal-title":"Image Vis. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, N., Donahue, J., Girshick, R., and Darrell, T. (2014, January 6\u201312). Part-Based R-CNNs for Fine-Grained Category Detection. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10590-1_54"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"704","DOI":"10.1016\/j.patcog.2017.10.002","article-title":"Mask-CNN: Localizing parts and selecting descriptors for fine-grained bird species categorization","volume":"76","author":"Wei","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ge, W., Lin, X., and Yu, Y. (2019, January 16\u201320). Weakly Supervised Complementary Parts Models for Fine-Grained Image Classification from the Bottom Up. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00315"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Huang, Z., and Li, Y. (2020, January 14\u201319). Interpretable and Accurate Fine-grained Recognition via Region Grouping. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00869"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., RoyChowdhury, A., and Maji, S. (2015, January 7\u201313). Bilinear CNN Models for Fine-Grained Visual Recognition. Proceedings of the IEEE International Conference on Computer Vision, Washington, DC, USA.","DOI":"10.1109\/ICCV.2015.170"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sun, G., Cholakkal, H., Khan, S., Khan, F., and Shao, L. (2020, January 7\u201312). Fine-grained Recognition: Accounting for Subtle Differences between Similar Classes. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i07.6882"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Agrawal, R., Imielinski, T., and Swami, A.N. (1993, January 26\u201328). Mining association rules between sets of items in large databases. Proceedings of the ACM Conference on Management of Data, Washington, DC, USA.","DOI":"10.1145\/170035.170072"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Han, J., Pei, J., and Yin, Y. (2000, January 10\u201314). Mining frequent patterns without candidate generation. Proceedings of the ACM Conference on Management of Data, Cairo, Egypt.","DOI":"10.1145\/342009.335372"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Fernando, B., Fromont, \u00c9., and Tuytelaars, T. (2012, January 7\u201313). Effective Use of Frequent Itemset Mining for Image Classification. Proceedings of the European Conference on Computer Vision, Florence, Italy.","DOI":"10.1007\/978-3-642-33718-5_16"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"8606","DOI":"10.1109\/TIP.2020.3015543","article-title":"Object Discovery From a Single Unlabeled Image by Mining Frequent Itemsets With Multi-Scale Features","volume":"29","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","unstructured":"Wah, C., Branson, S., Welinder, P., Perona, P., and Belongie, S. (2011). The Caltech-UCSD Birds-200-2011 Dataset, California Institute of Technology. Technical Report."},{"key":"ref_28","unstructured":"Khosla, A., Jayadevaprakash, N., Yao, B., and Fei-Fei, L. (2011, January 21\u201323). Novel Dataset for Fine-Grained Image Categorization: Stanford Dogs. Proceedings of the CVPR Workshop on Fine-Grained Visual Categorization (FGVC), Colorado Springs, CO, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Nilsback, M.E., and Zisserman, A. (2008, January 16\u201319). Automated Flower Classification over a Large Number of Classes. Proceedings of the 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing, Bhubaneswar, India.","DOI":"10.1109\/ICVGIP.2008.47"},{"key":"ref_30","unstructured":"Maji, S., Rahtu, E., Kannala, J., Blaschko, M.B., and Vedaldi, A. (2013). Fine-Grained Visual Classification of Aircraft. arXiv."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Krause, J., Stark, M., Deng, J., and Fei-Fei, L. (2013, January 2\u20138). 3D Object Representations for Fine-Grained Categorization. Proceedings of the 2013 IEEE International Conference on Computer Vision Workshops, Sydney, Australia.","DOI":"10.1109\/ICCVW.2013.77"},{"key":"ref_32","unstructured":"Wei, X.S., Wu, J., and Cui, Q. (2019). Deep Learning for Fine-Grained Image Analysis: A Survey. arXiv."},{"key":"ref_33","first-page":"1097","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_34","unstructured":"Babenko, A., and Lempitsky, V.S. (2015). Aggregating Deep Convolutional Features for Image Retrieval. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Kalantidis, Y., Mellina, C., and Osindero, S. (2015). Cross-Dimensional Weighting for Aggregated Deep Convolutional Features. European Conference on Computer Vision Workshops, Springer.","DOI":"10.1007\/978-3-319-46604-0_48"},{"key":"ref_36","unstructured":"Tolias, G., Sicre, R., and J\u00e9gou, H. (2016). Particular object retrieval with integral max-pooling of CNN activations. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Berg, T., Liu, J., Lee, S.W., Alexander, M.L., Jacobs, D., and Belhumeur, P. (2014, January 23\u201328). Birdsnap: Large-Scale Fine-Grained Visual Categorization of Birds. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.259"},{"key":"ref_38","unstructured":"Horn, G.V., Aodha, O.M., Song, Y., Cui, Y., Sun, C., Shepard, A., Adam, H., Perona, P., and Belongie, S.J. (2018, January 18\u201322). The iNaturalist Species Classification and Detection Dataset. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA."},{"key":"ref_39","unstructured":"Wei, X.S., Cui, Q., Yang, L., Wang, P., and Liu, L. (2019). RPC: A Large-Scale Retail Product Checkout Dataset. arXiv."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/156\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:04:29Z","timestamp":1760133869000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/156"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,20]]},"references-count":39,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["e24020156"],"URL":"https:\/\/doi.org\/10.3390\/e24020156","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,1,20]]}}}