{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T07:46:36Z","timestamp":1774943196420,"version":"3.50.1"},"reference-count":50,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100014857","name":"National Natural Science Foundation of China-Guangdong Joint Fund","doi-asserted-by":"publisher","award":["U1701266"],"award-info":[{"award-number":["U1701266"]}],"id":[{"id":"10.13039\/501100014857","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003453","name":"Natural Science Foundation of Guangdong Province","doi-asserted-by":"publisher","award":["2018A030313751"],"award-info":[{"award-number":["2018A030313751"]}],"id":[{"id":"10.13039\/501100003453","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Guangdong Provincial Key Laboratory of Intellectual Property and Big Data","award":["2018B030322016"],"award-info":[{"award-number":["2018B030322016"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Aiming at the high cost of data labeling and ignoring the internal relevance of features in existing trademark retrieval methods, this paper proposes an unsupervised trademark retrieval method based on attention mechanism. In the proposed method, the instance discrimination framework is adopted and a lightweight attention mechanism is introduced to allocate a more reasonable learning weight to key features. With an unsupervised way, this proposed method can obtain good feature representation of trademarks and improve the performance of trademark retrieval. Extensive comparative experiments on the METU trademark dataset are conducted. The experimental results show that the proposed method is significantly better than traditional trademark retrieval methods and most existing supervised learning methods. The proposed method obtained a smaller value of NAR (Normalized Average Rank) at 0.051, which verifies the effectiveness of the proposed method in trademark retrieval.<\/jats:p>","DOI":"10.3390\/s21051894","type":"journal-article","created":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T12:12:18Z","timestamp":1615205538000},"page":"1894","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Unsupervised Trademark Retrieval Method Based on Attention Mechanism"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5156-3538","authenticated-orcid":false,"given":"Jiangzhong","family":"Cao","sequence":"first","affiliation":[{"name":"School of Information Engineering, Guangdong University of Technology, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yunfei","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Guangdong University of Technology, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qingyun","family":"Dai","sequence":"additional","affiliation":[{"name":"Guangdong Provincial Key Laboratory of Intellectual Property and Big Data, Guangdong Polytechnic Normal University, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0633-7224","authenticated-orcid":false,"given":"Wing-Kuen","family":"Ling","sequence":"additional","affiliation":[{"name":"School of Information Engineering, Guangdong University of Technology, Guangzhou 510006, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Perez, C.A., Est\u00e9vez, P.A., Galdames, F.J., Schulz, D.A., Perez, J.P., Bast\u00edas, D., and Vilar, D.R. (2018, January 8\u201313). Trademark image retrieval using a combination of deep convolutional neural networks. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.","DOI":"10.1109\/IJCNN.2018.8489045"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2017","DOI":"10.1016\/j.patcog.2010.01.007","article-title":"An effective solution for trademark image retrieval by combining shape description and feature matching","volume":"43","author":"Qi","year":"2010","journal-title":"Pattern Recognit."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.eswa.2012.07.031","article-title":"Trademark image retrieval using an integrated shape descriptor. Expert Systems with Applications","volume":"40","author":"Anuar","year":"2013","journal-title":"Expert Syst. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Liu, F., Wang, B., and Zeng, F. (2017, January 17\u201320). Trademark image retrieval using hierarchical region feature description. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8296957"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Toriu, T., Miyazaki, M., Miyazaki, K., Toda, K., and Hama, H. (2017, January 15\u201317). A similar trademark retrieval system based on rotation invariant local features. Proceedings of the 2016 2nd International Conference on Frontiers of Signal Processing (ICFSP), Warsaw, Poland.","DOI":"10.1109\/ICFSP.2016.7802961"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Feng, Y., Shi, C., Qi, C., Xu, J., Xiao, B., and Wang, C. (2018, January 20\u201323). Aggregation of reversal invariant features from edge images for large-scale trademark retrieval. Proceedings of the 2018 4th International Conference on Control, Automation and Robotics (ICCAR), Auckland, New Zealand.","DOI":"10.1109\/ICCAR.2018.8384705"},{"key":"ref_7","unstructured":"Tursun, O., Aker, C., and Kalkan, S. (2017). A large-scale dataset and benchmark for similar trademark retrieval. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"032042","DOI":"10.1088\/1742-6596\/1237\/3\/032042","article-title":"Trademark Image Retrieval Based on Faster R-CNN","volume":"1237","author":"Wang","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_9","unstructured":"Tursun, O., Denman, S., Sivapalan, S., Sridharan, S., Fookes, C., and Mau, S. (2019). Component-based Attention for Large-scale Trademark Retrieval. Ieee Trans. Inf. Forensics Secur., 1."},{"key":"ref_10","unstructured":"Lan, T., Feng, X., Xia, Z., Pan, S., and Peng, J. Similar Trademark Image Retrieval Integrating LBP and Convolutional Neural Network. Proceedings of the Constructive Side-Channel Analysis and Secure Design."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.jvcir.2019.01.011","article-title":"Trademark image retrieval via transformation-invariant deep hashing","volume":"59","author":"Xia","year":"2019","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wu, Z., Xiong, Y., Yu, S.X., and Lin, D. (2018, January 18\u201323). Unsupervised Feature Learning via Non-parametric Instance Discrimination. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00393"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 27\u201330). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_14","unstructured":"Qilong, W., Banggu, W., Pengfei, Z., and Peihua, L. (2020, January 14\u201319). ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networks. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Doersch, C., and Zisserman, A. (2017, January 22\u201329). Multi-task Self-Supervised Visual Learning. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.226"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Doersch, C., Gupta, A., and Efros, A.A. (2015, January 7\u201313). Unsupervised Visual Representation Learning by Context Prediction. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.167"},{"key":"ref_17","first-page":"10","article-title":"Generative Adversarial Nets","volume":"1050","author":"Goodfellow","year":"2014","journal-title":"Stat"},{"key":"ref_18","unstructured":"Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv."},{"key":"ref_19","unstructured":"Donahue, J., Kr\u00e4henb\u00fchl, P., and Darrell, T. (2016). Adversarial feature learning. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 8\u201312). FaceNet: A unified embedding for face recognition and clustering. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298682"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Xiao, T., Li, S., Wang, B., Lin, L., and Wang, X. (2017, January 21\u201326). Joint Detection and Identification Feature Learning for Person Search. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.360"},{"key":"ref_22","unstructured":"Dosovitskiy, A., Springenberg, J.T., Riedmiller, M., and Brox, T. (2020, June 26). Discriminative Unsupervised Feature Learning with Convolutional Neural Networks. NIPS. Available online: http:\/\/citeseerx.ist.psu.edu\/viewdoc\/download?doi=10.1.1.748.8912&rep=rep1&type=pdf."},{"key":"ref_23","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_24","unstructured":"Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. CBAM: Convolutional Block Attention Module. Proceedings of the Lecture Notes in Computer Science."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gao, Z., Xie, J., Wang, Q., and Li, P. (2019, January 15\u201320). Global Second-Order Pooling Convolutional Networks. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00314"},{"key":"ref_26","first-page":"9401","article-title":"Gather-Excite: Exploiting Feature Context in Convolutional Neural Networks","volume":"31","author":"Hu","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_27","unstructured":"Park, J., Woo, S., Lee, J.Y., and Kweon, I. (2018, January 2\u20136). In Proceedings of the BAM: Bottleneck Attention Module. British Machine Vision Con-ference (BMVC), Newcastle, UK."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18\u201323). Non-local Neural Networks. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00813"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Cao, Y., Xu, J., Lin, S., Wei, F., and Hu, H. (2019, January 27\u201328). GCNet: Non-Local Networks Meet Squeeze-Excitation Networks and Beyond. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00246"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., and Lu, H. (2019, January 15\u201320). Dual Attention Network for Scene Segmentation. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00326"},{"key":"ref_31","unstructured":"Chen, Y., Kalantidis, Y., Li, J., Yan, S., and Feng, J. (2018, January 3\u20138). A 2-Nets: Double attention networks. Proceedings of the 32nd International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ioannou, Y., Robertson, D., Cipolla, R., and Criminisi, A. (2017, January 21\u201326). Deep Roots: Improving CNN Efficiency with Hierarchical Filter Groups. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.633"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Dollar, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated Residual Transformations for Deep Neural Networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhang, T., Qi, G.-J., Xiao, B., and Wang, J. (2017, January 22\u201329). Interleaved Group Convolutions. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.469"},{"key":"ref_36","first-page":"9","article-title":"Distilling the Knowledge in a Neural Network","volume":"1050","author":"Hinton","year":"2015","journal-title":"Stat"},{"key":"ref_37","unstructured":"Gutmann, M., and Hyv\u00e4rinen, A. (2010, January 13\u201315). Noise-contrastive estimation: A new estimation principle for unnormalized statistical models. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, JMLR Workshop and Confer-ence Proceedings, Chia Laguna Resort, Sardinia, Italy."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2015). Deep residual learning for image recognition. arXiv.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.cviu.2009.07.004","article-title":"Content-based retrieval of logo and trademarks in unconstrained color image databases using color edge gradient co-occurrence histograms","volume":"114","author":"Phan","year":"2010","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","article-title":"Multiresolution gray-scale and rotation invariant texture classification with local binary patterns","volume":"24","author":"Ojala","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1023\/A:1011139631724","article-title":"Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope","volume":"42","author":"Oliva","year":"2001","journal-title":"Int. J. Comput. Vis."},{"key":"ref_42","first-page":"631","article-title":"A hybrid trademark retrieval system using four-gray-level zernike moments and image compactness indices","volume":"4","author":"Her","year":"2011","journal-title":"Int. J. Image Process."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006). Surf: Speeded up Robust Features. European Conference on Computer Vision, Springer.","DOI":"10.1007\/11744023_32"},{"key":"ref_45","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR, San Diego, CA, USA."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Vural, M.F., Yardimci, Y., and Temlzel, A. (2009, January 12\u201317). Registration of multispectral satellite images with orientation-restricted SIFT. Proceedings of the 2009 IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa.","DOI":"10.1109\/IGARSS.2009.5417801"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2014, January 23\u201328). Going deeper with convolutions. Proceedings of the Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_48","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Li, X., Wang, W., Hu, X., and Yang, J. (2019, January 15\u201320). Selective Kernel Networks. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00060"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE international conference on computer vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/5\/1894\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:35:02Z","timestamp":1760160902000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/5\/1894"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,8]]},"references-count":50,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["s21051894"],"URL":"https:\/\/doi.org\/10.3390\/s21051894","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,8]]}}}